2026-02-24T18:20:01.799 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-24T18:20:01.815 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T18:20:01.898 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68687 branch: wip-yuri3-testing-2026-02-19-1610-tentacle description: rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{btree} base mem$/{normal-2} onode-segment$/{none} write$/{random/{compr$/{no$/{no}} random}}}} rados read-affinity/balance tasks/rados_api_tests validater/valgrind} email: null first_in_suite: false flavor: default job_id: '68687' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri3-testing-2026-02-19-1610-tentacle ceph: conf: client: debug monc: 20 debug ms: 1 debug objecter: 20 debug rados: 20 rados replica read policy: balance global: mon client directed command retry: 5 mon election default strategy: 3 ms bind msgr2: false ms inject socket failures: 5000 ms type: async osd heartbeat grace: 160 osd op thread timeout: 150 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osd crush smoke test: false mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 mon warn on pool no app: false paxos service trim min: 10 osd: bdev async discard: true bdev enable discard: true bluestore allocator: btree bluestore block size: 96636764160 bluestore fsck on mount: true bluestore onode segment size: 0 bluestore write v2 random: true bluestore zero block detection: true crush location: root=default host=host-$id debug bluefs: 1 debug bluestore: 1 debug monc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd class default list: '*' osd class load list: '*' osd client watch timeout: 240 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd fast shutdown: false osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd mclock skip benchmark: true osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - reached quota - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(SLOW_OPS\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(OBJECT_MISPLACED\) - slow request - overall HEALTH_ - \(PG_ - \(MON_DOWN\) - \(SLOW_OPS\) - slow request - OSD bench result - OSD_DOWN mon_bind_msgr2: false sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 stop-daemons-timeout: 1200 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: debuginfo: true flavor: default sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri3-testing-2026-02-19-1610-tentacle sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 owner: scheduled_jayaprakash@soko04.front.sepia.ceph.com priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - osd.0 - osd.4 - osd.8 - osd.12 - - mon.b - osd.1 - osd.5 - osd.9 - osd.13 - - mon.c - osd.2 - osd.6 - osd.10 - osd.14 - - mgr.x - osd.3 - osd.7 - osd.11 - osd.15 - client.0 seed: 6877 sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri3-testing-2026-02-19-1610-tentacle suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_36d388f27052dd940bdbaf543bb05bdba0acc155/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 targets: trial026.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBNqbk4j1X70T1HbeJ2qOq4ZzBl7xOtp6cfhGI0Dg2pIYUxCS3L4sfwzgX+owJ1776/VYEsDPUxZve8Q2xrwrm0= trial070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA8t79+FsG232zBP/FmRKiW6KmNE9rJBNllOQSHEhiSFx+W2FI2j6Sq1OUD8i9Jz7T9gXl8BvUBYtDcza5uLWNw= trial103.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFHOfZZRGtOBOBmlkS3yJ6fxAvPZEWXYGmFeocs/6fzdFnSlTy1/Vq5bfl5ms8MBByogcuM4bxd6esU/T9lQXCc= trial162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBzbFSyOm3fJdOPPxcFfzE+mFJhgge62cW1RiNNYpG7SeYIWFTzRO7CiSasq9XG7owOFsjRC73zl2ymusgDsDj0= tasks: - install: null - ceph: null - workunit: clients: client.0: - rados/test.sh env: ALLOW_TIMEOUTS: '1' timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - '-- Don''t run this test on tiny clusters if py_len(yaml.roles) < 4 then reject() end ' teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-24_16:27:17 tube: trial user: jayaprakash verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699 2026-02-24T18:20:01.898 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_36d388f27052dd940bdbaf543bb05bdba0acc155/qa; will attempt to use it 2026-02-24T18:20:01.898 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_36d388f27052dd940bdbaf543bb05bdba0acc155/qa/tasks 2026-02-24T18:20:01.898 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-24T18:20:01.900 INFO:teuthology.task.internal:Checking packages... 2026-02-24T18:20:01.900 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '36d388f27052dd940bdbaf543bb05bdba0acc155' 2026-02-24T18:20:01.900 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-24T18:20:01.900 INFO:teuthology.packaging:ref: None 2026-02-24T18:20:01.900 INFO:teuthology.packaging:tag: None 2026-02-24T18:20:01.900 INFO:teuthology.packaging:branch: wip-yuri3-testing-2026-02-19-1610-tentacle 2026-02-24T18:20:01.900 INFO:teuthology.packaging:sha1: 36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T18:20:01.900 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri3-testing-2026-02-19-1610-tentacle 2026-02-24T18:20:02.028 INFO:teuthology.task.internal:Found packages for ceph version 20.2.0-681.g36d388f2 2026-02-24T18:20:02.030 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-24T18:20:02.041 INFO:teuthology.task.internal:no buildpackages task found 2026-02-24T18:20:02.041 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-24T18:20:02.054 INFO:teuthology.task.internal:Saving configuration 2026-02-24T18:20:02.068 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-24T18:20:02.083 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-24T18:20:02.164 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial026.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68687', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 18:16:29.091355', 'locked_by': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBNqbk4j1X70T1HbeJ2qOq4ZzBl7xOtp6cfhGI0Dg2pIYUxCS3L4sfwzgX+owJ1776/VYEsDPUxZve8Q2xrwrm0='} 2026-02-24T18:20:02.223 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial070.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68687', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 18:16:29.091986', 'locked_by': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA8t79+FsG232zBP/FmRKiW6KmNE9rJBNllOQSHEhiSFx+W2FI2j6Sq1OUD8i9Jz7T9gXl8BvUBYtDcza5uLWNw='} 2026-02-24T18:20:02.280 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial103.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68687', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 18:16:29.092729', 'locked_by': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFHOfZZRGtOBOBmlkS3yJ6fxAvPZEWXYGmFeocs/6fzdFnSlTy1/Vq5bfl5ms8MBByogcuM4bxd6esU/T9lQXCc='} 2026-02-24T18:20:02.338 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial162.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68687', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-24 18:16:29.092381', 'locked_by': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBzbFSyOm3fJdOPPxcFfzE+mFJhgge62cW1RiNNYpG7SeYIWFTzRO7CiSasq9XG7owOFsjRC73zl2ymusgDsDj0='} 2026-02-24T18:20:02.338 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-24T18:20:02.350 INFO:teuthology.task.internal:roles: ubuntu@trial026.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'] 2026-02-24T18:20:02.350 INFO:teuthology.task.internal:roles: ubuntu@trial070.front.sepia.ceph.com - ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'] 2026-02-24T18:20:02.350 INFO:teuthology.task.internal:roles: ubuntu@trial103.front.sepia.ceph.com - ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'] 2026-02-24T18:20:02.350 INFO:teuthology.task.internal:roles: ubuntu@trial162.front.sepia.ceph.com - ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0'] 2026-02-24T18:20:02.350 INFO:teuthology.run_tasks:Running task console_log... 2026-02-24T18:20:02.596 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x79cfb9c676a0>, signals=[15]) 2026-02-24T18:20:02.596 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-24T18:20:02.607 INFO:teuthology.task.internal:Opening connections... 2026-02-24T18:20:02.607 DEBUG:teuthology.task.internal:connecting to ubuntu@trial026.front.sepia.ceph.com 2026-02-24T18:20:02.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:20:02.667 DEBUG:teuthology.task.internal:connecting to ubuntu@trial070.front.sepia.ceph.com 2026-02-24T18:20:02.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:20:02.731 DEBUG:teuthology.task.internal:connecting to ubuntu@trial103.front.sepia.ceph.com 2026-02-24T18:20:02.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:20:02.790 DEBUG:teuthology.task.internal:connecting to ubuntu@trial162.front.sepia.ceph.com 2026-02-24T18:20:02.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:20:02.849 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-24T18:20:02.861 DEBUG:teuthology.orchestra.run.trial026:> uname -m 2026-02-24T18:20:02.877 INFO:teuthology.orchestra.run.trial026.stdout:x86_64 2026-02-24T18:20:02.877 DEBUG:teuthology.orchestra.run.trial026:> cat /etc/os-release 2026-02-24T18:20:02.932 INFO:teuthology.orchestra.run.trial026.stdout:NAME="CentOS Stream" 2026-02-24T18:20:02.932 INFO:teuthology.orchestra.run.trial026.stdout:VERSION="9" 2026-02-24T18:20:02.932 INFO:teuthology.orchestra.run.trial026.stdout:ID="centos" 2026-02-24T18:20:02.932 INFO:teuthology.orchestra.run.trial026.stdout:ID_LIKE="rhel fedora" 2026-02-24T18:20:02.932 INFO:teuthology.orchestra.run.trial026.stdout:VERSION_ID="9" 2026-02-24T18:20:02.932 INFO:teuthology.orchestra.run.trial026.stdout:PLATFORM_ID="platform:el9" 2026-02-24T18:20:02.933 INFO:teuthology.orchestra.run.trial026.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T18:20:02.933 INFO:teuthology.orchestra.run.trial026.stdout:ANSI_COLOR="0;31" 2026-02-24T18:20:02.933 INFO:teuthology.orchestra.run.trial026.stdout:LOGO="fedora-logo-icon" 2026-02-24T18:20:02.933 INFO:teuthology.orchestra.run.trial026.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T18:20:02.933 INFO:teuthology.orchestra.run.trial026.stdout:HOME_URL="https://centos.org/" 2026-02-24T18:20:02.933 INFO:teuthology.orchestra.run.trial026.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T18:20:02.933 INFO:teuthology.orchestra.run.trial026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T18:20:02.933 INFO:teuthology.orchestra.run.trial026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T18:20:02.933 INFO:teuthology.lock.ops:Updating trial026.front.sepia.ceph.com on lock server 2026-02-24T18:20:03.007 DEBUG:teuthology.orchestra.run.trial070:> uname -m 2026-02-24T18:20:03.022 INFO:teuthology.orchestra.run.trial070.stdout:x86_64 2026-02-24T18:20:03.022 DEBUG:teuthology.orchestra.run.trial070:> cat /etc/os-release 2026-02-24T18:20:03.077 INFO:teuthology.orchestra.run.trial070.stdout:NAME="CentOS Stream" 2026-02-24T18:20:03.077 INFO:teuthology.orchestra.run.trial070.stdout:VERSION="9" 2026-02-24T18:20:03.077 INFO:teuthology.orchestra.run.trial070.stdout:ID="centos" 2026-02-24T18:20:03.077 INFO:teuthology.orchestra.run.trial070.stdout:ID_LIKE="rhel fedora" 2026-02-24T18:20:03.077 INFO:teuthology.orchestra.run.trial070.stdout:VERSION_ID="9" 2026-02-24T18:20:03.077 INFO:teuthology.orchestra.run.trial070.stdout:PLATFORM_ID="platform:el9" 2026-02-24T18:20:03.077 INFO:teuthology.orchestra.run.trial070.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T18:20:03.077 INFO:teuthology.orchestra.run.trial070.stdout:ANSI_COLOR="0;31" 2026-02-24T18:20:03.077 INFO:teuthology.orchestra.run.trial070.stdout:LOGO="fedora-logo-icon" 2026-02-24T18:20:03.077 INFO:teuthology.orchestra.run.trial070.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T18:20:03.078 INFO:teuthology.orchestra.run.trial070.stdout:HOME_URL="https://centos.org/" 2026-02-24T18:20:03.078 INFO:teuthology.orchestra.run.trial070.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T18:20:03.078 INFO:teuthology.orchestra.run.trial070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T18:20:03.078 INFO:teuthology.orchestra.run.trial070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T18:20:03.078 INFO:teuthology.lock.ops:Updating trial070.front.sepia.ceph.com on lock server 2026-02-24T18:20:03.153 DEBUG:teuthology.orchestra.run.trial103:> uname -m 2026-02-24T18:20:03.168 INFO:teuthology.orchestra.run.trial103.stdout:x86_64 2026-02-24T18:20:03.169 DEBUG:teuthology.orchestra.run.trial103:> cat /etc/os-release 2026-02-24T18:20:03.225 INFO:teuthology.orchestra.run.trial103.stdout:NAME="CentOS Stream" 2026-02-24T18:20:03.225 INFO:teuthology.orchestra.run.trial103.stdout:VERSION="9" 2026-02-24T18:20:03.225 INFO:teuthology.orchestra.run.trial103.stdout:ID="centos" 2026-02-24T18:20:03.225 INFO:teuthology.orchestra.run.trial103.stdout:ID_LIKE="rhel fedora" 2026-02-24T18:20:03.225 INFO:teuthology.orchestra.run.trial103.stdout:VERSION_ID="9" 2026-02-24T18:20:03.225 INFO:teuthology.orchestra.run.trial103.stdout:PLATFORM_ID="platform:el9" 2026-02-24T18:20:03.225 INFO:teuthology.orchestra.run.trial103.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T18:20:03.225 INFO:teuthology.orchestra.run.trial103.stdout:ANSI_COLOR="0;31" 2026-02-24T18:20:03.225 INFO:teuthology.orchestra.run.trial103.stdout:LOGO="fedora-logo-icon" 2026-02-24T18:20:03.225 INFO:teuthology.orchestra.run.trial103.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T18:20:03.225 INFO:teuthology.orchestra.run.trial103.stdout:HOME_URL="https://centos.org/" 2026-02-24T18:20:03.225 INFO:teuthology.orchestra.run.trial103.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T18:20:03.226 INFO:teuthology.orchestra.run.trial103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T18:20:03.226 INFO:teuthology.orchestra.run.trial103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T18:20:03.226 INFO:teuthology.lock.ops:Updating trial103.front.sepia.ceph.com on lock server 2026-02-24T18:20:03.309 DEBUG:teuthology.orchestra.run.trial162:> uname -m 2026-02-24T18:20:03.324 INFO:teuthology.orchestra.run.trial162.stdout:x86_64 2026-02-24T18:20:03.324 DEBUG:teuthology.orchestra.run.trial162:> cat /etc/os-release 2026-02-24T18:20:03.380 INFO:teuthology.orchestra.run.trial162.stdout:NAME="CentOS Stream" 2026-02-24T18:20:03.380 INFO:teuthology.orchestra.run.trial162.stdout:VERSION="9" 2026-02-24T18:20:03.380 INFO:teuthology.orchestra.run.trial162.stdout:ID="centos" 2026-02-24T18:20:03.380 INFO:teuthology.orchestra.run.trial162.stdout:ID_LIKE="rhel fedora" 2026-02-24T18:20:03.380 INFO:teuthology.orchestra.run.trial162.stdout:VERSION_ID="9" 2026-02-24T18:20:03.380 INFO:teuthology.orchestra.run.trial162.stdout:PLATFORM_ID="platform:el9" 2026-02-24T18:20:03.380 INFO:teuthology.orchestra.run.trial162.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-24T18:20:03.380 INFO:teuthology.orchestra.run.trial162.stdout:ANSI_COLOR="0;31" 2026-02-24T18:20:03.380 INFO:teuthology.orchestra.run.trial162.stdout:LOGO="fedora-logo-icon" 2026-02-24T18:20:03.380 INFO:teuthology.orchestra.run.trial162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-24T18:20:03.381 INFO:teuthology.orchestra.run.trial162.stdout:HOME_URL="https://centos.org/" 2026-02-24T18:20:03.381 INFO:teuthology.orchestra.run.trial162.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-24T18:20:03.381 INFO:teuthology.orchestra.run.trial162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-24T18:20:03.381 INFO:teuthology.orchestra.run.trial162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-24T18:20:03.381 INFO:teuthology.lock.ops:Updating trial162.front.sepia.ceph.com on lock server 2026-02-24T18:20:03.465 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-24T18:20:03.482 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-24T18:20:03.493 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-24T18:20:03.493 DEBUG:teuthology.orchestra.run.trial026:> test '!' -e /home/ubuntu/cephtest 2026-02-24T18:20:03.494 DEBUG:teuthology.orchestra.run.trial070:> test '!' -e /home/ubuntu/cephtest 2026-02-24T18:20:03.496 DEBUG:teuthology.orchestra.run.trial103:> test '!' -e /home/ubuntu/cephtest 2026-02-24T18:20:03.497 DEBUG:teuthology.orchestra.run.trial162:> test '!' -e /home/ubuntu/cephtest 2026-02-24T18:20:03.511 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-24T18:20:03.523 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-24T18:20:03.523 DEBUG:teuthology.orchestra.run.trial026:> test -z $(ls -A /var/lib/ceph) 2026-02-24T18:20:03.549 DEBUG:teuthology.orchestra.run.trial070:> test -z $(ls -A /var/lib/ceph) 2026-02-24T18:20:03.552 DEBUG:teuthology.orchestra.run.trial103:> test -z $(ls -A /var/lib/ceph) 2026-02-24T18:20:03.554 DEBUG:teuthology.orchestra.run.trial162:> test -z $(ls -A /var/lib/ceph) 2026-02-24T18:20:03.571 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-24T18:20:03.847 INFO:teuthology.run_tasks:Running task kernel... 2026-02-24T18:20:03.866 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-24T18:20:03.866 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-24T18:20:03.866 DEBUG:teuthology.orchestra.run.trial026:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T18:20:03.866 DEBUG:teuthology.orchestra.run.trial070:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T18:20:03.867 DEBUG:teuthology.orchestra.run.trial103:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T18:20:03.867 DEBUG:teuthology.orchestra.run.trial162:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-24T18:20:03.881 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:20:03.881 DEBUG:teuthology.orchestra.run.trial103:> uname -r 2026-02-24T18:20:03.881 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:20:03.882 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:20:03.882 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-24T18:20:03.882 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-24T18:20:03.882 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:20:03.882 DEBUG:teuthology.orchestra.run.trial162:> uname -r 2026-02-24T18:20:03.936 INFO:teuthology.orchestra.run.trial070.stdout:5.14.0-681.el9.x86_64 2026-02-24T18:20:03.937 INFO:teuthology.task.kernel:Running kernel on trial070: 5.14.0-681.el9.x86_64 2026-02-24T18:20:03.937 DEBUG:teuthology.orchestra.run.trial070:> sudo yum install -y kernel 2026-02-24T18:20:03.937 INFO:teuthology.orchestra.run.trial103.stdout:5.14.0-681.el9.x86_64 2026-02-24T18:20:03.937 INFO:teuthology.task.kernel:Running kernel on trial103: 5.14.0-681.el9.x86_64 2026-02-24T18:20:03.937 DEBUG:teuthology.orchestra.run.trial103:> sudo yum install -y kernel 2026-02-24T18:20:03.938 INFO:teuthology.orchestra.run.trial162.stdout:5.14.0-681.el9.x86_64 2026-02-24T18:20:03.938 INFO:teuthology.task.kernel:Running kernel on trial162: 5.14.0-681.el9.x86_64 2026-02-24T18:20:03.938 DEBUG:teuthology.orchestra.run.trial162:> sudo yum install -y kernel 2026-02-24T18:20:03.938 INFO:teuthology.orchestra.run.trial026.stdout:5.14.0-681.el9.x86_64 2026-02-24T18:20:03.938 INFO:teuthology.task.kernel:Running kernel on trial026: 5.14.0-681.el9.x86_64 2026-02-24T18:20:03.938 DEBUG:teuthology.orchestra.run.trial026:> sudo yum install -y kernel 2026-02-24T18:20:05.007 INFO:teuthology.orchestra.run.trial026.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-24T18:20:05.154 INFO:teuthology.orchestra.run.trial103.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-24T18:20:06.190 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.9 MB 00:01 2026-02-24T18:20:06.245 INFO:teuthology.orchestra.run.trial162.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.9 MB 00:01 2026-02-24T18:20:07.556 INFO:teuthology.orchestra.run.trial026.stdout:CentOS Stream 9 - AppStream 13 MB/s | 27 MB 00:02 2026-02-24T18:20:08.345 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - AppStream 17 MB/s | 27 MB 00:01 2026-02-24T18:20:08.792 INFO:teuthology.orchestra.run.trial162.stdout:CentOS Stream 9 - AppStream 13 MB/s | 27 MB 00:02 2026-02-24T18:20:11.815 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - CRB 7.5 MB/s | 8.0 MB 00:01 2026-02-24T18:20:12.703 INFO:teuthology.orchestra.run.trial162.stdout:CentOS Stream 9 - CRB 5.2 MB/s | 8.0 MB 00:01 2026-02-24T18:20:13.024 INFO:teuthology.orchestra.run.trial026.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 8.0 MB 00:03 2026-02-24T18:20:13.641 INFO:teuthology.orchestra.run.trial162.stdout:CentOS Stream 9 - Extras packages 99 kB/s | 20 kB 00:00 2026-02-24T18:20:13.694 INFO:teuthology.orchestra.run.trial103.stdout:CentOS Stream 9 - AppStream 3.4 MB/s | 27 MB 00:08 2026-02-24T18:20:13.801 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - Extras packages 16 kB/s | 20 kB 00:01 2026-02-24T18:20:14.847 INFO:teuthology.orchestra.run.trial070.stdout:Extra Packages for Enterprise Linux 21 MB/s | 20 MB 00:00 2026-02-24T18:20:14.883 INFO:teuthology.orchestra.run.trial026.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-24T18:20:16.323 INFO:teuthology.orchestra.run.trial026.stdout:Extra Packages for Enterprise Linux 15 MB/s | 20 MB 00:01 2026-02-24T18:20:16.606 INFO:teuthology.orchestra.run.trial103.stdout:CentOS Stream 9 - CRB 16 MB/s | 8.0 MB 00:00 2026-02-24T18:20:18.076 INFO:teuthology.orchestra.run.trial070.stdout:lab-extras 1.8 MB/s | 50 kB 00:00 2026-02-24T18:20:18.376 INFO:teuthology.orchestra.run.trial103.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-24T18:20:19.091 INFO:teuthology.orchestra.run.trial070.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-24T18:20:19.092 INFO:teuthology.orchestra.run.trial070.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-24T18:20:19.112 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:20:19.113 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:20:19.113 INFO:teuthology.orchestra.run.trial070.stdout: Package Architecture Version Repository Size 2026-02-24T18:20:19.113 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:20:19.113 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T18:20:19.113 INFO:teuthology.orchestra.run.trial070.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-24T18:20:19.114 INFO:teuthology.orchestra.run.trial070.stdout:Installing dependencies: 2026-02-24T18:20:19.114 INFO:teuthology.orchestra.run.trial070.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-24T18:20:19.114 INFO:teuthology.orchestra.run.trial070.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-24T18:20:19.114 INFO:teuthology.orchestra.run.trial070.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-24T18:20:19.114 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:20:19.114 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T18:20:19.114 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:20:19.114 INFO:teuthology.orchestra.run.trial070.stdout:Install 4 Packages 2026-02-24T18:20:19.114 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:20:19.114 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 89 M 2026-02-24T18:20:19.114 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 135 M 2026-02-24T18:20:19.115 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T18:20:19.492 INFO:teuthology.orchestra.run.trial026.stdout:lab-extras 2.2 MB/s | 50 kB 00:00 2026-02-24T18:20:20.380 INFO:teuthology.orchestra.run.trial070.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 750 kB/s | 901 kB 00:01 2026-02-24T18:20:20.501 INFO:teuthology.orchestra.run.trial026.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-24T18:20:20.501 INFO:teuthology.orchestra.run.trial026.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-24T18:20:20.521 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:20:20.522 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:20:20.522 INFO:teuthology.orchestra.run.trial026.stdout: Package Architecture Version Repository Size 2026-02-24T18:20:20.522 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:20:20.522 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T18:20:20.522 INFO:teuthology.orchestra.run.trial026.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-24T18:20:20.522 INFO:teuthology.orchestra.run.trial026.stdout:Installing dependencies: 2026-02-24T18:20:20.522 INFO:teuthology.orchestra.run.trial026.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-24T18:20:20.522 INFO:teuthology.orchestra.run.trial026.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-24T18:20:20.522 INFO:teuthology.orchestra.run.trial026.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-24T18:20:20.522 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:20:20.522 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T18:20:20.522 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:20:20.523 INFO:teuthology.orchestra.run.trial026.stdout:Install 4 Packages 2026-02-24T18:20:20.523 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:20:20.523 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 89 M 2026-02-24T18:20:20.523 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 135 M 2026-02-24T18:20:20.523 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T18:20:21.369 INFO:teuthology.orchestra.run.trial070.stdout:(2/4): kernel-modules-core-5.14.0-686.el9.x86_6 31 MB/s | 31 MB 00:00 2026-02-24T18:20:21.425 INFO:teuthology.orchestra.run.trial070.stdout:(3/4): kernel-core-5.14.0-686.el9.x86_64.rpm 7.6 MB/s | 17 MB 00:02 2026-02-24T18:20:21.488 INFO:teuthology.orchestra.run.trial026.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 996 kB/s | 901 kB 00:00 2026-02-24T18:20:21.587 INFO:teuthology.orchestra.run.trial162.stdout:Extra Packages for Enterprise Linux 2.6 MB/s | 20 MB 00:07 2026-02-24T18:20:21.962 INFO:teuthology.orchestra.run.trial026.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 12 MB/s | 17 MB 00:01 2026-02-24T18:20:22.433 INFO:teuthology.orchestra.run.trial026.stdout:(3/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 22 MB/s | 40 MB 00:01 2026-02-24T18:20:22.541 INFO:teuthology.orchestra.run.trial070.stdout:(4/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 12 MB/s | 40 MB 00:03 2026-02-24T18:20:22.543 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:20:22.544 INFO:teuthology.orchestra.run.trial070.stdout:Total 26 MB/s | 89 MB 00:03 2026-02-24T18:20:22.736 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T18:20:22.940 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T18:20:22.940 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T18:20:23.187 INFO:teuthology.orchestra.run.trial026.stdout:(4/4): kernel-modules-core-5.14.0-686.el9.x86_6 18 MB/s | 31 MB 00:01 2026-02-24T18:20:23.188 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:20:23.188 INFO:teuthology.orchestra.run.trial026.stdout:Total 33 MB/s | 89 MB 00:02 2026-02-24T18:20:23.323 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T18:20:23.323 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T18:20:23.377 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T18:20:23.577 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T18:20:23.577 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T18:20:23.961 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T18:20:23.962 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T18:20:24.429 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T18:20:24.717 INFO:teuthology.orchestra.run.trial070.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:20:24.739 INFO:teuthology.orchestra.run.trial162.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-24T18:20:24.739 INFO:teuthology.orchestra.run.trial070.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:25.077 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T18:20:25.382 INFO:teuthology.orchestra.run.trial026.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:20:25.403 INFO:teuthology.orchestra.run.trial026.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:25.752 INFO:teuthology.orchestra.run.trial162.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-24T18:20:25.752 INFO:teuthology.orchestra.run.trial162.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-24T18:20:25.772 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:20:25.773 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:20:25.773 INFO:teuthology.orchestra.run.trial162.stdout: Package Architecture Version Repository Size 2026-02-24T18:20:25.773 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:20:25.773 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T18:20:25.773 INFO:teuthology.orchestra.run.trial162.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-24T18:20:25.774 INFO:teuthology.orchestra.run.trial162.stdout:Installing dependencies: 2026-02-24T18:20:25.774 INFO:teuthology.orchestra.run.trial162.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-24T18:20:25.774 INFO:teuthology.orchestra.run.trial162.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-24T18:20:25.774 INFO:teuthology.orchestra.run.trial162.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-24T18:20:25.774 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:20:25.774 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T18:20:25.774 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:20:25.774 INFO:teuthology.orchestra.run.trial162.stdout:Install 4 Packages 2026-02-24T18:20:25.774 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:20:25.774 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 89 M 2026-02-24T18:20:25.774 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 135 M 2026-02-24T18:20:25.775 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T18:20:26.302 INFO:teuthology.orchestra.run.trial103.stdout:Extra Packages for Enterprise Linux 2.6 MB/s | 20 MB 00:07 2026-02-24T18:20:26.873 INFO:teuthology.orchestra.run.trial162.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 1.1 MB/s | 901 kB 00:00 2026-02-24T18:20:27.305 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:27.339 INFO:teuthology.orchestra.run.trial070.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:20:27.448 INFO:teuthology.orchestra.run.trial162.stdout:(2/4): kernel-core-5.14.0-686.el9.x86_64.rpm 13 MB/s | 17 MB 00:01 2026-02-24T18:20:27.856 INFO:teuthology.orchestra.run.trial162.stdout:(3/4): kernel-modules-core-5.14.0-686.el9.x86_6 32 MB/s | 31 MB 00:00 2026-02-24T18:20:27.978 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:28.011 INFO:teuthology.orchestra.run.trial026.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:20:28.224 INFO:teuthology.orchestra.run.trial162.stdout:(4/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 19 MB/s | 40 MB 00:02 2026-02-24T18:20:28.226 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:20:28.226 INFO:teuthology.orchestra.run.trial162.stdout:Total 36 MB/s | 89 MB 00:02 2026-02-24T18:20:28.416 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T18:20:28.625 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T18:20:28.625 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T18:20:29.009 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T18:20:29.010 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T18:20:29.477 INFO:teuthology.orchestra.run.trial103.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-24T18:20:30.121 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T18:20:30.381 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:20:30.387 INFO:teuthology.orchestra.run.trial070.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:30.410 INFO:teuthology.orchestra.run.trial162.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:20:30.432 INFO:teuthology.orchestra.run.trial162.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:30.490 INFO:teuthology.orchestra.run.trial103.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-24T18:20:30.490 INFO:teuthology.orchestra.run.trial103.stdout:Package kernel-5.14.0-681.el9.x86_64 is already installed. 2026-02-24T18:20:30.510 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:20:30.511 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:20:30.511 INFO:teuthology.orchestra.run.trial103.stdout: Package Architecture Version Repository Size 2026-02-24T18:20:30.511 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:20:30.511 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T18:20:30.511 INFO:teuthology.orchestra.run.trial103.stdout: kernel x86_64 5.14.0-686.el9 baseos 901 k 2026-02-24T18:20:30.511 INFO:teuthology.orchestra.run.trial103.stdout:Installing dependencies: 2026-02-24T18:20:30.511 INFO:teuthology.orchestra.run.trial103.stdout: kernel-core x86_64 5.14.0-686.el9 baseos 17 M 2026-02-24T18:20:30.512 INFO:teuthology.orchestra.run.trial103.stdout: kernel-modules x86_64 5.14.0-686.el9 baseos 40 M 2026-02-24T18:20:30.512 INFO:teuthology.orchestra.run.trial103.stdout: kernel-modules-core x86_64 5.14.0-686.el9 baseos 31 M 2026-02-24T18:20:30.512 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:20:30.512 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T18:20:30.512 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:20:30.512 INFO:teuthology.orchestra.run.trial103.stdout:Install 4 Packages 2026-02-24T18:20:30.512 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:20:30.512 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 89 M 2026-02-24T18:20:30.512 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 135 M 2026-02-24T18:20:30.512 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T18:20:31.048 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:20:31.055 INFO:teuthology.orchestra.run.trial026.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:32.357 INFO:teuthology.orchestra.run.trial103.stdout:(1/4): kernel-5.14.0-686.el9.x86_64.rpm 587 kB/s | 901 kB 00:01 2026-02-24T18:20:32.991 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:33.023 INFO:teuthology.orchestra.run.trial162.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:20:33.648 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:34.175 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:36.058 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:20:36.064 INFO:teuthology.orchestra.run.trial162.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:39.110 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:44.592 INFO:teuthology.orchestra.run.trial103.stdout:(2/4): kernel-modules-core-5.14.0-686.el9.x86_6 2.5 MB/s | 31 MB 00:12 2026-02-24T18:20:45.112 INFO:teuthology.orchestra.run.trial103.stdout:(3/4): kernel-modules-5.14.0-686.el9.x86_64.rpm 2.8 MB/s | 40 MB 00:14 2026-02-24T18:20:47.437 INFO:teuthology.orchestra.run.trial103.stdout:(4/4): kernel-core-5.14.0-686.el9.x86_64.rpm 1.0 MB/s | 17 MB 00:16 2026-02-24T18:20:47.439 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:20:47.439 INFO:teuthology.orchestra.run.trial103.stdout:Total 5.3 MB/s | 89 MB 00:16 2026-02-24T18:20:47.631 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T18:20:47.834 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T18:20:47.835 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T18:20:48.217 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T18:20:48.218 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T18:20:49.325 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T18:20:49.617 INFO:teuthology.orchestra.run.trial103.stdout: Installing : kernel-modules-core-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:20:49.639 INFO:teuthology.orchestra.run.trial103.stdout: Installing : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:50.981 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:51.003 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:51.191 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:51.191 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:20:51.191 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:51.191 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:20:51.249 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:51.249 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:20:51.249 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T18:20:51.250 INFO:teuthology.orchestra.run.trial070.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-24T18:20:51.250 INFO:teuthology.orchestra.run.trial070.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-24T18:20:51.250 INFO:teuthology.orchestra.run.trial070.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-24T18:20:51.250 INFO:teuthology.orchestra.run.trial070.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-24T18:20:51.250 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:20:51.250 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:20:51.311 DEBUG:teuthology.orchestra.run.trial070:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:20:51.340 INFO:teuthology.orchestra.run.trial070.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:20:51.341 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:20:51.341 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-24T18:20:51.341 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-24T18:20:51.342 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-24T18:20:51.342 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-24T18:20:51.342 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial070.front.sepia.ceph.com, path=None, version=distro) 2026-02-24T18:20:51.342 DEBUG:teuthology.orchestra.run.trial070:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:20:51.406 INFO:teuthology.orchestra.run.trial070.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:20:51.407 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:20:51.407 DEBUG:teuthology.orchestra.run.trial070:> sudo rpm -qi grub2-tools 2026-02-24T18:20:51.476 INFO:teuthology.orchestra.run.trial070.stdout:Name : grub2-tools 2026-02-24T18:20:51.476 INFO:teuthology.orchestra.run.trial070.stdout:Epoch : 1 2026-02-24T18:20:51.476 INFO:teuthology.orchestra.run.trial070.stdout:Version : 2.06 2026-02-24T18:20:51.476 INFO:teuthology.orchestra.run.trial070.stdout:Release : 120.el9 2026-02-24T18:20:51.476 INFO:teuthology.orchestra.run.trial070.stdout:Architecture: x86_64 2026-02-24T18:20:51.476 INFO:teuthology.orchestra.run.trial070.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-24T18:20:51.476 INFO:teuthology.orchestra.run.trial070.stdout:Group : Unspecified 2026-02-24T18:20:51.476 INFO:teuthology.orchestra.run.trial070.stdout:Size : 9108611 2026-02-24T18:20:51.476 INFO:teuthology.orchestra.run.trial070.stdout:License : GPLv3+ 2026-02-24T18:20:51.476 INFO:teuthology.orchestra.run.trial070.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-24T18:20:51.476 INFO:teuthology.orchestra.run.trial070.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-24T18:20:51.476 INFO:teuthology.orchestra.run.trial070.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-24T18:20:51.476 INFO:teuthology.orchestra.run.trial070.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-24T18:20:51.476 INFO:teuthology.orchestra.run.trial070.stdout:Packager : builder@centos.org 2026-02-24T18:20:51.476 INFO:teuthology.orchestra.run.trial070.stdout:Vendor : CentOS 2026-02-24T18:20:51.476 INFO:teuthology.orchestra.run.trial070.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-24T18:20:51.476 INFO:teuthology.orchestra.run.trial070.stdout:Summary : Support tools for GRUB. 2026-02-24T18:20:51.476 INFO:teuthology.orchestra.run.trial070.stdout:Description : 2026-02-24T18:20:51.476 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:20:51.476 INFO:teuthology.orchestra.run.trial070.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-24T18:20:51.476 INFO:teuthology.orchestra.run.trial070.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-24T18:20:51.476 INFO:teuthology.orchestra.run.trial070.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-24T18:20:51.476 INFO:teuthology.orchestra.run.trial070.stdout:hardware devices. 2026-02-24T18:20:51.476 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:20:51.476 INFO:teuthology.orchestra.run.trial070.stdout:This subpackage provides tools for support of all platforms. 2026-02-24T18:20:51.477 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-24T18:20:51.477 INFO:teuthology.task.kernel:Updating grub on trial070 to boot 5.14.0-686.el9.x86_64 2026-02-24T18:20:51.477 DEBUG:teuthology.orchestra.run.trial070:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-24T18:20:51.541 INFO:teuthology.orchestra.run.trial070.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-24T18:20:51.542 DEBUG:teuthology.orchestra.run.trial070:> sudo command -v grubby && echo yes || echo no 2026-02-24T18:20:51.583 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:51.606 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:51.608 INFO:teuthology.orchestra.run.trial070.stdout:/sbin/grubby 2026-02-24T18:20:51.610 INFO:teuthology.orchestra.run.trial070.stdout:yes 2026-02-24T18:20:51.611 DEBUG:teuthology.orchestra.run.trial070:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-24T18:20:51.675 INFO:teuthology.orchestra.run.trial070.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-24T18:20:51.677 DEBUG:teuthology.orchestra.run.trial070:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-24T18:20:51.752 DEBUG:teuthology.orchestra.run.trial070:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-24T18:20:51.789 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:51.789 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:20:51.790 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:51.790 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:20:51.847 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:51.848 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:20:51.848 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T18:20:51.848 INFO:teuthology.orchestra.run.trial026.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-24T18:20:51.848 INFO:teuthology.orchestra.run.trial026.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-24T18:20:51.848 INFO:teuthology.orchestra.run.trial026.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-24T18:20:51.848 INFO:teuthology.orchestra.run.trial026.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-24T18:20:51.848 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:20:51.848 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:20:51.910 DEBUG:teuthology.orchestra.run.trial026:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:20:51.940 INFO:teuthology.orchestra.run.trial026.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:20:51.941 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:20:51.941 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-24T18:20:51.941 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-24T18:20:51.941 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-24T18:20:51.941 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-24T18:20:51.942 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial026.front.sepia.ceph.com, path=None, version=distro) 2026-02-24T18:20:51.942 DEBUG:teuthology.orchestra.run.trial026:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:20:51.957 INFO:teuthology.orchestra.run.trial070.stderr:Generating grub configuration file ... 2026-02-24T18:20:52.006 INFO:teuthology.orchestra.run.trial026.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:20:52.007 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:20:52.007 DEBUG:teuthology.orchestra.run.trial026:> sudo rpm -qi grub2-tools 2026-02-24T18:20:52.025 INFO:teuthology.orchestra.run.trial070.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-24T18:20:52.032 INFO:teuthology.orchestra.run.trial070.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-24T18:20:52.076 INFO:teuthology.orchestra.run.trial026.stdout:Name : grub2-tools 2026-02-24T18:20:52.076 INFO:teuthology.orchestra.run.trial026.stdout:Epoch : 1 2026-02-24T18:20:52.076 INFO:teuthology.orchestra.run.trial026.stdout:Version : 2.06 2026-02-24T18:20:52.076 INFO:teuthology.orchestra.run.trial026.stdout:Release : 120.el9 2026-02-24T18:20:52.077 INFO:teuthology.orchestra.run.trial026.stdout:Architecture: x86_64 2026-02-24T18:20:52.077 INFO:teuthology.orchestra.run.trial026.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-24T18:20:52.077 INFO:teuthology.orchestra.run.trial026.stdout:Group : Unspecified 2026-02-24T18:20:52.077 INFO:teuthology.orchestra.run.trial026.stdout:Size : 9108611 2026-02-24T18:20:52.077 INFO:teuthology.orchestra.run.trial026.stdout:License : GPLv3+ 2026-02-24T18:20:52.078 INFO:teuthology.orchestra.run.trial026.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-24T18:20:52.078 INFO:teuthology.orchestra.run.trial026.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-24T18:20:52.078 INFO:teuthology.orchestra.run.trial026.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-24T18:20:52.078 INFO:teuthology.orchestra.run.trial026.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-24T18:20:52.078 INFO:teuthology.orchestra.run.trial026.stdout:Packager : builder@centos.org 2026-02-24T18:20:52.078 INFO:teuthology.orchestra.run.trial026.stdout:Vendor : CentOS 2026-02-24T18:20:52.079 INFO:teuthology.orchestra.run.trial026.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-24T18:20:52.079 INFO:teuthology.orchestra.run.trial026.stdout:Summary : Support tools for GRUB. 2026-02-24T18:20:52.079 INFO:teuthology.orchestra.run.trial026.stdout:Description : 2026-02-24T18:20:52.079 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:20:52.079 INFO:teuthology.orchestra.run.trial026.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-24T18:20:52.079 INFO:teuthology.orchestra.run.trial026.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-24T18:20:52.079 INFO:teuthology.orchestra.run.trial026.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-24T18:20:52.080 INFO:teuthology.orchestra.run.trial026.stdout:hardware devices. 2026-02-24T18:20:52.080 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:20:52.080 INFO:teuthology.orchestra.run.trial026.stdout:This subpackage provides tools for support of all platforms. 2026-02-24T18:20:52.082 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-24T18:20:52.082 INFO:teuthology.task.kernel:Updating grub on trial026 to boot 5.14.0-686.el9.x86_64 2026-02-24T18:20:52.082 DEBUG:teuthology.orchestra.run.trial026:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-24T18:20:52.146 INFO:teuthology.orchestra.run.trial026.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-24T18:20:52.147 DEBUG:teuthology.orchestra.run.trial026:> sudo command -v grubby && echo yes || echo no 2026-02-24T18:20:52.197 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:52.210 INFO:teuthology.orchestra.run.trial026.stdout:/sbin/grubby 2026-02-24T18:20:52.212 INFO:teuthology.orchestra.run.trial026.stdout:yes 2026-02-24T18:20:52.212 DEBUG:teuthology.orchestra.run.trial026:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-24T18:20:52.230 INFO:teuthology.orchestra.run.trial103.stdout: Installing : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:20:52.278 INFO:teuthology.orchestra.run.trial026.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-24T18:20:52.280 DEBUG:teuthology.orchestra.run.trial026:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-24T18:20:52.281 INFO:teuthology.orchestra.run.trial070.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-24T18:20:52.288 INFO:teuthology.orchestra.run.trial070.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-24T18:20:52.322 INFO:teuthology.orchestra.run.trial070.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-24T18:20:52.328 INFO:teuthology.orchestra.run.trial070.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-24T18:20:52.351 DEBUG:teuthology.orchestra.run.trial026:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-24T18:20:52.360 INFO:teuthology.orchestra.run.trial070.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-24T18:20:52.366 INFO:teuthology.orchestra.run.trial070.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-24T18:20:52.390 INFO:teuthology.orchestra.run.trial070.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-24T18:20:52.397 INFO:teuthology.orchestra.run.trial070.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-24T18:20:52.482 INFO:teuthology.orchestra.run.trial070.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T18:20:52.492 INFO:teuthology.orchestra.run.trial070.stderr:done 2026-02-24T18:20:52.494 DEBUG:teuthology.orchestra.run.trial070:> test -d /sys/firmware/efi 2026-02-24T18:20:52.510 DEBUG:teuthology.orchestra.run.trial070:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-24T18:20:52.556 INFO:teuthology.orchestra.run.trial026.stderr:Generating grub configuration file ... 2026-02-24T18:20:52.575 INFO:teuthology.orchestra.run.trial070.stdout:/boot/efi/EFI/BOOT 2026-02-24T18:20:52.575 INFO:teuthology.orchestra.run.trial070.stdout:/boot/efi/EFI/centos 2026-02-24T18:20:52.577 DEBUG:teuthology.orchestra.run.trial070:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-24T18:20:52.623 INFO:teuthology.orchestra.run.trial026.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-24T18:20:52.630 INFO:teuthology.orchestra.run.trial026.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-24T18:20:52.641 INFO:teuthology.orchestra.run.trial070.stdout:no 2026-02-24T18:20:52.642 DEBUG:teuthology.orchestra.run.trial070:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-24T18:20:52.707 INFO:teuthology.orchestra.run.trial070.stdout:yes 2026-02-24T18:20:52.707 DEBUG:teuthology.orchestra.run.trial070:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-24T18:20:52.772 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial070 2026-02-24T18:20:52.772 DEBUG:teuthology.orchestra.run.trial070:> sudo bash -c ' 2026-02-24T18:20:52.772 DEBUG:teuthology.orchestra.run.trial070:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T18:20:52.772 DEBUG:teuthology.orchestra.run.trial070:> ' 2026-02-24T18:20:52.877 INFO:teuthology.orchestra.run.trial026.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-24T18:20:52.883 INFO:teuthology.orchestra.run.trial026.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-24T18:20:52.917 INFO:teuthology.orchestra.run.trial026.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-24T18:20:52.924 INFO:teuthology.orchestra.run.trial026.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-24T18:20:52.956 INFO:teuthology.orchestra.run.trial026.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-24T18:20:52.962 INFO:teuthology.orchestra.run.trial026.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-24T18:20:52.985 INFO:teuthology.orchestra.run.trial026.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-24T18:20:52.992 INFO:teuthology.orchestra.run.trial026.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-24T18:20:53.078 INFO:teuthology.orchestra.run.trial026.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T18:20:53.086 INFO:teuthology.orchestra.run.trial026.stderr:done 2026-02-24T18:20:53.089 DEBUG:teuthology.orchestra.run.trial026:> test -d /sys/firmware/efi 2026-02-24T18:20:53.104 DEBUG:teuthology.orchestra.run.trial026:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-24T18:20:53.169 INFO:teuthology.orchestra.run.trial026.stdout:/boot/efi/EFI/BOOT 2026-02-24T18:20:53.169 INFO:teuthology.orchestra.run.trial026.stdout:/boot/efi/EFI/centos 2026-02-24T18:20:53.171 DEBUG:teuthology.orchestra.run.trial026:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-24T18:20:53.236 INFO:teuthology.orchestra.run.trial026.stdout:no 2026-02-24T18:20:53.236 DEBUG:teuthology.orchestra.run.trial026:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-24T18:20:53.301 INFO:teuthology.orchestra.run.trial026.stdout:yes 2026-02-24T18:20:53.302 DEBUG:teuthology.orchestra.run.trial026:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-24T18:20:53.365 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial026 2026-02-24T18:20:53.365 DEBUG:teuthology.orchestra.run.trial026:> sudo bash -c ' 2026-02-24T18:20:53.366 DEBUG:teuthology.orchestra.run.trial026:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T18:20:53.366 DEBUG:teuthology.orchestra.run.trial026:> ' 2026-02-24T18:20:55.264 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:20:55.270 INFO:teuthology.orchestra.run.trial103.stdout: Installing : kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:56.731 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:56.752 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:56.942 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:56.942 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:20:56.942 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:20:56.943 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:20:56.999 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:56.999 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:20:56.999 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T18:20:56.999 INFO:teuthology.orchestra.run.trial162.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-24T18:20:56.999 INFO:teuthology.orchestra.run.trial162.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-24T18:20:56.999 INFO:teuthology.orchestra.run.trial162.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-24T18:20:57.000 INFO:teuthology.orchestra.run.trial162.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-24T18:20:57.000 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:20:57.000 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:20:57.062 DEBUG:teuthology.orchestra.run.trial162:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:20:57.091 INFO:teuthology.orchestra.run.trial162.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:20:57.093 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:20:57.093 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-24T18:20:57.093 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-24T18:20:57.093 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-24T18:20:57.093 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2026-02-24T18:20:57.093 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial162.front.sepia.ceph.com, path=None, version=distro) 2026-02-24T18:20:57.094 DEBUG:teuthology.orchestra.run.trial162:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:20:57.158 INFO:teuthology.orchestra.run.trial162.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:20:57.160 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:20:57.160 DEBUG:teuthology.orchestra.run.trial162:> sudo rpm -qi grub2-tools 2026-02-24T18:20:57.228 INFO:teuthology.orchestra.run.trial162.stdout:Name : grub2-tools 2026-02-24T18:20:57.228 INFO:teuthology.orchestra.run.trial162.stdout:Epoch : 1 2026-02-24T18:20:57.228 INFO:teuthology.orchestra.run.trial162.stdout:Version : 2.06 2026-02-24T18:20:57.229 INFO:teuthology.orchestra.run.trial162.stdout:Release : 120.el9 2026-02-24T18:20:57.229 INFO:teuthology.orchestra.run.trial162.stdout:Architecture: x86_64 2026-02-24T18:20:57.229 INFO:teuthology.orchestra.run.trial162.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-24T18:20:57.229 INFO:teuthology.orchestra.run.trial162.stdout:Group : Unspecified 2026-02-24T18:20:57.229 INFO:teuthology.orchestra.run.trial162.stdout:Size : 9108611 2026-02-24T18:20:57.229 INFO:teuthology.orchestra.run.trial162.stdout:License : GPLv3+ 2026-02-24T18:20:57.229 INFO:teuthology.orchestra.run.trial162.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-24T18:20:57.229 INFO:teuthology.orchestra.run.trial162.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-24T18:20:57.229 INFO:teuthology.orchestra.run.trial162.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-24T18:20:57.229 INFO:teuthology.orchestra.run.trial162.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-24T18:20:57.230 INFO:teuthology.orchestra.run.trial162.stdout:Packager : builder@centos.org 2026-02-24T18:20:57.230 INFO:teuthology.orchestra.run.trial162.stdout:Vendor : CentOS 2026-02-24T18:20:57.230 INFO:teuthology.orchestra.run.trial162.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-24T18:20:57.230 INFO:teuthology.orchestra.run.trial162.stdout:Summary : Support tools for GRUB. 2026-02-24T18:20:57.230 INFO:teuthology.orchestra.run.trial162.stdout:Description : 2026-02-24T18:20:57.230 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:20:57.230 INFO:teuthology.orchestra.run.trial162.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-24T18:20:57.230 INFO:teuthology.orchestra.run.trial162.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-24T18:20:57.230 INFO:teuthology.orchestra.run.trial162.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-24T18:20:57.230 INFO:teuthology.orchestra.run.trial162.stdout:hardware devices. 2026-02-24T18:20:57.230 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:20:57.231 INFO:teuthology.orchestra.run.trial162.stdout:This subpackage provides tools for support of all platforms. 2026-02-24T18:20:57.232 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-24T18:20:57.232 INFO:teuthology.task.kernel:Updating grub on trial162 to boot 5.14.0-686.el9.x86_64 2026-02-24T18:20:57.232 DEBUG:teuthology.orchestra.run.trial162:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-24T18:20:57.295 INFO:teuthology.orchestra.run.trial162.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-24T18:20:57.297 DEBUG:teuthology.orchestra.run.trial162:> sudo command -v grubby && echo yes || echo no 2026-02-24T18:20:57.360 INFO:teuthology.orchestra.run.trial162.stdout:/sbin/grubby 2026-02-24T18:20:57.361 INFO:teuthology.orchestra.run.trial162.stdout:yes 2026-02-24T18:20:57.361 DEBUG:teuthology.orchestra.run.trial162:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-24T18:20:57.425 INFO:teuthology.orchestra.run.trial162.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-24T18:20:57.427 DEBUG:teuthology.orchestra.run.trial162:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-24T18:20:57.499 DEBUG:teuthology.orchestra.run.trial162:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-24T18:20:57.707 INFO:teuthology.orchestra.run.trial162.stderr:Generating grub configuration file ... 2026-02-24T18:20:57.776 INFO:teuthology.orchestra.run.trial162.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-24T18:20:57.782 INFO:teuthology.orchestra.run.trial162.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-24T18:20:58.036 INFO:teuthology.orchestra.run.trial162.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-24T18:20:58.043 INFO:teuthology.orchestra.run.trial162.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-24T18:20:58.077 INFO:teuthology.orchestra.run.trial162.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-24T18:20:58.084 INFO:teuthology.orchestra.run.trial162.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-24T18:20:58.115 INFO:teuthology.orchestra.run.trial162.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-24T18:20:58.121 INFO:teuthology.orchestra.run.trial162.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-24T18:20:58.144 INFO:teuthology.orchestra.run.trial162.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-24T18:20:58.151 INFO:teuthology.orchestra.run.trial162.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-24T18:20:58.237 INFO:teuthology.orchestra.run.trial162.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T18:20:58.245 INFO:teuthology.orchestra.run.trial162.stderr:done 2026-02-24T18:20:58.247 DEBUG:teuthology.orchestra.run.trial162:> test -d /sys/firmware/efi 2026-02-24T18:20:58.264 DEBUG:teuthology.orchestra.run.trial162:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-24T18:20:58.329 INFO:teuthology.orchestra.run.trial162.stdout:/boot/efi/EFI/BOOT 2026-02-24T18:20:58.330 INFO:teuthology.orchestra.run.trial162.stdout:/boot/efi/EFI/centos 2026-02-24T18:20:58.331 DEBUG:teuthology.orchestra.run.trial162:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-24T18:20:58.396 INFO:teuthology.orchestra.run.trial162.stdout:no 2026-02-24T18:20:58.397 DEBUG:teuthology.orchestra.run.trial162:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-24T18:20:58.460 INFO:teuthology.orchestra.run.trial162.stdout:yes 2026-02-24T18:20:58.460 DEBUG:teuthology.orchestra.run.trial162:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-24T18:20:58.520 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:20:58.524 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial162 2026-02-24T18:20:58.524 DEBUG:teuthology.orchestra.run.trial162:> sudo bash -c ' 2026-02-24T18:20:58.525 DEBUG:teuthology.orchestra.run.trial162:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T18:20:58.525 DEBUG:teuthology.orchestra.run.trial162:> ' 2026-02-24T18:21:16.049 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: kernel-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:16.071 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: kernel-modules-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:16.257 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: kernel-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:16.257 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : kernel-5.14.0-686.el9.x86_64 1/4 2026-02-24T18:21:16.258 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : kernel-core-5.14.0-686.el9.x86_64 2/4 2026-02-24T18:21:16.258 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : kernel-modules-5.14.0-686.el9.x86_64 3/4 2026-02-24T18:21:16.318 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : kernel-modules-core-5.14.0-686.el9.x86_64 4/4 2026-02-24T18:21:16.319 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:21:16.319 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T18:21:16.319 INFO:teuthology.orchestra.run.trial103.stdout: kernel-5.14.0-686.el9.x86_64 2026-02-24T18:21:16.319 INFO:teuthology.orchestra.run.trial103.stdout: kernel-core-5.14.0-686.el9.x86_64 2026-02-24T18:21:16.319 INFO:teuthology.orchestra.run.trial103.stdout: kernel-modules-5.14.0-686.el9.x86_64 2026-02-24T18:21:16.320 INFO:teuthology.orchestra.run.trial103.stdout: kernel-modules-core-5.14.0-686.el9.x86_64 2026-02-24T18:21:16.320 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:21:16.320 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:21:16.378 DEBUG:teuthology.orchestra.run.trial103:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:21:16.406 INFO:teuthology.orchestra.run.trial103.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:21:16.407 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:21:16.407 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-681.el9.x86_64 Expected: 5.14.0-686.el9.x86_64 2026-02-24T18:21:16.407 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-24T18:21:16.407 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-24T18:21:16.407 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2026-02-24T18:21:16.407 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial103.front.sepia.ceph.com, path=None, version=distro) 2026-02-24T18:21:16.407 DEBUG:teuthology.orchestra.run.trial103:> rpm -q kernel | sort -rV | head -n 1 2026-02-24T18:21:16.471 INFO:teuthology.orchestra.run.trial103.stdout:kernel-5.14.0-686.el9.x86_64 2026-02-24T18:21:16.471 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-686.el9.x86_64 2026-02-24T18:21:16.472 DEBUG:teuthology.orchestra.run.trial103:> sudo rpm -qi grub2-tools 2026-02-24T18:21:16.540 INFO:teuthology.orchestra.run.trial103.stdout:Name : grub2-tools 2026-02-24T18:21:16.540 INFO:teuthology.orchestra.run.trial103.stdout:Epoch : 1 2026-02-24T18:21:16.540 INFO:teuthology.orchestra.run.trial103.stdout:Version : 2.06 2026-02-24T18:21:16.540 INFO:teuthology.orchestra.run.trial103.stdout:Release : 120.el9 2026-02-24T18:21:16.540 INFO:teuthology.orchestra.run.trial103.stdout:Architecture: x86_64 2026-02-24T18:21:16.540 INFO:teuthology.orchestra.run.trial103.stdout:Install Date: Wed 18 Feb 2026 05:18:42 PM UTC 2026-02-24T18:21:16.540 INFO:teuthology.orchestra.run.trial103.stdout:Group : Unspecified 2026-02-24T18:21:16.540 INFO:teuthology.orchestra.run.trial103.stdout:Size : 9108611 2026-02-24T18:21:16.540 INFO:teuthology.orchestra.run.trial103.stdout:License : GPLv3+ 2026-02-24T18:21:16.540 INFO:teuthology.orchestra.run.trial103.stdout:Signature : RSA/SHA256, Thu 04 Dec 2025 09:42:59 AM UTC, Key ID 05b555b38483c65d 2026-02-24T18:21:16.540 INFO:teuthology.orchestra.run.trial103.stdout:Source RPM : grub2-2.06-120.el9.src.rpm 2026-02-24T18:21:16.540 INFO:teuthology.orchestra.run.trial103.stdout:Build Date : Wed 03 Dec 2025 12:10:38 PM UTC 2026-02-24T18:21:16.540 INFO:teuthology.orchestra.run.trial103.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-24T18:21:16.540 INFO:teuthology.orchestra.run.trial103.stdout:Packager : builder@centos.org 2026-02-24T18:21:16.540 INFO:teuthology.orchestra.run.trial103.stdout:Vendor : CentOS 2026-02-24T18:21:16.540 INFO:teuthology.orchestra.run.trial103.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-24T18:21:16.540 INFO:teuthology.orchestra.run.trial103.stdout:Summary : Support tools for GRUB. 2026-02-24T18:21:16.540 INFO:teuthology.orchestra.run.trial103.stdout:Description : 2026-02-24T18:21:16.540 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:21:16.540 INFO:teuthology.orchestra.run.trial103.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-24T18:21:16.540 INFO:teuthology.orchestra.run.trial103.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-24T18:21:16.540 INFO:teuthology.orchestra.run.trial103.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-24T18:21:16.540 INFO:teuthology.orchestra.run.trial103.stdout:hardware devices. 2026-02-24T18:21:16.540 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:21:16.540 INFO:teuthology.orchestra.run.trial103.stdout:This subpackage provides tools for support of all platforms. 2026-02-24T18:21:16.541 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-24T18:21:16.541 INFO:teuthology.task.kernel:Updating grub on trial103 to boot 5.14.0-686.el9.x86_64 2026-02-24T18:21:16.541 DEBUG:teuthology.orchestra.run.trial103:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-24T18:21:16.605 INFO:teuthology.orchestra.run.trial103.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-24T18:21:16.607 DEBUG:teuthology.orchestra.run.trial103:> sudo command -v grubby && echo yes || echo no 2026-02-24T18:21:16.670 INFO:teuthology.orchestra.run.trial103.stdout:/sbin/grubby 2026-02-24T18:21:16.672 INFO:teuthology.orchestra.run.trial103.stdout:yes 2026-02-24T18:21:16.672 DEBUG:teuthology.orchestra.run.trial103:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-686.el9.x86_64" | head -n 1 2026-02-24T18:21:16.736 INFO:teuthology.orchestra.run.trial103.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64.conf 2026-02-24T18:21:16.738 DEBUG:teuthology.orchestra.run.trial103:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-686.el9.x86_64 2026-02-24T18:21:16.810 DEBUG:teuthology.orchestra.run.trial103:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-24T18:21:17.015 INFO:teuthology.orchestra.run.trial103.stderr:Generating grub configuration file ... 2026-02-24T18:21:17.081 INFO:teuthology.orchestra.run.trial103.stderr:Found linux image: /boot/vmlinuz-5.14.0-686.el9.x86_64 2026-02-24T18:21:17.088 INFO:teuthology.orchestra.run.trial103.stderr:Found initrd image: /boot/initramfs-5.14.0-686.el9.x86_64.img 2026-02-24T18:21:17.339 INFO:teuthology.orchestra.run.trial103.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-24T18:21:17.346 INFO:teuthology.orchestra.run.trial103.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-24T18:21:17.380 INFO:teuthology.orchestra.run.trial103.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-24T18:21:17.386 INFO:teuthology.orchestra.run.trial103.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-24T18:21:17.417 INFO:teuthology.orchestra.run.trial103.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-24T18:21:17.423 INFO:teuthology.orchestra.run.trial103.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-24T18:21:17.447 INFO:teuthology.orchestra.run.trial103.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-24T18:21:17.453 INFO:teuthology.orchestra.run.trial103.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-24T18:21:17.538 INFO:teuthology.orchestra.run.trial103.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-24T18:21:17.546 INFO:teuthology.orchestra.run.trial103.stderr:done 2026-02-24T18:21:17.548 DEBUG:teuthology.orchestra.run.trial103:> test -d /sys/firmware/efi 2026-02-24T18:21:17.565 DEBUG:teuthology.orchestra.run.trial103:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-24T18:21:17.631 INFO:teuthology.orchestra.run.trial103.stdout:/boot/efi/EFI/BOOT 2026-02-24T18:21:17.631 INFO:teuthology.orchestra.run.trial103.stdout:/boot/efi/EFI/centos 2026-02-24T18:21:17.632 DEBUG:teuthology.orchestra.run.trial103:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-24T18:21:17.698 INFO:teuthology.orchestra.run.trial103.stdout:no 2026-02-24T18:21:17.698 DEBUG:teuthology.orchestra.run.trial103:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-24T18:21:17.764 INFO:teuthology.orchestra.run.trial103.stdout:yes 2026-02-24T18:21:17.765 DEBUG:teuthology.orchestra.run.trial103:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-24T18:21:17.830 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial103 2026-02-24T18:21:17.830 DEBUG:teuthology.orchestra.run.trial103:> sudo bash -c ' 2026-02-24T18:21:17.830 DEBUG:teuthology.orchestra.run.trial103:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-24T18:21:17.831 DEBUG:teuthology.orchestra.run.trial103:> ' 2026-02-24T18:21:22.815 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-24T18:21:22.815 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-24T18:21:22.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:21:23.408 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-24T18:21:23.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-24T18:21:23.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:21:28.567 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2026-02-24T18:21:28.567 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial162.front.sepia.ceph.com' 2026-02-24T18:21:28.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:21:47.874 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-24T18:21:47.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial103.front.sepia.ceph.com' 2026-02-24T18:21:47.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:22:22.832 DEBUG:teuthology.orchestra.remote:timed out 2026-02-24T18:22:23.418 DEBUG:teuthology.orchestra.remote:timed out 2026-02-24T18:22:28.571 DEBUG:teuthology.orchestra.remote:timed out 2026-02-24T18:22:31.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-24T18:22:31.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:22:31.953 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-24T18:22:32.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-24T18:22:32.101 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-686.el9.x86_64"... 2026-02-24T18:22:32.101 DEBUG:teuthology.orchestra.run.trial070:> uname -r 2026-02-24T18:22:32.157 INFO:teuthology.orchestra.run.trial070.stdout:5.14.0-686.el9.x86_64 2026-02-24T18:22:32.157 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-24T18:22:32.157 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T18:22:32.158 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-24T18:22:32.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-24T18:22:32.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:22:32.560 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-24T18:22:32.718 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-24T18:22:32.718 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-686.el9.x86_64"... 2026-02-24T18:22:32.719 DEBUG:teuthology.orchestra.run.trial026:> uname -r 2026-02-24T18:22:32.774 INFO:teuthology.orchestra.run.trial026.stdout:5.14.0-686.el9.x86_64 2026-02-24T18:22:32.775 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-24T18:22:32.775 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T18:22:32.775 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-24T18:22:33.158 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2026-02-24T18:22:33.159 DEBUG:teuthology.orchestra.run.trial070:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-24T18:22:33.189 INFO:teuthology.orchestra.run.trial070.stdout:ttyS1 2026-02-24T18:22:33.217 DEBUG:teuthology.parallel:result is None 2026-02-24T18:22:33.775 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-24T18:22:33.776 DEBUG:teuthology.orchestra.run.trial026:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-24T18:22:33.805 INFO:teuthology.orchestra.run.trial026.stdout:ttyS1 2026-02-24T18:22:33.829 DEBUG:teuthology.parallel:result is None 2026-02-24T18:22:37.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial162.front.sepia.ceph.com' 2026-02-24T18:22:37.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:22:37.668 DEBUG:teuthology.orchestra.run.trial162:> true 2026-02-24T18:22:37.823 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial162.front.sepia.ceph.com' 2026-02-24T18:22:37.823 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-686.el9.x86_64"... 2026-02-24T18:22:37.823 DEBUG:teuthology.orchestra.run.trial162:> uname -r 2026-02-24T18:22:37.878 INFO:teuthology.orchestra.run.trial162.stdout:5.14.0-686.el9.x86_64 2026-02-24T18:22:37.879 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-24T18:22:37.879 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T18:22:37.879 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-24T18:22:38.879 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2026-02-24T18:22:38.879 DEBUG:teuthology.orchestra.run.trial162:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-24T18:22:38.909 INFO:teuthology.orchestra.run.trial162.stdout:ttyS1 2026-02-24T18:22:38.940 DEBUG:teuthology.parallel:result is None 2026-02-24T18:22:47.876 DEBUG:teuthology.orchestra.remote:timed out 2026-02-24T18:22:56.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial103.front.sepia.ceph.com' 2026-02-24T18:22:56.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:22:57.007 DEBUG:teuthology.orchestra.run.trial103:> true 2026-02-24T18:22:57.166 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial103.front.sepia.ceph.com' 2026-02-24T18:22:57.166 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-686.el9.x86_64"... 2026-02-24T18:22:57.166 DEBUG:teuthology.orchestra.run.trial103:> uname -r 2026-02-24T18:22:57.222 INFO:teuthology.orchestra.run.trial103.stdout:5.14.0-686.el9.x86_64 2026-02-24T18:22:57.223 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-686.el9.x86_64 vs 5.14.0-686.el9.x86_64 2026-02-24T18:22:57.223 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-24T18:22:57.223 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-24T18:22:58.224 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2026-02-24T18:22:58.224 DEBUG:teuthology.orchestra.run.trial103:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-24T18:22:58.254 INFO:teuthology.orchestra.run.trial103.stdout:ttyS1 2026-02-24T18:22:58.282 DEBUG:teuthology.parallel:result is None 2026-02-24T18:22:58.283 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-24T18:22:58.294 INFO:teuthology.task.internal:Creating test directory... 2026-02-24T18:22:58.294 DEBUG:teuthology.orchestra.run.trial026:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T18:22:58.297 DEBUG:teuthology.orchestra.run.trial070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T18:22:58.300 DEBUG:teuthology.orchestra.run.trial103:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T18:22:58.324 DEBUG:teuthology.orchestra.run.trial162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-24T18:22:58.343 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-24T18:22:58.356 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-24T18:22:58.370 INFO:teuthology.task.internal:Creating archive directory... 2026-02-24T18:22:58.371 DEBUG:teuthology.orchestra.run.trial026:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T18:22:58.373 DEBUG:teuthology.orchestra.run.trial070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T18:22:58.376 DEBUG:teuthology.orchestra.run.trial103:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T18:22:58.380 DEBUG:teuthology.orchestra.run.trial162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-24T18:22:58.410 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-24T18:22:58.422 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-24T18:22:58.422 DEBUG:teuthology.orchestra.run.trial026:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T18:22:58.430 DEBUG:teuthology.orchestra.run.trial070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T18:22:58.432 DEBUG:teuthology.orchestra.run.trial103:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T18:22:58.436 DEBUG:teuthology.orchestra.run.trial162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-24T18:22:58.451 INFO:teuthology.orchestra.run.trial026.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:22:58.455 INFO:teuthology.orchestra.run.trial070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:22:58.458 INFO:teuthology.orchestra.run.trial103.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:22:58.460 INFO:teuthology.orchestra.run.trial026.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:22:58.464 INFO:teuthology.orchestra.run.trial070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:22:58.464 INFO:teuthology.orchestra.run.trial162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:22:58.466 INFO:teuthology.orchestra.run.trial103.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:22:58.473 INFO:teuthology.orchestra.run.trial162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-24T18:22:58.475 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-24T18:22:58.488 INFO:teuthology.task.internal:Configuring sudo... 2026-02-24T18:22:58.488 DEBUG:teuthology.orchestra.run.trial026:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T18:22:58.503 DEBUG:teuthology.orchestra.run.trial070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T18:22:58.507 DEBUG:teuthology.orchestra.run.trial103:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T18:22:58.510 DEBUG:teuthology.orchestra.run.trial162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-24T18:22:58.539 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-24T18:22:58.551 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-24T18:22:58.552 DEBUG:teuthology.orchestra.run.trial026:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T18:22:58.568 DEBUG:teuthology.orchestra.run.trial070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T18:22:58.571 DEBUG:teuthology.orchestra.run.trial103:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T18:22:58.574 DEBUG:teuthology.orchestra.run.trial162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-24T18:22:58.595 DEBUG:teuthology.orchestra.run.trial026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:22:58.716 DEBUG:teuthology.orchestra.run.trial026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:22:58.741 DEBUG:teuthology.orchestra.run.trial026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:22:58.886 DEBUG:teuthology.orchestra.run.trial026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:22:58.911 DEBUG:teuthology.orchestra.run.trial026:> set -ex 2026-02-24T18:22:58.911 DEBUG:teuthology.orchestra.run.trial026:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T18:22:58.975 DEBUG:teuthology.orchestra.run.trial070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:22:59.085 DEBUG:teuthology.orchestra.run.trial070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:22:59.111 DEBUG:teuthology.orchestra.run.trial070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:22:59.250 DEBUG:teuthology.orchestra.run.trial070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:22:59.275 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-24T18:22:59.275 DEBUG:teuthology.orchestra.run.trial070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T18:22:59.339 DEBUG:teuthology.orchestra.run.trial103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:22:59.451 DEBUG:teuthology.orchestra.run.trial103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:22:59.476 DEBUG:teuthology.orchestra.run.trial103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:22:59.798 DEBUG:teuthology.orchestra.run.trial103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:22:59.823 DEBUG:teuthology.orchestra.run.trial103:> set -ex 2026-02-24T18:22:59.823 DEBUG:teuthology.orchestra.run.trial103:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T18:22:59.887 DEBUG:teuthology.orchestra.run.trial162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:23:00.011 DEBUG:teuthology.orchestra.run.trial162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T18:23:00.036 DEBUG:teuthology.orchestra.run.trial162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:23:00.180 DEBUG:teuthology.orchestra.run.trial162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T18:23:00.205 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-24T18:23:00.205 DEBUG:teuthology.orchestra.run.trial162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-24T18:23:00.268 DEBUG:teuthology.orchestra.run.trial026:> sudo service rsyslog restart 2026-02-24T18:23:00.270 DEBUG:teuthology.orchestra.run.trial070:> sudo service rsyslog restart 2026-02-24T18:23:00.272 DEBUG:teuthology.orchestra.run.trial103:> sudo service rsyslog restart 2026-02-24T18:23:00.274 DEBUG:teuthology.orchestra.run.trial162:> sudo service rsyslog restart 2026-02-24T18:23:00.296 INFO:teuthology.orchestra.run.trial026.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T18:23:00.298 INFO:teuthology.orchestra.run.trial070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T18:23:00.300 INFO:teuthology.orchestra.run.trial103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T18:23:00.337 INFO:teuthology.orchestra.run.trial162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T18:23:00.829 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-24T18:23:00.844 INFO:teuthology.task.internal:Starting timer... 2026-02-24T18:23:00.844 INFO:teuthology.run_tasks:Running task pcp... 2026-02-24T18:23:00.861 INFO:teuthology.run_tasks:Running task selinux... 2026-02-24T18:23:00.873 DEBUG:teuthology.orchestra.run.trial026:> sudo service auditd rotate 2026-02-24T18:23:00.902 INFO:teuthology.orchestra.run.trial026.stdout:Rotating logs: 2026-02-24T18:23:00.904 DEBUG:teuthology.orchestra.run.trial070:> sudo service auditd rotate 2026-02-24T18:23:00.932 INFO:teuthology.orchestra.run.trial070.stdout:Rotating logs: 2026-02-24T18:23:00.934 DEBUG:teuthology.orchestra.run.trial103:> sudo service auditd rotate 2026-02-24T18:23:00.962 INFO:teuthology.orchestra.run.trial103.stdout:Rotating logs: 2026-02-24T18:23:00.964 DEBUG:teuthology.orchestra.run.trial162:> sudo service auditd rotate 2026-02-24T18:23:00.992 INFO:teuthology.orchestra.run.trial162.stdout:Rotating logs: 2026-02-24T18:23:00.994 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-24T18:23:00.994 DEBUG:teuthology.orchestra.run.trial026:> /usr/sbin/getenforce 2026-02-24T18:23:01.011 INFO:teuthology.orchestra.run.trial026.stdout:Permissive 2026-02-24T18:23:01.011 DEBUG:teuthology.orchestra.run.trial070:> /usr/sbin/getenforce 2026-02-24T18:23:01.028 INFO:teuthology.orchestra.run.trial070.stdout:Permissive 2026-02-24T18:23:01.028 DEBUG:teuthology.orchestra.run.trial103:> /usr/sbin/getenforce 2026-02-24T18:23:01.043 INFO:teuthology.orchestra.run.trial103.stdout:Permissive 2026-02-24T18:23:01.043 DEBUG:teuthology.orchestra.run.trial162:> /usr/sbin/getenforce 2026-02-24T18:23:01.058 INFO:teuthology.orchestra.run.trial162.stdout:Permissive 2026-02-24T18:23:01.059 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial026.front.sepia.ceph.com': 'permissive', 'ubuntu@trial070.front.sepia.ceph.com': 'permissive', 'ubuntu@trial103.front.sepia.ceph.com': 'permissive', 'ubuntu@trial162.front.sepia.ceph.com': 'permissive'} 2026-02-24T18:23:01.059 DEBUG:teuthology.orchestra.run.trial026:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T18:23:01.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:23:01.084 DEBUG:teuthology.orchestra.run.trial070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T18:23:01.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:23:01.110 DEBUG:teuthology.orchestra.run.trial103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T18:23:01.134 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:23:01.135 DEBUG:teuthology.orchestra.run.trial162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T18:23:01.161 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T18:23:01.162 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-24T18:23:01.162 DEBUG:teuthology.orchestra.run.trial026:> sudo /usr/sbin/setenforce permissive 2026-02-24T18:23:01.188 DEBUG:teuthology.orchestra.run.trial070:> sudo /usr/sbin/setenforce permissive 2026-02-24T18:23:01.212 DEBUG:teuthology.orchestra.run.trial103:> sudo /usr/sbin/setenforce permissive 2026-02-24T18:23:01.236 DEBUG:teuthology.orchestra.run.trial162:> sudo /usr/sbin/setenforce permissive 2026-02-24T18:23:01.262 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-24T18:23:01.280 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-24T18:23:01.291 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-24T18:23:01.292 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial026.front.sepia.ceph.com,trial070.front.sepia.ceph.com,trial103.front.sepia.ceph.com,trial162.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-24T18:25:50.544 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial026.front.sepia.ceph.com'), Remote(name='ubuntu@trial070.front.sepia.ceph.com'), Remote(name='ubuntu@trial103.front.sepia.ceph.com'), Remote(name='ubuntu@trial162.front.sepia.ceph.com')] 2026-02-24T18:25:50.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-24T18:25:50.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:25:50.625 DEBUG:teuthology.orchestra.run.trial026:> true 2026-02-24T18:25:50.711 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial026.front.sepia.ceph.com' 2026-02-24T18:25:50.711 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-24T18:25:50.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:25:50.793 DEBUG:teuthology.orchestra.run.trial070:> true 2026-02-24T18:25:50.868 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial070.front.sepia.ceph.com' 2026-02-24T18:25:50.868 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial103.front.sepia.ceph.com' 2026-02-24T18:25:50.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:25:50.930 DEBUG:teuthology.orchestra.run.trial103:> true 2026-02-24T18:25:51.004 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial103.front.sepia.ceph.com' 2026-02-24T18:25:51.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial162.front.sepia.ceph.com' 2026-02-24T18:25:51.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-24T18:25:51.086 DEBUG:teuthology.orchestra.run.trial162:> true 2026-02-24T18:25:51.162 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial162.front.sepia.ceph.com' 2026-02-24T18:25:51.163 INFO:teuthology.run_tasks:Running task clock... 2026-02-24T18:25:51.197 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-24T18:25:51.197 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T18:25:51.198 DEBUG:teuthology.orchestra.run.trial026:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T18:25:51.200 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T18:25:51.200 DEBUG:teuthology.orchestra.run.trial070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T18:25:51.251 INFO:teuthology.orchestra.run.trial026.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-24T18:25:51.251 INFO:teuthology.orchestra.run.trial026.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-24T18:25:51.252 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T18:25:51.252 DEBUG:teuthology.orchestra.run.trial103:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T18:25:51.254 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-24T18:25:51.254 DEBUG:teuthology.orchestra.run.trial162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T18:25:51.256 INFO:teuthology.orchestra.run.trial026.stderr:sudo: ntpd: command not found 2026-02-24T18:25:51.265 INFO:teuthology.orchestra.run.trial026.stdout:506 Cannot talk to daemon 2026-02-24T18:25:51.278 INFO:teuthology.orchestra.run.trial026.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-24T18:25:51.278 INFO:teuthology.orchestra.run.trial070.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-24T18:25:51.280 INFO:teuthology.orchestra.run.trial103.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-24T18:25:51.282 INFO:teuthology.orchestra.run.trial162.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-24T18:25:51.289 INFO:teuthology.orchestra.run.trial026.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-24T18:25:51.290 INFO:teuthology.orchestra.run.trial070.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-24T18:25:51.291 INFO:teuthology.orchestra.run.trial103.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-24T18:25:51.295 INFO:teuthology.orchestra.run.trial162.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-24T18:25:51.310 INFO:teuthology.orchestra.run.trial103.stderr:sudo: ntpd: command not found 2026-02-24T18:25:51.311 INFO:teuthology.orchestra.run.trial070.stderr:sudo: ntpd: command not found 2026-02-24T18:25:51.316 INFO:teuthology.orchestra.run.trial162.stderr:sudo: ntpd: command not found 2026-02-24T18:25:51.320 INFO:teuthology.orchestra.run.trial103.stdout:506 Cannot talk to daemon 2026-02-24T18:25:51.320 INFO:teuthology.orchestra.run.trial070.stdout:506 Cannot talk to daemon 2026-02-24T18:25:51.325 INFO:teuthology.orchestra.run.trial162.stdout:506 Cannot talk to daemon 2026-02-24T18:25:51.331 INFO:teuthology.orchestra.run.trial070.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-24T18:25:51.332 INFO:teuthology.orchestra.run.trial103.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-24T18:25:51.335 INFO:teuthology.orchestra.run.trial026.stderr:bash: line 1: ntpq: command not found 2026-02-24T18:25:51.337 INFO:teuthology.orchestra.run.trial162.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-24T18:25:51.338 INFO:teuthology.orchestra.run.trial026.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T18:25:51.338 INFO:teuthology.orchestra.run.trial026.stdout:=============================================================================== 2026-02-24T18:25:51.338 INFO:teuthology.orchestra.run.trial026.stdout:^? time.cloudflare.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:51.338 INFO:teuthology.orchestra.run.trial026.stdout:^? 149.28.61.105.vultruserc> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:51.338 INFO:teuthology.orchestra.run.trial026.stdout:^? arm1.maxhost.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:51.338 INFO:teuthology.orchestra.run.trial026.stdout:^? usmoi.meezy.link 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:51.343 INFO:teuthology.orchestra.run.trial070.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-24T18:25:51.344 INFO:teuthology.orchestra.run.trial103.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-24T18:25:51.348 INFO:teuthology.orchestra.run.trial162.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-24T18:25:51.387 INFO:teuthology.orchestra.run.trial070.stderr:bash: line 1: ntpq: command not found 2026-02-24T18:25:51.389 INFO:teuthology.orchestra.run.trial070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T18:25:51.390 INFO:teuthology.orchestra.run.trial070.stdout:=============================================================================== 2026-02-24T18:25:51.390 INFO:teuthology.orchestra.run.trial070.stdout:^? srcf-ntp.stanford.edu 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:51.390 INFO:teuthology.orchestra.run.trial070.stdout:^? 73.185.182.209 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:51.390 INFO:teuthology.orchestra.run.trial070.stdout:^? lax1.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:51.390 INFO:teuthology.orchestra.run.trial070.stdout:^? frumentum-zeus.infra.fru> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:51.393 INFO:teuthology.orchestra.run.trial103.stderr:bash: line 1: ntpq: command not found 2026-02-24T18:25:51.396 INFO:teuthology.orchestra.run.trial103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T18:25:51.396 INFO:teuthology.orchestra.run.trial103.stdout:=============================================================================== 2026-02-24T18:25:51.396 INFO:teuthology.orchestra.run.trial103.stdout:^? 170-187-147-56.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:51.396 INFO:teuthology.orchestra.run.trial103.stdout:^? 44.190.5.123 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:51.396 INFO:teuthology.orchestra.run.trial103.stdout:^? 108.61.215.221.vultruser> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:51.396 INFO:teuthology.orchestra.run.trial103.stdout:^? 23.186.168.129 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:51.397 INFO:teuthology.orchestra.run.trial162.stderr:bash: line 1: ntpq: command not found 2026-02-24T18:25:51.400 INFO:teuthology.orchestra.run.trial162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T18:25:51.400 INFO:teuthology.orchestra.run.trial162.stdout:=============================================================================== 2026-02-24T18:25:51.400 INFO:teuthology.orchestra.run.trial162.stdout:^? 172-233-177-198.ip.linod> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:51.400 INFO:teuthology.orchestra.run.trial162.stdout:^? nyc2.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:51.400 INFO:teuthology.orchestra.run.trial162.stdout:^? beta.kenyonralph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:51.400 INFO:teuthology.orchestra.run.trial162.stdout:^? 216-144-228-179-host.col> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-24T18:25:51.401 INFO:teuthology.run_tasks:Running task install... 2026-02-24T18:25:51.415 DEBUG:teuthology.task.install:project ceph 2026-02-24T18:25:51.415 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155'}} 2026-02-24T18:25:51.415 DEBUG:teuthology.task.install:config {'debuginfo': True, 'flavor': 'default', 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155'} 2026-02-24T18:25:51.415 INFO:teuthology.task.install:Using flavor: default 2026-02-24T18:25:51.422 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2026-02-24T18:25:51.422 INFO:teuthology.task.install:extra packages: [] 2026-02-24T18:25:51.423 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'tag': None, 'wait_for_package': False} 2026-02-24T18:25:51.423 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T18:25:51.424 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'tag': None, 'wait_for_package': False} 2026-02-24T18:25:51.425 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T18:25:51.426 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'tag': None, 'wait_for_package': False} 2026-02-24T18:25:51.426 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T18:25:51.427 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'tag': None, 'wait_for_package': False} 2026-02-24T18:25:51.427 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T18:25:51.678 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/ 2026-02-24T18:25:51.679 INFO:teuthology.task.install.rpm:Package version is 20.2.0-681.g36d388f2 2026-02-24T18:25:51.682 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/ 2026-02-24T18:25:51.682 INFO:teuthology.task.install.rpm:Package version is 20.2.0-681.g36d388f2 2026-02-24T18:25:51.683 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/ 2026-02-24T18:25:51.683 INFO:teuthology.task.install.rpm:Package version is 20.2.0-681.g36d388f2 2026-02-24T18:25:51.707 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/ 2026-02-24T18:25:51.707 INFO:teuthology.task.install.rpm:Package version is 20.2.0-681.g36d388f2 2026-02-24T18:25:52.076 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T18:25:52.077 DEBUG:teuthology.orchestra.run.trial026:> set -ex 2026-02-24T18:25:52.077 DEBUG:teuthology.orchestra.run.trial026:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T18:25:52.079 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T18:25:52.079 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-24T18:25:52.079 DEBUG:teuthology.orchestra.run.trial070:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T18:25:52.097 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T18:25:52.097 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-24T18:25:52.097 DEBUG:teuthology.orchestra.run.trial162:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T18:25:52.105 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-24T18:25:52.105 DEBUG:teuthology.orchestra.run.trial070:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/36d388f27052dd940bdbaf543bb05bdba0acc155/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T18:25:52.106 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-24T18:25:52.106 DEBUG:teuthology.orchestra.run.trial026:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/36d388f27052dd940bdbaf543bb05bdba0acc155/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T18:25:52.124 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-24T18:25:52.124 DEBUG:teuthology.orchestra.run.trial162:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/36d388f27052dd940bdbaf543bb05bdba0acc155/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T18:25:52.141 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-19-1610-tentacle/36d388f27052dd940bdbaf543bb05bdba0acc155/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-24T18:25:52.141 DEBUG:teuthology.orchestra.run.trial103:> set -ex 2026-02-24T18:25:52.141 DEBUG:teuthology.orchestra.run.trial103:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-24T18:25:52.167 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-24T18:25:52.167 DEBUG:teuthology.orchestra.run.trial103:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/36d388f27052dd940bdbaf543bb05bdba0acc155/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-24T18:25:52.169 DEBUG:teuthology.orchestra.run.trial070:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T18:25:52.170 DEBUG:teuthology.orchestra.run.trial026:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T18:25:52.189 DEBUG:teuthology.orchestra.run.trial162:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T18:25:52.232 DEBUG:teuthology.orchestra.run.trial103:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-24T18:25:52.244 DEBUG:teuthology.orchestra.run.trial070:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T18:25:52.245 DEBUG:teuthology.orchestra.run.trial026:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T18:25:52.263 DEBUG:teuthology.orchestra.run.trial162:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T18:25:52.305 DEBUG:teuthology.orchestra.run.trial103:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-24T18:25:52.307 INFO:teuthology.orchestra.run.trial026.stdout:check_obsoletes = 1 2026-02-24T18:25:52.308 DEBUG:teuthology.orchestra.run.trial026:> sudo yum clean all 2026-02-24T18:25:52.309 INFO:teuthology.orchestra.run.trial070.stdout:check_obsoletes = 1 2026-02-24T18:25:52.309 DEBUG:teuthology.orchestra.run.trial070:> sudo yum clean all 2026-02-24T18:25:52.327 INFO:teuthology.orchestra.run.trial162.stdout:check_obsoletes = 1 2026-02-24T18:25:52.328 DEBUG:teuthology.orchestra.run.trial162:> sudo yum clean all 2026-02-24T18:25:52.369 INFO:teuthology.orchestra.run.trial103.stdout:check_obsoletes = 1 2026-02-24T18:25:52.371 DEBUG:teuthology.orchestra.run.trial103:> sudo yum clean all 2026-02-24T18:25:52.458 INFO:teuthology.orchestra.run.trial070.stdout:41 files removed 2026-02-24T18:25:52.459 INFO:teuthology.orchestra.run.trial026.stdout:41 files removed 2026-02-24T18:25:52.472 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-radosgw 2026-02-24T18:25:52.474 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install ceph-radosgw 2026-02-24T18:25:52.478 INFO:teuthology.orchestra.run.trial162.stdout:41 files removed 2026-02-24T18:25:52.492 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-radosgw 2026-02-24T18:25:52.518 INFO:teuthology.orchestra.run.trial103.stdout:41 files removed 2026-02-24T18:25:52.533 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install ceph-radosgw 2026-02-24T18:25:53.313 INFO:teuthology.orchestra.run.trial070.stdout:ceph packages for x86_64 125 kB/s | 87 kB 00:00 2026-02-24T18:25:53.315 INFO:teuthology.orchestra.run.trial026.stdout:ceph packages for x86_64 125 kB/s | 87 kB 00:00 2026-02-24T18:25:53.334 INFO:teuthology.orchestra.run.trial162.stdout:ceph packages for x86_64 125 kB/s | 87 kB 00:00 2026-02-24T18:25:53.373 INFO:teuthology.orchestra.run.trial103.stdout:ceph packages for x86_64 126 kB/s | 87 kB 00:00 2026-02-24T18:25:53.976 INFO:teuthology.orchestra.run.trial070.stdout:ceph noarch packages 28 kB/s | 18 kB 00:00 2026-02-24T18:25:53.986 INFO:teuthology.orchestra.run.trial026.stdout:ceph noarch packages 28 kB/s | 18 kB 00:00 2026-02-24T18:25:53.999 INFO:teuthology.orchestra.run.trial162.stdout:ceph noarch packages 28 kB/s | 18 kB 00:00 2026-02-24T18:25:54.043 INFO:teuthology.orchestra.run.trial103.stdout:ceph noarch packages 28 kB/s | 18 kB 00:00 2026-02-24T18:25:54.487 INFO:teuthology.orchestra.run.trial070.stdout:ceph source packages 4.0 kB/s | 1.9 kB 00:00 2026-02-24T18:25:54.493 INFO:teuthology.orchestra.run.trial026.stdout:ceph source packages 4.0 kB/s | 1.9 kB 00:00 2026-02-24T18:25:54.511 INFO:teuthology.orchestra.run.trial162.stdout:ceph source packages 4.0 kB/s | 1.9 kB 00:00 2026-02-24T18:25:54.541 INFO:teuthology.orchestra.run.trial103.stdout:ceph source packages 4.1 kB/s | 1.9 kB 00:00 2026-02-24T18:25:55.139 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.9 MB 00:00 2026-02-24T18:25:55.305 INFO:teuthology.orchestra.run.trial026.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.9 MB 00:00 2026-02-24T18:25:56.114 INFO:teuthology.orchestra.run.trial103.stdout:CentOS Stream 9 - BaseOS 5.7 MB/s | 8.9 MB 00:01 2026-02-24T18:25:56.280 INFO:teuthology.orchestra.run.trial162.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 8.9 MB 00:01 2026-02-24T18:25:56.873 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - AppStream 22 MB/s | 27 MB 00:01 2026-02-24T18:26:00.177 INFO:teuthology.orchestra.run.trial103.stdout:CentOS Stream 9 - AppStream 7.6 MB/s | 27 MB 00:03 2026-02-24T18:26:00.249 INFO:teuthology.orchestra.run.trial162.stdout:CentOS Stream 9 - AppStream 7.8 MB/s | 27 MB 00:03 2026-02-24T18:26:00.425 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - CRB 6.8 MB/s | 8.0 MB 00:01 2026-02-24T18:26:01.311 INFO:teuthology.orchestra.run.trial070.stdout:CentOS Stream 9 - Extras packages 135 kB/s | 20 kB 00:00 2026-02-24T18:26:01.602 INFO:teuthology.orchestra.run.trial026.stdout:CentOS Stream 9 - AppStream 4.7 MB/s | 27 MB 00:05 2026-02-24T18:26:02.161 INFO:teuthology.orchestra.run.trial070.stdout:Extra Packages for Enterprise Linux 26 MB/s | 20 MB 00:00 2026-02-24T18:26:02.906 INFO:teuthology.orchestra.run.trial162.stdout:CentOS Stream 9 - CRB 29 MB/s | 8.0 MB 00:00 2026-02-24T18:26:04.765 INFO:teuthology.orchestra.run.trial162.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 20 kB 00:01 2026-02-24T18:26:05.069 INFO:teuthology.orchestra.run.trial026.stdout:CentOS Stream 9 - CRB 7.7 MB/s | 8.0 MB 00:01 2026-02-24T18:26:05.145 INFO:teuthology.orchestra.run.trial162.stdout:Extra Packages for Enterprise Linux 64 MB/s | 20 MB 00:00 2026-02-24T18:26:05.374 INFO:teuthology.orchestra.run.trial070.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-24T18:26:06.602 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:26:06.604 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:26:06.604 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repository Size 2026-02-24T18:26:06.604 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:26:06.604 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T18:26:06.604 INFO:teuthology.orchestra.run.trial070.stdout: ceph-radosgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-24T18:26:06.604 INFO:teuthology.orchestra.run.trial070.stdout:Upgrading: 2026-02-24T18:26:06.605 INFO:teuthology.orchestra.run.trial070.stdout: librados2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.5 M 2026-02-24T18:26:06.605 INFO:teuthology.orchestra.run.trial070.stdout: librbd1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.8 M 2026-02-24T18:26:06.605 INFO:teuthology.orchestra.run.trial070.stdout:Installing dependencies: 2026-02-24T18:26:06.605 INFO:teuthology.orchestra.run.trial070.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-24T18:26:06.605 INFO:teuthology.orchestra.run.trial070.stdout: ceph-base x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.9 M 2026-02-24T18:26:06.605 INFO:teuthology.orchestra.run.trial070.stdout: ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-24T18:26:06.605 INFO:teuthology.orchestra.run.trial070.stdout: ceph-selinux x86_64 2:20.2.0-681.g36d388f2.el9 ceph 25 k 2026-02-24T18:26:06.605 INFO:teuthology.orchestra.run.trial070.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-24T18:26:06.605 INFO:teuthology.orchestra.run.trial070.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-24T18:26:06.606 INFO:teuthology.orchestra.run.trial070.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-24T18:26:06.606 INFO:teuthology.orchestra.run.trial070.stdout: libcephfs2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 869 k 2026-02-24T18:26:06.606 INFO:teuthology.orchestra.run.trial070.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-24T18:26:06.606 INFO:teuthology.orchestra.run.trial070.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-24T18:26:06.606 INFO:teuthology.orchestra.run.trial070.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-24T18:26:06.606 INFO:teuthology.orchestra.run.trial070.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-24T18:26:06.606 INFO:teuthology.orchestra.run.trial070.stdout: libradosstriper1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 250 k 2026-02-24T18:26:06.607 INFO:teuthology.orchestra.run.trial070.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-24T18:26:06.607 INFO:teuthology.orchestra.run.trial070.stdout: librgw2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.4 M 2026-02-24T18:26:06.607 INFO:teuthology.orchestra.run.trial070.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-24T18:26:06.607 INFO:teuthology.orchestra.run.trial070.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-24T18:26:06.607 INFO:teuthology.orchestra.run.trial070.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-24T18:26:06.607 INFO:teuthology.orchestra.run.trial070.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-24T18:26:06.607 INFO:teuthology.orchestra.run.trial070.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-24T18:26:06.608 INFO:teuthology.orchestra.run.trial070.stdout: python3-ceph-argparse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 45 k 2026-02-24T18:26:06.608 INFO:teuthology.orchestra.run.trial070.stdout: python3-ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 175 k 2026-02-24T18:26:06.608 INFO:teuthology.orchestra.run.trial070.stdout: python3-cephfs x86_64 2:20.2.0-681.g36d388f2.el9 ceph 163 k 2026-02-24T18:26:06.608 INFO:teuthology.orchestra.run.trial070.stdout: python3-rados x86_64 2:20.2.0-681.g36d388f2.el9 ceph 323 k 2026-02-24T18:26:06.608 INFO:teuthology.orchestra.run.trial070.stdout: python3-rbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 306 k 2026-02-24T18:26:06.608 INFO:teuthology.orchestra.run.trial070.stdout: python3-rgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 99 k 2026-02-24T18:26:06.609 INFO:teuthology.orchestra.run.trial070.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-24T18:26:06.609 INFO:teuthology.orchestra.run.trial070.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-24T18:26:06.609 INFO:teuthology.orchestra.run.trial070.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-24T18:26:06.609 INFO:teuthology.orchestra.run.trial070.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-24T18:26:06.609 INFO:teuthology.orchestra.run.trial070.stdout:Installing weak dependencies: 2026-02-24T18:26:06.609 INFO:teuthology.orchestra.run.trial070.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-24T18:26:06.609 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:26:06.610 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T18:26:06.610 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:26:06.610 INFO:teuthology.orchestra.run.trial070.stdout:Install 32 Packages 2026-02-24T18:26:06.610 INFO:teuthology.orchestra.run.trial070.stdout:Upgrade 2 Packages 2026-02-24T18:26:06.610 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:26:06.611 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 78 M 2026-02-24T18:26:06.611 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T18:26:06.634 INFO:teuthology.orchestra.run.trial026.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 20 kB 00:00 2026-02-24T18:26:08.315 INFO:teuthology.orchestra.run.trial162.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-24T18:26:08.413 INFO:teuthology.orchestra.run.trial103.stdout:CentOS Stream 9 - CRB 1.4 MB/s | 8.0 MB 00:05 2026-02-24T18:26:08.918 INFO:teuthology.orchestra.run.trial026.stdout:Extra Packages for Enterprise Linux 9.2 MB/s | 20 MB 00:02 2026-02-24T18:26:09.536 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:26:09.538 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:26:09.538 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repository Size 2026-02-24T18:26:09.538 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:26:09.538 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T18:26:09.538 INFO:teuthology.orchestra.run.trial162.stdout: ceph-radosgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-24T18:26:09.538 INFO:teuthology.orchestra.run.trial162.stdout:Upgrading: 2026-02-24T18:26:09.538 INFO:teuthology.orchestra.run.trial162.stdout: librados2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.5 M 2026-02-24T18:26:09.538 INFO:teuthology.orchestra.run.trial162.stdout: librbd1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.8 M 2026-02-24T18:26:09.538 INFO:teuthology.orchestra.run.trial162.stdout:Installing dependencies: 2026-02-24T18:26:09.538 INFO:teuthology.orchestra.run.trial162.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-24T18:26:09.539 INFO:teuthology.orchestra.run.trial162.stdout: ceph-base x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.9 M 2026-02-24T18:26:09.539 INFO:teuthology.orchestra.run.trial162.stdout: ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-24T18:26:09.539 INFO:teuthology.orchestra.run.trial162.stdout: ceph-selinux x86_64 2:20.2.0-681.g36d388f2.el9 ceph 25 k 2026-02-24T18:26:09.539 INFO:teuthology.orchestra.run.trial162.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-24T18:26:09.539 INFO:teuthology.orchestra.run.trial162.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-24T18:26:09.539 INFO:teuthology.orchestra.run.trial162.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-24T18:26:09.539 INFO:teuthology.orchestra.run.trial162.stdout: libcephfs2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 869 k 2026-02-24T18:26:09.539 INFO:teuthology.orchestra.run.trial162.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-24T18:26:09.539 INFO:teuthology.orchestra.run.trial162.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-24T18:26:09.539 INFO:teuthology.orchestra.run.trial162.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-24T18:26:09.539 INFO:teuthology.orchestra.run.trial162.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-24T18:26:09.539 INFO:teuthology.orchestra.run.trial162.stdout: libradosstriper1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 250 k 2026-02-24T18:26:09.540 INFO:teuthology.orchestra.run.trial162.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-24T18:26:09.540 INFO:teuthology.orchestra.run.trial162.stdout: librgw2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.4 M 2026-02-24T18:26:09.540 INFO:teuthology.orchestra.run.trial162.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-24T18:26:09.540 INFO:teuthology.orchestra.run.trial162.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-24T18:26:09.540 INFO:teuthology.orchestra.run.trial162.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-24T18:26:09.540 INFO:teuthology.orchestra.run.trial162.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-24T18:26:09.540 INFO:teuthology.orchestra.run.trial162.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-24T18:26:09.540 INFO:teuthology.orchestra.run.trial162.stdout: python3-ceph-argparse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 45 k 2026-02-24T18:26:09.540 INFO:teuthology.orchestra.run.trial162.stdout: python3-ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 175 k 2026-02-24T18:26:09.540 INFO:teuthology.orchestra.run.trial162.stdout: python3-cephfs x86_64 2:20.2.0-681.g36d388f2.el9 ceph 163 k 2026-02-24T18:26:09.540 INFO:teuthology.orchestra.run.trial162.stdout: python3-rados x86_64 2:20.2.0-681.g36d388f2.el9 ceph 323 k 2026-02-24T18:26:09.540 INFO:teuthology.orchestra.run.trial162.stdout: python3-rbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 306 k 2026-02-24T18:26:09.540 INFO:teuthology.orchestra.run.trial162.stdout: python3-rgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 99 k 2026-02-24T18:26:09.541 INFO:teuthology.orchestra.run.trial162.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-24T18:26:09.541 INFO:teuthology.orchestra.run.trial162.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-24T18:26:09.541 INFO:teuthology.orchestra.run.trial162.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-24T18:26:09.541 INFO:teuthology.orchestra.run.trial162.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-24T18:26:09.541 INFO:teuthology.orchestra.run.trial162.stdout:Installing weak dependencies: 2026-02-24T18:26:09.541 INFO:teuthology.orchestra.run.trial162.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-24T18:26:09.541 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:26:09.541 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T18:26:09.541 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:26:09.541 INFO:teuthology.orchestra.run.trial162.stdout:Install 32 Packages 2026-02-24T18:26:09.541 INFO:teuthology.orchestra.run.trial162.stdout:Upgrade 2 Packages 2026-02-24T18:26:09.541 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:26:09.542 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 78 M 2026-02-24T18:26:09.542 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T18:26:10.040 INFO:teuthology.orchestra.run.trial103.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 20 kB 00:00 2026-02-24T18:26:10.090 INFO:teuthology.orchestra.run.trial070.stdout:(1/34): ceph-base-20.2.0-681.g36d388f2.el9.x86_ 1.9 MB/s | 5.9 MB 00:03 2026-02-24T18:26:10.160 INFO:teuthology.orchestra.run.trial070.stdout:(2/34): ceph-selinux-20.2.0-681.g36d388f2.el9.x 359 kB/s | 25 kB 00:00 2026-02-24T18:26:10.436 INFO:teuthology.orchestra.run.trial103.stdout:Extra Packages for Enterprise Linux 61 MB/s | 20 MB 00:00 2026-02-24T18:26:10.761 INFO:teuthology.orchestra.run.trial070.stdout:(3/34): libcephfs2-20.2.0-681.g36d388f2.el9.x86 1.4 MB/s | 869 kB 00:00 2026-02-24T18:26:10.949 INFO:teuthology.orchestra.run.trial070.stdout:(4/34): libradosstriper1-20.2.0-681.g36d388f2.e 1.3 MB/s | 250 kB 00:00 2026-02-24T18:26:12.095 INFO:teuthology.orchestra.run.trial026.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-24T18:26:13.320 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:26:13.321 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:26:13.321 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repository Size 2026-02-24T18:26:13.322 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:26:13.322 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T18:26:13.322 INFO:teuthology.orchestra.run.trial026.stdout: ceph-radosgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-24T18:26:13.322 INFO:teuthology.orchestra.run.trial026.stdout:Upgrading: 2026-02-24T18:26:13.322 INFO:teuthology.orchestra.run.trial026.stdout: librados2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.5 M 2026-02-24T18:26:13.322 INFO:teuthology.orchestra.run.trial026.stdout: librbd1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.8 M 2026-02-24T18:26:13.322 INFO:teuthology.orchestra.run.trial026.stdout:Installing dependencies: 2026-02-24T18:26:13.322 INFO:teuthology.orchestra.run.trial026.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-24T18:26:13.322 INFO:teuthology.orchestra.run.trial026.stdout: ceph-base x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.9 M 2026-02-24T18:26:13.322 INFO:teuthology.orchestra.run.trial026.stdout: ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-24T18:26:13.322 INFO:teuthology.orchestra.run.trial026.stdout: ceph-selinux x86_64 2:20.2.0-681.g36d388f2.el9 ceph 25 k 2026-02-24T18:26:13.322 INFO:teuthology.orchestra.run.trial026.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-24T18:26:13.323 INFO:teuthology.orchestra.run.trial026.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-24T18:26:13.323 INFO:teuthology.orchestra.run.trial026.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-24T18:26:13.323 INFO:teuthology.orchestra.run.trial026.stdout: libcephfs2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 869 k 2026-02-24T18:26:13.323 INFO:teuthology.orchestra.run.trial026.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-24T18:26:13.323 INFO:teuthology.orchestra.run.trial026.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-24T18:26:13.323 INFO:teuthology.orchestra.run.trial026.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-24T18:26:13.323 INFO:teuthology.orchestra.run.trial026.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-24T18:26:13.323 INFO:teuthology.orchestra.run.trial026.stdout: libradosstriper1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 250 k 2026-02-24T18:26:13.323 INFO:teuthology.orchestra.run.trial026.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-24T18:26:13.323 INFO:teuthology.orchestra.run.trial026.stdout: librgw2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.4 M 2026-02-24T18:26:13.323 INFO:teuthology.orchestra.run.trial026.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-24T18:26:13.323 INFO:teuthology.orchestra.run.trial026.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-24T18:26:13.324 INFO:teuthology.orchestra.run.trial026.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-24T18:26:13.324 INFO:teuthology.orchestra.run.trial026.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-24T18:26:13.324 INFO:teuthology.orchestra.run.trial026.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-24T18:26:13.324 INFO:teuthology.orchestra.run.trial026.stdout: python3-ceph-argparse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 45 k 2026-02-24T18:26:13.324 INFO:teuthology.orchestra.run.trial026.stdout: python3-ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 175 k 2026-02-24T18:26:13.324 INFO:teuthology.orchestra.run.trial026.stdout: python3-cephfs x86_64 2:20.2.0-681.g36d388f2.el9 ceph 163 k 2026-02-24T18:26:13.324 INFO:teuthology.orchestra.run.trial026.stdout: python3-rados x86_64 2:20.2.0-681.g36d388f2.el9 ceph 323 k 2026-02-24T18:26:13.324 INFO:teuthology.orchestra.run.trial026.stdout: python3-rbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 306 k 2026-02-24T18:26:13.324 INFO:teuthology.orchestra.run.trial026.stdout: python3-rgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 99 k 2026-02-24T18:26:13.324 INFO:teuthology.orchestra.run.trial026.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-24T18:26:13.324 INFO:teuthology.orchestra.run.trial026.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-24T18:26:13.324 INFO:teuthology.orchestra.run.trial026.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-24T18:26:13.324 INFO:teuthology.orchestra.run.trial026.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-24T18:26:13.325 INFO:teuthology.orchestra.run.trial026.stdout:Installing weak dependencies: 2026-02-24T18:26:13.325 INFO:teuthology.orchestra.run.trial026.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-24T18:26:13.325 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:26:13.325 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T18:26:13.325 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:26:13.325 INFO:teuthology.orchestra.run.trial026.stdout:Install 32 Packages 2026-02-24T18:26:13.325 INFO:teuthology.orchestra.run.trial026.stdout:Upgrade 2 Packages 2026-02-24T18:26:13.325 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:26:13.326 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 78 M 2026-02-24T18:26:13.326 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T18:26:13.587 INFO:teuthology.orchestra.run.trial103.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-24T18:26:14.543 INFO:teuthology.orchestra.run.trial070.stdout:(5/34): librgw2-20.2.0-681.g36d388f2.el9.x86_64 1.8 MB/s | 6.4 MB 00:03 2026-02-24T18:26:14.606 INFO:teuthology.orchestra.run.trial070.stdout:(6/34): python3-ceph-argparse-20.2.0-681.g36d38 718 kB/s | 45 kB 00:00 2026-02-24T18:26:14.739 INFO:teuthology.orchestra.run.trial070.stdout:(7/34): python3-ceph-common-20.2.0-681.g36d388f 1.3 MB/s | 175 kB 00:00 2026-02-24T18:26:14.812 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:26:14.813 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:26:14.813 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repository Size 2026-02-24T18:26:14.813 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:26:14.813 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T18:26:14.813 INFO:teuthology.orchestra.run.trial103.stdout: ceph-radosgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-24T18:26:14.814 INFO:teuthology.orchestra.run.trial103.stdout:Upgrading: 2026-02-24T18:26:14.814 INFO:teuthology.orchestra.run.trial103.stdout: librados2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.5 M 2026-02-24T18:26:14.814 INFO:teuthology.orchestra.run.trial103.stdout: librbd1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.8 M 2026-02-24T18:26:14.814 INFO:teuthology.orchestra.run.trial103.stdout:Installing dependencies: 2026-02-24T18:26:14.814 INFO:teuthology.orchestra.run.trial103.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-24T18:26:14.814 INFO:teuthology.orchestra.run.trial103.stdout: ceph-base x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.9 M 2026-02-24T18:26:14.814 INFO:teuthology.orchestra.run.trial103.stdout: ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 M 2026-02-24T18:26:14.814 INFO:teuthology.orchestra.run.trial103.stdout: ceph-selinux x86_64 2:20.2.0-681.g36d388f2.el9 ceph 25 k 2026-02-24T18:26:14.814 INFO:teuthology.orchestra.run.trial103.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-24T18:26:14.814 INFO:teuthology.orchestra.run.trial103.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-24T18:26:14.814 INFO:teuthology.orchestra.run.trial103.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-24T18:26:14.814 INFO:teuthology.orchestra.run.trial103.stdout: libcephfs2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 869 k 2026-02-24T18:26:14.815 INFO:teuthology.orchestra.run.trial103.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-24T18:26:14.815 INFO:teuthology.orchestra.run.trial103.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-24T18:26:14.815 INFO:teuthology.orchestra.run.trial103.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-24T18:26:14.815 INFO:teuthology.orchestra.run.trial103.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-24T18:26:14.815 INFO:teuthology.orchestra.run.trial103.stdout: libradosstriper1 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 250 k 2026-02-24T18:26:14.815 INFO:teuthology.orchestra.run.trial103.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-24T18:26:14.815 INFO:teuthology.orchestra.run.trial103.stdout: librgw2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.4 M 2026-02-24T18:26:14.815 INFO:teuthology.orchestra.run.trial103.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-24T18:26:14.815 INFO:teuthology.orchestra.run.trial103.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-24T18:26:14.815 INFO:teuthology.orchestra.run.trial103.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-24T18:26:14.815 INFO:teuthology.orchestra.run.trial103.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-24T18:26:14.815 INFO:teuthology.orchestra.run.trial103.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-24T18:26:14.815 INFO:teuthology.orchestra.run.trial103.stdout: python3-ceph-argparse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 45 k 2026-02-24T18:26:14.816 INFO:teuthology.orchestra.run.trial103.stdout: python3-ceph-common x86_64 2:20.2.0-681.g36d388f2.el9 ceph 175 k 2026-02-24T18:26:14.816 INFO:teuthology.orchestra.run.trial103.stdout: python3-cephfs x86_64 2:20.2.0-681.g36d388f2.el9 ceph 163 k 2026-02-24T18:26:14.816 INFO:teuthology.orchestra.run.trial103.stdout: python3-rados x86_64 2:20.2.0-681.g36d388f2.el9 ceph 323 k 2026-02-24T18:26:14.816 INFO:teuthology.orchestra.run.trial103.stdout: python3-rbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 306 k 2026-02-24T18:26:14.816 INFO:teuthology.orchestra.run.trial103.stdout: python3-rgw x86_64 2:20.2.0-681.g36d388f2.el9 ceph 99 k 2026-02-24T18:26:14.816 INFO:teuthology.orchestra.run.trial103.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-24T18:26:14.816 INFO:teuthology.orchestra.run.trial103.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-24T18:26:14.816 INFO:teuthology.orchestra.run.trial103.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-24T18:26:14.816 INFO:teuthology.orchestra.run.trial103.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-24T18:26:14.816 INFO:teuthology.orchestra.run.trial103.stdout:Installing weak dependencies: 2026-02-24T18:26:14.816 INFO:teuthology.orchestra.run.trial103.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-24T18:26:14.816 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:26:14.817 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T18:26:14.817 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:26:14.817 INFO:teuthology.orchestra.run.trial103.stdout:Install 32 Packages 2026-02-24T18:26:14.817 INFO:teuthology.orchestra.run.trial103.stdout:Upgrade 2 Packages 2026-02-24T18:26:14.817 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:26:14.817 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 78 M 2026-02-24T18:26:14.818 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T18:26:14.873 INFO:teuthology.orchestra.run.trial070.stdout:(8/34): python3-cephfs-20.2.0-681.g36d388f2.el9 1.2 MB/s | 163 kB 00:00 2026-02-24T18:26:15.082 INFO:teuthology.orchestra.run.trial070.stdout:(9/34): python3-rados-20.2.0-681.g36d388f2.el9. 1.5 MB/s | 323 kB 00:00 2026-02-24T18:26:15.289 INFO:teuthology.orchestra.run.trial070.stdout:(10/34): python3-rbd-20.2.0-681.g36d388f2.el9.x 1.4 MB/s | 306 kB 00:00 2026-02-24T18:26:15.359 INFO:teuthology.orchestra.run.trial070.stdout:(11/34): python3-rgw-20.2.0-681.g36d388f2.el9.x 1.4 MB/s | 99 kB 00:00 2026-02-24T18:26:15.370 INFO:teuthology.orchestra.run.trial070.stdout:(12/34): mailcap-2.1.49-5.el9.noarch.rpm 3.0 MB/s | 33 kB 00:00 2026-02-24T18:26:15.378 INFO:teuthology.orchestra.run.trial070.stdout:(13/34): pciutils-3.7.0-7.el9.x86_64.rpm 11 MB/s | 93 kB 00:00 2026-02-24T18:26:15.953 INFO:teuthology.orchestra.run.trial070.stdout:(14/34): boost-program-options-1.75.0-13.el9.x8 181 kB/s | 104 kB 00:00 2026-02-24T18:26:16.507 INFO:teuthology.orchestra.run.trial070.stdout:(15/34): libnbd-1.20.3-4.el9.x86_64.rpm 296 kB/s | 164 kB 00:00 2026-02-24T18:26:16.905 INFO:teuthology.orchestra.run.trial070.stdout:(16/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 403 kB/s | 160 kB 00:00 2026-02-24T18:26:17.067 INFO:teuthology.orchestra.run.trial070.stdout:(17/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 279 kB/s | 45 kB 00:00 2026-02-24T18:26:17.209 INFO:teuthology.orchestra.run.trial162.stdout:(1/34): ceph-base-20.2.0-681.g36d388f2.el9.x86_ 837 kB/s | 5.9 MB 00:07 2026-02-24T18:26:17.274 INFO:teuthology.orchestra.run.trial162.stdout:(2/34): ceph-selinux-20.2.0-681.g36d388f2.el9.x 386 kB/s | 25 kB 00:00 2026-02-24T18:26:18.094 INFO:teuthology.orchestra.run.trial070.stdout:(18/34): librdkafka-1.6.1-102.el9.x86_64.rpm 644 kB/s | 662 kB 00:01 2026-02-24T18:26:18.492 INFO:teuthology.orchestra.run.trial070.stdout:(19/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 735 kB/s | 292 kB 00:00 2026-02-24T18:26:18.657 INFO:teuthology.orchestra.run.trial162.stdout:(3/34): libcephfs2-20.2.0-681.g36d388f2.el9.x86 628 kB/s | 869 kB 00:01 2026-02-24T18:26:18.733 INFO:teuthology.orchestra.run.trial070.stdout:(20/34): qatlib-25.08.0-2.el9.x86_64.rpm 995 kB/s | 240 kB 00:00 2026-02-24T18:26:18.817 INFO:teuthology.orchestra.run.trial070.stdout:(21/34): qatlib-service-25.08.0-2.el9.x86_64.rp 441 kB/s | 37 kB 00:00 2026-02-24T18:26:18.901 INFO:teuthology.orchestra.run.trial070.stdout:(22/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 798 kB/s | 66 kB 00:00 2026-02-24T18:26:19.059 INFO:teuthology.orchestra.run.trial162.stdout:(4/34): libradosstriper1-20.2.0-681.g36d388f2.e 623 kB/s | 250 kB 00:00 2026-02-24T18:26:19.189 INFO:teuthology.orchestra.run.trial070.stdout:(23/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.0 MB/s | 308 kB 00:00 2026-02-24T18:26:19.389 INFO:teuthology.orchestra.run.trial070.stdout:(24/34): libarrow-9.0.0-15.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2026-02-24T18:26:19.427 INFO:teuthology.orchestra.run.trial070.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 657 kB/s | 25 kB 00:00 2026-02-24T18:26:19.465 INFO:teuthology.orchestra.run.trial070.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 1.3 MB/s | 49 kB 00:00 2026-02-24T18:26:19.518 INFO:teuthology.orchestra.run.trial070.stdout:(27/34): libunwind-1.6.2-1.el9.x86_64.rpm 1.2 MB/s | 67 kB 00:00 2026-02-24T18:26:19.561 INFO:teuthology.orchestra.run.trial070.stdout:(28/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 19 MB/s | 838 kB 00:00 2026-02-24T18:26:19.600 INFO:teuthology.orchestra.run.trial070.stdout:(29/34): re2-20211101-20.el9.x86_64.rpm 4.8 MB/s | 191 kB 00:00 2026-02-24T18:26:19.649 INFO:teuthology.orchestra.run.trial070.stdout:(30/34): thrift-0.15.0-4.el9.x86_64.rpm 33 MB/s | 1.6 MB 00:00 2026-02-24T18:26:21.339 INFO:teuthology.orchestra.run.trial026.stdout:(1/34): ceph-base-20.2.0-681.g36d388f2.el9.x86_ 771 kB/s | 5.9 MB 00:07 2026-02-24T18:26:21.409 INFO:teuthology.orchestra.run.trial026.stdout:(2/34): ceph-selinux-20.2.0-681.g36d388f2.el9.x 361 kB/s | 25 kB 00:00 2026-02-24T18:26:21.460 INFO:teuthology.orchestra.run.trial103.stdout:(1/34): ceph-base-20.2.0-681.g36d388f2.el9.x86_ 982 kB/s | 5.9 MB 00:06 2026-02-24T18:26:21.477 INFO:teuthology.orchestra.run.trial070.stdout:(31/34): librados2-20.2.0-681.g36d388f2.el9.x86 1.9 MB/s | 3.5 MB 00:01 2026-02-24T18:26:21.532 INFO:teuthology.orchestra.run.trial103.stdout:(2/34): ceph-selinux-20.2.0-681.g36d388f2.el9.x 352 kB/s | 25 kB 00:00 2026-02-24T18:26:22.009 INFO:teuthology.orchestra.run.trial026.stdout:(3/34): libcephfs2-20.2.0-681.g36d388f2.el9.x86 1.4 MB/s | 869 kB 00:00 2026-02-24T18:26:22.204 INFO:teuthology.orchestra.run.trial026.stdout:(4/34): libradosstriper1-20.2.0-681.g36d388f2.e 1.3 MB/s | 250 kB 00:00 2026-02-24T18:26:22.688 INFO:teuthology.orchestra.run.trial070.stdout:(32/34): librbd1-20.2.0-681.g36d388f2.el9.x86_6 2.3 MB/s | 2.8 MB 00:01 2026-02-24T18:26:22.805 INFO:teuthology.orchestra.run.trial103.stdout:(3/34): libcephfs2-20.2.0-681.g36d388f2.el9.x86 683 kB/s | 869 kB 00:01 2026-02-24T18:26:23.152 INFO:teuthology.orchestra.run.trial103.stdout:(4/34): libradosstriper1-20.2.0-681.g36d388f2.e 721 kB/s | 250 kB 00:00 2026-02-24T18:26:24.451 INFO:teuthology.orchestra.run.trial103.stdout:(5/34): ceph-radosgw-20.2.0-681.g36d388f2.el9.x 2.6 MB/s | 24 MB 00:09 2026-02-24T18:26:24.521 INFO:teuthology.orchestra.run.trial103.stdout:(6/34): python3-ceph-argparse-20.2.0-681.g36d38 650 kB/s | 45 kB 00:00 2026-02-24T18:26:24.592 INFO:teuthology.orchestra.run.trial103.stdout:(7/34): python3-ceph-common-20.2.0-681.g36d388f 2.4 MB/s | 175 kB 00:00 2026-02-24T18:26:24.664 INFO:teuthology.orchestra.run.trial103.stdout:(8/34): python3-cephfs-20.2.0-681.g36d388f2.el9 2.2 MB/s | 163 kB 00:00 2026-02-24T18:26:24.805 INFO:teuthology.orchestra.run.trial103.stdout:(9/34): python3-rados-20.2.0-681.g36d388f2.el9. 2.2 MB/s | 323 kB 00:00 2026-02-24T18:26:24.840 INFO:teuthology.orchestra.run.trial162.stdout:(5/34): librgw2-20.2.0-681.g36d388f2.el9.x86_64 1.1 MB/s | 6.4 MB 00:05 2026-02-24T18:26:24.905 INFO:teuthology.orchestra.run.trial162.stdout:(6/34): python3-ceph-argparse-20.2.0-681.g36d38 692 kB/s | 45 kB 00:00 2026-02-24T18:26:24.937 INFO:teuthology.orchestra.run.trial103.stdout:(10/34): python3-rbd-20.2.0-681.g36d388f2.el9.x 2.3 MB/s | 306 kB 00:00 2026-02-24T18:26:25.004 INFO:teuthology.orchestra.run.trial103.stdout:(11/34): python3-rgw-20.2.0-681.g36d388f2.el9.x 1.5 MB/s | 99 kB 00:00 2026-02-24T18:26:25.103 INFO:teuthology.orchestra.run.trial162.stdout:(7/34): python3-ceph-common-20.2.0-681.g36d388f 885 kB/s | 175 kB 00:00 2026-02-24T18:26:25.186 INFO:teuthology.orchestra.run.trial070.stdout:(33/34): ceph-radosgw-20.2.0-681.g36d388f2.el9. 1.3 MB/s | 24 MB 00:18 2026-02-24T18:26:25.206 INFO:teuthology.orchestra.run.trial026.stdout:(5/34): librgw2-20.2.0-681.g36d388f2.el9.x86_64 2.1 MB/s | 6.4 MB 00:03 2026-02-24T18:26:25.269 INFO:teuthology.orchestra.run.trial026.stdout:(6/34): python3-ceph-argparse-20.2.0-681.g36d38 720 kB/s | 45 kB 00:00 2026-02-24T18:26:25.292 INFO:teuthology.orchestra.run.trial162.stdout:(8/34): python3-cephfs-20.2.0-681.g36d388f2.el9 861 kB/s | 163 kB 00:00 2026-02-24T18:26:25.397 INFO:teuthology.orchestra.run.trial026.stdout:(7/34): python3-ceph-common-20.2.0-681.g36d388f 1.3 MB/s | 175 kB 00:00 2026-02-24T18:26:25.530 INFO:teuthology.orchestra.run.trial026.stdout:(8/34): python3-cephfs-20.2.0-681.g36d388f2.el9 1.2 MB/s | 163 kB 00:00 2026-02-24T18:26:25.553 INFO:teuthology.orchestra.run.trial162.stdout:(9/34): python3-rados-20.2.0-681.g36d388f2.el9. 1.2 MB/s | 323 kB 00:00 2026-02-24T18:26:25.663 INFO:teuthology.orchestra.run.trial103.stdout:(12/34): mailcap-2.1.49-5.el9.noarch.rpm 50 kB/s | 33 kB 00:00 2026-02-24T18:26:25.668 INFO:teuthology.orchestra.run.trial026.stdout:(9/34): python3-rados-20.2.0-681.g36d388f2.el9. 2.3 MB/s | 323 kB 00:00 2026-02-24T18:26:25.807 INFO:teuthology.orchestra.run.trial026.stdout:(10/34): python3-rbd-20.2.0-681.g36d388f2.el9.x 2.2 MB/s | 306 kB 00:00 2026-02-24T18:26:25.828 INFO:teuthology.orchestra.run.trial162.stdout:(10/34): python3-rbd-20.2.0-681.g36d388f2.el9.x 1.1 MB/s | 306 kB 00:00 2026-02-24T18:26:25.875 INFO:teuthology.orchestra.run.trial026.stdout:(11/34): python3-rgw-20.2.0-681.g36d388f2.el9.x 1.4 MB/s | 99 kB 00:00 2026-02-24T18:26:25.898 INFO:teuthology.orchestra.run.trial103.stdout:(13/34): pciutils-3.7.0-7.el9.x86_64.rpm 396 kB/s | 93 kB 00:00 2026-02-24T18:26:25.968 INFO:teuthology.orchestra.run.trial162.stdout:(11/34): ceph-radosgw-20.2.0-681.g36d388f2.el9. 1.5 MB/s | 24 MB 00:15 2026-02-24T18:26:25.968 INFO:teuthology.orchestra.run.trial162.stdout:(12/34): python3-rgw-20.2.0-681.g36d388f2.el9.x 710 kB/s | 99 kB 00:00 2026-02-24T18:26:25.971 INFO:teuthology.orchestra.run.trial103.stdout:(14/34): boost-program-options-1.75.0-13.el9.x8 1.4 MB/s | 104 kB 00:00 2026-02-24T18:26:25.992 INFO:teuthology.orchestra.run.trial162.stdout:(13/34): mailcap-2.1.49-5.el9.noarch.rpm 1.4 MB/s | 33 kB 00:00 2026-02-24T18:26:25.995 INFO:teuthology.orchestra.run.trial162.stdout:(14/34): pciutils-3.7.0-7.el9.x86_64.rpm 3.4 MB/s | 93 kB 00:00 2026-02-24T18:26:26.007 INFO:teuthology.orchestra.run.trial103.stdout:(15/34): libnbd-1.20.3-4.el9.x86_64.rpm 4.5 MB/s | 164 kB 00:00 2026-02-24T18:26:26.035 INFO:teuthology.orchestra.run.trial103.stdout:(16/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 5.5 MB/s | 160 kB 00:00 2026-02-24T18:26:26.064 INFO:teuthology.orchestra.run.trial103.stdout:(17/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.5 MB/s | 45 kB 00:00 2026-02-24T18:26:26.099 INFO:teuthology.orchestra.run.trial103.stdout:(18/34): librdkafka-1.6.1-102.el9.x86_64.rpm 19 MB/s | 662 kB 00:00 2026-02-24T18:26:26.128 INFO:teuthology.orchestra.run.trial103.stdout:(19/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 9.7 MB/s | 292 kB 00:00 2026-02-24T18:26:26.159 INFO:teuthology.orchestra.run.trial103.stdout:(20/34): qatlib-25.08.0-2.el9.x86_64.rpm 7.6 MB/s | 240 kB 00:00 2026-02-24T18:26:26.188 INFO:teuthology.orchestra.run.trial103.stdout:(21/34): qatlib-service-25.08.0-2.el9.x86_64.rp 1.3 MB/s | 37 kB 00:00 2026-02-24T18:26:26.220 INFO:teuthology.orchestra.run.trial103.stdout:(22/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.0 MB/s | 66 kB 00:00 2026-02-24T18:26:26.249 INFO:teuthology.orchestra.run.trial103.stdout:(23/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 10 MB/s | 308 kB 00:00 2026-02-24T18:26:26.278 INFO:teuthology.orchestra.run.trial103.stdout:(24/34): libarrow-9.0.0-15.el9.x86_64.rpm 152 MB/s | 4.4 MB 00:00 2026-02-24T18:26:26.283 INFO:teuthology.orchestra.run.trial103.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 5.3 MB/s | 25 kB 00:00 2026-02-24T18:26:26.288 INFO:teuthology.orchestra.run.trial103.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 9.8 MB/s | 49 kB 00:00 2026-02-24T18:26:26.293 INFO:teuthology.orchestra.run.trial103.stdout:(27/34): libunwind-1.6.2-1.el9.x86_64.rpm 13 MB/s | 67 kB 00:00 2026-02-24T18:26:26.301 INFO:teuthology.orchestra.run.trial103.stdout:(28/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 102 MB/s | 838 kB 00:00 2026-02-24T18:26:26.307 INFO:teuthology.orchestra.run.trial103.stdout:(29/34): re2-20211101-20.el9.x86_64.rpm 30 MB/s | 191 kB 00:00 2026-02-24T18:26:26.318 INFO:teuthology.orchestra.run.trial103.stdout:(30/34): thrift-0.15.0-4.el9.x86_64.rpm 157 MB/s | 1.6 MB 00:00 2026-02-24T18:26:26.434 INFO:teuthology.orchestra.run.trial026.stdout:(12/34): mailcap-2.1.49-5.el9.noarch.rpm 59 kB/s | 33 kB 00:00 2026-02-24T18:26:26.639 INFO:teuthology.orchestra.run.trial162.stdout:(15/34): libnbd-1.20.3-4.el9.x86_64.rpm 255 kB/s | 164 kB 00:00 2026-02-24T18:26:26.647 INFO:teuthology.orchestra.run.trial162.stdout:(16/34): boost-program-options-1.75.0-13.el9.x8 159 kB/s | 104 kB 00:00 2026-02-24T18:26:26.671 INFO:teuthology.orchestra.run.trial026.stdout:(13/34): pciutils-3.7.0-7.el9.x86_64.rpm 393 kB/s | 93 kB 00:00 2026-02-24T18:26:26.689 INFO:teuthology.orchestra.run.trial026.stdout:(14/34): boost-program-options-1.75.0-13.el9.x8 5.8 MB/s | 104 kB 00:00 2026-02-24T18:26:26.698 INFO:teuthology.orchestra.run.trial026.stdout:(15/34): libnbd-1.20.3-4.el9.x86_64.rpm 18 MB/s | 164 kB 00:00 2026-02-24T18:26:26.705 INFO:teuthology.orchestra.run.trial026.stdout:(16/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 23 MB/s | 160 kB 00:00 2026-02-24T18:26:26.710 INFO:teuthology.orchestra.run.trial026.stdout:(17/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 10 MB/s | 45 kB 00:00 2026-02-24T18:26:26.720 INFO:teuthology.orchestra.run.trial026.stdout:(18/34): librdkafka-1.6.1-102.el9.x86_64.rpm 62 MB/s | 662 kB 00:00 2026-02-24T18:26:26.726 INFO:teuthology.orchestra.run.trial026.stdout:(19/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 45 MB/s | 292 kB 00:00 2026-02-24T18:26:26.732 INFO:teuthology.orchestra.run.trial026.stdout:(20/34): qatlib-25.08.0-2.el9.x86_64.rpm 38 MB/s | 240 kB 00:00 2026-02-24T18:26:26.737 INFO:teuthology.orchestra.run.trial026.stdout:(21/34): qatlib-service-25.08.0-2.el9.x86_64.rp 8.3 MB/s | 37 kB 00:00 2026-02-24T18:26:26.741 INFO:teuthology.orchestra.run.trial026.stdout:(22/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 15 MB/s | 66 kB 00:00 2026-02-24T18:26:26.809 INFO:teuthology.orchestra.run.trial162.stdout:(17/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 280 kB/s | 45 kB 00:00 2026-02-24T18:26:26.880 INFO:teuthology.orchestra.run.trial162.stdout:(18/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 666 kB/s | 160 kB 00:00 2026-02-24T18:26:26.983 INFO:teuthology.orchestra.run.trial026.stdout:(23/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.2 MB/s | 308 kB 00:00 2026-02-24T18:26:27.202 INFO:teuthology.orchestra.run.trial026.stdout:(24/34): libarrow-9.0.0-15.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2026-02-24T18:26:27.237 INFO:teuthology.orchestra.run.trial026.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 712 kB/s | 25 kB 00:00 2026-02-24T18:26:27.272 INFO:teuthology.orchestra.run.trial026.stdout:(26/34): liboath-2.6.12-1.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2026-02-24T18:26:27.277 INFO:teuthology.orchestra.run.trial162.stdout:(19/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 737 kB/s | 292 kB 00:00 2026-02-24T18:26:27.307 INFO:teuthology.orchestra.run.trial026.stdout:(27/34): libunwind-1.6.2-1.el9.x86_64.rpm 1.9 MB/s | 67 kB 00:00 2026-02-24T18:26:27.347 INFO:teuthology.orchestra.run.trial026.stdout:(28/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 21 MB/s | 838 kB 00:00 2026-02-24T18:26:27.383 INFO:teuthology.orchestra.run.trial026.stdout:(29/34): re2-20211101-20.el9.x86_64.rpm 5.2 MB/s | 191 kB 00:00 2026-02-24T18:26:27.428 INFO:teuthology.orchestra.run.trial026.stdout:(30/34): thrift-0.15.0-4.el9.x86_64.rpm 35 MB/s | 1.6 MB 00:00 2026-02-24T18:26:27.596 INFO:teuthology.orchestra.run.trial162.stdout:(20/34): qatlib-25.08.0-2.el9.x86_64.rpm 751 kB/s | 240 kB 00:00 2026-02-24T18:26:27.679 INFO:teuthology.orchestra.run.trial162.stdout:(21/34): qatlib-service-25.08.0-2.el9.x86_64.rp 446 kB/s | 37 kB 00:00 2026-02-24T18:26:27.764 INFO:teuthology.orchestra.run.trial162.stdout:(22/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 788 kB/s | 66 kB 00:00 2026-02-24T18:26:27.813 INFO:teuthology.orchestra.run.trial103.stdout:(31/34): librados2-20.2.0-681.g36d388f2.el9.x86 2.4 MB/s | 3.5 MB 00:01 2026-02-24T18:26:27.978 INFO:teuthology.orchestra.run.trial162.stdout:(23/34): ceph-common-20.2.0-681.g36d388f2.el9.x 1.3 MB/s | 24 MB 00:17 2026-02-24T18:26:28.223 INFO:teuthology.orchestra.run.trial162.stdout:(24/34): librdkafka-1.6.1-102.el9.x86_64.rpm 468 kB/s | 662 kB 00:01 2026-02-24T18:26:28.224 INFO:teuthology.orchestra.run.trial162.stdout:(25/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 668 kB/s | 308 kB 00:00 2026-02-24T18:26:28.289 INFO:teuthology.orchestra.run.trial162.stdout:(26/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 382 kB/s | 25 kB 00:00 2026-02-24T18:26:28.358 INFO:teuthology.orchestra.run.trial162.stdout:(27/34): libunwind-1.6.2-1.el9.x86_64.rpm 964 kB/s | 67 kB 00:00 2026-02-24T18:26:28.514 INFO:teuthology.orchestra.run.trial162.stdout:(28/34): liboath-2.6.12-1.el9.x86_64.rpm 168 kB/s | 49 kB 00:00 2026-02-24T18:26:28.533 INFO:teuthology.orchestra.run.trial162.stdout:(29/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 4.7 MB/s | 838 kB 00:00 2026-02-24T18:26:28.668 INFO:teuthology.orchestra.run.trial162.stdout:(30/34): libarrow-9.0.0-15.el9.x86_64.rpm 6.4 MB/s | 4.4 MB 00:00 2026-02-24T18:26:28.681 INFO:teuthology.orchestra.run.trial162.stdout:(31/34): thrift-0.15.0-4.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2026-02-24T18:26:28.714 INFO:teuthology.orchestra.run.trial162.stdout:(32/34): re2-20211101-20.el9.x86_64.rpm 958 kB/s | 191 kB 00:00 2026-02-24T18:26:29.002 INFO:teuthology.orchestra.run.trial026.stdout:(31/34): librados2-20.2.0-681.g36d388f2.el9.x86 2.2 MB/s | 3.5 MB 00:01 2026-02-24T18:26:29.155 INFO:teuthology.orchestra.run.trial103.stdout:(32/34): librbd1-20.2.0-681.g36d388f2.el9.x86_6 2.1 MB/s | 2.8 MB 00:01 2026-02-24T18:26:30.070 INFO:teuthology.orchestra.run.trial026.stdout:(32/34): librbd1-20.2.0-681.g36d388f2.el9.x86_6 2.7 MB/s | 2.8 MB 00:01 2026-02-24T18:26:30.143 INFO:teuthology.orchestra.run.trial103.stdout:(33/34): librgw2-20.2.0-681.g36d388f2.el9.x86_6 933 kB/s | 6.4 MB 00:06 2026-02-24T18:26:30.571 INFO:teuthology.orchestra.run.trial103.stdout:(34/34): ceph-common-20.2.0-681.g36d388f2.el9.x 1.6 MB/s | 24 MB 00:15 2026-02-24T18:26:30.574 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:26:30.574 INFO:teuthology.orchestra.run.trial103.stdout:Total 4.9 MB/s | 78 MB 00:15 2026-02-24T18:26:30.661 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T18:26:30.680 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T18:26:30.680 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T18:26:30.971 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T18:26:30.971 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T18:26:31.209 INFO:teuthology.orchestra.run.trial162.stdout:(33/34): librbd1-20.2.0-681.g36d388f2.el9.x86_6 1.1 MB/s | 2.8 MB 00:02 2026-02-24T18:26:31.313 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T18:26:31.325 INFO:teuthology.orchestra.run.trial103.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/36 2026-02-24T18:26:31.397 INFO:teuthology.orchestra.run.trial026.stdout:(33/34): ceph-common-20.2.0-681.g36d388f2.el9.x 1.3 MB/s | 24 MB 00:17 2026-02-24T18:26:31.476 INFO:teuthology.orchestra.run.trial103.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/36 2026-02-24T18:26:31.480 INFO:teuthology.orchestra.run.trial103.stdout: Upgrading : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:31.511 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:31.549 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-24T18:26:31.550 INFO:teuthology.orchestra.run.trial103.stdout: Installing : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:31.562 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:31.571 INFO:teuthology.orchestra.run.trial103.stdout: Installing : liboath-2.6.12-1.el9.x86_64 6/36 2026-02-24T18:26:31.573 INFO:teuthology.orchestra.run.trial103.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/36 2026-02-24T18:26:31.576 INFO:teuthology.orchestra.run.trial103.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/36 2026-02-24T18:26:31.580 INFO:teuthology.orchestra.run.trial103.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 9/36 2026-02-24T18:26:31.589 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 10/36 2026-02-24T18:26:31.601 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-24T18:26:31.601 INFO:teuthology.orchestra.run.trial103.stdout: Installing : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:31.615 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:31.650 INFO:teuthology.orchestra.run.trial103.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-24T18:26:31.655 INFO:teuthology.orchestra.run.trial103.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-24T18:26:31.662 INFO:teuthology.orchestra.run.trial103.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-24T18:26:31.664 INFO:teuthology.orchestra.run.trial103.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-24T18:26:31.669 INFO:teuthology.orchestra.run.trial103.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-24T18:26:31.792 INFO:teuthology.orchestra.run.trial103.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-24T18:26:31.793 INFO:teuthology.orchestra.run.trial103.stdout: Upgrading : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-24T18:26:31.819 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-24T18:26:31.821 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 20/36 2026-02-24T18:26:31.827 INFO:teuthology.orchestra.run.trial103.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-24T18:26:32.104 INFO:teuthology.orchestra.run.trial103.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-24T18:26:32.105 INFO:teuthology.orchestra.run.trial103.stdout: Installing : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-24T18:26:32.122 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-24T18:26:32.125 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 24/36 2026-02-24T18:26:32.130 INFO:teuthology.orchestra.run.trial103.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-24T18:26:32.132 INFO:teuthology.orchestra.run.trial103.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-24T18:26:32.133 INFO:teuthology.orchestra.run.trial103.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:26:32.151 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:26:32.154 INFO:teuthology.orchestra.run.trial103.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-24T18:26:32.187 INFO:teuthology.orchestra.run.trial103.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-24T18:26:32.188 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 30/36 2026-02-24T18:26:33.244 INFO:teuthology.orchestra.run.trial162.stdout:(34/34): librados2-20.2.0-681.g36d388f2.el9.x86 787 kB/s | 3.5 MB 00:04 2026-02-24T18:26:33.248 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:26:33.248 INFO:teuthology.orchestra.run.trial162.stdout:Total 3.3 MB/s | 78 MB 00:23 2026-02-24T18:26:33.262 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:33.264 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:33.332 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T18:26:33.334 INFO:teuthology.orchestra.run.trial026.stdout:(34/34): ceph-radosgw-20.2.0-681.g36d388f2.el9. 1.2 MB/s | 24 MB 00:19 2026-02-24T18:26:33.337 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:26:33.337 INFO:teuthology.orchestra.run.trial026.stdout:Total 3.9 MB/s | 78 MB 00:20 2026-02-24T18:26:33.350 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T18:26:33.350 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T18:26:33.400 INFO:teuthology.orchestra.run.trial070.stdout:(34/34): ceph-common-20.2.0-681.g36d388f2.el9.x 923 kB/s | 24 MB 00:26 2026-02-24T18:26:33.403 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:26:33.403 INFO:teuthology.orchestra.run.trial070.stdout:Total 2.9 MB/s | 78 MB 00:26 2026-02-24T18:26:33.424 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T18:26:33.441 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T18:26:33.442 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T18:26:33.489 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T18:26:33.506 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T18:26:33.506 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T18:26:33.559 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:33.563 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-24T18:26:33.599 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-24T18:26:33.599 INFO:teuthology.orchestra.run.trial103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-24T18:26:33.599 INFO:teuthology.orchestra.run.trial103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-24T18:26:33.599 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:26:33.603 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:33.640 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T18:26:33.641 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T18:26:33.731 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T18:26:33.731 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T18:26:33.796 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T18:26:33.796 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T18:26:33.985 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T18:26:33.997 INFO:teuthology.orchestra.run.trial162.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/36 2026-02-24T18:26:34.063 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T18:26:34.074 INFO:teuthology.orchestra.run.trial026.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/36 2026-02-24T18:26:34.129 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T18:26:34.140 INFO:teuthology.orchestra.run.trial070.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/36 2026-02-24T18:26:34.150 INFO:teuthology.orchestra.run.trial162.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/36 2026-02-24T18:26:34.154 INFO:teuthology.orchestra.run.trial162.stdout: Upgrading : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:34.185 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:34.222 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-24T18:26:34.223 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:34.227 INFO:teuthology.orchestra.run.trial026.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/36 2026-02-24T18:26:34.230 INFO:teuthology.orchestra.run.trial026.stdout: Upgrading : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:34.235 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:34.243 INFO:teuthology.orchestra.run.trial162.stdout: Installing : liboath-2.6.12-1.el9.x86_64 6/36 2026-02-24T18:26:34.245 INFO:teuthology.orchestra.run.trial162.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/36 2026-02-24T18:26:34.248 INFO:teuthology.orchestra.run.trial162.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/36 2026-02-24T18:26:34.253 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 9/36 2026-02-24T18:26:34.258 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:34.261 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 10/36 2026-02-24T18:26:34.275 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-24T18:26:34.276 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:34.289 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:34.293 INFO:teuthology.orchestra.run.trial070.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/36 2026-02-24T18:26:34.294 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-24T18:26:34.295 INFO:teuthology.orchestra.run.trial026.stdout: Installing : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:34.299 INFO:teuthology.orchestra.run.trial070.stdout: Upgrading : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:34.306 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:34.313 INFO:teuthology.orchestra.run.trial026.stdout: Installing : liboath-2.6.12-1.el9.x86_64 6/36 2026-02-24T18:26:34.315 INFO:teuthology.orchestra.run.trial026.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/36 2026-02-24T18:26:34.318 INFO:teuthology.orchestra.run.trial026.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/36 2026-02-24T18:26:34.323 INFO:teuthology.orchestra.run.trial026.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 9/36 2026-02-24T18:26:34.324 INFO:teuthology.orchestra.run.trial162.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-24T18:26:34.325 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:34.328 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-24T18:26:34.331 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 10/36 2026-02-24T18:26:34.335 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-24T18:26:34.337 INFO:teuthology.orchestra.run.trial162.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-24T18:26:34.341 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-24T18:26:34.343 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-24T18:26:34.343 INFO:teuthology.orchestra.run.trial026.stdout: Installing : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:34.357 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:34.361 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-24T18:26:34.362 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:34.374 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:34.382 INFO:teuthology.orchestra.run.trial070.stdout: Installing : liboath-2.6.12-1.el9.x86_64 6/36 2026-02-24T18:26:34.384 INFO:teuthology.orchestra.run.trial070.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 7/36 2026-02-24T18:26:34.387 INFO:teuthology.orchestra.run.trial070.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 8/36 2026-02-24T18:26:34.391 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 9/36 2026-02-24T18:26:34.393 INFO:teuthology.orchestra.run.trial026.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-24T18:26:34.397 INFO:teuthology.orchestra.run.trial026.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-24T18:26:34.400 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 10/36 2026-02-24T18:26:34.403 INFO:teuthology.orchestra.run.trial026.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-24T18:26:34.405 INFO:teuthology.orchestra.run.trial026.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-24T18:26:34.409 INFO:teuthology.orchestra.run.trial026.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-24T18:26:34.411 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-24T18:26:34.412 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:34.424 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:34.456 INFO:teuthology.orchestra.run.trial070.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-24T18:26:34.459 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-24T18:26:34.464 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-24T18:26:34.465 INFO:teuthology.orchestra.run.trial162.stdout: Upgrading : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-24T18:26:34.465 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-24T18:26:34.468 INFO:teuthology.orchestra.run.trial070.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-24T18:26:34.472 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-24T18:26:34.490 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-24T18:26:34.493 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 20/36 2026-02-24T18:26:34.499 INFO:teuthology.orchestra.run.trial162.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-24T18:26:34.532 INFO:teuthology.orchestra.run.trial026.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-24T18:26:34.533 INFO:teuthology.orchestra.run.trial026.stdout: Upgrading : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-24T18:26:34.558 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-24T18:26:34.560 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 20/36 2026-02-24T18:26:34.568 INFO:teuthology.orchestra.run.trial026.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-24T18:26:34.594 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-24T18:26:34.595 INFO:teuthology.orchestra.run.trial070.stdout: Upgrading : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-24T18:26:34.619 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 19/36 2026-02-24T18:26:34.621 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 20/36 2026-02-24T18:26:34.630 INFO:teuthology.orchestra.run.trial070.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-24T18:26:34.779 INFO:teuthology.orchestra.run.trial162.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-24T18:26:34.780 INFO:teuthology.orchestra.run.trial162.stdout: Installing : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-24T18:26:34.796 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-24T18:26:34.800 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 24/36 2026-02-24T18:26:34.804 INFO:teuthology.orchestra.run.trial162.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-24T18:26:34.806 INFO:teuthology.orchestra.run.trial162.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-24T18:26:34.807 INFO:teuthology.orchestra.run.trial162.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:26:34.825 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:26:34.828 INFO:teuthology.orchestra.run.trial162.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-24T18:26:34.846 INFO:teuthology.orchestra.run.trial026.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-24T18:26:34.848 INFO:teuthology.orchestra.run.trial026.stdout: Installing : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-24T18:26:34.861 INFO:teuthology.orchestra.run.trial162.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-24T18:26:34.863 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-24T18:26:34.863 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 30/36 2026-02-24T18:26:34.867 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 24/36 2026-02-24T18:26:34.871 INFO:teuthology.orchestra.run.trial026.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-24T18:26:34.873 INFO:teuthology.orchestra.run.trial026.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-24T18:26:34.874 INFO:teuthology.orchestra.run.trial026.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:26:34.892 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:26:34.895 INFO:teuthology.orchestra.run.trial026.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-24T18:26:34.907 INFO:teuthology.orchestra.run.trial070.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-24T18:26:34.909 INFO:teuthology.orchestra.run.trial070.stdout: Installing : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-24T18:26:34.924 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 23/36 2026-02-24T18:26:34.927 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 24/36 2026-02-24T18:26:34.928 INFO:teuthology.orchestra.run.trial026.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-24T18:26:34.930 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 30/36 2026-02-24T18:26:34.934 INFO:teuthology.orchestra.run.trial070.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-24T18:26:34.937 INFO:teuthology.orchestra.run.trial070.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-24T18:26:34.938 INFO:teuthology.orchestra.run.trial070.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:26:34.956 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-24T18:26:34.958 INFO:teuthology.orchestra.run.trial070.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-24T18:26:34.992 INFO:teuthology.orchestra.run.trial070.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-24T18:26:34.994 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 30/36 2026-02-24T18:26:35.939 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:35.942 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:36.009 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:36.011 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:36.069 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:36.072 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:36.236 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:36.239 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-24T18:26:36.280 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-24T18:26:36.280 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-24T18:26:36.280 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-24T18:26:36.280 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:26:36.283 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:36.309 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:36.313 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-24T18:26:36.351 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-24T18:26:36.351 INFO:teuthology.orchestra.run.trial026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-24T18:26:36.352 INFO:teuthology.orchestra.run.trial026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-24T18:26:36.352 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:26:36.355 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:36.368 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 31/36 2026-02-24T18:26:36.372 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-24T18:26:36.416 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 32/36 2026-02-24T18:26:36.416 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-24T18:26:36.416 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-24T18:26:36.416 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:26:36.419 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:38.068 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:38.068 INFO:teuthology.orchestra.run.trial103.stdout:skipping the directory /sys 2026-02-24T18:26:38.068 INFO:teuthology.orchestra.run.trial103.stdout:skipping the directory /proc 2026-02-24T18:26:38.068 INFO:teuthology.orchestra.run.trial103.stdout:skipping the directory /mnt 2026-02-24T18:26:38.068 INFO:teuthology.orchestra.run.trial103.stdout:skipping the directory /var/tmp 2026-02-24T18:26:38.068 INFO:teuthology.orchestra.run.trial103.stdout:skipping the directory /home 2026-02-24T18:26:38.068 INFO:teuthology.orchestra.run.trial103.stdout:skipping the directory /root 2026-02-24T18:26:38.068 INFO:teuthology.orchestra.run.trial103.stdout:skipping the directory /tmp 2026-02-24T18:26:38.068 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:26:39.094 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-24T18:26:39.118 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-24T18:26:39.118 INFO:teuthology.orchestra.run.trial103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:26:39.118 INFO:teuthology.orchestra.run.trial103.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-24T18:26:39.118 INFO:teuthology.orchestra.run.trial103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:26:39.118 INFO:teuthology.orchestra.run.trial103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:26:39.118 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:26:39.120 INFO:teuthology.orchestra.run.trial103.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:26:39.133 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:26:39.133 INFO:teuthology.orchestra.run.trial103.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:39.190 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:39.190 INFO:teuthology.orchestra.run.trial103.stdout:Creating group 'qat' with GID 992. 2026-02-24T18:26:39.190 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:26:39.518 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 1/36 2026-02-24T18:26:39.518 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2/36 2026-02-24T18:26:39.518 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:39.518 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-24T18:26:39.518 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:39.518 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 6/36 2026-02-24T18:26:39.518 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 7/36 2026-02-24T18:26:39.518 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 8/36 2026-02-24T18:26:39.518 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 9/36 2026-02-24T18:26:39.518 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 10/36 2026-02-24T18:26:39.518 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-24T18:26:39.518 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:39.518 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 13/36 2026-02-24T18:26:39.518 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-24T18:26:39.518 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-24T18:26:39.518 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-24T18:26:39.518 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-24T18:26:39.518 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-24T18:26:39.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-24T18:26:39.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-24T18:26:39.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-24T18:26:39.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-24T18:26:39.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-24T18:26:39.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-24T18:26:39.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-24T18:26:39.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-24T18:26:39.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-24T18:26:39.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-24T18:26:39.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-24T18:26:39.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-24T18:26:39.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-24T18:26:39.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-24T18:26:39.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:39.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-24T18:26:39.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 35/36 2026-02-24T18:26:39.587 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:39.587 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:26:39.587 INFO:teuthology.orchestra.run.trial103.stdout:Upgraded: 2026-02-24T18:26:39.587 INFO:teuthology.orchestra.run.trial103.stdout: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:39.587 INFO:teuthology.orchestra.run.trial103.stdout: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:39.587 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T18:26:39.587 INFO:teuthology.orchestra.run.trial103.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-24T18:26:39.588 INFO:teuthology.orchestra.run.trial103.stdout: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:39.588 INFO:teuthology.orchestra.run.trial103.stdout: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:39.588 INFO:teuthology.orchestra.run.trial103.stdout: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:39.588 INFO:teuthology.orchestra.run.trial103.stdout: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:39.588 INFO:teuthology.orchestra.run.trial103.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-24T18:26:39.588 INFO:teuthology.orchestra.run.trial103.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-24T18:26:39.588 INFO:teuthology.orchestra.run.trial103.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-24T18:26:39.588 INFO:teuthology.orchestra.run.trial103.stdout: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:39.588 INFO:teuthology.orchestra.run.trial103.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-24T18:26:39.588 INFO:teuthology.orchestra.run.trial103.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-24T18:26:39.588 INFO:teuthology.orchestra.run.trial103.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-24T18:26:39.588 INFO:teuthology.orchestra.run.trial103.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-24T18:26:39.589 INFO:teuthology.orchestra.run.trial103.stdout: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:39.589 INFO:teuthology.orchestra.run.trial103.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-24T18:26:39.589 INFO:teuthology.orchestra.run.trial103.stdout: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:39.589 INFO:teuthology.orchestra.run.trial103.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-24T18:26:39.589 INFO:teuthology.orchestra.run.trial103.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-24T18:26:39.589 INFO:teuthology.orchestra.run.trial103.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-24T18:26:39.589 INFO:teuthology.orchestra.run.trial103.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-24T18:26:39.589 INFO:teuthology.orchestra.run.trial103.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-24T18:26:39.589 INFO:teuthology.orchestra.run.trial103.stdout: python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:39.589 INFO:teuthology.orchestra.run.trial103.stdout: python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:39.589 INFO:teuthology.orchestra.run.trial103.stdout: python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:39.589 INFO:teuthology.orchestra.run.trial103.stdout: python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:39.589 INFO:teuthology.orchestra.run.trial103.stdout: python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:39.590 INFO:teuthology.orchestra.run.trial103.stdout: python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:39.590 INFO:teuthology.orchestra.run.trial103.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-24T18:26:39.590 INFO:teuthology.orchestra.run.trial103.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-24T18:26:39.590 INFO:teuthology.orchestra.run.trial103.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-24T18:26:39.590 INFO:teuthology.orchestra.run.trial103.stdout: re2-1:20211101-20.el9.x86_64 2026-02-24T18:26:39.590 INFO:teuthology.orchestra.run.trial103.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-24T18:26:39.590 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:26:39.590 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:26:39.631 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install ceph-test 2026-02-24T18:26:39.952 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:00:26 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:26:40.035 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:26:40.036 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:26:40.036 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repository Size 2026-02-24T18:26:40.036 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:26:40.036 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T18:26:40.037 INFO:teuthology.orchestra.run.trial103.stdout: ceph-test x86_64 2:20.2.0-681.g36d388f2.el9 ceph 84 M 2026-02-24T18:26:40.037 INFO:teuthology.orchestra.run.trial103.stdout:Installing dependencies: 2026-02-24T18:26:40.037 INFO:teuthology.orchestra.run.trial103.stdout: libcephsqlite x86_64 2:20.2.0-681.g36d388f2.el9 ceph 164 k 2026-02-24T18:26:40.037 INFO:teuthology.orchestra.run.trial103.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-24T18:26:40.037 INFO:teuthology.orchestra.run.trial103.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-24T18:26:40.037 INFO:teuthology.orchestra.run.trial103.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-24T18:26:40.037 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:26:40.037 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T18:26:40.037 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:26:40.037 INFO:teuthology.orchestra.run.trial103.stdout:Install 5 Packages 2026-02-24T18:26:40.037 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:26:40.037 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 85 M 2026-02-24T18:26:40.038 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 365 M 2026-02-24T18:26:40.038 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T18:26:40.583 INFO:teuthology.orchestra.run.trial103.stdout:(1/5): libcephsqlite-20.2.0-681.g36d388f2.el9.x 339 kB/s | 164 kB 00:00 2026-02-24T18:26:40.753 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:40.753 INFO:teuthology.orchestra.run.trial162.stdout:skipping the directory /sys 2026-02-24T18:26:40.753 INFO:teuthology.orchestra.run.trial162.stdout:skipping the directory /proc 2026-02-24T18:26:40.753 INFO:teuthology.orchestra.run.trial162.stdout:skipping the directory /mnt 2026-02-24T18:26:40.753 INFO:teuthology.orchestra.run.trial162.stdout:skipping the directory /var/tmp 2026-02-24T18:26:40.753 INFO:teuthology.orchestra.run.trial162.stdout:skipping the directory /home 2026-02-24T18:26:40.753 INFO:teuthology.orchestra.run.trial162.stdout:skipping the directory /root 2026-02-24T18:26:40.753 INFO:teuthology.orchestra.run.trial162.stdout:skipping the directory /tmp 2026-02-24T18:26:40.753 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:26:40.858 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:40.858 INFO:teuthology.orchestra.run.trial026.stdout:skipping the directory /sys 2026-02-24T18:26:40.858 INFO:teuthology.orchestra.run.trial026.stdout:skipping the directory /proc 2026-02-24T18:26:40.858 INFO:teuthology.orchestra.run.trial026.stdout:skipping the directory /mnt 2026-02-24T18:26:40.858 INFO:teuthology.orchestra.run.trial026.stdout:skipping the directory /var/tmp 2026-02-24T18:26:40.858 INFO:teuthology.orchestra.run.trial026.stdout:skipping the directory /home 2026-02-24T18:26:40.859 INFO:teuthology.orchestra.run.trial026.stdout:skipping the directory /root 2026-02-24T18:26:40.859 INFO:teuthology.orchestra.run.trial026.stdout:skipping the directory /tmp 2026-02-24T18:26:40.859 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:26:40.864 INFO:teuthology.orchestra.run.trial103.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 304 kB/s | 233 kB 00:00 2026-02-24T18:26:40.933 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:40.933 INFO:teuthology.orchestra.run.trial070.stdout:skipping the directory /sys 2026-02-24T18:26:40.933 INFO:teuthology.orchestra.run.trial070.stdout:skipping the directory /proc 2026-02-24T18:26:40.933 INFO:teuthology.orchestra.run.trial070.stdout:skipping the directory /mnt 2026-02-24T18:26:40.933 INFO:teuthology.orchestra.run.trial070.stdout:skipping the directory /var/tmp 2026-02-24T18:26:40.933 INFO:teuthology.orchestra.run.trial070.stdout:skipping the directory /home 2026-02-24T18:26:40.934 INFO:teuthology.orchestra.run.trial070.stdout:skipping the directory /root 2026-02-24T18:26:40.934 INFO:teuthology.orchestra.run.trial070.stdout:skipping the directory /tmp 2026-02-24T18:26:40.934 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:26:41.368 INFO:teuthology.orchestra.run.trial103.stdout:(3/5): socat-1.7.4.1-8.el9.x86_64.rpm 387 kB/s | 303 kB 00:00 2026-02-24T18:26:41.486 INFO:teuthology.orchestra.run.trial103.stdout:(4/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 102 kB/s | 64 kB 00:00 2026-02-24T18:26:41.779 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-24T18:26:41.803 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-24T18:26:41.803 INFO:teuthology.orchestra.run.trial162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:26:41.804 INFO:teuthology.orchestra.run.trial162.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-24T18:26:41.804 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:26:41.804 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:26:41.804 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:26:41.805 INFO:teuthology.orchestra.run.trial162.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:26:41.817 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:26:41.817 INFO:teuthology.orchestra.run.trial162.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:41.872 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:41.872 INFO:teuthology.orchestra.run.trial162.stdout:Creating group 'qat' with GID 992. 2026-02-24T18:26:41.872 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:26:41.893 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-24T18:26:41.916 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-24T18:26:41.916 INFO:teuthology.orchestra.run.trial026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:26:41.917 INFO:teuthology.orchestra.run.trial026.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-24T18:26:41.917 INFO:teuthology.orchestra.run.trial026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:26:41.917 INFO:teuthology.orchestra.run.trial026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:26:41.917 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:26:41.918 INFO:teuthology.orchestra.run.trial026.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:26:41.931 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:26:41.931 INFO:teuthology.orchestra.run.trial026.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:41.962 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-24T18:26:41.985 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 34/36 2026-02-24T18:26:41.985 INFO:teuthology.orchestra.run.trial070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:26:41.985 INFO:teuthology.orchestra.run.trial070.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-24T18:26:41.985 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:26:41.985 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-24T18:26:41.985 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:26:41.986 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:41.986 INFO:teuthology.orchestra.run.trial026.stdout:Creating group 'qat' with GID 992. 2026-02-24T18:26:41.986 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:26:41.987 INFO:teuthology.orchestra.run.trial070.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:26:41.998 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-24T18:26:41.998 INFO:teuthology.orchestra.run.trial070.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:42.054 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:42.054 INFO:teuthology.orchestra.run.trial070.stdout:Creating group 'qat' with GID 992. 2026-02-24T18:26:42.054 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:26:42.202 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 1/36 2026-02-24T18:26:42.202 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2/36 2026-02-24T18:26:42.202 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:42.202 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-24T18:26:42.203 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:42.203 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 6/36 2026-02-24T18:26:42.203 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 7/36 2026-02-24T18:26:42.203 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 8/36 2026-02-24T18:26:42.203 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 9/36 2026-02-24T18:26:42.203 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 10/36 2026-02-24T18:26:42.203 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-24T18:26:42.203 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:42.203 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 13/36 2026-02-24T18:26:42.203 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-24T18:26:42.203 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-24T18:26:42.203 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-24T18:26:42.203 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-24T18:26:42.203 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-24T18:26:42.203 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-24T18:26:42.203 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-24T18:26:42.204 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-24T18:26:42.204 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-24T18:26:42.204 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-24T18:26:42.204 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-24T18:26:42.204 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-24T18:26:42.204 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-24T18:26:42.204 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-24T18:26:42.204 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-24T18:26:42.204 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-24T18:26:42.204 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-24T18:26:42.204 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-24T18:26:42.204 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-24T18:26:42.204 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:42.204 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-24T18:26:42.204 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 35/36 2026-02-24T18:26:42.269 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:42.269 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:26:42.269 INFO:teuthology.orchestra.run.trial162.stdout:Upgraded: 2026-02-24T18:26:42.269 INFO:teuthology.orchestra.run.trial162.stdout: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.269 INFO:teuthology.orchestra.run.trial162.stdout: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.269 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T18:26:42.269 INFO:teuthology.orchestra.run.trial162.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-24T18:26:42.269 INFO:teuthology.orchestra.run.trial162.stdout: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: re2-1:20211101-20.el9.x86_64 2026-02-24T18:26:42.270 INFO:teuthology.orchestra.run.trial162.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-24T18:26:42.271 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:26:42.271 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:26:42.312 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-test 2026-02-24T18:26:42.322 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 1/36 2026-02-24T18:26:42.323 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2/36 2026-02-24T18:26:42.323 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:42.323 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-24T18:26:42.323 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:42.323 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 6/36 2026-02-24T18:26:42.323 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 7/36 2026-02-24T18:26:42.323 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 8/36 2026-02-24T18:26:42.323 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 9/36 2026-02-24T18:26:42.323 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 10/36 2026-02-24T18:26:42.323 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-24T18:26:42.323 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:42.324 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 13/36 2026-02-24T18:26:42.324 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-24T18:26:42.324 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-24T18:26:42.324 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-24T18:26:42.324 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-24T18:26:42.324 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-24T18:26:42.324 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-24T18:26:42.324 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-24T18:26:42.324 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-24T18:26:42.324 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-24T18:26:42.324 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-24T18:26:42.324 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-24T18:26:42.325 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-24T18:26:42.325 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-24T18:26:42.325 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-24T18:26:42.325 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-24T18:26:42.325 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-24T18:26:42.325 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-24T18:26:42.325 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-24T18:26:42.325 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-24T18:26:42.325 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:42.325 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-24T18:26:42.325 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 35/36 2026-02-24T18:26:42.373 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 1/36 2026-02-24T18:26:42.373 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2/36 2026-02-24T18:26:42.373 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 3/36 2026-02-24T18:26:42.373 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 4/36 2026-02-24T18:26:42.373 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 5/36 2026-02-24T18:26:42.373 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 6/36 2026-02-24T18:26:42.373 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 7/36 2026-02-24T18:26:42.373 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x 8/36 2026-02-24T18:26:42.373 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86 9/36 2026-02-24T18:26:42.373 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 10/36 2026-02-24T18:26:42.374 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 11/36 2026-02-24T18:26:42.374 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 12/36 2026-02-24T18:26:42.374 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 13/36 2026-02-24T18:26:42.374 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-24T18:26:42.374 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-24T18:26:42.374 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-24T18:26:42.374 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-24T18:26:42.374 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-24T18:26:42.374 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-24T18:26:42.374 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-24T18:26:42.374 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-24T18:26:42.374 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-24T18:26:42.375 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-24T18:26:42.375 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-24T18:26:42.375 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-24T18:26:42.375 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-24T18:26:42.375 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-24T18:26:42.375 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-24T18:26:42.375 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-24T18:26:42.375 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-24T18:26:42.375 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-24T18:26:42.375 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-24T18:26:42.375 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librados2-2:20.2.0-681.g36d388f2.el9.x86_64 33/36 2026-02-24T18:26:42.375 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-24T18:26:42.376 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 35/36 2026-02-24T18:26:42.389 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:42.389 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:26:42.389 INFO:teuthology.orchestra.run.trial026.stdout:Upgraded: 2026-02-24T18:26:42.390 INFO:teuthology.orchestra.run.trial026.stdout: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.390 INFO:teuthology.orchestra.run.trial026.stdout: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.390 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T18:26:42.390 INFO:teuthology.orchestra.run.trial026.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-24T18:26:42.390 INFO:teuthology.orchestra.run.trial026.stdout: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.390 INFO:teuthology.orchestra.run.trial026.stdout: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.390 INFO:teuthology.orchestra.run.trial026.stdout: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.390 INFO:teuthology.orchestra.run.trial026.stdout: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.390 INFO:teuthology.orchestra.run.trial026.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-24T18:26:42.390 INFO:teuthology.orchestra.run.trial026.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-24T18:26:42.390 INFO:teuthology.orchestra.run.trial026.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-24T18:26:42.391 INFO:teuthology.orchestra.run.trial026.stdout: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.391 INFO:teuthology.orchestra.run.trial026.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-24T18:26:42.391 INFO:teuthology.orchestra.run.trial026.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-24T18:26:42.391 INFO:teuthology.orchestra.run.trial026.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-24T18:26:42.391 INFO:teuthology.orchestra.run.trial026.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-24T18:26:42.391 INFO:teuthology.orchestra.run.trial026.stdout: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.391 INFO:teuthology.orchestra.run.trial026.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-24T18:26:42.391 INFO:teuthology.orchestra.run.trial026.stdout: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.391 INFO:teuthology.orchestra.run.trial026.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-24T18:26:42.391 INFO:teuthology.orchestra.run.trial026.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-24T18:26:42.391 INFO:teuthology.orchestra.run.trial026.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-24T18:26:42.391 INFO:teuthology.orchestra.run.trial026.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-24T18:26:42.392 INFO:teuthology.orchestra.run.trial026.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-24T18:26:42.392 INFO:teuthology.orchestra.run.trial026.stdout: python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.392 INFO:teuthology.orchestra.run.trial026.stdout: python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.392 INFO:teuthology.orchestra.run.trial026.stdout: python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.392 INFO:teuthology.orchestra.run.trial026.stdout: python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.392 INFO:teuthology.orchestra.run.trial026.stdout: python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.392 INFO:teuthology.orchestra.run.trial026.stdout: python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.392 INFO:teuthology.orchestra.run.trial026.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-24T18:26:42.392 INFO:teuthology.orchestra.run.trial026.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-24T18:26:42.392 INFO:teuthology.orchestra.run.trial026.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-24T18:26:42.392 INFO:teuthology.orchestra.run.trial026.stdout: re2-1:20211101-20.el9.x86_64 2026-02-24T18:26:42.392 INFO:teuthology.orchestra.run.trial026.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-24T18:26:42.393 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:26:42.393 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:26:42.431 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install ceph-test 2026-02-24T18:26:42.438 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-24T18:26:42.438 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:26:42.438 INFO:teuthology.orchestra.run.trial070.stdout:Upgraded: 2026-02-24T18:26:42.438 INFO:teuthology.orchestra.run.trial070.stdout: librados2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.438 INFO:teuthology.orchestra.run.trial070.stdout: librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.438 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T18:26:42.438 INFO:teuthology.orchestra.run.trial070.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-24T18:26:42.439 INFO:teuthology.orchestra.run.trial070.stdout: ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.439 INFO:teuthology.orchestra.run.trial070.stdout: ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.439 INFO:teuthology.orchestra.run.trial070.stdout: ceph-radosgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.439 INFO:teuthology.orchestra.run.trial070.stdout: ceph-selinux-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.439 INFO:teuthology.orchestra.run.trial070.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-24T18:26:42.439 INFO:teuthology.orchestra.run.trial070.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-24T18:26:42.439 INFO:teuthology.orchestra.run.trial070.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-24T18:26:42.439 INFO:teuthology.orchestra.run.trial070.stdout: libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.439 INFO:teuthology.orchestra.run.trial070.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-24T18:26:42.439 INFO:teuthology.orchestra.run.trial070.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-24T18:26:42.439 INFO:teuthology.orchestra.run.trial070.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-24T18:26:42.440 INFO:teuthology.orchestra.run.trial070.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-24T18:26:42.440 INFO:teuthology.orchestra.run.trial070.stdout: libradosstriper1-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.440 INFO:teuthology.orchestra.run.trial070.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-24T18:26:42.440 INFO:teuthology.orchestra.run.trial070.stdout: librgw2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.440 INFO:teuthology.orchestra.run.trial070.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-24T18:26:42.440 INFO:teuthology.orchestra.run.trial070.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-24T18:26:42.440 INFO:teuthology.orchestra.run.trial070.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-24T18:26:42.440 INFO:teuthology.orchestra.run.trial070.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-24T18:26:42.440 INFO:teuthology.orchestra.run.trial070.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-24T18:26:42.440 INFO:teuthology.orchestra.run.trial070.stdout: python3-ceph-argparse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.440 INFO:teuthology.orchestra.run.trial070.stdout: python3-ceph-common-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.440 INFO:teuthology.orchestra.run.trial070.stdout: python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.441 INFO:teuthology.orchestra.run.trial070.stdout: python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.441 INFO:teuthology.orchestra.run.trial070.stdout: python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.441 INFO:teuthology.orchestra.run.trial070.stdout: python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:26:42.441 INFO:teuthology.orchestra.run.trial070.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-24T18:26:42.441 INFO:teuthology.orchestra.run.trial070.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-24T18:26:42.441 INFO:teuthology.orchestra.run.trial070.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-24T18:26:42.441 INFO:teuthology.orchestra.run.trial070.stdout: re2-1:20211101-20.el9.x86_64 2026-02-24T18:26:42.441 INFO:teuthology.orchestra.run.trial070.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-24T18:26:42.441 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:26:42.441 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:26:42.480 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-test 2026-02-24T18:26:42.628 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:00:34 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:26:42.714 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:26:42.714 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:26:42.714 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repository Size 2026-02-24T18:26:42.714 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:26:42.714 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T18:26:42.714 INFO:teuthology.orchestra.run.trial162.stdout: ceph-test x86_64 2:20.2.0-681.g36d388f2.el9 ceph 84 M 2026-02-24T18:26:42.714 INFO:teuthology.orchestra.run.trial162.stdout:Installing dependencies: 2026-02-24T18:26:42.714 INFO:teuthology.orchestra.run.trial162.stdout: libcephsqlite x86_64 2:20.2.0-681.g36d388f2.el9 ceph 164 k 2026-02-24T18:26:42.714 INFO:teuthology.orchestra.run.trial162.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-24T18:26:42.714 INFO:teuthology.orchestra.run.trial162.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-24T18:26:42.714 INFO:teuthology.orchestra.run.trial162.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-24T18:26:42.714 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:26:42.714 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T18:26:42.714 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:26:42.714 INFO:teuthology.orchestra.run.trial162.stdout:Install 5 Packages 2026-02-24T18:26:42.714 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:26:42.715 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 85 M 2026-02-24T18:26:42.715 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 365 M 2026-02-24T18:26:42.715 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T18:26:42.749 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:00:30 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:26:42.792 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:00:37 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:26:42.810 INFO:teuthology.orchestra.run.trial162.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 8.6 MB/s | 233 kB 00:00 2026-02-24T18:26:42.822 INFO:teuthology.orchestra.run.trial162.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 23 MB/s | 303 kB 00:00 2026-02-24T18:26:42.827 INFO:teuthology.orchestra.run.trial162.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 13 MB/s | 64 kB 00:00 2026-02-24T18:26:42.833 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:26:42.834 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:26:42.834 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repository Size 2026-02-24T18:26:42.835 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:26:42.835 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T18:26:42.835 INFO:teuthology.orchestra.run.trial026.stdout: ceph-test x86_64 2:20.2.0-681.g36d388f2.el9 ceph 84 M 2026-02-24T18:26:42.835 INFO:teuthology.orchestra.run.trial026.stdout:Installing dependencies: 2026-02-24T18:26:42.835 INFO:teuthology.orchestra.run.trial026.stdout: libcephsqlite x86_64 2:20.2.0-681.g36d388f2.el9 ceph 164 k 2026-02-24T18:26:42.835 INFO:teuthology.orchestra.run.trial026.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-24T18:26:42.835 INFO:teuthology.orchestra.run.trial026.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-24T18:26:42.835 INFO:teuthology.orchestra.run.trial026.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-24T18:26:42.835 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:26:42.835 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T18:26:42.836 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:26:42.836 INFO:teuthology.orchestra.run.trial026.stdout:Install 5 Packages 2026-02-24T18:26:42.836 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:26:42.836 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 85 M 2026-02-24T18:26:42.836 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 365 M 2026-02-24T18:26:42.836 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T18:26:42.874 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:26:42.875 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:26:42.875 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repository Size 2026-02-24T18:26:42.876 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:26:42.876 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T18:26:42.876 INFO:teuthology.orchestra.run.trial070.stdout: ceph-test x86_64 2:20.2.0-681.g36d388f2.el9 ceph 84 M 2026-02-24T18:26:42.876 INFO:teuthology.orchestra.run.trial070.stdout:Installing dependencies: 2026-02-24T18:26:42.876 INFO:teuthology.orchestra.run.trial070.stdout: libcephsqlite x86_64 2:20.2.0-681.g36d388f2.el9 ceph 164 k 2026-02-24T18:26:42.876 INFO:teuthology.orchestra.run.trial070.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-24T18:26:42.876 INFO:teuthology.orchestra.run.trial070.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-24T18:26:42.876 INFO:teuthology.orchestra.run.trial070.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-24T18:26:42.876 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:26:42.876 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T18:26:42.876 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:26:42.877 INFO:teuthology.orchestra.run.trial070.stdout:Install 5 Packages 2026-02-24T18:26:42.877 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:26:42.877 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 85 M 2026-02-24T18:26:42.877 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 365 M 2026-02-24T18:26:42.877 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T18:26:43.076 INFO:teuthology.orchestra.run.trial026.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 1.2 MB/s | 233 kB 00:00 2026-02-24T18:26:43.088 INFO:teuthology.orchestra.run.trial070.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 1.5 MB/s | 233 kB 00:00 2026-02-24T18:26:43.129 INFO:teuthology.orchestra.run.trial026.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 5.6 MB/s | 303 kB 00:00 2026-02-24T18:26:43.141 INFO:teuthology.orchestra.run.trial070.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 5.6 MB/s | 303 kB 00:00 2026-02-24T18:26:43.155 INFO:teuthology.orchestra.run.trial026.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.4 MB/s | 64 kB 00:00 2026-02-24T18:26:43.167 INFO:teuthology.orchestra.run.trial070.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.4 MB/s | 64 kB 00:00 2026-02-24T18:26:43.454 INFO:teuthology.orchestra.run.trial026.stdout:(4/5): libcephsqlite-20.2.0-681.g36d388f2.el9.x 293 kB/s | 164 kB 00:00 2026-02-24T18:26:43.503 INFO:teuthology.orchestra.run.trial162.stdout:(4/5): libcephsqlite-20.2.0-681.g36d388f2.el9.x 228 kB/s | 164 kB 00:00 2026-02-24T18:26:43.555 INFO:teuthology.orchestra.run.trial070.stdout:(4/5): libcephsqlite-20.2.0-681.g36d388f2.el9.x 264 kB/s | 164 kB 00:00 2026-02-24T18:27:13.580 INFO:teuthology.orchestra.run.trial103.stdout:(5/5): ceph-test-20.2.0-681.g36d388f2.el9.x86_6 2.5 MB/s | 84 MB 00:33 2026-02-24T18:27:13.581 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:13.581 INFO:teuthology.orchestra.run.trial103.stdout:Total 2.5 MB/s | 85 MB 00:33 2026-02-24T18:27:13.606 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T18:27:13.616 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T18:27:13.617 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T18:27:13.903 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T18:27:13.903 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T18:27:14.218 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T18:27:14.224 INFO:teuthology.orchestra.run.trial103.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-24T18:27:14.228 INFO:teuthology.orchestra.run.trial103.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-24T18:27:14.236 INFO:teuthology.orchestra.run.trial103.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-24T18:27:14.237 INFO:teuthology.orchestra.run.trial103.stdout: Installing : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-24T18:27:17.942 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-24T18:27:17.960 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-24T18:27:18.304 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-24T18:27:18.304 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 1/5 2026-02-24T18:27:18.304 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2/5 2026-02-24T18:27:18.304 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-24T18:27:18.304 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-24T18:27:18.363 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-24T18:27:18.364 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:27:18.364 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T18:27:18.364 INFO:teuthology.orchestra.run.trial103.stdout: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:18.364 INFO:teuthology.orchestra.run.trial103.stdout: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:18.364 INFO:teuthology.orchestra.run.trial103.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-24T18:27:18.365 INFO:teuthology.orchestra.run.trial103.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-24T18:27:18.365 INFO:teuthology.orchestra.run.trial103.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-24T18:27:18.365 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:27:18.365 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:27:18.402 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install ceph 2026-02-24T18:27:18.721 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:01:05 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:27:18.807 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:27:18.808 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:27:18.808 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repository Size 2026-02-24T18:27:18.808 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:27:18.808 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T18:27:18.808 INFO:teuthology.orchestra.run.trial103.stdout: ceph x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.5 k 2026-02-24T18:27:18.808 INFO:teuthology.orchestra.run.trial103.stdout:Installing dependencies: 2026-02-24T18:27:18.809 INFO:teuthology.orchestra.run.trial103.stdout: ceph-mds x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.3 M 2026-02-24T18:27:18.809 INFO:teuthology.orchestra.run.trial103.stdout: ceph-mgr x86_64 2:20.2.0-681.g36d388f2.el9 ceph 961 k 2026-02-24T18:27:18.809 INFO:teuthology.orchestra.run.trial103.stdout: ceph-mgr-modules-core noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 290 k 2026-02-24T18:27:18.809 INFO:teuthology.orchestra.run.trial103.stdout: ceph-mon x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.1 M 2026-02-24T18:27:18.809 INFO:teuthology.orchestra.run.trial103.stdout: ceph-osd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 17 M 2026-02-24T18:27:18.809 INFO:teuthology.orchestra.run.trial103.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-24T18:27:18.809 INFO:teuthology.orchestra.run.trial103.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-24T18:27:18.809 INFO:teuthology.orchestra.run.trial103.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-24T18:27:18.809 INFO:teuthology.orchestra.run.trial103.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-24T18:27:18.809 INFO:teuthology.orchestra.run.trial103.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-24T18:27:18.809 INFO:teuthology.orchestra.run.trial103.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-24T18:27:18.809 INFO:teuthology.orchestra.run.trial103.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-24T18:27:18.809 INFO:teuthology.orchestra.run.trial103.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-24T18:27:18.810 INFO:teuthology.orchestra.run.trial103.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-24T18:27:18.810 INFO:teuthology.orchestra.run.trial103.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-24T18:27:18.810 INFO:teuthology.orchestra.run.trial103.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-24T18:27:18.810 INFO:teuthology.orchestra.run.trial103.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-24T18:27:18.810 INFO:teuthology.orchestra.run.trial103.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-24T18:27:18.810 INFO:teuthology.orchestra.run.trial103.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-24T18:27:18.810 INFO:teuthology.orchestra.run.trial103.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-24T18:27:18.810 INFO:teuthology.orchestra.run.trial103.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-24T18:27:18.810 INFO:teuthology.orchestra.run.trial103.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-24T18:27:18.810 INFO:teuthology.orchestra.run.trial103.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-24T18:27:18.810 INFO:teuthology.orchestra.run.trial103.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-24T18:27:18.810 INFO:teuthology.orchestra.run.trial103.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-24T18:27:18.811 INFO:teuthology.orchestra.run.trial103.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-24T18:27:18.811 INFO:teuthology.orchestra.run.trial103.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-24T18:27:18.811 INFO:teuthology.orchestra.run.trial103.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-24T18:27:18.811 INFO:teuthology.orchestra.run.trial103.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-24T18:27:18.811 INFO:teuthology.orchestra.run.trial103.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-24T18:27:18.811 INFO:teuthology.orchestra.run.trial103.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-24T18:27:18.811 INFO:teuthology.orchestra.run.trial103.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-24T18:27:18.811 INFO:teuthology.orchestra.run.trial103.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-24T18:27:18.811 INFO:teuthology.orchestra.run.trial103.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-24T18:27:18.811 INFO:teuthology.orchestra.run.trial103.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-24T18:27:18.811 INFO:teuthology.orchestra.run.trial103.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-24T18:27:18.811 INFO:teuthology.orchestra.run.trial103.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-24T18:27:18.811 INFO:teuthology.orchestra.run.trial103.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-24T18:27:18.812 INFO:teuthology.orchestra.run.trial103.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-24T18:27:18.812 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:27:18.812 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T18:27:18.812 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:27:18.812 INFO:teuthology.orchestra.run.trial103.stdout:Install 40 Packages 2026-02-24T18:27:18.812 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:27:18.813 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 30 M 2026-02-24T18:27:18.813 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 100 M 2026-02-24T18:27:18.813 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T18:27:19.710 INFO:teuthology.orchestra.run.trial103.stdout:(1/40): ceph-20.2.0-681.g36d388f2.el9.x86_64.rp 23 kB/s | 6.5 kB 00:00 2026-02-24T18:27:21.229 INFO:teuthology.orchestra.run.trial103.stdout:(2/40): ceph-mgr-20.2.0-681.g36d388f2.el9.x86_6 533 kB/s | 961 kB 00:01 2026-02-24T18:27:21.769 INFO:teuthology.orchestra.run.trial103.stdout:(3/40): ceph-mon-20.2.0-681.g36d388f2.el9.x86_6 2.5 MB/s | 5.1 MB 00:02 2026-02-24T18:27:21.840 INFO:teuthology.orchestra.run.trial103.stdout:(4/40): ceph-mgr-modules-core-20.2.0-681.g36d38 4.0 MB/s | 290 kB 00:00 2026-02-24T18:27:22.416 INFO:teuthology.orchestra.run.trial103.stdout:(5/40): ledmon-libs-1.1.0-3.el9.x86_64.rpm 70 kB/s | 40 kB 00:00 2026-02-24T18:27:22.912 INFO:teuthology.orchestra.run.trial103.stdout:(6/40): ceph-mds-20.2.0-681.g36d388f2.el9.x86_6 689 kB/s | 2.3 MB 00:03 2026-02-24T18:27:23.051 INFO:teuthology.orchestra.run.trial103.stdout:(7/40): libconfig-1.7.2-9.el9.x86_64.rpm 113 kB/s | 72 kB 00:00 2026-02-24T18:27:23.679 INFO:teuthology.orchestra.run.trial103.stdout:(8/40): python3-cffi-1.14.5-5.el9.x86_64.rpm 330 kB/s | 253 kB 00:00 2026-02-24T18:27:24.055 INFO:teuthology.orchestra.run.trial103.stdout:(9/40): python3-cryptography-36.0.1-5.el9.x86_6 1.2 MB/s | 1.2 MB 00:01 2026-02-24T18:27:24.352 INFO:teuthology.orchestra.run.trial103.stdout:(10/40): python3-ply-3.11-14.el9.noarch.rpm 158 kB/s | 106 kB 00:00 2026-02-24T18:27:24.760 INFO:teuthology.orchestra.run.trial103.stdout:(11/40): python3-pycparser-2.20-6.el9.noarch.rp 192 kB/s | 135 kB 00:00 2026-02-24T18:27:25.064 INFO:teuthology.orchestra.run.trial103.stdout:(12/40): python3-pyparsing-2.4.7-9.el9.noarch.r 211 kB/s | 150 kB 00:00 2026-02-24T18:27:25.462 INFO:teuthology.orchestra.run.trial103.stdout:(13/40): python3-requests-2.25.1-10.el9.noarch. 180 kB/s | 126 kB 00:00 2026-02-24T18:27:25.726 INFO:teuthology.orchestra.run.trial162.stdout:(5/5): ceph-test-20.2.0-681.g36d388f2.el9.x86_6 2.0 MB/s | 84 MB 00:42 2026-02-24T18:27:25.727 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:25.727 INFO:teuthology.orchestra.run.trial162.stdout:Total 2.0 MB/s | 85 MB 00:43 2026-02-24T18:27:25.751 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T18:27:25.762 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T18:27:25.762 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T18:27:25.817 INFO:teuthology.orchestra.run.trial103.stdout:(14/40): python3-urllib3-1.26.5-7.el9.noarch.rp 289 kB/s | 218 kB 00:00 2026-02-24T18:27:26.047 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T18:27:26.047 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T18:27:26.197 INFO:teuthology.orchestra.run.trial103.stdout:(15/40): unzip-6.0-59.el9.x86_64.rpm 247 kB/s | 182 kB 00:00 2026-02-24T18:27:26.283 INFO:teuthology.orchestra.run.trial103.stdout:(16/40): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 2.8 MB/s | 246 kB 00:00 2026-02-24T18:27:26.308 INFO:teuthology.orchestra.run.trial103.stdout:(17/40): lua-5.4.4-4.el9.x86_64.rpm 7.5 MB/s | 188 kB 00:00 2026-02-24T18:27:26.332 INFO:teuthology.orchestra.run.trial103.stdout:(18/40): python3-libstoragemgmt-1.10.1-1.el9.x8 7.2 MB/s | 177 kB 00:00 2026-02-24T18:27:26.355 INFO:teuthology.orchestra.run.trial103.stdout:(19/40): python3-packaging-20.9-5.el9.noarch.rp 3.3 MB/s | 77 kB 00:00 2026-02-24T18:27:26.359 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T18:27:26.365 INFO:teuthology.orchestra.run.trial162.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-24T18:27:26.369 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-24T18:27:26.376 INFO:teuthology.orchestra.run.trial162.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-24T18:27:26.377 INFO:teuthology.orchestra.run.trial103.stdout:(20/40): python3-toml-0.10.2-6.el9.noarch.rpm 1.8 MB/s | 42 kB 00:00 2026-02-24T18:27:26.378 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-24T18:27:26.578 INFO:teuthology.orchestra.run.trial103.stdout:(21/40): lua-devel-5.4.4-4.el9.x86_64.rpm 111 kB/s | 22 kB 00:00 2026-02-24T18:27:26.597 INFO:teuthology.orchestra.run.trial103.stdout:(22/40): zip-3.0-35.el9.x86_64.rpm 341 kB/s | 266 kB 00:00 2026-02-24T18:27:26.783 INFO:teuthology.orchestra.run.trial103.stdout:(23/40): python3-autocommand-2.2.2-8.el9.noarch 158 kB/s | 29 kB 00:00 2026-02-24T18:27:26.861 INFO:teuthology.orchestra.run.trial103.stdout:(24/40): luarocks-3.9.2-5.el9.noarch.rpm 535 kB/s | 151 kB 00:00 2026-02-24T18:27:26.874 INFO:teuthology.orchestra.run.trial103.stdout:(25/40): python3-backports-tarfile-1.2.0-1.el9. 663 kB/s | 60 kB 00:00 2026-02-24T18:27:26.910 INFO:teuthology.orchestra.run.trial103.stdout:(26/40): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 875 kB/s | 43 kB 00:00 2026-02-24T18:27:26.982 INFO:teuthology.orchestra.run.trial103.stdout:(27/40): python3-cheroot-10.0.1-4.el9.noarch.rp 1.6 MB/s | 173 kB 00:00 2026-02-24T18:27:27.020 INFO:teuthology.orchestra.run.trial103.stdout:(28/40): python3-cherrypy-18.6.1-2.el9.noarch.r 3.2 MB/s | 358 kB 00:00 2026-02-24T18:27:27.025 INFO:teuthology.orchestra.run.trial103.stdout:(29/40): python3-jaraco-8.2.1-3.el9.noarch.rpm 251 kB/s | 11 kB 00:00 2026-02-24T18:27:27.063 INFO:teuthology.orchestra.run.trial103.stdout:(30/40): python3-jaraco-classes-3.2.1-5.el9.noa 415 kB/s | 18 kB 00:00 2026-02-24T18:27:27.070 INFO:teuthology.orchestra.run.trial103.stdout:(31/40): python3-jaraco-collections-3.0.0-8.el9 514 kB/s | 23 kB 00:00 2026-02-24T18:27:27.106 INFO:teuthology.orchestra.run.trial103.stdout:(32/40): python3-jaraco-context-6.0.1-3.el9.noa 462 kB/s | 20 kB 00:00 2026-02-24T18:27:27.115 INFO:teuthology.orchestra.run.trial103.stdout:(33/40): python3-jaraco-functools-3.5.0-2.el9.n 432 kB/s | 19 kB 00:00 2026-02-24T18:27:27.148 INFO:teuthology.orchestra.run.trial103.stdout:(34/40): python3-jaraco-text-4.0.0-2.el9.noarch 621 kB/s | 26 kB 00:00 2026-02-24T18:27:27.169 INFO:teuthology.orchestra.run.trial103.stdout:(35/40): python3-more-itertools-8.12.0-2.el9.no 1.4 MB/s | 79 kB 00:00 2026-02-24T18:27:27.191 INFO:teuthology.orchestra.run.trial103.stdout:(36/40): python3-portend-3.1.0-2.el9.noarch.rpm 386 kB/s | 16 kB 00:00 2026-02-24T18:27:27.224 INFO:teuthology.orchestra.run.trial103.stdout:(37/40): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.6 MB/s | 90 kB 00:00 2026-02-24T18:27:27.234 INFO:teuthology.orchestra.run.trial103.stdout:(38/40): python3-tempora-5.0.0-2.el9.noarch.rpm 822 kB/s | 36 kB 00:00 2026-02-24T18:27:27.268 INFO:teuthology.orchestra.run.trial103.stdout:(39/40): python3-zc-lockfile-2.0-10.el9.noarch. 452 kB/s | 20 kB 00:00 2026-02-24T18:27:30.094 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-24T18:27:30.113 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-24T18:27:30.423 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-24T18:27:30.423 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 1/5 2026-02-24T18:27:30.424 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2/5 2026-02-24T18:27:30.424 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-24T18:27:30.424 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-24T18:27:30.479 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-24T18:27:30.479 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:30.479 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T18:27:30.479 INFO:teuthology.orchestra.run.trial162.stdout: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:30.479 INFO:teuthology.orchestra.run.trial162.stdout: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:30.479 INFO:teuthology.orchestra.run.trial162.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-24T18:27:30.479 INFO:teuthology.orchestra.run.trial162.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-24T18:27:30.479 INFO:teuthology.orchestra.run.trial162.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-24T18:27:30.479 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:30.479 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:27:30.515 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph 2026-02-24T18:27:30.826 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:22 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:27:30.910 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:27:30.911 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:27:30.911 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repository Size 2026-02-24T18:27:30.912 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:27:30.912 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T18:27:30.912 INFO:teuthology.orchestra.run.trial162.stdout: ceph x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.5 k 2026-02-24T18:27:30.912 INFO:teuthology.orchestra.run.trial162.stdout:Installing dependencies: 2026-02-24T18:27:30.912 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mds x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.3 M 2026-02-24T18:27:30.912 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr x86_64 2:20.2.0-681.g36d388f2.el9 ceph 961 k 2026-02-24T18:27:30.912 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-modules-core noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 290 k 2026-02-24T18:27:30.912 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mon x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.1 M 2026-02-24T18:27:30.912 INFO:teuthology.orchestra.run.trial162.stdout: ceph-osd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 17 M 2026-02-24T18:27:30.912 INFO:teuthology.orchestra.run.trial162.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-24T18:27:30.912 INFO:teuthology.orchestra.run.trial162.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-24T18:27:30.913 INFO:teuthology.orchestra.run.trial162.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-24T18:27:30.913 INFO:teuthology.orchestra.run.trial162.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-24T18:27:30.913 INFO:teuthology.orchestra.run.trial162.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-24T18:27:30.913 INFO:teuthology.orchestra.run.trial162.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-24T18:27:30.913 INFO:teuthology.orchestra.run.trial162.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-24T18:27:30.913 INFO:teuthology.orchestra.run.trial162.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-24T18:27:30.913 INFO:teuthology.orchestra.run.trial162.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-24T18:27:30.913 INFO:teuthology.orchestra.run.trial162.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-24T18:27:30.913 INFO:teuthology.orchestra.run.trial162.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-24T18:27:30.913 INFO:teuthology.orchestra.run.trial162.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-24T18:27:30.913 INFO:teuthology.orchestra.run.trial162.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-24T18:27:30.913 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-24T18:27:30.914 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-24T18:27:30.914 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-24T18:27:30.914 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-24T18:27:30.914 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-24T18:27:30.914 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-24T18:27:30.914 INFO:teuthology.orchestra.run.trial162.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-24T18:27:30.914 INFO:teuthology.orchestra.run.trial162.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-24T18:27:30.914 INFO:teuthology.orchestra.run.trial162.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-24T18:27:30.914 INFO:teuthology.orchestra.run.trial162.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-24T18:27:30.914 INFO:teuthology.orchestra.run.trial162.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-24T18:27:30.914 INFO:teuthology.orchestra.run.trial162.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-24T18:27:30.914 INFO:teuthology.orchestra.run.trial162.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-24T18:27:30.915 INFO:teuthology.orchestra.run.trial162.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-24T18:27:30.915 INFO:teuthology.orchestra.run.trial162.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-24T18:27:30.915 INFO:teuthology.orchestra.run.trial162.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-24T18:27:30.915 INFO:teuthology.orchestra.run.trial162.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-24T18:27:30.915 INFO:teuthology.orchestra.run.trial162.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-24T18:27:30.915 INFO:teuthology.orchestra.run.trial162.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-24T18:27:30.915 INFO:teuthology.orchestra.run.trial162.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-24T18:27:30.915 INFO:teuthology.orchestra.run.trial162.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-24T18:27:30.915 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:30.915 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T18:27:30.915 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:27:30.915 INFO:teuthology.orchestra.run.trial162.stdout:Install 40 Packages 2026-02-24T18:27:30.915 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:30.916 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 30 M 2026-02-24T18:27:30.916 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 100 M 2026-02-24T18:27:30.917 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T18:27:31.622 INFO:teuthology.orchestra.run.trial162.stdout:(1/40): ceph-20.2.0-681.g36d388f2.el9.x86_64.rp 29 kB/s | 6.5 kB 00:00 2026-02-24T18:27:32.846 INFO:teuthology.orchestra.run.trial162.stdout:(2/40): ceph-mgr-20.2.0-681.g36d388f2.el9.x86_6 664 kB/s | 961 kB 00:01 2026-02-24T18:27:33.759 INFO:teuthology.orchestra.run.trial162.stdout:(3/40): ceph-mds-20.2.0-681.g36d388f2.el9.x86_6 1.0 MB/s | 2.3 MB 00:02 2026-02-24T18:27:33.894 INFO:teuthology.orchestra.run.trial162.stdout:(4/40): ceph-mgr-modules-core-20.2.0-681.g36d38 2.1 MB/s | 290 kB 00:00 2026-02-24T18:27:33.905 INFO:teuthology.orchestra.run.trial162.stdout:(5/40): ledmon-libs-1.1.0-3.el9.x86_64.rpm 3.7 MB/s | 40 kB 00:00 2026-02-24T18:27:33.913 INFO:teuthology.orchestra.run.trial162.stdout:(6/40): libconfig-1.7.2-9.el9.x86_64.rpm 9.3 MB/s | 72 kB 00:00 2026-02-24T18:27:33.923 INFO:teuthology.orchestra.run.trial162.stdout:(7/40): python3-cffi-1.14.5-5.el9.x86_64.rpm 25 MB/s | 253 kB 00:00 2026-02-24T18:27:33.957 INFO:teuthology.orchestra.run.trial162.stdout:(8/40): python3-cryptography-36.0.1-5.el9.x86_6 37 MB/s | 1.2 MB 00:00 2026-02-24T18:27:33.963 INFO:teuthology.orchestra.run.trial162.stdout:(9/40): python3-ply-3.11-14.el9.noarch.rpm 18 MB/s | 106 kB 00:00 2026-02-24T18:27:33.969 INFO:teuthology.orchestra.run.trial162.stdout:(10/40): python3-pycparser-2.20-6.el9.noarch.rp 21 MB/s | 135 kB 00:00 2026-02-24T18:27:33.976 INFO:teuthology.orchestra.run.trial162.stdout:(11/40): python3-pyparsing-2.4.7-9.el9.noarch.r 24 MB/s | 150 kB 00:00 2026-02-24T18:27:33.982 INFO:teuthology.orchestra.run.trial162.stdout:(12/40): python3-requests-2.25.1-10.el9.noarch. 19 MB/s | 126 kB 00:00 2026-02-24T18:27:33.989 INFO:teuthology.orchestra.run.trial162.stdout:(13/40): python3-urllib3-1.26.5-7.el9.noarch.rp 32 MB/s | 218 kB 00:00 2026-02-24T18:27:33.996 INFO:teuthology.orchestra.run.trial162.stdout:(14/40): unzip-6.0-59.el9.x86_64.rpm 26 MB/s | 182 kB 00:00 2026-02-24T18:27:34.003 INFO:teuthology.orchestra.run.trial162.stdout:(15/40): zip-3.0-35.el9.x86_64.rpm 41 MB/s | 266 kB 00:00 2026-02-24T18:27:34.074 INFO:teuthology.orchestra.run.trial162.stdout:(16/40): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 3.4 MB/s | 246 kB 00:00 2026-02-24T18:27:34.115 INFO:teuthology.orchestra.run.trial162.stdout:(17/40): lua-5.4.4-4.el9.x86_64.rpm 4.6 MB/s | 188 kB 00:00 2026-02-24T18:27:34.136 INFO:teuthology.orchestra.run.trial103.stdout:(40/40): ceph-osd-20.2.0-681.g36d388f2.el9.x86_ 1.3 MB/s | 17 MB 00:12 2026-02-24T18:27:34.138 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:34.138 INFO:teuthology.orchestra.run.trial103.stdout:Total 2.0 MB/s | 30 MB 00:15 2026-02-24T18:27:34.150 INFO:teuthology.orchestra.run.trial162.stdout:(18/40): python3-libstoragemgmt-1.10.1-1.el9.x8 4.9 MB/s | 177 kB 00:00 2026-02-24T18:27:34.183 INFO:teuthology.orchestra.run.trial162.stdout:(19/40): python3-packaging-20.9-5.el9.noarch.rp 2.3 MB/s | 77 kB 00:00 2026-02-24T18:27:34.218 INFO:teuthology.orchestra.run.trial162.stdout:(20/40): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2026-02-24T18:27:34.273 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T18:27:34.291 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T18:27:34.291 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T18:27:34.436 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T18:27:34.436 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T18:27:34.619 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T18:27:34.621 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/40 2026-02-24T18:27:34.626 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/40 2026-02-24T18:27:34.626 INFO:teuthology.orchestra.run.trial162.stdout:(21/40): lua-devel-5.4.4-4.el9.x86_64.rpm 55 kB/s | 22 kB 00:00 2026-02-24T18:27:34.631 INFO:teuthology.orchestra.run.trial103.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/40 2026-02-24T18:27:34.634 INFO:teuthology.orchestra.run.trial103.stdout: Installing : unzip-6.0-59.el9.x86_64 4/40 2026-02-24T18:27:34.640 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/40 2026-02-24T18:27:34.664 INFO:teuthology.orchestra.run.trial103.stdout: Installing : zip-3.0-35.el9.x86_64 6/40 2026-02-24T18:27:34.668 INFO:teuthology.orchestra.run.trial103.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/40 2026-02-24T18:27:34.671 INFO:teuthology.orchestra.run.trial162.stdout:(22/40): luarocks-3.9.2-5.el9.noarch.rpm 3.3 MB/s | 151 kB 00:00 2026-02-24T18:27:34.672 INFO:teuthology.orchestra.run.trial103.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/40 2026-02-24T18:27:34.677 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/40 2026-02-24T18:27:34.679 INFO:teuthology.orchestra.run.trial162.stdout:(23/40): python3-autocommand-2.2.2-8.el9.noarch 3.5 MB/s | 29 kB 00:00 2026-02-24T18:27:34.683 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/40 2026-02-24T18:27:34.687 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/40 2026-02-24T18:27:34.688 INFO:teuthology.orchestra.run.trial162.stdout:(24/40): python3-backports-tarfile-1.2.0-1.el9. 7.2 MB/s | 60 kB 00:00 2026-02-24T18:27:34.693 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/40 2026-02-24T18:27:34.694 INFO:teuthology.orchestra.run.trial162.stdout:(25/40): ceph-mon-20.2.0-681.g36d388f2.el9.x86_ 1.7 MB/s | 5.1 MB 00:03 2026-02-24T18:27:34.695 INFO:teuthology.orchestra.run.trial162.stdout:(26/40): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 5.3 MB/s | 43 kB 00:00 2026-02-24T18:27:34.698 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/40 2026-02-24T18:27:34.702 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/40 2026-02-24T18:27:34.708 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/40 2026-02-24T18:27:34.711 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/40 2026-02-24T18:27:34.712 INFO:teuthology.orchestra.run.trial162.stdout:(27/40): python3-cherrypy-18.6.1-2.el9.noarch.r 21 MB/s | 358 kB 00:00 2026-02-24T18:27:34.718 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/40 2026-02-24T18:27:34.720 INFO:teuthology.orchestra.run.trial162.stdout:(28/40): python3-jaraco-8.2.1-3.el9.noarch.rpm 1.4 MB/s | 11 kB 00:00 2026-02-24T18:27:34.721 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/40 2026-02-24T18:27:34.727 INFO:teuthology.orchestra.run.trial162.stdout:(29/40): python3-jaraco-classes-3.2.1-5.el9.noa 2.3 MB/s | 18 kB 00:00 2026-02-24T18:27:34.729 INFO:teuthology.orchestra.run.trial162.stdout:(30/40): python3-cheroot-10.0.1-4.el9.noarch.rp 4.9 MB/s | 173 kB 00:00 2026-02-24T18:27:34.736 INFO:teuthology.orchestra.run.trial162.stdout:(31/40): python3-jaraco-collections-3.0.0-8.el9 2.8 MB/s | 23 kB 00:00 2026-02-24T18:27:34.737 INFO:teuthology.orchestra.run.trial162.stdout:(32/40): python3-jaraco-context-6.0.1-3.el9.noa 2.5 MB/s | 20 kB 00:00 2026-02-24T18:27:34.744 INFO:teuthology.orchestra.run.trial162.stdout:(33/40): python3-jaraco-functools-3.5.0-2.el9.n 2.3 MB/s | 19 kB 00:00 2026-02-24T18:27:34.744 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/40 2026-02-24T18:27:34.745 INFO:teuthology.orchestra.run.trial162.stdout:(34/40): python3-jaraco-text-4.0.0-2.el9.noarch 3.2 MB/s | 26 kB 00:00 2026-02-24T18:27:34.753 INFO:teuthology.orchestra.run.trial162.stdout:(35/40): python3-more-itertools-8.12.0-2.el9.no 8.9 MB/s | 79 kB 00:00 2026-02-24T18:27:34.753 INFO:teuthology.orchestra.run.trial162.stdout:(36/40): python3-portend-3.1.0-2.el9.noarch.rpm 1.9 MB/s | 16 kB 00:00 2026-02-24T18:27:34.757 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/40 2026-02-24T18:27:34.762 INFO:teuthology.orchestra.run.trial162.stdout:(37/40): python3-pyOpenSSL-21.0.0-1.el9.noarch. 9.7 MB/s | 90 kB 00:00 2026-02-24T18:27:34.762 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/40 2026-02-24T18:27:34.763 INFO:teuthology.orchestra.run.trial162.stdout:(38/40): python3-tempora-5.0.0-2.el9.noarch.rpm 3.8 MB/s | 36 kB 00:00 2026-02-24T18:27:34.771 INFO:teuthology.orchestra.run.trial162.stdout:(39/40): python3-zc-lockfile-2.0-10.el9.noarch. 2.3 MB/s | 20 kB 00:00 2026-02-24T18:27:34.772 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/40 2026-02-24T18:27:34.778 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/40 2026-02-24T18:27:34.792 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/40 2026-02-24T18:27:34.807 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/40 2026-02-24T18:27:34.883 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/40 2026-02-24T18:27:34.892 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/40 2026-02-24T18:27:34.915 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/40 2026-02-24T18:27:34.945 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/40 2026-02-24T18:27:34.950 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/40 2026-02-24T18:27:34.997 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/40 2026-02-24T18:27:35.039 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 32/40 2026-02-24T18:27:35.041 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-24T18:27:35.063 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-24T18:27:35.064 INFO:teuthology.orchestra.run.trial103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:35.064 INFO:teuthology.orchestra.run.trial103.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-24T18:27:35.064 INFO:teuthology.orchestra.run.trial103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:27:35.064 INFO:teuthology.orchestra.run.trial103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:27:35.064 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:27:35.068 INFO:teuthology.orchestra.run.trial103.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/40 2026-02-24T18:27:35.085 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:35.085 INFO:teuthology.orchestra.run.trial103.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-24T18:27:35.085 INFO:teuthology.orchestra.run.trial103.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-24T18:27:35.085 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:27:35.092 INFO:teuthology.orchestra.run.trial103.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:35.117 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:35.117 INFO:teuthology.orchestra.run.trial103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-24T18:27:35.117 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:27:35.799 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/40 2026-02-24T18:27:35.801 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-24T18:27:35.825 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-24T18:27:35.825 INFO:teuthology.orchestra.run.trial103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:35.825 INFO:teuthology.orchestra.run.trial103.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-24T18:27:35.825 INFO:teuthology.orchestra.run.trial103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:27:35.825 INFO:teuthology.orchestra.run.trial103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:27:35.825 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:27:36.037 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-24T18:27:36.058 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-24T18:27:36.058 INFO:teuthology.orchestra.run.trial103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:36.059 INFO:teuthology.orchestra.run.trial103.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-24T18:27:36.059 INFO:teuthology.orchestra.run.trial103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:27:36.059 INFO:teuthology.orchestra.run.trial103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:27:36.059 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:27:36.155 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-24T18:27:36.176 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-24T18:27:36.176 INFO:teuthology.orchestra.run.trial103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:36.176 INFO:teuthology.orchestra.run.trial103.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-24T18:27:36.176 INFO:teuthology.orchestra.run.trial103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:27:36.176 INFO:teuthology.orchestra.run.trial103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:27:36.176 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:27:36.194 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-24T18:27:36.519 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-24T18:27:36.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 1/40 2026-02-24T18:27:36.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2/40 2026-02-24T18:27:36.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 3/40 2026-02-24T18:27:36.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 4/40 2026-02-24T18:27:36.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 5/40 2026-02-24T18:27:36.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 6/40 2026-02-24T18:27:36.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 7/40 2026-02-24T18:27:36.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 8/40 2026-02-24T18:27:36.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 9/40 2026-02-24T18:27:36.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 10/40 2026-02-24T18:27:36.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/40 2026-02-24T18:27:36.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/40 2026-02-24T18:27:36.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 13/40 2026-02-24T18:27:36.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 14/40 2026-02-24T18:27:36.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 15/40 2026-02-24T18:27:36.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : unzip-6.0-59.el9.x86_64 16/40 2026-02-24T18:27:36.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : zip-3.0-35.el9.x86_64 17/40 2026-02-24T18:27:36.519 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 18/40 2026-02-24T18:27:36.520 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : lua-5.4.4-4.el9.x86_64 19/40 2026-02-24T18:27:36.520 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 20/40 2026-02-24T18:27:36.520 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 21/40 2026-02-24T18:27:36.520 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 22/40 2026-02-24T18:27:36.520 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 23/40 2026-02-24T18:27:36.520 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 24/40 2026-02-24T18:27:36.520 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 25/40 2026-02-24T18:27:36.520 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 26/40 2026-02-24T18:27:36.520 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 27/40 2026-02-24T18:27:36.520 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 28/40 2026-02-24T18:27:36.520 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 29/40 2026-02-24T18:27:36.520 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 30/40 2026-02-24T18:27:36.520 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 31/40 2026-02-24T18:27:36.520 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 32/40 2026-02-24T18:27:36.520 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 33/40 2026-02-24T18:27:36.520 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 34/40 2026-02-24T18:27:36.520 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 35/40 2026-02-24T18:27:36.520 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 36/40 2026-02-24T18:27:36.520 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 37/40 2026-02-24T18:27:36.520 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 38/40 2026-02-24T18:27:36.520 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 39/40 2026-02-24T18:27:36.583 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 40/40 2026-02-24T18:27:36.583 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:27:36.583 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T18:27:36.583 INFO:teuthology.orchestra.run.trial103.stdout: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:36.583 INFO:teuthology.orchestra.run.trial103.stdout: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:36.583 INFO:teuthology.orchestra.run.trial103.stdout: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:36.583 INFO:teuthology.orchestra.run.trial103.stdout: ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:36.584 INFO:teuthology.orchestra.run.trial103.stdout: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:36.584 INFO:teuthology.orchestra.run.trial103.stdout: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:36.584 INFO:teuthology.orchestra.run.trial103.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-24T18:27:36.584 INFO:teuthology.orchestra.run.trial103.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-24T18:27:36.584 INFO:teuthology.orchestra.run.trial103.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:27:36.584 INFO:teuthology.orchestra.run.trial103.stdout: lua-5.4.4-4.el9.x86_64 2026-02-24T18:27:36.584 INFO:teuthology.orchestra.run.trial103.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-24T18:27:36.584 INFO:teuthology.orchestra.run.trial103.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-24T18:27:36.584 INFO:teuthology.orchestra.run.trial103.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-24T18:27:36.584 INFO:teuthology.orchestra.run.trial103.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-24T18:27:36.584 INFO:teuthology.orchestra.run.trial103.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-24T18:27:36.585 INFO:teuthology.orchestra.run.trial103.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-24T18:27:36.585 INFO:teuthology.orchestra.run.trial103.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-24T18:27:36.585 INFO:teuthology.orchestra.run.trial103.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-24T18:27:36.585 INFO:teuthology.orchestra.run.trial103.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-24T18:27:36.585 INFO:teuthology.orchestra.run.trial103.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-24T18:27:36.585 INFO:teuthology.orchestra.run.trial103.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-24T18:27:36.585 INFO:teuthology.orchestra.run.trial103.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-24T18:27:36.585 INFO:teuthology.orchestra.run.trial103.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-24T18:27:36.585 INFO:teuthology.orchestra.run.trial103.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-24T18:27:36.585 INFO:teuthology.orchestra.run.trial103.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-24T18:27:36.585 INFO:teuthology.orchestra.run.trial103.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:27:36.585 INFO:teuthology.orchestra.run.trial103.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-24T18:27:36.585 INFO:teuthology.orchestra.run.trial103.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-24T18:27:36.586 INFO:teuthology.orchestra.run.trial103.stdout: python3-ply-3.11-14.el9.noarch 2026-02-24T18:27:36.586 INFO:teuthology.orchestra.run.trial103.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-24T18:27:36.586 INFO:teuthology.orchestra.run.trial103.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-24T18:27:36.586 INFO:teuthology.orchestra.run.trial103.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-24T18:27:36.586 INFO:teuthology.orchestra.run.trial103.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-24T18:27:36.586 INFO:teuthology.orchestra.run.trial103.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-24T18:27:36.586 INFO:teuthology.orchestra.run.trial103.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-24T18:27:36.586 INFO:teuthology.orchestra.run.trial103.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-24T18:27:36.586 INFO:teuthology.orchestra.run.trial103.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-24T18:27:36.586 INFO:teuthology.orchestra.run.trial103.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-24T18:27:36.586 INFO:teuthology.orchestra.run.trial103.stdout: unzip-6.0-59.el9.x86_64 2026-02-24T18:27:36.586 INFO:teuthology.orchestra.run.trial103.stdout: zip-3.0-35.el9.x86_64 2026-02-24T18:27:36.587 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:27:36.587 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:27:36.622 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install ceph-base 2026-02-24T18:27:36.801 INFO:teuthology.orchestra.run.trial162.stdout:(40/40): ceph-osd-20.2.0-681.g36d388f2.el9.x86_ 4.3 MB/s | 17 MB 00:03 2026-02-24T18:27:36.804 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:36.804 INFO:teuthology.orchestra.run.trial162.stdout:Total 5.1 MB/s | 30 MB 00:05 2026-02-24T18:27:36.940 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:01:23 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:27:36.942 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T18:27:36.961 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T18:27:36.961 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T18:27:37.006 INFO:teuthology.orchestra.run.trial103.stdout:Package ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:37.024 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:27:37.024 INFO:teuthology.orchestra.run.trial103.stdout:Nothing to do. 2026-02-24T18:27:37.024 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:27:37.046 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install cephadm 2026-02-24T18:27:37.105 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T18:27:37.106 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T18:27:37.288 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T18:27:37.290 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/40 2026-02-24T18:27:37.295 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/40 2026-02-24T18:27:37.300 INFO:teuthology.orchestra.run.trial162.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/40 2026-02-24T18:27:37.302 INFO:teuthology.orchestra.run.trial162.stdout: Installing : unzip-6.0-59.el9.x86_64 4/40 2026-02-24T18:27:37.307 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/40 2026-02-24T18:27:37.332 INFO:teuthology.orchestra.run.trial162.stdout: Installing : zip-3.0-35.el9.x86_64 6/40 2026-02-24T18:27:37.335 INFO:teuthology.orchestra.run.trial162.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/40 2026-02-24T18:27:37.340 INFO:teuthology.orchestra.run.trial162.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/40 2026-02-24T18:27:37.344 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/40 2026-02-24T18:27:37.350 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/40 2026-02-24T18:27:37.354 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/40 2026-02-24T18:27:37.357 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:01:24 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:27:37.360 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/40 2026-02-24T18:27:37.365 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/40 2026-02-24T18:27:37.369 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/40 2026-02-24T18:27:37.374 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/40 2026-02-24T18:27:37.378 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/40 2026-02-24T18:27:37.385 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/40 2026-02-24T18:27:37.388 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/40 2026-02-24T18:27:37.410 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/40 2026-02-24T18:27:37.423 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/40 2026-02-24T18:27:37.428 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/40 2026-02-24T18:27:37.438 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/40 2026-02-24T18:27:37.440 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:27:37.441 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:27:37.441 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repository Size 2026-02-24T18:27:37.441 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:27:37.441 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T18:27:37.441 INFO:teuthology.orchestra.run.trial103.stdout: cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 1.0 M 2026-02-24T18:27:37.441 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:27:37.442 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T18:27:37.442 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:27:37.442 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T18:27:37.442 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:27:37.442 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 1.0 M 2026-02-24T18:27:37.442 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 1.0 M 2026-02-24T18:27:37.442 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T18:27:37.444 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/40 2026-02-24T18:27:37.457 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/40 2026-02-24T18:27:37.473 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/40 2026-02-24T18:27:37.547 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/40 2026-02-24T18:27:37.555 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/40 2026-02-24T18:27:37.578 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/40 2026-02-24T18:27:37.607 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/40 2026-02-24T18:27:37.613 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/40 2026-02-24T18:27:37.659 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/40 2026-02-24T18:27:37.702 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 32/40 2026-02-24T18:27:37.703 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-24T18:27:37.725 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-24T18:27:37.725 INFO:teuthology.orchestra.run.trial162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:37.726 INFO:teuthology.orchestra.run.trial162.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-24T18:27:37.726 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:27:37.726 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:27:37.726 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:37.730 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/40 2026-02-24T18:27:37.747 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:37.747 INFO:teuthology.orchestra.run.trial162.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-24T18:27:37.747 INFO:teuthology.orchestra.run.trial162.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-24T18:27:37.747 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:37.755 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:37.779 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:37.779 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-24T18:27:37.779 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:38.462 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/40 2026-02-24T18:27:38.464 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-24T18:27:38.489 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-24T18:27:38.489 INFO:teuthology.orchestra.run.trial162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:38.489 INFO:teuthology.orchestra.run.trial162.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-24T18:27:38.489 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:27:38.489 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:27:38.490 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:38.703 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-24T18:27:38.725 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-24T18:27:38.726 INFO:teuthology.orchestra.run.trial162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:38.726 INFO:teuthology.orchestra.run.trial162.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-24T18:27:38.726 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:27:38.726 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:27:38.726 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:38.823 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-24T18:27:38.845 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-24T18:27:38.845 INFO:teuthology.orchestra.run.trial162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:38.845 INFO:teuthology.orchestra.run.trial162.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-24T18:27:38.846 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:27:38.846 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:27:38.846 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:38.863 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-24T18:27:38.903 INFO:teuthology.orchestra.run.trial103.stdout:cephadm-20.2.0-681.g36d388f2.el9.noarch.rpm 699 kB/s | 1.0 MB 00:01 2026-02-24T18:27:38.903 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:38.903 INFO:teuthology.orchestra.run.trial103.stdout:Total 698 kB/s | 1.0 MB 00:01 2026-02-24T18:27:38.903 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T18:27:38.906 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T18:27:38.906 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T18:27:38.910 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T18:27:38.911 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T18:27:38.929 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T18:27:38.995 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:39.010 INFO:teuthology.orchestra.run.trial103.stdout: Installing : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:39.077 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:39.137 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:39.138 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:27:39.138 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T18:27:39.138 INFO:teuthology.orchestra.run.trial103.stdout: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:39.138 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:27:39.138 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:27:39.166 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install ceph-immutable-object-cache 2026-02-24T18:27:39.189 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 1/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 3/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 4/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 5/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 6/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 7/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 8/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 9/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 10/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 13/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 14/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 15/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : unzip-6.0-59.el9.x86_64 16/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : zip-3.0-35.el9.x86_64 17/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 18/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : lua-5.4.4-4.el9.x86_64 19/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 20/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 21/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 22/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 23/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 24/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 25/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 26/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 27/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 28/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 29/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 30/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 31/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 32/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 33/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 34/40 2026-02-24T18:27:39.190 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 35/40 2026-02-24T18:27:39.191 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 36/40 2026-02-24T18:27:39.191 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 37/40 2026-02-24T18:27:39.191 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 38/40 2026-02-24T18:27:39.191 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 39/40 2026-02-24T18:27:39.253 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 40/40 2026-02-24T18:27:39.253 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:39.253 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T18:27:39.253 INFO:teuthology.orchestra.run.trial162.stdout: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:39.253 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:39.253 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:39.253 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:39.253 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:39.253 INFO:teuthology.orchestra.run.trial162.stdout: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:39.253 INFO:teuthology.orchestra.run.trial162.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-24T18:27:39.253 INFO:teuthology.orchestra.run.trial162.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-24T18:27:39.253 INFO:teuthology.orchestra.run.trial162.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:27:39.253 INFO:teuthology.orchestra.run.trial162.stdout: lua-5.4.4-4.el9.x86_64 2026-02-24T18:27:39.253 INFO:teuthology.orchestra.run.trial162.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-24T18:27:39.253 INFO:teuthology.orchestra.run.trial162.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: python3-ply-3.11-14.el9.noarch 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: unzip-6.0-59.el9.x86_64 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: zip-3.0-35.el9.x86_64 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:39.254 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:27:39.289 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-base 2026-02-24T18:27:39.482 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:01:26 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:27:39.565 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:27:39.565 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:27:39.565 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repo Size 2026-02-24T18:27:39.565 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:27:39.565 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T18:27:39.565 INFO:teuthology.orchestra.run.trial103.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-681.g36d388f2.el9 ceph 154 k 2026-02-24T18:27:39.565 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:27:39.565 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T18:27:39.565 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:27:39.565 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T18:27:39.566 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:27:39.566 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 154 k 2026-02-24T18:27:39.566 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 447 k 2026-02-24T18:27:39.566 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T18:27:39.609 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:31 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:27:39.675 INFO:teuthology.orchestra.run.trial162.stdout:Package ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:39.693 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:27:39.693 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-24T18:27:39.694 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:27:39.714 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install cephadm 2026-02-24T18:27:40.025 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:32 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:27:40.077 INFO:teuthology.orchestra.run.trial103.stdout:ceph-immutable-object-cache-20.2.0-681.g36d388f 301 kB/s | 154 kB 00:00 2026-02-24T18:27:40.077 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:40.077 INFO:teuthology.orchestra.run.trial103.stdout:Total 300 kB/s | 154 kB 00:00 2026-02-24T18:27:40.077 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T18:27:40.083 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T18:27:40.083 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T18:27:40.109 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T18:27:40.110 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T18:27:40.111 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:27:40.111 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:27:40.111 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repository Size 2026-02-24T18:27:40.111 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:27:40.111 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T18:27:40.111 INFO:teuthology.orchestra.run.trial162.stdout: cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 1.0 M 2026-02-24T18:27:40.111 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:40.111 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T18:27:40.111 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:27:40.111 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T18:27:40.111 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:40.111 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 1.0 M 2026-02-24T18:27:40.111 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 1.0 M 2026-02-24T18:27:40.111 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T18:27:40.160 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T18:27:40.161 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:27:40.183 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:27:40.184 INFO:teuthology.orchestra.run.trial103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:40.184 INFO:teuthology.orchestra.run.trial103.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-24T18:27:40.184 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:27:40.491 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:27:40.491 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:27:40.491 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T18:27:40.491 INFO:teuthology.orchestra.run.trial103.stdout: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:40.491 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:27:40.491 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:27:40.520 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install ceph-mgr 2026-02-24T18:27:40.838 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:01:27 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:27:40.903 INFO:teuthology.orchestra.run.trial103.stdout:Package ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:40.920 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:27:40.921 INFO:teuthology.orchestra.run.trial103.stdout:Nothing to do. 2026-02-24T18:27:40.921 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:27:40.943 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install ceph-mgr-dashboard 2026-02-24T18:27:41.263 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:01:28 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:27:41.346 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:27:41.346 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:27:41.346 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repository Size 2026-02-24T18:27:41.346 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:27:41.347 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T18:27:41.347 INFO:teuthology.orchestra.run.trial103.stdout: ceph-mgr-dashboard noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 11 M 2026-02-24T18:27:41.347 INFO:teuthology.orchestra.run.trial103.stdout:Installing dependencies: 2026-02-24T18:27:41.347 INFO:teuthology.orchestra.run.trial103.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-24T18:27:41.347 INFO:teuthology.orchestra.run.trial103.stdout: ceph-grafana-dashboards noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 43 k 2026-02-24T18:27:41.347 INFO:teuthology.orchestra.run.trial103.stdout: ceph-prometheus-alerts noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 17 k 2026-02-24T18:27:41.347 INFO:teuthology.orchestra.run.trial103.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-24T18:27:41.347 INFO:teuthology.orchestra.run.trial103.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-24T18:27:41.347 INFO:teuthology.orchestra.run.trial103.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-24T18:27:41.347 INFO:teuthology.orchestra.run.trial103.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-24T18:27:41.347 INFO:teuthology.orchestra.run.trial103.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-24T18:27:41.347 INFO:teuthology.orchestra.run.trial103.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-24T18:27:41.347 INFO:teuthology.orchestra.run.trial103.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-24T18:27:41.347 INFO:teuthology.orchestra.run.trial103.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-24T18:27:41.347 INFO:teuthology.orchestra.run.trial103.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-24T18:27:41.347 INFO:teuthology.orchestra.run.trial103.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-24T18:27:41.347 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:27:41.347 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T18:27:41.347 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:27:41.347 INFO:teuthology.orchestra.run.trial103.stdout:Install 14 Packages 2026-02-24T18:27:41.347 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:27:41.348 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 16 M 2026-02-24T18:27:41.348 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 158 M 2026-02-24T18:27:41.348 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T18:27:41.498 INFO:teuthology.orchestra.run.trial162.stdout:cephadm-20.2.0-681.g36d388f2.el9.noarch.rpm 736 kB/s | 1.0 MB 00:01 2026-02-24T18:27:41.499 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:41.499 INFO:teuthology.orchestra.run.trial162.stdout:Total 736 kB/s | 1.0 MB 00:01 2026-02-24T18:27:41.499 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T18:27:41.502 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T18:27:41.502 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T18:27:41.506 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T18:27:41.507 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T18:27:41.525 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T18:27:41.592 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:41.606 INFO:teuthology.orchestra.run.trial162.stdout: Installing : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:41.674 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:41.735 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:41.735 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:41.735 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T18:27:41.735 INFO:teuthology.orchestra.run.trial162.stdout: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:41.735 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:41.735 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:27:41.763 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-immutable-object-cache 2026-02-24T18:27:41.927 INFO:teuthology.orchestra.run.trial103.stdout:(1/14): ceph-prometheus-alerts-20.2.0-681.g36d3 49 kB/s | 17 kB 00:00 2026-02-24T18:27:41.960 INFO:teuthology.orchestra.run.trial103.stdout:(2/14): protobuf-3.14.0-17.el9.x86_64.rpm 31 MB/s | 1.0 MB 00:00 2026-02-24T18:27:41.965 INFO:teuthology.orchestra.run.trial103.stdout:(3/14): python3-jmespath-1.0.1-1.el9.noarch.rpm 8.6 MB/s | 48 kB 00:00 2026-02-24T18:27:41.974 INFO:teuthology.orchestra.run.trial103.stdout:(4/14): python3-protobuf-3.14.0-17.el9.noarch.r 29 MB/s | 267 kB 00:00 2026-02-24T18:27:42.079 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:34 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:27:42.101 INFO:teuthology.orchestra.run.trial103.stdout:(5/14): protobuf-compiler-3.14.0-17.el9.x86_64. 6.7 MB/s | 862 kB 00:00 2026-02-24T18:27:42.168 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:27:42.168 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:27:42.168 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-24T18:27:42.168 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:27:42.168 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T18:27:42.168 INFO:teuthology.orchestra.run.trial162.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-681.g36d388f2.el9 ceph 154 k 2026-02-24T18:27:42.168 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:42.168 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T18:27:42.169 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:27:42.169 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T18:27:42.169 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:42.169 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 154 k 2026-02-24T18:27:42.169 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 447 k 2026-02-24T18:27:42.169 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T18:27:42.180 INFO:teuthology.orchestra.run.trial103.stdout:(6/14): ceph-grafana-dashboards-20.2.0-681.g36d 71 kB/s | 43 kB 00:00 2026-02-24T18:27:42.255 INFO:teuthology.orchestra.run.trial103.stdout:(7/14): grpc-data-1.46.7-10.el9.noarch.rpm 260 kB/s | 19 kB 00:00 2026-02-24T18:27:42.307 INFO:teuthology.orchestra.run.trial103.stdout:(8/14): abseil-cpp-20211102.0-4.el9.x86_64.rpm 2.6 MB/s | 551 kB 00:00 2026-02-24T18:27:42.336 INFO:teuthology.orchestra.run.trial103.stdout:(9/14): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.0 MB/s | 144 kB 00:00 2026-02-24T18:27:42.362 INFO:teuthology.orchestra.run.trial103.stdout:(10/14): python3-repoze-lru-0.7-16.el9.noarch.r 1.1 MB/s | 31 kB 00:00 2026-02-24T18:27:42.395 INFO:teuthology.orchestra.run.trial103.stdout:(11/14): python3-routes-2.5.1-5.el9.noarch.rpm 5.7 MB/s | 188 kB 00:00 2026-02-24T18:27:42.408 INFO:teuthology.orchestra.run.trial103.stdout:(12/14): python3-grpcio-1.46.7-10.el9.x86_64.rp 13 MB/s | 2.0 MB 00:00 2026-02-24T18:27:42.421 INFO:teuthology.orchestra.run.trial103.stdout:(13/14): python3-xmltodict-0.12.0-15.el9.noarch 836 kB/s | 22 kB 00:00 2026-02-24T18:27:42.654 INFO:teuthology.orchestra.run.trial162.stdout:ceph-immutable-object-cache-20.2.0-681.g36d388f 317 kB/s | 154 kB 00:00 2026-02-24T18:27:42.654 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:42.654 INFO:teuthology.orchestra.run.trial162.stdout:Total 317 kB/s | 154 kB 00:00 2026-02-24T18:27:42.654 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T18:27:42.659 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T18:27:42.659 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T18:27:42.686 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T18:27:42.686 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T18:27:42.735 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T18:27:42.737 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:27:42.761 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:27:42.761 INFO:teuthology.orchestra.run.trial162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:42.761 INFO:teuthology.orchestra.run.trial162.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-24T18:27:42.761 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:43.043 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:27:43.043 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:43.044 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T18:27:43.044 INFO:teuthology.orchestra.run.trial162.stdout: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:43.044 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:43.044 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:27:43.073 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-mgr 2026-02-24T18:27:43.389 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:35 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:27:43.454 INFO:teuthology.orchestra.run.trial162.stdout:Package ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:43.471 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:27:43.472 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-24T18:27:43.472 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:27:43.494 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-mgr-dashboard 2026-02-24T18:27:43.808 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:35 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:27:43.896 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:27:43.897 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:27:43.898 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repository Size 2026-02-24T18:27:43.898 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:27:43.898 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T18:27:43.898 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-dashboard noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 11 M 2026-02-24T18:27:43.898 INFO:teuthology.orchestra.run.trial162.stdout:Installing dependencies: 2026-02-24T18:27:43.898 INFO:teuthology.orchestra.run.trial162.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-24T18:27:43.898 INFO:teuthology.orchestra.run.trial162.stdout: ceph-grafana-dashboards noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 43 k 2026-02-24T18:27:43.898 INFO:teuthology.orchestra.run.trial162.stdout: ceph-prometheus-alerts noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 17 k 2026-02-24T18:27:43.898 INFO:teuthology.orchestra.run.trial162.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-24T18:27:43.898 INFO:teuthology.orchestra.run.trial162.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-24T18:27:43.899 INFO:teuthology.orchestra.run.trial162.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-24T18:27:43.899 INFO:teuthology.orchestra.run.trial162.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-24T18:27:43.899 INFO:teuthology.orchestra.run.trial162.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-24T18:27:43.899 INFO:teuthology.orchestra.run.trial162.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-24T18:27:43.899 INFO:teuthology.orchestra.run.trial162.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-24T18:27:43.899 INFO:teuthology.orchestra.run.trial162.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-24T18:27:43.899 INFO:teuthology.orchestra.run.trial162.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-24T18:27:43.899 INFO:teuthology.orchestra.run.trial162.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-24T18:27:43.899 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:43.899 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T18:27:43.899 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:27:43.899 INFO:teuthology.orchestra.run.trial162.stdout:Install 14 Packages 2026-02-24T18:27:43.900 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:43.900 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 16 M 2026-02-24T18:27:43.900 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 158 M 2026-02-24T18:27:43.900 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T18:27:44.535 INFO:teuthology.orchestra.run.trial070.stdout:(5/5): ceph-test-20.2.0-681.g36d388f2.el9.x86_6 1.4 MB/s | 84 MB 01:01 2026-02-24T18:27:44.536 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:44.536 INFO:teuthology.orchestra.run.trial070.stdout:Total 1.4 MB/s | 85 MB 01:01 2026-02-24T18:27:44.560 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T18:27:44.570 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T18:27:44.570 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T18:27:44.642 INFO:teuthology.orchestra.run.trial162.stdout:(1/14): ceph-prometheus-alerts-20.2.0-681.g36d3 50 kB/s | 17 kB 00:00 2026-02-24T18:27:44.714 INFO:teuthology.orchestra.run.trial162.stdout:(2/14): ceph-grafana-dashboards-20.2.0-681.g36d 104 kB/s | 43 kB 00:00 2026-02-24T18:27:44.858 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T18:27:44.858 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T18:27:45.171 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T18:27:45.176 INFO:teuthology.orchestra.run.trial070.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-24T18:27:45.180 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-24T18:27:45.188 INFO:teuthology.orchestra.run.trial070.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-24T18:27:45.189 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-24T18:27:45.344 INFO:teuthology.orchestra.run.trial162.stdout:(3/14): python3-jmespath-1.0.1-1.el9.noarch.rpm 75 kB/s | 48 kB 00:00 2026-02-24T18:27:45.816 INFO:teuthology.orchestra.run.trial162.stdout:(4/14): python3-protobuf-3.14.0-17.el9.noarch.r 567 kB/s | 267 kB 00:00 2026-02-24T18:27:45.894 INFO:teuthology.orchestra.run.trial162.stdout:(5/14): protobuf-compiler-3.14.0-17.el9.x86_64. 11 MB/s | 862 kB 00:00 2026-02-24T18:27:46.170 INFO:teuthology.orchestra.run.trial162.stdout:(6/14): abseil-cpp-20211102.0-4.el9.x86_64.rpm 2.0 MB/s | 551 kB 00:00 2026-02-24T18:27:46.211 INFO:teuthology.orchestra.run.trial162.stdout:(7/14): grpc-data-1.46.7-10.el9.noarch.rpm 465 kB/s | 19 kB 00:00 2026-02-24T18:27:46.324 INFO:teuthology.orchestra.run.trial162.stdout:(8/14): python3-grpcio-1.46.7-10.el9.x86_64.rpm 18 MB/s | 2.0 MB 00:00 2026-02-24T18:27:46.359 INFO:teuthology.orchestra.run.trial162.stdout:(9/14): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.0 MB/s | 144 kB 00:00 2026-02-24T18:27:46.370 INFO:teuthology.orchestra.run.trial162.stdout:(10/14): protobuf-3.14.0-17.el9.x86_64.rpm 595 kB/s | 1.0 MB 00:01 2026-02-24T18:27:46.392 INFO:teuthology.orchestra.run.trial162.stdout:(11/14): python3-repoze-lru-0.7-16.el9.noarch.r 940 kB/s | 31 kB 00:00 2026-02-24T18:27:46.427 INFO:teuthology.orchestra.run.trial162.stdout:(12/14): python3-xmltodict-0.12.0-15.el9.noarch 630 kB/s | 22 kB 00:00 2026-02-24T18:27:46.578 INFO:teuthology.orchestra.run.trial162.stdout:(13/14): python3-routes-2.5.1-5.el9.noarch.rpm 908 kB/s | 188 kB 00:00 2026-02-24T18:27:47.717 INFO:teuthology.orchestra.run.trial026.stdout:(5/5): ceph-test-20.2.0-681.g36d388f2.el9.x86_6 1.3 MB/s | 84 MB 01:04 2026-02-24T18:27:47.718 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:47.718 INFO:teuthology.orchestra.run.trial026.stdout:Total 1.3 MB/s | 85 MB 01:04 2026-02-24T18:27:47.742 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T18:27:47.751 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T18:27:47.751 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T18:27:48.041 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T18:27:48.041 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T18:27:48.363 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T18:27:48.369 INFO:teuthology.orchestra.run.trial026.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-24T18:27:48.373 INFO:teuthology.orchestra.run.trial026.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-24T18:27:48.381 INFO:teuthology.orchestra.run.trial026.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-24T18:27:48.381 INFO:teuthology.orchestra.run.trial026.stdout: Installing : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-24T18:27:48.598 INFO:teuthology.orchestra.run.trial162.stdout:(14/14): ceph-mgr-dashboard-20.2.0-681.g36d388f 2.5 MB/s | 11 MB 00:04 2026-02-24T18:27:48.601 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:48.601 INFO:teuthology.orchestra.run.trial162.stdout:Total 3.4 MB/s | 16 MB 00:04 2026-02-24T18:27:48.638 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T18:27:48.648 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T18:27:48.648 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T18:27:48.745 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T18:27:48.745 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T18:27:48.863 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T18:27:48.870 INFO:teuthology.orchestra.run.trial162.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 1/14 2026-02-24T18:27:48.874 INFO:teuthology.orchestra.run.trial162.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 2/14 2026-02-24T18:27:48.879 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 3/14 2026-02-24T18:27:48.890 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 4/14 2026-02-24T18:27:48.892 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 5/14 2026-02-24T18:27:48.919 INFO:teuthology.orchestra.run.trial162.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 6/14 2026-02-24T18:27:48.963 INFO:teuthology.orchestra.run.trial162.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 7/14 2026-02-24T18:27:48.992 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 8/14 2026-02-24T18:27:49.002 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 9/14 2026-02-24T18:27:49.009 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/14 2026-02-24T18:27:49.011 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 11/14 2026-02-24T18:27:49.018 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 12/14 2026-02-24T18:27:49.020 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-24T18:27:49.039 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-24T18:27:49.383 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-24T18:27:49.383 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 1/5 2026-02-24T18:27:49.383 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2/5 2026-02-24T18:27:49.383 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-24T18:27:49.383 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-24T18:27:49.440 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-24T18:27:49.440 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:27:49.440 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T18:27:49.440 INFO:teuthology.orchestra.run.trial070.stdout: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:49.440 INFO:teuthology.orchestra.run.trial070.stdout: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:49.440 INFO:teuthology.orchestra.run.trial070.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-24T18:27:49.440 INFO:teuthology.orchestra.run.trial070.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-24T18:27:49.440 INFO:teuthology.orchestra.run.trial070.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-24T18:27:49.440 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:27:49.440 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:27:49.476 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph 2026-02-24T18:27:49.797 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:44 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:27:49.881 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:27:49.882 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:27:49.882 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repository Size 2026-02-24T18:27:49.882 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:27:49.882 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T18:27:49.883 INFO:teuthology.orchestra.run.trial070.stdout: ceph x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.5 k 2026-02-24T18:27:49.883 INFO:teuthology.orchestra.run.trial070.stdout:Installing dependencies: 2026-02-24T18:27:49.883 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mds x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.3 M 2026-02-24T18:27:49.883 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr x86_64 2:20.2.0-681.g36d388f2.el9 ceph 961 k 2026-02-24T18:27:49.883 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-modules-core noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 290 k 2026-02-24T18:27:49.883 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mon x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.1 M 2026-02-24T18:27:49.883 INFO:teuthology.orchestra.run.trial070.stdout: ceph-osd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 17 M 2026-02-24T18:27:49.883 INFO:teuthology.orchestra.run.trial070.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-24T18:27:49.883 INFO:teuthology.orchestra.run.trial070.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-24T18:27:49.883 INFO:teuthology.orchestra.run.trial070.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-24T18:27:49.883 INFO:teuthology.orchestra.run.trial070.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-24T18:27:49.884 INFO:teuthology.orchestra.run.trial070.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-24T18:27:49.884 INFO:teuthology.orchestra.run.trial070.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-24T18:27:49.884 INFO:teuthology.orchestra.run.trial070.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-24T18:27:49.884 INFO:teuthology.orchestra.run.trial070.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-24T18:27:49.884 INFO:teuthology.orchestra.run.trial070.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-24T18:27:49.884 INFO:teuthology.orchestra.run.trial070.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-24T18:27:49.884 INFO:teuthology.orchestra.run.trial070.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-24T18:27:49.884 INFO:teuthology.orchestra.run.trial070.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-24T18:27:49.884 INFO:teuthology.orchestra.run.trial070.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-24T18:27:49.884 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-24T18:27:49.884 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-24T18:27:49.884 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-24T18:27:49.885 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-24T18:27:49.885 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-24T18:27:49.885 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-24T18:27:49.885 INFO:teuthology.orchestra.run.trial070.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-24T18:27:49.885 INFO:teuthology.orchestra.run.trial070.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-24T18:27:49.885 INFO:teuthology.orchestra.run.trial070.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-24T18:27:49.885 INFO:teuthology.orchestra.run.trial070.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-24T18:27:49.885 INFO:teuthology.orchestra.run.trial070.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-24T18:27:49.885 INFO:teuthology.orchestra.run.trial070.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-24T18:27:49.885 INFO:teuthology.orchestra.run.trial070.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-24T18:27:49.885 INFO:teuthology.orchestra.run.trial070.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-24T18:27:49.885 INFO:teuthology.orchestra.run.trial070.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-24T18:27:49.885 INFO:teuthology.orchestra.run.trial070.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-24T18:27:49.886 INFO:teuthology.orchestra.run.trial070.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-24T18:27:49.886 INFO:teuthology.orchestra.run.trial070.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-24T18:27:49.886 INFO:teuthology.orchestra.run.trial070.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-24T18:27:49.886 INFO:teuthology.orchestra.run.trial070.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-24T18:27:49.886 INFO:teuthology.orchestra.run.trial070.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-24T18:27:49.886 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:27:49.886 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T18:27:49.886 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:27:49.886 INFO:teuthology.orchestra.run.trial070.stdout:Install 40 Packages 2026-02-24T18:27:49.886 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:27:49.887 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 30 M 2026-02-24T18:27:49.887 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 100 M 2026-02-24T18:27:49.887 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T18:27:50.144 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 13/14 2026-02-24T18:27:50.148 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-24T18:27:50.351 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-24T18:27:50.351 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 1/14 2026-02-24T18:27:50.351 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 2/14 2026-02-24T18:27:50.351 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 3/14 2026-02-24T18:27:50.351 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 4/14 2026-02-24T18:27:50.351 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 5/14 2026-02-24T18:27:50.352 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 6/14 2026-02-24T18:27:50.352 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 7/14 2026-02-24T18:27:50.352 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 8/14 2026-02-24T18:27:50.352 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 9/14 2026-02-24T18:27:50.352 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 10/14 2026-02-24T18:27:50.352 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 11/14 2026-02-24T18:27:50.352 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 12/14 2026-02-24T18:27:50.352 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 13/14 2026-02-24T18:27:50.410 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 14/14 2026-02-24T18:27:50.410 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:50.410 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T18:27:50.410 INFO:teuthology.orchestra.run.trial162.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-24T18:27:50.410 INFO:teuthology.orchestra.run.trial162.stdout: ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:50.410 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:50.411 INFO:teuthology.orchestra.run.trial162.stdout: ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:50.411 INFO:teuthology.orchestra.run.trial162.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-24T18:27:50.411 INFO:teuthology.orchestra.run.trial162.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-24T18:27:50.411 INFO:teuthology.orchestra.run.trial162.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-24T18:27:50.411 INFO:teuthology.orchestra.run.trial162.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-24T18:27:50.411 INFO:teuthology.orchestra.run.trial162.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-24T18:27:50.411 INFO:teuthology.orchestra.run.trial162.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-24T18:27:50.412 INFO:teuthology.orchestra.run.trial162.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-24T18:27:50.412 INFO:teuthology.orchestra.run.trial162.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-24T18:27:50.412 INFO:teuthology.orchestra.run.trial162.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-24T18:27:50.412 INFO:teuthology.orchestra.run.trial162.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-24T18:27:50.412 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:50.412 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:27:50.444 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-24T18:27:50.615 INFO:teuthology.orchestra.run.trial070.stdout:(1/40): ceph-20.2.0-681.g36d388f2.el9.x86_64.rp 25 kB/s | 6.5 kB 00:00 2026-02-24T18:27:50.764 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:42 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:27:50.850 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:27:50.850 INFO:teuthology.orchestra.run.trial162.stdout:====================================================================================== 2026-02-24T18:27:50.851 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repository Size 2026-02-24T18:27:50.851 INFO:teuthology.orchestra.run.trial162.stdout:====================================================================================== 2026-02-24T18:27:50.851 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T18:27:50.851 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 7.4 M 2026-02-24T18:27:50.851 INFO:teuthology.orchestra.run.trial162.stdout:Installing dependencies: 2026-02-24T18:27:50.851 INFO:teuthology.orchestra.run.trial162.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-24T18:27:50.851 INFO:teuthology.orchestra.run.trial162.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-24T18:27:50.851 INFO:teuthology.orchestra.run.trial162.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-24T18:27:50.851 INFO:teuthology.orchestra.run.trial162.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-24T18:27:50.851 INFO:teuthology.orchestra.run.trial162.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-24T18:27:50.851 INFO:teuthology.orchestra.run.trial162.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-24T18:27:50.852 INFO:teuthology.orchestra.run.trial162.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-24T18:27:50.852 INFO:teuthology.orchestra.run.trial162.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-24T18:27:50.852 INFO:teuthology.orchestra.run.trial162.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-24T18:27:50.852 INFO:teuthology.orchestra.run.trial162.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-24T18:27:50.852 INFO:teuthology.orchestra.run.trial162.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-24T18:27:50.852 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:50.852 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T18:27:50.852 INFO:teuthology.orchestra.run.trial162.stdout:====================================================================================== 2026-02-24T18:27:50.852 INFO:teuthology.orchestra.run.trial162.stdout:Install 12 Packages 2026-02-24T18:27:50.852 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:50.853 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 43 M 2026-02-24T18:27:50.853 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 234 M 2026-02-24T18:27:50.853 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T18:27:51.091 INFO:teuthology.orchestra.run.trial162.stdout:(1/12): libquadmath-11.5.0-14.el9.x86_64.rpm 1.9 MB/s | 184 kB 00:00 2026-02-24T18:27:51.123 INFO:teuthology.orchestra.run.trial162.stdout:(2/12): libgfortran-11.5.0-14.el9.x86_64.rpm 6.1 MB/s | 794 kB 00:00 2026-02-24T18:27:51.164 INFO:teuthology.orchestra.run.trial162.stdout:(3/12): flexiblas-3.0.4-9.el9.x86_64.rpm 407 kB/s | 30 kB 00:00 2026-02-24T18:27:51.204 INFO:teuthology.orchestra.run.trial162.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-9.el9.x 375 kB/s | 15 kB 00:00 2026-02-24T18:27:51.214 INFO:teuthology.orchestra.run.trial162.stdout:(5/12): flexiblas-netlib-3.0.4-9.el9.x86_64.rpm 33 MB/s | 3.0 MB 00:00 2026-02-24T18:27:51.237 INFO:teuthology.orchestra.run.trial162.stdout:(6/12): openblas-0.3.29-1.el9.x86_64.rpm 1.3 MB/s | 42 kB 00:00 2026-02-24T18:27:51.271 INFO:teuthology.orchestra.run.trial162.stdout:(7/12): openblas-openmp-0.3.29-1.el9.x86_64.rpm 92 MB/s | 5.3 MB 00:00 2026-02-24T18:27:51.277 INFO:teuthology.orchestra.run.trial162.stdout:(8/12): python3-devel-3.9.25-3.el9.x86_64.rpm 5.9 MB/s | 244 kB 00:00 2026-02-24T18:27:51.319 INFO:teuthology.orchestra.run.trial162.stdout:(9/12): python3-numpy-f2py-1.23.5-2.el9.x86_64. 10 MB/s | 442 kB 00:00 2026-02-24T18:27:51.336 INFO:teuthology.orchestra.run.trial162.stdout:(10/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 94 MB/s | 6.1 MB 00:00 2026-02-24T18:27:51.481 INFO:teuthology.orchestra.run.trial162.stdout:(11/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 119 MB/s | 19 MB 00:00 2026-02-24T18:27:51.764 INFO:teuthology.orchestra.run.trial070.stdout:(2/40): ceph-mgr-20.2.0-681.g36d388f2.el9.x86_6 682 kB/s | 961 kB 00:01 2026-02-24T18:27:52.095 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 4/5 2026-02-24T18:27:52.114 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-24T18:27:52.182 INFO:teuthology.orchestra.run.trial103.stdout:(14/14): ceph-mgr-dashboard-20.2.0-681.g36d388f 1.0 MB/s | 11 MB 00:10 2026-02-24T18:27:52.183 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:52.183 INFO:teuthology.orchestra.run.trial103.stdout:Total 1.5 MB/s | 16 MB 00:10 2026-02-24T18:27:52.220 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T18:27:52.229 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T18:27:52.229 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T18:27:52.325 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T18:27:52.325 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T18:27:52.445 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T18:27:52.446 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 5/5 2026-02-24T18:27:52.446 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 1/5 2026-02-24T18:27:52.446 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2/5 2026-02-24T18:27:52.446 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-24T18:27:52.446 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-24T18:27:52.453 INFO:teuthology.orchestra.run.trial103.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 1/14 2026-02-24T18:27:52.456 INFO:teuthology.orchestra.run.trial103.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 2/14 2026-02-24T18:27:52.461 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 3/14 2026-02-24T18:27:52.472 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 4/14 2026-02-24T18:27:52.474 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 5/14 2026-02-24T18:27:52.502 INFO:teuthology.orchestra.run.trial103.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 6/14 2026-02-24T18:27:52.505 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-24T18:27:52.505 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:27:52.505 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T18:27:52.505 INFO:teuthology.orchestra.run.trial026.stdout: ceph-test-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:52.506 INFO:teuthology.orchestra.run.trial026.stdout: libcephsqlite-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:52.506 INFO:teuthology.orchestra.run.trial026.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-24T18:27:52.506 INFO:teuthology.orchestra.run.trial026.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-24T18:27:52.506 INFO:teuthology.orchestra.run.trial026.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-24T18:27:52.506 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:27:52.506 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:27:52.543 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install ceph 2026-02-24T18:27:52.546 INFO:teuthology.orchestra.run.trial103.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 7/14 2026-02-24T18:27:52.574 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 8/14 2026-02-24T18:27:52.584 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 9/14 2026-02-24T18:27:52.590 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/14 2026-02-24T18:27:52.593 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 11/14 2026-02-24T18:27:52.600 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 12/14 2026-02-24T18:27:52.857 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:01:40 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:27:52.941 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:27:52.942 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:27:52.942 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repository Size 2026-02-24T18:27:52.942 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:27:52.942 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T18:27:52.942 INFO:teuthology.orchestra.run.trial026.stdout: ceph x86_64 2:20.2.0-681.g36d388f2.el9 ceph 6.5 k 2026-02-24T18:27:52.942 INFO:teuthology.orchestra.run.trial026.stdout:Installing dependencies: 2026-02-24T18:27:52.942 INFO:teuthology.orchestra.run.trial026.stdout: ceph-mds x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.3 M 2026-02-24T18:27:52.942 INFO:teuthology.orchestra.run.trial026.stdout: ceph-mgr x86_64 2:20.2.0-681.g36d388f2.el9 ceph 961 k 2026-02-24T18:27:52.942 INFO:teuthology.orchestra.run.trial026.stdout: ceph-mgr-modules-core noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 290 k 2026-02-24T18:27:52.942 INFO:teuthology.orchestra.run.trial026.stdout: ceph-mon x86_64 2:20.2.0-681.g36d388f2.el9 ceph 5.1 M 2026-02-24T18:27:52.943 INFO:teuthology.orchestra.run.trial026.stdout: ceph-osd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 17 M 2026-02-24T18:27:52.943 INFO:teuthology.orchestra.run.trial026.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-24T18:27:52.943 INFO:teuthology.orchestra.run.trial026.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-24T18:27:52.943 INFO:teuthology.orchestra.run.trial026.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-24T18:27:52.943 INFO:teuthology.orchestra.run.trial026.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-24T18:27:52.943 INFO:teuthology.orchestra.run.trial026.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-24T18:27:52.943 INFO:teuthology.orchestra.run.trial026.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-24T18:27:52.943 INFO:teuthology.orchestra.run.trial026.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-24T18:27:52.943 INFO:teuthology.orchestra.run.trial026.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-24T18:27:52.943 INFO:teuthology.orchestra.run.trial026.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-24T18:27:52.943 INFO:teuthology.orchestra.run.trial026.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-24T18:27:52.943 INFO:teuthology.orchestra.run.trial026.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-24T18:27:52.943 INFO:teuthology.orchestra.run.trial026.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-24T18:27:52.943 INFO:teuthology.orchestra.run.trial026.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-24T18:27:52.943 INFO:teuthology.orchestra.run.trial026.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-24T18:27:52.943 INFO:teuthology.orchestra.run.trial026.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-24T18:27:52.943 INFO:teuthology.orchestra.run.trial026.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-24T18:27:52.943 INFO:teuthology.orchestra.run.trial026.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-24T18:27:52.943 INFO:teuthology.orchestra.run.trial026.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-24T18:27:52.943 INFO:teuthology.orchestra.run.trial026.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-24T18:27:52.943 INFO:teuthology.orchestra.run.trial026.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-24T18:27:52.943 INFO:teuthology.orchestra.run.trial026.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-24T18:27:52.943 INFO:teuthology.orchestra.run.trial026.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-24T18:27:52.943 INFO:teuthology.orchestra.run.trial026.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-24T18:27:52.943 INFO:teuthology.orchestra.run.trial026.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-24T18:27:52.944 INFO:teuthology.orchestra.run.trial026.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-24T18:27:52.944 INFO:teuthology.orchestra.run.trial026.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-24T18:27:52.944 INFO:teuthology.orchestra.run.trial026.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-24T18:27:52.944 INFO:teuthology.orchestra.run.trial026.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-24T18:27:52.944 INFO:teuthology.orchestra.run.trial026.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-24T18:27:52.944 INFO:teuthology.orchestra.run.trial026.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-24T18:27:52.944 INFO:teuthology.orchestra.run.trial026.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-24T18:27:52.944 INFO:teuthology.orchestra.run.trial026.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-24T18:27:52.944 INFO:teuthology.orchestra.run.trial026.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-24T18:27:52.944 INFO:teuthology.orchestra.run.trial026.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-24T18:27:52.944 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:27:52.944 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T18:27:52.944 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:27:52.944 INFO:teuthology.orchestra.run.trial026.stdout:Install 40 Packages 2026-02-24T18:27:52.944 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:27:52.944 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 30 M 2026-02-24T18:27:52.945 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 100 M 2026-02-24T18:27:52.945 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T18:27:53.216 INFO:teuthology.orchestra.run.trial070.stdout:(3/40): ceph-mds-20.2.0-681.g36d388f2.el9.x86_6 840 kB/s | 2.3 MB 00:02 2026-02-24T18:27:53.476 INFO:teuthology.orchestra.run.trial070.stdout:(4/40): ceph-mgr-modules-core-20.2.0-681.g36d38 1.1 MB/s | 290 kB 00:00 2026-02-24T18:27:53.490 INFO:teuthology.orchestra.run.trial070.stdout:(5/40): ledmon-libs-1.1.0-3.el9.x86_64.rpm 2.8 MB/s | 40 kB 00:00 2026-02-24T18:27:53.500 INFO:teuthology.orchestra.run.trial070.stdout:(6/40): libconfig-1.7.2-9.el9.x86_64.rpm 7.7 MB/s | 72 kB 00:00 2026-02-24T18:27:53.511 INFO:teuthology.orchestra.run.trial070.stdout:(7/40): python3-cffi-1.14.5-5.el9.x86_64.rpm 21 MB/s | 253 kB 00:00 2026-02-24T18:27:53.549 INFO:teuthology.orchestra.run.trial070.stdout:(8/40): python3-cryptography-36.0.1-5.el9.x86_6 33 MB/s | 1.2 MB 00:00 2026-02-24T18:27:53.557 INFO:teuthology.orchestra.run.trial070.stdout:(9/40): python3-ply-3.11-14.el9.noarch.rpm 14 MB/s | 106 kB 00:00 2026-02-24T18:27:53.565 INFO:teuthology.orchestra.run.trial070.stdout:(10/40): python3-pycparser-2.20-6.el9.noarch.rp 17 MB/s | 135 kB 00:00 2026-02-24T18:27:53.572 INFO:teuthology.orchestra.run.trial070.stdout:(11/40): python3-pyparsing-2.4.7-9.el9.noarch.r 22 MB/s | 150 kB 00:00 2026-02-24T18:27:53.580 INFO:teuthology.orchestra.run.trial070.stdout:(12/40): python3-requests-2.25.1-10.el9.noarch. 15 MB/s | 126 kB 00:00 2026-02-24T18:27:53.587 INFO:teuthology.orchestra.run.trial070.stdout:(13/40): python3-urllib3-1.26.5-7.el9.noarch.rp 29 MB/s | 218 kB 00:00 2026-02-24T18:27:53.595 INFO:teuthology.orchestra.run.trial070.stdout:(14/40): unzip-6.0-59.el9.x86_64.rpm 23 MB/s | 182 kB 00:00 2026-02-24T18:27:53.603 INFO:teuthology.orchestra.run.trial070.stdout:(15/40): zip-3.0-35.el9.x86_64.rpm 34 MB/s | 266 kB 00:00 2026-02-24T18:27:53.736 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 13/14 2026-02-24T18:27:53.741 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-24T18:27:53.830 INFO:teuthology.orchestra.run.trial070.stdout:(16/40): ceph-mon-20.2.0-681.g36d388f2.el9.x86_ 1.6 MB/s | 5.1 MB 00:03 2026-02-24T18:27:53.934 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-24T18:27:53.935 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 1/14 2026-02-24T18:27:53.935 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 2/14 2026-02-24T18:27:53.935 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 3/14 2026-02-24T18:27:53.935 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 4/14 2026-02-24T18:27:53.935 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 5/14 2026-02-24T18:27:53.935 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 6/14 2026-02-24T18:27:53.935 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 7/14 2026-02-24T18:27:53.935 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 8/14 2026-02-24T18:27:53.935 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 9/14 2026-02-24T18:27:53.936 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 10/14 2026-02-24T18:27:53.936 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 11/14 2026-02-24T18:27:53.936 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 12/14 2026-02-24T18:27:53.936 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 13/14 2026-02-24T18:27:53.995 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 14/14 2026-02-24T18:27:53.995 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:27:53.995 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T18:27:53.995 INFO:teuthology.orchestra.run.trial103.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-24T18:27:53.995 INFO:teuthology.orchestra.run.trial103.stdout: ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:53.995 INFO:teuthology.orchestra.run.trial103.stdout: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:53.995 INFO:teuthology.orchestra.run.trial103.stdout: ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:53.995 INFO:teuthology.orchestra.run.trial103.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-24T18:27:53.995 INFO:teuthology.orchestra.run.trial103.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-24T18:27:53.995 INFO:teuthology.orchestra.run.trial103.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-24T18:27:53.995 INFO:teuthology.orchestra.run.trial103.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-24T18:27:53.995 INFO:teuthology.orchestra.run.trial103.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-24T18:27:53.995 INFO:teuthology.orchestra.run.trial103.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-24T18:27:53.995 INFO:teuthology.orchestra.run.trial103.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-24T18:27:53.995 INFO:teuthology.orchestra.run.trial103.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-24T18:27:53.995 INFO:teuthology.orchestra.run.trial103.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-24T18:27:53.995 INFO:teuthology.orchestra.run.trial103.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-24T18:27:53.995 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:27:53.995 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:27:54.017 INFO:teuthology.orchestra.run.trial026.stdout:(1/40): ceph-20.2.0-681.g36d388f2.el9.x86_64.rp 24 kB/s | 6.5 kB 00:00 2026-02-24T18:27:54.028 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-24T18:27:54.105 INFO:teuthology.orchestra.run.trial070.stdout:(17/40): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 491 kB/s | 246 kB 00:00 2026-02-24T18:27:54.224 INFO:teuthology.orchestra.run.trial070.stdout:(18/40): python3-libstoragemgmt-1.10.1-1.el9.x8 1.4 MB/s | 177 kB 00:00 2026-02-24T18:27:54.302 INFO:teuthology.orchestra.run.trial070.stdout:(19/40): lua-5.4.4-4.el9.x86_64.rpm 399 kB/s | 188 kB 00:00 2026-02-24T18:27:54.320 INFO:teuthology.orchestra.run.trial070.stdout:(20/40): python3-packaging-20.9-5.el9.noarch.rp 805 kB/s | 77 kB 00:00 2026-02-24T18:27:54.324 INFO:teuthology.orchestra.run.trial070.stdout:(21/40): lua-devel-5.4.4-4.el9.x86_64.rpm 5.3 MB/s | 22 kB 00:00 2026-02-24T18:27:54.347 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:01:41 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:27:54.392 INFO:teuthology.orchestra.run.trial070.stdout:(22/40): python3-toml-0.10.2-6.el9.noarch.rpm 461 kB/s | 42 kB 00:00 2026-02-24T18:27:54.432 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:27:54.433 INFO:teuthology.orchestra.run.trial103.stdout:====================================================================================== 2026-02-24T18:27:54.434 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repository Size 2026-02-24T18:27:54.434 INFO:teuthology.orchestra.run.trial103.stdout:====================================================================================== 2026-02-24T18:27:54.434 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T18:27:54.434 INFO:teuthology.orchestra.run.trial103.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 7.4 M 2026-02-24T18:27:54.434 INFO:teuthology.orchestra.run.trial103.stdout:Installing dependencies: 2026-02-24T18:27:54.434 INFO:teuthology.orchestra.run.trial103.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-24T18:27:54.434 INFO:teuthology.orchestra.run.trial103.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-24T18:27:54.434 INFO:teuthology.orchestra.run.trial103.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-24T18:27:54.434 INFO:teuthology.orchestra.run.trial103.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-24T18:27:54.434 INFO:teuthology.orchestra.run.trial103.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-24T18:27:54.434 INFO:teuthology.orchestra.run.trial103.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-24T18:27:54.435 INFO:teuthology.orchestra.run.trial103.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-24T18:27:54.435 INFO:teuthology.orchestra.run.trial103.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-24T18:27:54.435 INFO:teuthology.orchestra.run.trial103.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-24T18:27:54.435 INFO:teuthology.orchestra.run.trial103.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-24T18:27:54.435 INFO:teuthology.orchestra.run.trial103.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-24T18:27:54.435 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:27:54.435 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T18:27:54.435 INFO:teuthology.orchestra.run.trial103.stdout:====================================================================================== 2026-02-24T18:27:54.435 INFO:teuthology.orchestra.run.trial103.stdout:Install 12 Packages 2026-02-24T18:27:54.435 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:27:54.435 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 43 M 2026-02-24T18:27:54.436 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 234 M 2026-02-24T18:27:54.436 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T18:27:54.437 INFO:teuthology.orchestra.run.trial070.stdout:(23/40): luarocks-3.9.2-5.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2026-02-24T18:27:54.466 INFO:teuthology.orchestra.run.trial070.stdout:(24/40): python3-backports-tarfile-1.2.0-1.el9. 2.1 MB/s | 60 kB 00:00 2026-02-24T18:27:54.466 INFO:teuthology.orchestra.run.trial070.stdout:(25/40): python3-autocommand-2.2.2-8.el9.noarch 397 kB/s | 29 kB 00:00 2026-02-24T18:27:54.500 INFO:teuthology.orchestra.run.trial070.stdout:(26/40): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.2 MB/s | 43 kB 00:00 2026-02-24T18:27:54.533 INFO:teuthology.orchestra.run.trial070.stdout:(27/40): python3-cheroot-10.0.1-4.el9.noarch.rp 2.6 MB/s | 173 kB 00:00 2026-02-24T18:27:54.546 INFO:teuthology.orchestra.run.trial026.stdout:(2/40): ceph-mgr-20.2.0-681.g36d388f2.el9.x86_6 1.2 MB/s | 961 kB 00:00 2026-02-24T18:27:54.553 INFO:teuthology.orchestra.run.trial070.stdout:(28/40): python3-cherrypy-18.6.1-2.el9.noarch.r 6.7 MB/s | 358 kB 00:00 2026-02-24T18:27:54.561 INFO:teuthology.orchestra.run.trial070.stdout:(29/40): python3-jaraco-8.2.1-3.el9.noarch.rpm 373 kB/s | 11 kB 00:00 2026-02-24T18:27:54.579 INFO:teuthology.orchestra.run.trial070.stdout:(30/40): python3-jaraco-classes-3.2.1-5.el9.noa 671 kB/s | 18 kB 00:00 2026-02-24T18:27:54.590 INFO:teuthology.orchestra.run.trial070.stdout:(31/40): python3-jaraco-collections-3.0.0-8.el9 810 kB/s | 23 kB 00:00 2026-02-24T18:27:54.609 INFO:teuthology.orchestra.run.trial070.stdout:(32/40): python3-jaraco-context-6.0.1-3.el9.noa 656 kB/s | 20 kB 00:00 2026-02-24T18:27:54.621 INFO:teuthology.orchestra.run.trial070.stdout:(33/40): python3-jaraco-functools-3.5.0-2.el9.n 628 kB/s | 19 kB 00:00 2026-02-24T18:27:54.636 INFO:teuthology.orchestra.run.trial070.stdout:(34/40): python3-jaraco-text-4.0.0-2.el9.noarch 973 kB/s | 26 kB 00:00 2026-02-24T18:27:54.647 INFO:teuthology.orchestra.run.trial070.stdout:(35/40): python3-more-itertools-8.12.0-2.el9.no 2.9 MB/s | 79 kB 00:00 2026-02-24T18:27:54.667 INFO:teuthology.orchestra.run.trial070.stdout:(36/40): python3-portend-3.1.0-2.el9.noarch.rpm 546 kB/s | 16 kB 00:00 2026-02-24T18:27:54.684 INFO:teuthology.orchestra.run.trial070.stdout:(37/40): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.4 MB/s | 90 kB 00:00 2026-02-24T18:27:54.694 INFO:teuthology.orchestra.run.trial070.stdout:(38/40): python3-tempora-5.0.0-2.el9.noarch.rpm 1.2 MB/s | 36 kB 00:00 2026-02-24T18:27:54.715 INFO:teuthology.orchestra.run.trial070.stdout:(39/40): python3-zc-lockfile-2.0-10.el9.noarch. 631 kB/s | 20 kB 00:00 2026-02-24T18:27:55.018 INFO:teuthology.orchestra.run.trial103.stdout:(1/12): libquadmath-11.5.0-14.el9.x86_64.rpm 395 kB/s | 184 kB 00:00 2026-02-24T18:27:55.045 INFO:teuthology.orchestra.run.trial103.stdout:(2/12): flexiblas-3.0.4-9.el9.x86_64.rpm 1.0 MB/s | 30 kB 00:00 2026-02-24T18:27:55.070 INFO:teuthology.orchestra.run.trial026.stdout:(3/40): ceph-mds-20.2.0-681.g36d388f2.el9.x86_6 1.8 MB/s | 2.3 MB 00:01 2026-02-24T18:27:55.113 INFO:teuthology.orchestra.run.trial103.stdout:(3/12): flexiblas-netlib-3.0.4-9.el9.x86_64.rpm 44 MB/s | 3.0 MB 00:00 2026-02-24T18:27:55.122 INFO:teuthology.orchestra.run.trial103.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-9.el9.x 1.6 MB/s | 15 kB 00:00 2026-02-24T18:27:55.131 INFO:teuthology.orchestra.run.trial103.stdout:(5/12): openblas-0.3.29-1.el9.x86_64.rpm 4.5 MB/s | 42 kB 00:00 2026-02-24T18:27:55.159 INFO:teuthology.orchestra.run.trial103.stdout:(6/12): openblas-openmp-0.3.29-1.el9.x86_64.rpm 192 MB/s | 5.3 MB 00:00 2026-02-24T18:27:55.172 INFO:teuthology.orchestra.run.trial103.stdout:(7/12): python3-devel-3.9.25-3.el9.x86_64.rpm 20 MB/s | 244 kB 00:00 2026-02-24T18:27:55.183 INFO:teuthology.orchestra.run.trial103.stdout:(8/12): libgfortran-11.5.0-14.el9.x86_64.rpm 1.2 MB/s | 794 kB 00:00 2026-02-24T18:27:55.205 INFO:teuthology.orchestra.run.trial103.stdout:(9/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 182 MB/s | 6.1 MB 00:00 2026-02-24T18:27:55.250 INFO:teuthology.orchestra.run.trial103.stdout:(10/12): python3-numpy-f2py-1.23.5-2.el9.x86_64 6.4 MB/s | 442 kB 00:00 2026-02-24T18:27:55.258 INFO:teuthology.orchestra.run.trial026.stdout:(4/40): ceph-mgr-modules-core-20.2.0-681.g36d38 1.5 MB/s | 290 kB 00:00 2026-02-24T18:27:55.291 INFO:teuthology.orchestra.run.trial026.stdout:(5/40): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.2 MB/s | 40 kB 00:00 2026-02-24T18:27:55.294 INFO:teuthology.orchestra.run.trial103.stdout:(11/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 217 MB/s | 19 MB 00:00 2026-02-24T18:27:55.313 INFO:teuthology.orchestra.run.trial026.stdout:(6/40): libconfig-1.7.2-9.el9.x86_64.rpm 3.2 MB/s | 72 kB 00:00 2026-02-24T18:27:55.339 INFO:teuthology.orchestra.run.trial026.stdout:(7/40): python3-cffi-1.14.5-5.el9.x86_64.rpm 9.6 MB/s | 253 kB 00:00 2026-02-24T18:27:55.378 INFO:teuthology.orchestra.run.trial026.stdout:(8/40): python3-cryptography-36.0.1-5.el9.x86_6 32 MB/s | 1.2 MB 00:00 2026-02-24T18:27:55.390 INFO:teuthology.orchestra.run.trial026.stdout:(9/40): python3-ply-3.11-14.el9.noarch.rpm 9.0 MB/s | 106 kB 00:00 2026-02-24T18:27:55.402 INFO:teuthology.orchestra.run.trial026.stdout:(10/40): python3-pycparser-2.20-6.el9.noarch.rp 11 MB/s | 135 kB 00:00 2026-02-24T18:27:55.414 INFO:teuthology.orchestra.run.trial026.stdout:(11/40): python3-pyparsing-2.4.7-9.el9.noarch.r 12 MB/s | 150 kB 00:00 2026-02-24T18:27:55.426 INFO:teuthology.orchestra.run.trial026.stdout:(12/40): python3-requests-2.25.1-10.el9.noarch. 10 MB/s | 126 kB 00:00 2026-02-24T18:27:55.439 INFO:teuthology.orchestra.run.trial026.stdout:(13/40): python3-urllib3-1.26.5-7.el9.noarch.rp 17 MB/s | 218 kB 00:00 2026-02-24T18:27:55.452 INFO:teuthology.orchestra.run.trial026.stdout:(14/40): unzip-6.0-59.el9.x86_64.rpm 14 MB/s | 182 kB 00:00 2026-02-24T18:27:55.464 INFO:teuthology.orchestra.run.trial026.stdout:(15/40): zip-3.0-35.el9.x86_64.rpm 21 MB/s | 266 kB 00:00 2026-02-24T18:27:55.630 INFO:teuthology.orchestra.run.trial070.stdout:(40/40): ceph-osd-20.2.0-681.g36d388f2.el9.x86_ 4.4 MB/s | 17 MB 00:03 2026-02-24T18:27:55.631 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:55.631 INFO:teuthology.orchestra.run.trial070.stdout:Total 5.3 MB/s | 30 MB 00:05 2026-02-24T18:27:55.780 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T18:27:55.797 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T18:27:55.798 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T18:27:55.941 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T18:27:55.941 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T18:27:55.962 INFO:teuthology.orchestra.run.trial026.stdout:(16/40): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 495 kB/s | 246 kB 00:00 2026-02-24T18:27:56.082 INFO:teuthology.orchestra.run.trial026.stdout:(17/40): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2026-02-24T18:27:56.121 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T18:27:56.124 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/40 2026-02-24T18:27:56.129 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/40 2026-02-24T18:27:56.133 INFO:teuthology.orchestra.run.trial070.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/40 2026-02-24T18:27:56.135 INFO:teuthology.orchestra.run.trial070.stdout: Installing : unzip-6.0-59.el9.x86_64 4/40 2026-02-24T18:27:56.141 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/40 2026-02-24T18:27:56.165 INFO:teuthology.orchestra.run.trial070.stdout: Installing : zip-3.0-35.el9.x86_64 6/40 2026-02-24T18:27:56.170 INFO:teuthology.orchestra.run.trial070.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/40 2026-02-24T18:27:56.175 INFO:teuthology.orchestra.run.trial070.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/40 2026-02-24T18:27:56.180 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/40 2026-02-24T18:27:56.186 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/40 2026-02-24T18:27:56.190 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/40 2026-02-24T18:27:56.195 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/40 2026-02-24T18:27:56.199 INFO:teuthology.orchestra.run.trial026.stdout:(18/40): python3-libstoragemgmt-1.10.1-1.el9.x8 1.5 MB/s | 177 kB 00:00 2026-02-24T18:27:56.200 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/40 2026-02-24T18:27:56.204 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/40 2026-02-24T18:27:56.208 INFO:teuthology.orchestra.run.trial162.stdout:(12/12): ceph-mgr-diskprediction-local-20.2.0-6 1.4 MB/s | 7.4 MB 00:05 2026-02-24T18:27:56.209 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:56.209 INFO:teuthology.orchestra.run.trial162.stdout:Total 8.0 MB/s | 43 MB 00:05 2026-02-24T18:27:56.210 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/40 2026-02-24T18:27:56.213 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/40 2026-02-24T18:27:56.220 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/40 2026-02-24T18:27:56.223 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/40 2026-02-24T18:27:56.246 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/40 2026-02-24T18:27:56.258 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/40 2026-02-24T18:27:56.263 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/40 2026-02-24T18:27:56.273 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/40 2026-02-24T18:27:56.280 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/40 2026-02-24T18:27:56.293 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/40 2026-02-24T18:27:56.294 INFO:teuthology.orchestra.run.trial026.stdout:(19/40): python3-packaging-20.9-5.el9.noarch.rp 815 kB/s | 77 kB 00:00 2026-02-24T18:27:56.308 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/40 2026-02-24T18:27:56.372 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T18:27:56.380 INFO:teuthology.orchestra.run.trial026.stdout:(20/40): python3-toml-0.10.2-6.el9.noarch.rpm 484 kB/s | 42 kB 00:00 2026-02-24T18:27:56.383 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/40 2026-02-24T18:27:56.385 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T18:27:56.385 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T18:27:56.391 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/40 2026-02-24T18:27:56.410 INFO:teuthology.orchestra.run.trial026.stdout:(21/40): lua-devel-5.4.4-4.el9.x86_64.rpm 733 kB/s | 22 kB 00:00 2026-02-24T18:27:56.414 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/40 2026-02-24T18:27:56.444 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/40 2026-02-24T18:27:56.449 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/40 2026-02-24T18:27:56.495 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/40 2026-02-24T18:27:56.538 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 32/40 2026-02-24T18:27:56.539 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-24T18:27:56.562 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-24T18:27:56.563 INFO:teuthology.orchestra.run.trial070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:56.563 INFO:teuthology.orchestra.run.trial070.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-24T18:27:56.563 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:27:56.563 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:27:56.563 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:27:56.567 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/40 2026-02-24T18:27:56.584 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:56.584 INFO:teuthology.orchestra.run.trial070.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-24T18:27:56.584 INFO:teuthology.orchestra.run.trial070.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-24T18:27:56.584 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:27:56.587 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T18:27:56.587 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T18:27:56.594 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:56.595 INFO:teuthology.orchestra.run.trial026.stdout:(22/40): luarocks-3.9.2-5.el9.noarch.rpm 824 kB/s | 151 kB 00:00 2026-02-24T18:27:56.618 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:27:56.618 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-24T18:27:56.618 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:27:56.632 INFO:teuthology.orchestra.run.trial026.stdout:(23/40): python3-autocommand-2.2.2-8.el9.noarch 789 kB/s | 29 kB 00:00 2026-02-24T18:27:56.674 INFO:teuthology.orchestra.run.trial026.stdout:(24/40): python3-backports-tarfile-1.2.0-1.el9. 1.4 MB/s | 60 kB 00:00 2026-02-24T18:27:56.712 INFO:teuthology.orchestra.run.trial026.stdout:(25/40): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.1 MB/s | 43 kB 00:00 2026-02-24T18:27:56.771 INFO:teuthology.orchestra.run.trial026.stdout:(26/40): python3-cheroot-10.0.1-4.el9.noarch.rp 2.9 MB/s | 173 kB 00:00 2026-02-24T18:27:56.808 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T18:27:56.811 INFO:teuthology.orchestra.run.trial162.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 1/12 2026-02-24T18:27:56.818 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-24T18:27:56.846 INFO:teuthology.orchestra.run.trial026.stdout:(27/40): python3-cherrypy-18.6.1-2.el9.noarch.r 4.7 MB/s | 358 kB 00:00 2026-02-24T18:27:56.852 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-24T18:27:56.856 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 4/12 2026-02-24T18:27:56.880 INFO:teuthology.orchestra.run.trial026.stdout:(28/40): python3-jaraco-8.2.1-3.el9.noarch.rpm 312 kB/s | 11 kB 00:00 2026-02-24T18:27:56.914 INFO:teuthology.orchestra.run.trial026.stdout:(29/40): python3-jaraco-classes-3.2.1-5.el9.noa 520 kB/s | 18 kB 00:00 2026-02-24T18:27:56.917 INFO:teuthology.orchestra.run.trial162.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-24T18:27:56.920 INFO:teuthology.orchestra.run.trial162.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-24T18:27:56.942 INFO:teuthology.orchestra.run.trial162.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 7/12 2026-02-24T18:27:56.949 INFO:teuthology.orchestra.run.trial026.stdout:(30/40): python3-jaraco-collections-3.0.0-8.el9 679 kB/s | 23 kB 00:00 2026-02-24T18:27:56.983 INFO:teuthology.orchestra.run.trial026.stdout:(31/40): python3-jaraco-context-6.0.1-3.el9.noa 577 kB/s | 20 kB 00:00 2026-02-24T18:27:57.017 INFO:teuthology.orchestra.run.trial026.stdout:(32/40): python3-jaraco-functools-3.5.0-2.el9.n 573 kB/s | 19 kB 00:00 2026-02-24T18:27:57.051 INFO:teuthology.orchestra.run.trial026.stdout:(33/40): python3-jaraco-text-4.0.0-2.el9.noarch 777 kB/s | 26 kB 00:00 2026-02-24T18:27:57.087 INFO:teuthology.orchestra.run.trial026.stdout:(34/40): python3-more-itertools-8.12.0-2.el9.no 2.1 MB/s | 79 kB 00:00 2026-02-24T18:27:57.121 INFO:teuthology.orchestra.run.trial026.stdout:(35/40): python3-portend-3.1.0-2.el9.noarch.rpm 484 kB/s | 16 kB 00:00 2026-02-24T18:27:57.157 INFO:teuthology.orchestra.run.trial026.stdout:(36/40): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.4 MB/s | 90 kB 00:00 2026-02-24T18:27:57.191 INFO:teuthology.orchestra.run.trial026.stdout:(37/40): python3-tempora-5.0.0-2.el9.noarch.rpm 1.0 MB/s | 36 kB 00:00 2026-02-24T18:27:57.225 INFO:teuthology.orchestra.run.trial026.stdout:(38/40): python3-zc-lockfile-2.0-10.el9.noarch. 587 kB/s | 20 kB 00:00 2026-02-24T18:27:57.261 INFO:teuthology.orchestra.run.trial162.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 8/12 2026-02-24T18:27:57.297 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/40 2026-02-24T18:27:57.299 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-24T18:27:57.324 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-24T18:27:57.324 INFO:teuthology.orchestra.run.trial070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:57.324 INFO:teuthology.orchestra.run.trial070.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-24T18:27:57.324 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:27:57.324 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:27:57.324 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:27:57.333 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-24T18:27:57.536 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-24T18:27:57.558 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-24T18:27:57.558 INFO:teuthology.orchestra.run.trial070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:57.559 INFO:teuthology.orchestra.run.trial070.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-24T18:27:57.559 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:27:57.559 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:27:57.559 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:27:57.655 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-24T18:27:57.675 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-24T18:27:57.676 INFO:teuthology.orchestra.run.trial070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:27:57.676 INFO:teuthology.orchestra.run.trial070.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-24T18:27:57.676 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:27:57.676 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:27:57.676 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:27:57.693 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-24T18:27:57.996 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-24T18:27:58.042 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-24T18:27:58.043 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 1/40 2026-02-24T18:27:58.043 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2/40 2026-02-24T18:27:58.043 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 3/40 2026-02-24T18:27:58.043 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 4/40 2026-02-24T18:27:58.043 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 5/40 2026-02-24T18:27:58.043 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 6/40 2026-02-24T18:27:58.043 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 7/40 2026-02-24T18:27:58.043 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 8/40 2026-02-24T18:27:58.043 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 9/40 2026-02-24T18:27:58.043 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 10/40 2026-02-24T18:27:58.043 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/40 2026-02-24T18:27:58.044 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/40 2026-02-24T18:27:58.044 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 13/40 2026-02-24T18:27:58.044 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 14/40 2026-02-24T18:27:58.044 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 15/40 2026-02-24T18:27:58.044 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : unzip-6.0-59.el9.x86_64 16/40 2026-02-24T18:27:58.044 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : zip-3.0-35.el9.x86_64 17/40 2026-02-24T18:27:58.044 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 18/40 2026-02-24T18:27:58.044 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : lua-5.4.4-4.el9.x86_64 19/40 2026-02-24T18:27:58.044 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 20/40 2026-02-24T18:27:58.044 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 21/40 2026-02-24T18:27:58.044 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 22/40 2026-02-24T18:27:58.044 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 23/40 2026-02-24T18:27:58.044 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 24/40 2026-02-24T18:27:58.045 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 25/40 2026-02-24T18:27:58.045 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 26/40 2026-02-24T18:27:58.045 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 27/40 2026-02-24T18:27:58.045 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 28/40 2026-02-24T18:27:58.045 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 29/40 2026-02-24T18:27:58.045 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 30/40 2026-02-24T18:27:58.045 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 31/40 2026-02-24T18:27:58.045 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 32/40 2026-02-24T18:27:58.045 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 33/40 2026-02-24T18:27:58.045 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 34/40 2026-02-24T18:27:58.045 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 35/40 2026-02-24T18:27:58.045 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 36/40 2026-02-24T18:27:58.045 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 37/40 2026-02-24T18:27:58.046 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 38/40 2026-02-24T18:27:58.046 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 39/40 2026-02-24T18:27:58.104 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 40/40 2026-02-24T18:27:58.104 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:27:58.104 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T18:27:58.104 INFO:teuthology.orchestra.run.trial070.stdout: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:58.105 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:58.105 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:58.105 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:58.105 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:58.105 INFO:teuthology.orchestra.run.trial070.stdout: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:27:58.105 INFO:teuthology.orchestra.run.trial070.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-24T18:27:58.106 INFO:teuthology.orchestra.run.trial070.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-24T18:27:58.106 INFO:teuthology.orchestra.run.trial070.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:27:58.106 INFO:teuthology.orchestra.run.trial070.stdout: lua-5.4.4-4.el9.x86_64 2026-02-24T18:27:58.106 INFO:teuthology.orchestra.run.trial070.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-24T18:27:58.106 INFO:teuthology.orchestra.run.trial070.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-24T18:27:58.106 INFO:teuthology.orchestra.run.trial070.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-24T18:27:58.107 INFO:teuthology.orchestra.run.trial070.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-24T18:27:58.107 INFO:teuthology.orchestra.run.trial070.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-24T18:27:58.107 INFO:teuthology.orchestra.run.trial070.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-24T18:27:58.107 INFO:teuthology.orchestra.run.trial070.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-24T18:27:58.107 INFO:teuthology.orchestra.run.trial070.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-24T18:27:58.107 INFO:teuthology.orchestra.run.trial070.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-24T18:27:58.107 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-24T18:27:58.108 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-24T18:27:58.108 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-24T18:27:58.108 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-24T18:27:58.108 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-24T18:27:58.108 INFO:teuthology.orchestra.run.trial070.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-24T18:27:58.108 INFO:teuthology.orchestra.run.trial070.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:27:58.108 INFO:teuthology.orchestra.run.trial070.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-24T18:27:58.109 INFO:teuthology.orchestra.run.trial070.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-24T18:27:58.109 INFO:teuthology.orchestra.run.trial070.stdout: python3-ply-3.11-14.el9.noarch 2026-02-24T18:27:58.109 INFO:teuthology.orchestra.run.trial070.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-24T18:27:58.109 INFO:teuthology.orchestra.run.trial070.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-24T18:27:58.109 INFO:teuthology.orchestra.run.trial070.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-24T18:27:58.109 INFO:teuthology.orchestra.run.trial070.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-24T18:27:58.110 INFO:teuthology.orchestra.run.trial070.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-24T18:27:58.110 INFO:teuthology.orchestra.run.trial070.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-24T18:27:58.110 INFO:teuthology.orchestra.run.trial070.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-24T18:27:58.110 INFO:teuthology.orchestra.run.trial070.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-24T18:27:58.110 INFO:teuthology.orchestra.run.trial070.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-24T18:27:58.110 INFO:teuthology.orchestra.run.trial070.stdout: unzip-6.0-59.el9.x86_64 2026-02-24T18:27:58.110 INFO:teuthology.orchestra.run.trial070.stdout: zip-3.0-35.el9.x86_64 2026-02-24T18:27:58.111 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:27:58.111 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:27:58.139 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-base 2026-02-24T18:27:58.347 INFO:teuthology.orchestra.run.trial026.stdout:(39/40): ceph-mon-20.2.0-681.g36d388f2.el9.x86_ 1.2 MB/s | 5.1 MB 00:04 2026-02-24T18:27:58.450 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-24T18:27:58.451 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-24T18:27:58.453 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:53 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:27:58.517 INFO:teuthology.orchestra.run.trial070.stdout:Package ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:27:58.534 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:27:58.535 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-24T18:27:58.535 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:27:58.556 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install cephadm 2026-02-24T18:27:58.771 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-24T18:27:58.771 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 1/12 2026-02-24T18:27:58.771 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-24T18:27:58.771 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-24T18:27:58.771 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 4/12 2026-02-24T18:27:58.771 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 5/12 2026-02-24T18:27:58.771 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 6/12 2026-02-24T18:27:58.771 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-24T18:27:58.772 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-24T18:27:58.772 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 9/12 2026-02-24T18:27:58.772 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-24T18:27:58.772 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-24T18:27:58.833 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-24T18:27:58.833 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:58.833 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T18:27:58.833 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:58.833 INFO:teuthology.orchestra.run.trial162.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-24T18:27:58.833 INFO:teuthology.orchestra.run.trial162.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-24T18:27:58.834 INFO:teuthology.orchestra.run.trial162.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-24T18:27:58.834 INFO:teuthology.orchestra.run.trial162.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-24T18:27:58.834 INFO:teuthology.orchestra.run.trial162.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-24T18:27:58.834 INFO:teuthology.orchestra.run.trial162.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-24T18:27:58.834 INFO:teuthology.orchestra.run.trial162.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-24T18:27:58.834 INFO:teuthology.orchestra.run.trial162.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-24T18:27:58.834 INFO:teuthology.orchestra.run.trial162.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-24T18:27:58.834 INFO:teuthology.orchestra.run.trial162.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-24T18:27:58.834 INFO:teuthology.orchestra.run.trial162.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-24T18:27:58.834 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:58.834 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:27:58.867 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:53 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:27:58.871 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-mgr-rook 2026-02-24T18:27:58.950 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:27:58.950 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:27:58.950 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repository Size 2026-02-24T18:27:58.950 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:27:58.950 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T18:27:58.950 INFO:teuthology.orchestra.run.trial070.stdout: cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 1.0 M 2026-02-24T18:27:58.950 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:27:58.950 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T18:27:58.951 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:27:58.951 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T18:27:58.951 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:27:58.951 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 1.0 M 2026-02-24T18:27:58.951 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 1.0 M 2026-02-24T18:27:58.951 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T18:27:59.197 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:51 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:27:59.246 INFO:teuthology.orchestra.run.trial026.stdout:(40/40): ceph-osd-20.2.0-681.g36d388f2.el9.x86_ 3.6 MB/s | 17 MB 00:04 2026-02-24T18:27:59.247 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:59.248 INFO:teuthology.orchestra.run.trial026.stdout:Total 4.8 MB/s | 30 MB 00:06 2026-02-24T18:27:59.283 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:27:59.284 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:27:59.284 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repository Size 2026-02-24T18:27:59.284 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:27:59.284 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T18:27:59.285 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-rook noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 50 k 2026-02-24T18:27:59.285 INFO:teuthology.orchestra.run.trial162.stdout:Installing dependencies: 2026-02-24T18:27:59.285 INFO:teuthology.orchestra.run.trial162.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-24T18:27:59.285 INFO:teuthology.orchestra.run.trial162.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-24T18:27:59.285 INFO:teuthology.orchestra.run.trial162.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-24T18:27:59.285 INFO:teuthology.orchestra.run.trial162.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-24T18:27:59.285 INFO:teuthology.orchestra.run.trial162.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-24T18:27:59.285 INFO:teuthology.orchestra.run.trial162.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-24T18:27:59.285 INFO:teuthology.orchestra.run.trial162.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-24T18:27:59.285 INFO:teuthology.orchestra.run.trial162.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-24T18:27:59.286 INFO:teuthology.orchestra.run.trial162.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-24T18:27:59.286 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:59.286 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T18:27:59.286 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:27:59.286 INFO:teuthology.orchestra.run.trial162.stdout:Install 10 Packages 2026-02-24T18:27:59.286 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:27:59.286 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 2.0 M 2026-02-24T18:27:59.286 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 25 M 2026-02-24T18:27:59.286 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T18:27:59.400 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T18:27:59.419 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T18:27:59.419 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T18:27:59.562 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T18:27:59.563 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T18:27:59.649 INFO:teuthology.orchestra.run.trial070.stdout:cephadm-20.2.0-681.g36d388f2.el9.noarch.rpm 1.4 MB/s | 1.0 MB 00:00 2026-02-24T18:27:59.650 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:27:59.650 INFO:teuthology.orchestra.run.trial070.stdout:Total 1.4 MB/s | 1.0 MB 00:00 2026-02-24T18:27:59.650 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T18:27:59.653 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T18:27:59.653 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T18:27:59.657 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T18:27:59.658 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T18:27:59.676 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T18:27:59.742 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:59.743 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T18:27:59.746 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/40 2026-02-24T18:27:59.751 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/40 2026-02-24T18:27:59.756 INFO:teuthology.orchestra.run.trial026.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/40 2026-02-24T18:27:59.756 INFO:teuthology.orchestra.run.trial070.stdout: Installing : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:59.757 INFO:teuthology.orchestra.run.trial026.stdout: Installing : unzip-6.0-59.el9.x86_64 4/40 2026-02-24T18:27:59.763 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/40 2026-02-24T18:27:59.789 INFO:teuthology.orchestra.run.trial026.stdout: Installing : zip-3.0-35.el9.x86_64 6/40 2026-02-24T18:27:59.793 INFO:teuthology.orchestra.run.trial026.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/40 2026-02-24T18:27:59.798 INFO:teuthology.orchestra.run.trial026.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/40 2026-02-24T18:27:59.803 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/40 2026-02-24T18:27:59.809 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/40 2026-02-24T18:27:59.813 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/40 2026-02-24T18:27:59.819 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/40 2026-02-24T18:27:59.824 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:59.824 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/40 2026-02-24T18:27:59.828 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/40 2026-02-24T18:27:59.834 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/40 2026-02-24T18:27:59.837 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/40 2026-02-24T18:27:59.844 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/40 2026-02-24T18:27:59.847 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/40 2026-02-24T18:27:59.870 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/40 2026-02-24T18:27:59.882 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:27:59.882 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:27:59.882 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T18:27:59.882 INFO:teuthology.orchestra.run.trial070.stdout: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:27:59.882 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:27:59.883 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:27:59.883 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/40 2026-02-24T18:27:59.888 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/40 2026-02-24T18:27:59.898 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/40 2026-02-24T18:27:59.905 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/40 2026-02-24T18:27:59.908 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-immutable-object-cache 2026-02-24T18:27:59.912 INFO:teuthology.orchestra.run.trial162.stdout:(1/10): ceph-mgr-rook-20.2.0-681.g36d388f2.el9. 132 kB/s | 50 kB 00:00 2026-02-24T18:27:59.918 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/40 2026-02-24T18:27:59.934 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/40 2026-02-24T18:28:00.009 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/40 2026-02-24T18:28:00.017 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/40 2026-02-24T18:28:00.041 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/40 2026-02-24T18:28:00.071 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/40 2026-02-24T18:28:00.076 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/40 2026-02-24T18:28:00.123 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/40 2026-02-24T18:28:00.167 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 32/40 2026-02-24T18:28:00.168 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-24T18:28:00.191 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 33/40 2026-02-24T18:28:00.191 INFO:teuthology.orchestra.run.trial026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:28:00.191 INFO:teuthology.orchestra.run.trial026.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-24T18:28:00.191 INFO:teuthology.orchestra.run.trial026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:28:00.191 INFO:teuthology.orchestra.run.trial026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-24T18:28:00.191 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:00.195 INFO:teuthology.orchestra.run.trial026.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/40 2026-02-24T18:28:00.212 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:28:00.212 INFO:teuthology.orchestra.run.trial026.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-24T18:28:00.212 INFO:teuthology.orchestra.run.trial026.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-24T18:28:00.212 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:00.217 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:55 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:00.219 INFO:teuthology.orchestra.run.trial026.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:28:00.243 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/40 2026-02-24T18:28:00.243 INFO:teuthology.orchestra.run.trial026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-24T18:28:00.243 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:00.254 INFO:teuthology.orchestra.run.trial162.stdout:(2/10): python3-pyasn1-0.4.8-7.el9.noarch.rpm 218 kB/s | 157 kB 00:00 2026-02-24T18:28:00.300 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:28:00.301 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:00.301 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-24T18:28:00.301 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:00.301 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T18:28:00.301 INFO:teuthology.orchestra.run.trial070.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-681.g36d388f2.el9 ceph 154 k 2026-02-24T18:28:00.301 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:00.301 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T18:28:00.301 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:00.301 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T18:28:00.301 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:00.302 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 154 k 2026-02-24T18:28:00.302 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 447 k 2026-02-24T18:28:00.302 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T18:28:00.327 INFO:teuthology.orchestra.run.trial162.stdout:(3/10): python3-cachetools-4.2.4-1.el9.noarch.r 441 kB/s | 32 kB 00:00 2026-02-24T18:28:00.342 INFO:teuthology.orchestra.run.trial162.stdout:(4/10): python3-pyasn1-modules-0.4.8-7.el9.noar 342 kB/s | 277 kB 00:00 2026-02-24T18:28:00.350 INFO:teuthology.orchestra.run.trial162.stdout:(5/10): python3-certifi-2023.05.07-4.el9.noarch 621 kB/s | 14 kB 00:00 2026-02-24T18:28:00.451 INFO:teuthology.orchestra.run.trial162.stdout:(6/10): python3-kubernetes-26.1.0-3.el9.noarch. 10 MB/s | 1.0 MB 00:00 2026-02-24T18:28:00.474 INFO:teuthology.orchestra.run.trial162.stdout:(7/10): python3-rsa-4.9-2.el9.noarch.rpm 2.5 MB/s | 59 kB 00:00 2026-02-24T18:28:00.489 INFO:teuthology.orchestra.run.trial162.stdout:(8/10): python3-google-auth-2.45.0-1.el9.noarch 1.7 MB/s | 254 kB 00:00 2026-02-24T18:28:00.498 INFO:teuthology.orchestra.run.trial162.stdout:(9/10): python3-websocket-client-1.2.3-2.el9.no 3.6 MB/s | 90 kB 00:00 2026-02-24T18:28:00.538 INFO:teuthology.orchestra.run.trial162.stdout:(10/10): python3-requests-oauthlib-1.3.0-12.el9 86 kB/s | 54 kB 00:00 2026-02-24T18:28:00.539 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:00.539 INFO:teuthology.orchestra.run.trial162.stdout:Total 1.6 MB/s | 2.0 MB 00:01 2026-02-24T18:28:00.563 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T18:28:00.570 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T18:28:00.570 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T18:28:00.610 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T18:28:00.610 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T18:28:00.686 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T18:28:00.738 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 1/10 2026-02-24T18:28:00.747 INFO:teuthology.orchestra.run.trial070.stdout:ceph-immutable-object-cache-20.2.0-681.g36d388f 345 kB/s | 154 kB 00:00 2026-02-24T18:28:00.747 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:00.747 INFO:teuthology.orchestra.run.trial070.stdout:Total 345 kB/s | 154 kB 00:00 2026-02-24T18:28:00.748 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T18:28:00.751 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 2/10 2026-02-24T18:28:00.752 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T18:28:00.752 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T18:28:00.765 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-24T18:28:00.770 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-24T18:28:00.778 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-24T18:28:00.779 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T18:28:00.779 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T18:28:00.818 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-24T18:28:00.829 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T18:28:00.830 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:28:00.831 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-24T18:28:00.852 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:28:00.852 INFO:teuthology.orchestra.run.trial070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:28:00.852 INFO:teuthology.orchestra.run.trial070.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-24T18:28:00.853 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:00.921 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/40 2026-02-24T18:28:00.923 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-24T18:28:00.949 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 37/40 2026-02-24T18:28:00.949 INFO:teuthology.orchestra.run.trial026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:28:00.949 INFO:teuthology.orchestra.run.trial026.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-24T18:28:00.949 INFO:teuthology.orchestra.run.trial026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:28:00.949 INFO:teuthology.orchestra.run.trial026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-24T18:28:00.949 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:01.140 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:28:01.140 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:01.140 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T18:28:01.140 INFO:teuthology.orchestra.run.trial070.stdout: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:01.140 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:01.140 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:28:01.156 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-24T18:28:01.161 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-24T18:28:01.168 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-mgr 2026-02-24T18:28:01.170 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-24T18:28:01.172 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-24T18:28:01.183 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 38/40 2026-02-24T18:28:01.183 INFO:teuthology.orchestra.run.trial026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:28:01.183 INFO:teuthology.orchestra.run.trial026.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-24T18:28:01.183 INFO:teuthology.orchestra.run.trial026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:28:01.183 INFO:teuthology.orchestra.run.trial026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-24T18:28:01.183 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:01.279 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-24T18:28:01.284 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-24T18:28:01.284 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 1/10 2026-02-24T18:28:01.284 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 2/10 2026-02-24T18:28:01.284 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 3/10 2026-02-24T18:28:01.284 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-24T18:28:01.285 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-24T18:28:01.285 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-24T18:28:01.285 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-24T18:28:01.285 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-24T18:28:01.285 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-24T18:28:01.299 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 39/40 2026-02-24T18:28:01.299 INFO:teuthology.orchestra.run.trial026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:28:01.300 INFO:teuthology.orchestra.run.trial026.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-24T18:28:01.300 INFO:teuthology.orchestra.run.trial026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:28:01.300 INFO:teuthology.orchestra.run.trial026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-24T18:28:01.300 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:01.317 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-24T18:28:01.345 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-24T18:28:01.345 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:01.345 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T18:28:01.345 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:28:01.346 INFO:teuthology.orchestra.run.trial162.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-24T18:28:01.346 INFO:teuthology.orchestra.run.trial162.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-24T18:28:01.346 INFO:teuthology.orchestra.run.trial162.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-24T18:28:01.346 INFO:teuthology.orchestra.run.trial162.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-24T18:28:01.346 INFO:teuthology.orchestra.run.trial162.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-24T18:28:01.346 INFO:teuthology.orchestra.run.trial162.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-24T18:28:01.346 INFO:teuthology.orchestra.run.trial162.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-24T18:28:01.346 INFO:teuthology.orchestra.run.trial162.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-24T18:28:01.346 INFO:teuthology.orchestra.run.trial162.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-24T18:28:01.346 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:01.346 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:28:01.376 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-mgr-cephadm 2026-02-24T18:28:01.482 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:56 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:01.539 INFO:teuthology.orchestra.run.trial103.stdout:(12/12): ceph-mgr-diskprediction-local-20.2.0-6 1.1 MB/s | 7.4 MB 00:06 2026-02-24T18:28:01.540 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:01.540 INFO:teuthology.orchestra.run.trial103.stdout:Total 6.0 MB/s | 43 MB 00:07 2026-02-24T18:28:01.547 INFO:teuthology.orchestra.run.trial070.stdout:Package ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:01.565 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:28:01.565 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-24T18:28:01.566 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:28:01.587 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-mgr-dashboard 2026-02-24T18:28:01.657 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 40/40 2026-02-24T18:28:01.657 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-2:20.2.0-681.g36d388f2.el9.x86_64 1/40 2026-02-24T18:28:01.657 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2/40 2026-02-24T18:28:01.658 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 3/40 2026-02-24T18:28:01.658 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 4/40 2026-02-24T18:28:01.658 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 5/40 2026-02-24T18:28:01.658 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.n 6/40 2026-02-24T18:28:01.658 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 7/40 2026-02-24T18:28:01.658 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 8/40 2026-02-24T18:28:01.658 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 9/40 2026-02-24T18:28:01.658 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 10/40 2026-02-24T18:28:01.658 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/40 2026-02-24T18:28:01.658 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/40 2026-02-24T18:28:01.659 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 13/40 2026-02-24T18:28:01.659 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 14/40 2026-02-24T18:28:01.659 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 15/40 2026-02-24T18:28:01.659 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : unzip-6.0-59.el9.x86_64 16/40 2026-02-24T18:28:01.659 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : zip-3.0-35.el9.x86_64 17/40 2026-02-24T18:28:01.659 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 18/40 2026-02-24T18:28:01.659 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : lua-5.4.4-4.el9.x86_64 19/40 2026-02-24T18:28:01.659 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 20/40 2026-02-24T18:28:01.659 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 21/40 2026-02-24T18:28:01.659 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 22/40 2026-02-24T18:28:01.660 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 23/40 2026-02-24T18:28:01.660 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 24/40 2026-02-24T18:28:01.660 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 25/40 2026-02-24T18:28:01.660 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 26/40 2026-02-24T18:28:01.660 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 27/40 2026-02-24T18:28:01.660 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 28/40 2026-02-24T18:28:01.660 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 29/40 2026-02-24T18:28:01.660 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 30/40 2026-02-24T18:28:01.660 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 31/40 2026-02-24T18:28:01.660 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 32/40 2026-02-24T18:28:01.660 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 33/40 2026-02-24T18:28:01.661 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 34/40 2026-02-24T18:28:01.661 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 35/40 2026-02-24T18:28:01.661 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 36/40 2026-02-24T18:28:01.661 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 37/40 2026-02-24T18:28:01.661 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 38/40 2026-02-24T18:28:01.661 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 39/40 2026-02-24T18:28:01.683 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:53 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:28:01.700 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T18:28:01.713 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T18:28:01.714 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T18:28:01.718 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 40/40 2026-02-24T18:28:01.718 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:01.718 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T18:28:01.719 INFO:teuthology.orchestra.run.trial026.stdout: ceph-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:01.719 INFO:teuthology.orchestra.run.trial026.stdout: ceph-mds-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:01.719 INFO:teuthology.orchestra.run.trial026.stdout: ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:01.719 INFO:teuthology.orchestra.run.trial026.stdout: ceph-mgr-modules-core-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:28:01.719 INFO:teuthology.orchestra.run.trial026.stdout: ceph-mon-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:01.719 INFO:teuthology.orchestra.run.trial026.stdout: ceph-osd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:01.719 INFO:teuthology.orchestra.run.trial026.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-24T18:28:01.719 INFO:teuthology.orchestra.run.trial026.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-24T18:28:01.719 INFO:teuthology.orchestra.run.trial026.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:28:01.719 INFO:teuthology.orchestra.run.trial026.stdout: lua-5.4.4-4.el9.x86_64 2026-02-24T18:28:01.720 INFO:teuthology.orchestra.run.trial026.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-24T18:28:01.720 INFO:teuthology.orchestra.run.trial026.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-24T18:28:01.720 INFO:teuthology.orchestra.run.trial026.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-24T18:28:01.720 INFO:teuthology.orchestra.run.trial026.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-24T18:28:01.720 INFO:teuthology.orchestra.run.trial026.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-24T18:28:01.720 INFO:teuthology.orchestra.run.trial026.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-24T18:28:01.720 INFO:teuthology.orchestra.run.trial026.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-24T18:28:01.720 INFO:teuthology.orchestra.run.trial026.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-24T18:28:01.720 INFO:teuthology.orchestra.run.trial026.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-24T18:28:01.720 INFO:teuthology.orchestra.run.trial026.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-24T18:28:01.721 INFO:teuthology.orchestra.run.trial026.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-24T18:28:01.721 INFO:teuthology.orchestra.run.trial026.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-24T18:28:01.721 INFO:teuthology.orchestra.run.trial026.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-24T18:28:01.721 INFO:teuthology.orchestra.run.trial026.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-24T18:28:01.721 INFO:teuthology.orchestra.run.trial026.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-24T18:28:01.721 INFO:teuthology.orchestra.run.trial026.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-24T18:28:01.721 INFO:teuthology.orchestra.run.trial026.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-24T18:28:01.721 INFO:teuthology.orchestra.run.trial026.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-24T18:28:01.721 INFO:teuthology.orchestra.run.trial026.stdout: python3-ply-3.11-14.el9.noarch 2026-02-24T18:28:01.721 INFO:teuthology.orchestra.run.trial026.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-24T18:28:01.721 INFO:teuthology.orchestra.run.trial026.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-24T18:28:01.721 INFO:teuthology.orchestra.run.trial026.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-24T18:28:01.722 INFO:teuthology.orchestra.run.trial026.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-24T18:28:01.722 INFO:teuthology.orchestra.run.trial026.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-24T18:28:01.722 INFO:teuthology.orchestra.run.trial026.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-24T18:28:01.722 INFO:teuthology.orchestra.run.trial026.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-24T18:28:01.722 INFO:teuthology.orchestra.run.trial026.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-24T18:28:01.722 INFO:teuthology.orchestra.run.trial026.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-24T18:28:01.722 INFO:teuthology.orchestra.run.trial026.stdout: unzip-6.0-59.el9.x86_64 2026-02-24T18:28:01.722 INFO:teuthology.orchestra.run.trial026.stdout: zip-3.0-35.el9.x86_64 2026-02-24T18:28:01.722 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:01.723 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:28:01.757 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install ceph-base 2026-02-24T18:28:01.768 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:28:01.769 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:28:01.769 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repository Size 2026-02-24T18:28:01.769 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:28:01.769 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T18:28:01.769 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 173 k 2026-02-24T18:28:01.769 INFO:teuthology.orchestra.run.trial162.stdout:Installing dependencies: 2026-02-24T18:28:01.770 INFO:teuthology.orchestra.run.trial162.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-24T18:28:01.770 INFO:teuthology.orchestra.run.trial162.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-24T18:28:01.770 INFO:teuthology.orchestra.run.trial162.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-24T18:28:01.770 INFO:teuthology.orchestra.run.trial162.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-24T18:28:01.770 INFO:teuthology.orchestra.run.trial162.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-24T18:28:01.770 INFO:teuthology.orchestra.run.trial162.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-24T18:28:01.770 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:01.770 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T18:28:01.770 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:28:01.770 INFO:teuthology.orchestra.run.trial162.stdout:Install 7 Packages 2026-02-24T18:28:01.770 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:01.771 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 7.1 M 2026-02-24T18:28:01.771 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 33 M 2026-02-24T18:28:01.771 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T18:28:01.902 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:01:56 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:01.914 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T18:28:01.915 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T18:28:01.985 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:28:01.986 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:01.986 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repository Size 2026-02-24T18:28:01.986 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:01.987 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T18:28:01.987 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-dashboard noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 11 M 2026-02-24T18:28:01.987 INFO:teuthology.orchestra.run.trial070.stdout:Installing dependencies: 2026-02-24T18:28:01.987 INFO:teuthology.orchestra.run.trial070.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-24T18:28:01.987 INFO:teuthology.orchestra.run.trial070.stdout: ceph-grafana-dashboards noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 43 k 2026-02-24T18:28:01.987 INFO:teuthology.orchestra.run.trial070.stdout: ceph-prometheus-alerts noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 17 k 2026-02-24T18:28:01.987 INFO:teuthology.orchestra.run.trial070.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-24T18:28:01.987 INFO:teuthology.orchestra.run.trial070.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-24T18:28:01.987 INFO:teuthology.orchestra.run.trial070.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-24T18:28:01.988 INFO:teuthology.orchestra.run.trial070.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-24T18:28:01.988 INFO:teuthology.orchestra.run.trial070.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-24T18:28:01.988 INFO:teuthology.orchestra.run.trial070.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-24T18:28:01.988 INFO:teuthology.orchestra.run.trial070.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-24T18:28:01.988 INFO:teuthology.orchestra.run.trial070.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-24T18:28:01.988 INFO:teuthology.orchestra.run.trial070.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-24T18:28:01.988 INFO:teuthology.orchestra.run.trial070.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-24T18:28:01.988 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:01.988 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T18:28:01.988 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:01.988 INFO:teuthology.orchestra.run.trial070.stdout:Install 14 Packages 2026-02-24T18:28:01.989 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:01.989 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 16 M 2026-02-24T18:28:01.989 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 158 M 2026-02-24T18:28:01.989 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T18:28:02.076 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:01:50 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:28:02.131 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T18:28:02.133 INFO:teuthology.orchestra.run.trial103.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 1/12 2026-02-24T18:28:02.139 INFO:teuthology.orchestra.run.trial103.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-24T18:28:02.141 INFO:teuthology.orchestra.run.trial026.stdout:Package ceph-base-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:02.158 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:28:02.159 INFO:teuthology.orchestra.run.trial026.stdout:Nothing to do. 2026-02-24T18:28:02.159 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:28:02.173 INFO:teuthology.orchestra.run.trial103.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-24T18:28:02.177 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 4/12 2026-02-24T18:28:02.181 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install cephadm 2026-02-24T18:28:02.236 INFO:teuthology.orchestra.run.trial103.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-24T18:28:02.238 INFO:teuthology.orchestra.run.trial103.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-24T18:28:02.259 INFO:teuthology.orchestra.run.trial103.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 7/12 2026-02-24T18:28:02.496 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:01:50 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:28:02.578 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:28:02.578 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:02.579 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repository Size 2026-02-24T18:28:02.579 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:02.579 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T18:28:02.579 INFO:teuthology.orchestra.run.trial026.stdout: cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 1.0 M 2026-02-24T18:28:02.579 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:02.579 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T18:28:02.579 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:02.579 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T18:28:02.579 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:02.579 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 1.0 M 2026-02-24T18:28:02.579 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 1.0 M 2026-02-24T18:28:02.579 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T18:28:02.579 INFO:teuthology.orchestra.run.trial103.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 8/12 2026-02-24T18:28:02.650 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-24T18:28:02.672 INFO:teuthology.orchestra.run.trial162.stdout:(1/7): ceph-mgr-cephadm-20.2.0-681.g36d388f2.el 357 kB/s | 173 kB 00:00 2026-02-24T18:28:02.807 INFO:teuthology.orchestra.run.trial070.stdout:(1/14): ceph-prometheus-alerts-20.2.0-681.g36d3 51 kB/s | 17 kB 00:00 2026-02-24T18:28:02.875 INFO:teuthology.orchestra.run.trial070.stdout:(2/14): ceph-grafana-dashboards-20.2.0-681.g36d 106 kB/s | 43 kB 00:00 2026-02-24T18:28:02.937 INFO:teuthology.orchestra.run.trial070.stdout:(3/14): protobuf-3.14.0-17.el9.x86_64.rpm 7.8 MB/s | 1.0 MB 00:00 2026-02-24T18:28:02.938 INFO:teuthology.orchestra.run.trial070.stdout:(4/14): python3-jmespath-1.0.1-1.el9.noarch.rpm 753 kB/s | 48 kB 00:00 2026-02-24T18:28:02.961 INFO:teuthology.orchestra.run.trial070.stdout:(5/14): python3-protobuf-3.14.0-17.el9.noarch.r 11 MB/s | 267 kB 00:00 2026-02-24T18:28:02.987 INFO:teuthology.orchestra.run.trial162.stdout:(2/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 311 kB/s | 249 kB 00:00 2026-02-24T18:28:03.115 INFO:teuthology.orchestra.run.trial070.stdout:(6/14): protobuf-compiler-3.14.0-17.el9.x86_64. 4.8 MB/s | 862 kB 00:00 2026-02-24T18:28:03.153 INFO:teuthology.orchestra.run.trial162.stdout:(3/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 72 kB/s | 35 kB 00:00 2026-02-24T18:28:03.195 INFO:teuthology.orchestra.run.trial162.stdout:(4/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.6 MB/s | 548 kB 00:00 2026-02-24T18:28:03.198 INFO:teuthology.orchestra.run.trial162.stdout:(5/7): python3-natsort-7.1.1-5.el9.noarch.rpm 1.3 MB/s | 58 kB 00:00 2026-02-24T18:28:03.222 INFO:teuthology.orchestra.run.trial162.stdout:(6/7): python3-typing-extensions-4.15.0-1.el9.n 3.2 MB/s | 86 kB 00:00 2026-02-24T18:28:03.289 INFO:teuthology.orchestra.run.trial070.stdout:(7/14): grpc-data-1.46.7-10.el9.noarch.rpm 112 kB/s | 19 kB 00:00 2026-02-24T18:28:03.309 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-24T18:28:03.332 INFO:teuthology.orchestra.run.trial070.stdout:(8/14): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.5 MB/s | 551 kB 00:00 2026-02-24T18:28:03.381 INFO:teuthology.orchestra.run.trial070.stdout:(9/14): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.9 MB/s | 144 kB 00:00 2026-02-24T18:28:03.424 INFO:teuthology.orchestra.run.trial070.stdout:(10/14): python3-repoze-lru-0.7-16.el9.noarch.r 723 kB/s | 31 kB 00:00 2026-02-24T18:28:03.473 INFO:teuthology.orchestra.run.trial162.stdout:(7/7): python3-babel-2.9.1-2.el9.noarch.rpm 4.6 MB/s | 6.0 MB 00:01 2026-02-24T18:28:03.475 INFO:teuthology.orchestra.run.trial070.stdout:(11/14): python3-routes-2.5.1-5.el9.noarch.rpm 3.6 MB/s | 188 kB 00:00 2026-02-24T18:28:03.476 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:03.476 INFO:teuthology.orchestra.run.trial162.stdout:Total 4.2 MB/s | 7.1 MB 00:01 2026-02-24T18:28:03.513 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T18:28:03.518 INFO:teuthology.orchestra.run.trial070.stdout:(12/14): python3-xmltodict-0.12.0-15.el9.noarch 521 kB/s | 22 kB 00:00 2026-02-24T18:28:03.520 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T18:28:03.520 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T18:28:03.526 INFO:teuthology.orchestra.run.trial026.stdout:cephadm-20.2.0-681.g36d388f2.el9.noarch.rpm 1.1 MB/s | 1.0 MB 00:00 2026-02-24T18:28:03.527 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:03.527 INFO:teuthology.orchestra.run.trial026.stdout:Total 1.1 MB/s | 1.0 MB 00:00 2026-02-24T18:28:03.527 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T18:28:03.529 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T18:28:03.529 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T18:28:03.533 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T18:28:03.533 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T18:28:03.552 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T18:28:03.590 INFO:teuthology.orchestra.run.trial070.stdout:(13/14): python3-grpcio-1.46.7-10.el9.x86_64.rp 6.8 MB/s | 2.0 MB 00:00 2026-02-24T18:28:03.593 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T18:28:03.593 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T18:28:03.618 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:28:03.633 INFO:teuthology.orchestra.run.trial026.stdout: Installing : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:28:03.684 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T18:28:03.701 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:28:03.732 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-24T18:28:03.742 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-24T18:28:03.747 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-24T18:28:03.761 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/1 2026-02-24T18:28:03.761 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:03.761 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T18:28:03.761 INFO:teuthology.orchestra.run.trial026.stdout: cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:28:03.761 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:03.761 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:28:03.766 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-24T18:28:03.767 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-24T18:28:03.789 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install ceph-immutable-object-cache 2026-02-24T18:28:03.968 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-24T18:28:03.991 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-24T18:28:04.014 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-24T18:28:04.015 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-24T18:28:04.056 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-24T18:28:04.056 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 1/12 2026-02-24T18:28:04.056 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-24T18:28:04.056 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-24T18:28:04.056 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 4/12 2026-02-24T18:28:04.057 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 5/12 2026-02-24T18:28:04.057 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 6/12 2026-02-24T18:28:04.057 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-24T18:28:04.057 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-24T18:28:04.057 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 9/12 2026-02-24T18:28:04.057 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-24T18:28:04.057 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-24T18:28:04.104 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:01:52 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:28:04.118 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-24T18:28:04.118 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:04.118 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T18:28:04.119 INFO:teuthology.orchestra.run.trial103.stdout: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:28:04.119 INFO:teuthology.orchestra.run.trial103.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-24T18:28:04.119 INFO:teuthology.orchestra.run.trial103.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-24T18:28:04.119 INFO:teuthology.orchestra.run.trial103.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-24T18:28:04.119 INFO:teuthology.orchestra.run.trial103.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-24T18:28:04.119 INFO:teuthology.orchestra.run.trial103.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-24T18:28:04.119 INFO:teuthology.orchestra.run.trial103.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-24T18:28:04.119 INFO:teuthology.orchestra.run.trial103.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-24T18:28:04.119 INFO:teuthology.orchestra.run.trial103.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-24T18:28:04.119 INFO:teuthology.orchestra.run.trial103.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-24T18:28:04.119 INFO:teuthology.orchestra.run.trial103.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-24T18:28:04.120 INFO:teuthology.orchestra.run.trial103.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-24T18:28:04.120 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:04.120 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:28:04.128 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-24T18:28:04.128 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/7 2026-02-24T18:28:04.128 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-24T18:28:04.128 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-24T18:28:04.128 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-24T18:28:04.128 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-24T18:28:04.128 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-24T18:28:04.155 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install ceph-mgr-rook 2026-02-24T18:28:04.187 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:28:04.188 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:04.188 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repo Size 2026-02-24T18:28:04.188 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:04.188 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T18:28:04.188 INFO:teuthology.orchestra.run.trial026.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-681.g36d388f2.el9 ceph 154 k 2026-02-24T18:28:04.188 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:04.188 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T18:28:04.188 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:04.188 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T18:28:04.188 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:04.188 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 154 k 2026-02-24T18:28:04.188 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 447 k 2026-02-24T18:28:04.188 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T18:28:04.189 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-24T18:28:04.189 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:04.189 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T18:28:04.189 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:28:04.189 INFO:teuthology.orchestra.run.trial162.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-24T18:28:04.190 INFO:teuthology.orchestra.run.trial162.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-24T18:28:04.190 INFO:teuthology.orchestra.run.trial162.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-24T18:28:04.190 INFO:teuthology.orchestra.run.trial162.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-24T18:28:04.190 INFO:teuthology.orchestra.run.trial162.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-24T18:28:04.190 INFO:teuthology.orchestra.run.trial162.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-24T18:28:04.190 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:04.190 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:28:04.219 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-fuse 2026-02-24T18:28:04.475 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:01:51 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:28:04.532 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:56 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:28:04.558 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:28:04.559 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:04.559 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repository Size 2026-02-24T18:28:04.559 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:04.559 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T18:28:04.559 INFO:teuthology.orchestra.run.trial103.stdout: ceph-mgr-rook noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 50 k 2026-02-24T18:28:04.560 INFO:teuthology.orchestra.run.trial103.stdout:Installing dependencies: 2026-02-24T18:28:04.560 INFO:teuthology.orchestra.run.trial103.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-24T18:28:04.560 INFO:teuthology.orchestra.run.trial103.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-24T18:28:04.560 INFO:teuthology.orchestra.run.trial103.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-24T18:28:04.560 INFO:teuthology.orchestra.run.trial103.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-24T18:28:04.560 INFO:teuthology.orchestra.run.trial103.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-24T18:28:04.560 INFO:teuthology.orchestra.run.trial103.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-24T18:28:04.560 INFO:teuthology.orchestra.run.trial103.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-24T18:28:04.560 INFO:teuthology.orchestra.run.trial103.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-24T18:28:04.560 INFO:teuthology.orchestra.run.trial103.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-24T18:28:04.560 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:04.560 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T18:28:04.561 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:04.561 INFO:teuthology.orchestra.run.trial103.stdout:Install 10 Packages 2026-02-24T18:28:04.561 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:04.561 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 2.0 M 2026-02-24T18:28:04.562 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 25 M 2026-02-24T18:28:04.562 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T18:28:04.617 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:28:04.618 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:28:04.618 INFO:teuthology.orchestra.run.trial162.stdout: Package Architecture Version Repository Size 2026-02-24T18:28:04.618 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:28:04.618 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T18:28:04.618 INFO:teuthology.orchestra.run.trial162.stdout: ceph-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 942 k 2026-02-24T18:28:04.618 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:04.618 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T18:28:04.618 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:28:04.618 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T18:28:04.619 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:04.619 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 942 k 2026-02-24T18:28:04.619 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 2.7 M 2026-02-24T18:28:04.619 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T18:28:04.666 INFO:teuthology.orchestra.run.trial026.stdout:ceph-immutable-object-cache-20.2.0-681.g36d388f 322 kB/s | 154 kB 00:00 2026-02-24T18:28:04.667 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:04.667 INFO:teuthology.orchestra.run.trial026.stdout:Total 322 kB/s | 154 kB 00:00 2026-02-24T18:28:04.667 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T18:28:04.672 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T18:28:04.672 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T18:28:04.698 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T18:28:04.698 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T18:28:04.748 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T18:28:04.749 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:28:04.754 INFO:teuthology.orchestra.run.trial103.stdout:(1/10): python3-pyasn1-0.4.8-7.el9.noarch.rpm 8.1 MB/s | 157 kB 00:00 2026-02-24T18:28:04.759 INFO:teuthology.orchestra.run.trial103.stdout:(2/10): python3-requests-oauthlib-1.3.0-12.el9. 9.7 MB/s | 54 kB 00:00 2026-02-24T18:28:04.771 INFO:teuthology.orchestra.run.trial103.stdout:(3/10): python3-pyasn1-modules-0.4.8-7.el9.noar 7.5 MB/s | 277 kB 00:00 2026-02-24T18:28:04.772 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:28:04.772 INFO:teuthology.orchestra.run.trial026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:28:04.772 INFO:teuthology.orchestra.run.trial026.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-24T18:28:04.772 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:04.830 INFO:teuthology.orchestra.run.trial103.stdout:(4/10): python3-cachetools-4.2.4-1.el9.noarch.r 459 kB/s | 32 kB 00:00 2026-02-24T18:28:04.850 INFO:teuthology.orchestra.run.trial103.stdout:(5/10): python3-certifi-2023.05.07-4.el9.noarch 179 kB/s | 14 kB 00:00 2026-02-24T18:28:04.900 INFO:teuthology.orchestra.run.trial103.stdout:(6/10): python3-google-auth-2.45.0-1.el9.noarch 3.6 MB/s | 254 kB 00:00 2026-02-24T18:28:04.925 INFO:teuthology.orchestra.run.trial103.stdout:(7/10): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2026-02-24T18:28:04.951 INFO:teuthology.orchestra.run.trial103.stdout:(8/10): python3-websocket-client-1.2.3-2.el9.no 3.4 MB/s | 90 kB 00:00 2026-02-24T18:28:05.007 INFO:teuthology.orchestra.run.trial103.stdout:(9/10): python3-kubernetes-26.1.0-3.el9.noarch. 6.5 MB/s | 1.0 MB 00:00 2026-02-24T18:28:05.067 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.e 1/1 2026-02-24T18:28:05.068 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:05.068 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T18:28:05.068 INFO:teuthology.orchestra.run.trial026.stdout: ceph-immutable-object-cache-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:05.068 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:05.068 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:28:05.096 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install ceph-mgr 2026-02-24T18:28:05.223 INFO:teuthology.orchestra.run.trial103.stdout:(10/10): ceph-mgr-rook-20.2.0-681.g36d388f2.el9 103 kB/s | 50 kB 00:00 2026-02-24T18:28:05.223 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:05.224 INFO:teuthology.orchestra.run.trial103.stdout:Total 3.0 MB/s | 2.0 MB 00:00 2026-02-24T18:28:05.249 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T18:28:05.256 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T18:28:05.256 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T18:28:05.297 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T18:28:05.297 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T18:28:05.373 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T18:28:05.417 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:01:53 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:28:05.423 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 1/10 2026-02-24T18:28:05.436 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 2/10 2026-02-24T18:28:05.450 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-24T18:28:05.455 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-24T18:28:05.463 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-24T18:28:05.482 INFO:teuthology.orchestra.run.trial026.stdout:Package ceph-mgr-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:05.500 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:28:05.500 INFO:teuthology.orchestra.run.trial026.stdout:Nothing to do. 2026-02-24T18:28:05.500 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:28:05.502 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-24T18:28:05.514 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-24T18:28:05.523 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install ceph-mgr-dashboard 2026-02-24T18:28:05.829 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-24T18:28:05.841 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:01:53 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:28:05.843 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-24T18:28:05.844 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-24T18:28:05.888 INFO:teuthology.orchestra.run.trial162.stdout:ceph-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 742 kB/s | 942 kB 00:01 2026-02-24T18:28:05.888 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:05.888 INFO:teuthology.orchestra.run.trial162.stdout:Total 741 kB/s | 942 kB 00:01 2026-02-24T18:28:05.889 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T18:28:05.893 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T18:28:05.894 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T18:28:05.925 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:28:05.927 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T18:28:05.927 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T18:28:05.927 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:05.927 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repository Size 2026-02-24T18:28:05.927 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:05.927 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T18:28:05.928 INFO:teuthology.orchestra.run.trial026.stdout: ceph-mgr-dashboard noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 11 M 2026-02-24T18:28:05.928 INFO:teuthology.orchestra.run.trial026.stdout:Installing dependencies: 2026-02-24T18:28:05.928 INFO:teuthology.orchestra.run.trial026.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-24T18:28:05.928 INFO:teuthology.orchestra.run.trial026.stdout: ceph-grafana-dashboards noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 43 k 2026-02-24T18:28:05.928 INFO:teuthology.orchestra.run.trial026.stdout: ceph-prometheus-alerts noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 17 k 2026-02-24T18:28:05.928 INFO:teuthology.orchestra.run.trial026.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-24T18:28:05.928 INFO:teuthology.orchestra.run.trial026.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-24T18:28:05.928 INFO:teuthology.orchestra.run.trial026.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-24T18:28:05.928 INFO:teuthology.orchestra.run.trial026.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-24T18:28:05.929 INFO:teuthology.orchestra.run.trial026.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-24T18:28:05.929 INFO:teuthology.orchestra.run.trial026.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-24T18:28:05.929 INFO:teuthology.orchestra.run.trial026.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-24T18:28:05.929 INFO:teuthology.orchestra.run.trial026.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-24T18:28:05.929 INFO:teuthology.orchestra.run.trial026.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-24T18:28:05.929 INFO:teuthology.orchestra.run.trial026.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-24T18:28:05.929 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:05.929 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T18:28:05.929 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:05.930 INFO:teuthology.orchestra.run.trial026.stdout:Install 14 Packages 2026-02-24T18:28:05.930 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:05.930 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 16 M 2026-02-24T18:28:05.930 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 158 M 2026-02-24T18:28:05.930 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T18:28:05.961 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-24T18:28:05.961 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 1/10 2026-02-24T18:28:05.961 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 2/10 2026-02-24T18:28:05.961 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 3/10 2026-02-24T18:28:05.961 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-24T18:28:05.961 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-24T18:28:05.961 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-24T18:28:05.962 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-24T18:28:05.962 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-24T18:28:05.962 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-24T18:28:06.014 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T18:28:06.022 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-24T18:28:06.023 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:06.023 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T18:28:06.023 INFO:teuthology.orchestra.run.trial103.stdout: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:28:06.023 INFO:teuthology.orchestra.run.trial103.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-24T18:28:06.023 INFO:teuthology.orchestra.run.trial103.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-24T18:28:06.023 INFO:teuthology.orchestra.run.trial103.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-24T18:28:06.023 INFO:teuthology.orchestra.run.trial103.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-24T18:28:06.023 INFO:teuthology.orchestra.run.trial103.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-24T18:28:06.023 INFO:teuthology.orchestra.run.trial103.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-24T18:28:06.023 INFO:teuthology.orchestra.run.trial103.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-24T18:28:06.024 INFO:teuthology.orchestra.run.trial103.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-24T18:28:06.024 INFO:teuthology.orchestra.run.trial103.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-24T18:28:06.024 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:06.024 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:28:06.032 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:06.053 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install ceph-mgr-cephadm 2026-02-24T18:28:06.253 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:06.315 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:06.315 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:06.315 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T18:28:06.315 INFO:teuthology.orchestra.run.trial162.stdout: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:06.315 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:06.316 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:28:06.343 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-volume 2026-02-24T18:28:06.363 INFO:teuthology.orchestra.run.trial070.stdout:(14/14): ceph-mgr-dashboard-20.2.0-681.g36d388f 2.7 MB/s | 11 MB 00:03 2026-02-24T18:28:06.366 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:06.366 INFO:teuthology.orchestra.run.trial070.stdout:Total 3.6 MB/s | 16 MB 00:04 2026-02-24T18:28:06.372 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:01:53 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:28:06.401 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T18:28:06.411 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T18:28:06.411 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T18:28:06.458 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:28:06.459 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:06.459 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repository Size 2026-02-24T18:28:06.459 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:06.459 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T18:28:06.459 INFO:teuthology.orchestra.run.trial103.stdout: ceph-mgr-cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 173 k 2026-02-24T18:28:06.459 INFO:teuthology.orchestra.run.trial103.stdout:Installing dependencies: 2026-02-24T18:28:06.459 INFO:teuthology.orchestra.run.trial103.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-24T18:28:06.459 INFO:teuthology.orchestra.run.trial103.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-24T18:28:06.460 INFO:teuthology.orchestra.run.trial103.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-24T18:28:06.460 INFO:teuthology.orchestra.run.trial103.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-24T18:28:06.460 INFO:teuthology.orchestra.run.trial103.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-24T18:28:06.460 INFO:teuthology.orchestra.run.trial103.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-24T18:28:06.460 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:06.460 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T18:28:06.460 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:06.460 INFO:teuthology.orchestra.run.trial103.stdout:Install 7 Packages 2026-02-24T18:28:06.460 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:06.460 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 7.1 M 2026-02-24T18:28:06.460 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 33 M 2026-02-24T18:28:06.461 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T18:28:06.507 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T18:28:06.507 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T18:28:06.624 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T18:28:06.632 INFO:teuthology.orchestra.run.trial070.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 1/14 2026-02-24T18:28:06.636 INFO:teuthology.orchestra.run.trial070.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 2/14 2026-02-24T18:28:06.641 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 3/14 2026-02-24T18:28:06.652 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 4/14 2026-02-24T18:28:06.654 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 5/14 2026-02-24T18:28:06.660 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:01:58 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:28:06.682 INFO:teuthology.orchestra.run.trial070.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 6/14 2026-02-24T18:28:06.694 INFO:teuthology.orchestra.run.trial026.stdout:(1/14): ceph-prometheus-alerts-20.2.0-681.g36d3 50 kB/s | 17 kB 00:00 2026-02-24T18:28:06.727 INFO:teuthology.orchestra.run.trial070.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 7/14 2026-02-24T18:28:06.746 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:28:06.747 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:28:06.748 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repository Size 2026-02-24T18:28:06.748 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:28:06.748 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T18:28:06.748 INFO:teuthology.orchestra.run.trial162.stdout: ceph-volume noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 297 k 2026-02-24T18:28:06.748 INFO:teuthology.orchestra.run.trial162.stdout:Installing dependencies: 2026-02-24T18:28:06.748 INFO:teuthology.orchestra.run.trial162.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-24T18:28:06.748 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:06.748 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T18:28:06.748 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:28:06.748 INFO:teuthology.orchestra.run.trial162.stdout:Install 2 Packages 2026-02-24T18:28:06.749 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:06.749 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 648 k 2026-02-24T18:28:06.749 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 2.2 M 2026-02-24T18:28:06.749 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T18:28:06.750 INFO:teuthology.orchestra.run.trial103.stdout:(1/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 1.6 MB/s | 249 kB 00:00 2026-02-24T18:28:06.756 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 8/14 2026-02-24T18:28:06.765 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 9/14 2026-02-24T18:28:06.768 INFO:teuthology.orchestra.run.trial026.stdout:(2/14): ceph-grafana-dashboards-20.2.0-681.g36d 102 kB/s | 43 kB 00:00 2026-02-24T18:28:06.772 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/14 2026-02-24T18:28:06.775 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 11/14 2026-02-24T18:28:06.777 INFO:teuthology.orchestra.run.trial103.stdout:(2/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 1.3 MB/s | 35 kB 00:00 2026-02-24T18:28:06.782 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 12/14 2026-02-24T18:28:06.822 INFO:teuthology.orchestra.run.trial026.stdout:(3/14): protobuf-3.14.0-17.el9.x86_64.rpm 7.9 MB/s | 1.0 MB 00:00 2026-02-24T18:28:06.832 INFO:teuthology.orchestra.run.trial026.stdout:(4/14): python3-jmespath-1.0.1-1.el9.noarch.rpm 748 kB/s | 48 kB 00:00 2026-02-24T18:28:06.846 INFO:teuthology.orchestra.run.trial026.stdout:(5/14): python3-protobuf-3.14.0-17.el9.noarch.r 11 MB/s | 267 kB 00:00 2026-02-24T18:28:06.858 INFO:teuthology.orchestra.run.trial103.stdout:(3/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 6.6 MB/s | 548 kB 00:00 2026-02-24T18:28:06.874 INFO:teuthology.orchestra.run.trial103.stdout:(4/7): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 6.0 MB 00:00 2026-02-24T18:28:06.875 INFO:teuthology.orchestra.run.trial103.stdout:(5/7): python3-natsort-7.1.1-5.el9.noarch.rpm 3.4 MB/s | 58 kB 00:00 2026-02-24T18:28:06.916 INFO:teuthology.orchestra.run.trial103.stdout:(6/7): python3-typing-extensions-4.15.0-1.el9.n 2.0 MB/s | 86 kB 00:00 2026-02-24T18:28:07.131 INFO:teuthology.orchestra.run.trial103.stdout:(7/7): ceph-mgr-cephadm-20.2.0-681.g36d388f2.el 322 kB/s | 173 kB 00:00 2026-02-24T18:28:07.132 INFO:teuthology.orchestra.run.trial162.stdout:(1/2): cryptsetup-2.8.1-3.el9.x86_64.rpm 4.4 MB/s | 351 kB 00:00 2026-02-24T18:28:07.133 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:07.133 INFO:teuthology.orchestra.run.trial103.stdout:Total 11 MB/s | 7.1 MB 00:00 2026-02-24T18:28:07.175 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T18:28:07.182 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T18:28:07.182 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T18:28:07.255 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T18:28:07.255 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T18:28:07.346 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T18:28:07.395 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-24T18:28:07.404 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-24T18:28:07.410 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-24T18:28:07.433 INFO:teuthology.orchestra.run.trial026.stdout:(6/14): abseil-cpp-20211102.0-4.el9.x86_64.rpm 939 kB/s | 551 kB 00:00 2026-02-24T18:28:07.505 INFO:teuthology.orchestra.run.trial026.stdout:(7/14): grpc-data-1.46.7-10.el9.noarch.rpm 270 kB/s | 19 kB 00:00 2026-02-24T18:28:07.578 INFO:teuthology.orchestra.run.trial162.stdout:(2/2): ceph-volume-20.2.0-681.g36d388f2.el9.noa 566 kB/s | 297 kB 00:00 2026-02-24T18:28:07.579 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:07.579 INFO:teuthology.orchestra.run.trial162.stdout:Total 779 kB/s | 648 kB 00:00 2026-02-24T18:28:07.589 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T18:28:07.595 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T18:28:07.595 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T18:28:07.629 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-24T18:28:07.638 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T18:28:07.638 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T18:28:07.652 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-24T18:28:07.675 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-24T18:28:07.677 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-24T18:28:07.719 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T18:28:07.724 INFO:teuthology.orchestra.run.trial026.stdout:(8/14): python3-grpcio-1.46.7-10.el9.x86_64.rpm 9.3 MB/s | 2.0 MB 00:00 2026-02-24T18:28:07.782 INFO:teuthology.orchestra.run.trial162.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 1/2 2026-02-24T18:28:07.784 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-24T18:28:07.795 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-24T18:28:07.795 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/7 2026-02-24T18:28:07.795 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-24T18:28:07.795 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-24T18:28:07.795 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-24T18:28:07.796 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-24T18:28:07.796 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-24T18:28:07.799 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-24T18:28:07.799 INFO:teuthology.orchestra.run.trial162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:28:07.799 INFO:teuthology.orchestra.run.trial162.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-24T18:28:07.799 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:07.807 INFO:teuthology.orchestra.run.trial026.stdout:(9/14): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.7 MB/s | 144 kB 00:00 2026-02-24T18:28:07.857 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-24T18:28:07.857 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:07.857 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T18:28:07.857 INFO:teuthology.orchestra.run.trial103.stdout: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:28:07.858 INFO:teuthology.orchestra.run.trial103.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-24T18:28:07.858 INFO:teuthology.orchestra.run.trial103.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-24T18:28:07.858 INFO:teuthology.orchestra.run.trial103.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-24T18:28:07.858 INFO:teuthology.orchestra.run.trial103.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-24T18:28:07.858 INFO:teuthology.orchestra.run.trial103.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-24T18:28:07.858 INFO:teuthology.orchestra.run.trial103.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-24T18:28:07.858 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:07.858 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:28:07.879 INFO:teuthology.orchestra.run.trial026.stdout:(10/14): python3-repoze-lru-0.7-16.el9.noarch.r 425 kB/s | 31 kB 00:00 2026-02-24T18:28:07.889 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install ceph-fuse 2026-02-24T18:28:07.911 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 13/14 2026-02-24T18:28:07.916 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-24T18:28:08.015 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 1/2 2026-02-24T18:28:08.078 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 2/2 2026-02-24T18:28:08.078 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:08.078 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T18:28:08.078 INFO:teuthology.orchestra.run.trial162.stdout: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch cryptsetup-2.8.1-3.el9.x86_64 2026-02-24T18:28:08.079 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:08.079 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:28:08.104 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-24T18:28:08.104 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 1/14 2026-02-24T18:28:08.104 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 2/14 2026-02-24T18:28:08.105 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 3/14 2026-02-24T18:28:08.105 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 4/14 2026-02-24T18:28:08.105 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 5/14 2026-02-24T18:28:08.105 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 6/14 2026-02-24T18:28:08.105 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 7/14 2026-02-24T18:28:08.105 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 8/14 2026-02-24T18:28:08.105 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 9/14 2026-02-24T18:28:08.105 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 10/14 2026-02-24T18:28:08.105 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 11/14 2026-02-24T18:28:08.105 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 12/14 2026-02-24T18:28:08.105 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 13/14 2026-02-24T18:28:08.109 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install librados-devel 2026-02-24T18:28:08.117 INFO:teuthology.orchestra.run.trial026.stdout:(11/14): python3-routes-2.5.1-5.el9.noarch.rpm 792 kB/s | 188 kB 00:00 2026-02-24T18:28:08.163 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 14/14 2026-02-24T18:28:08.163 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:08.163 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T18:28:08.163 INFO:teuthology.orchestra.run.trial070.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-24T18:28:08.163 INFO:teuthology.orchestra.run.trial070.stdout: ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:28:08.163 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:28:08.163 INFO:teuthology.orchestra.run.trial070.stdout: ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:28:08.164 INFO:teuthology.orchestra.run.trial070.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-24T18:28:08.164 INFO:teuthology.orchestra.run.trial070.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-24T18:28:08.164 INFO:teuthology.orchestra.run.trial070.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-24T18:28:08.164 INFO:teuthology.orchestra.run.trial070.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-24T18:28:08.164 INFO:teuthology.orchestra.run.trial070.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-24T18:28:08.164 INFO:teuthology.orchestra.run.trial070.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-24T18:28:08.164 INFO:teuthology.orchestra.run.trial070.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-24T18:28:08.164 INFO:teuthology.orchestra.run.trial070.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-24T18:28:08.164 INFO:teuthology.orchestra.run.trial070.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-24T18:28:08.164 INFO:teuthology.orchestra.run.trial070.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-24T18:28:08.164 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:08.165 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:28:08.189 INFO:teuthology.orchestra.run.trial026.stdout:(12/14): python3-xmltodict-0.12.0-15.el9.noarch 307 kB/s | 22 kB 00:00 2026-02-24T18:28:08.197 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-24T18:28:08.211 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:01:55 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:28:08.298 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:28:08.299 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:08.299 INFO:teuthology.orchestra.run.trial103.stdout: Package Architecture Version Repository Size 2026-02-24T18:28:08.299 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:08.299 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T18:28:08.299 INFO:teuthology.orchestra.run.trial103.stdout: ceph-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 942 k 2026-02-24T18:28:08.299 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:08.299 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T18:28:08.299 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:08.299 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T18:28:08.300 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:08.300 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 942 k 2026-02-24T18:28:08.300 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 2.7 M 2026-02-24T18:28:08.300 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T18:28:08.428 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:02:00 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:28:08.513 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:02:03 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:08.514 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:28:08.514 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:28:08.514 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-24T18:28:08.514 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:28:08.514 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T18:28:08.514 INFO:teuthology.orchestra.run.trial162.stdout: librados-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 126 k 2026-02-24T18:28:08.514 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:08.514 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T18:28:08.515 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:28:08.515 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T18:28:08.515 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:08.515 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 126 k 2026-02-24T18:28:08.515 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 449 k 2026-02-24T18:28:08.515 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T18:28:08.597 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:28:08.597 INFO:teuthology.orchestra.run.trial070.stdout:====================================================================================== 2026-02-24T18:28:08.597 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repository Size 2026-02-24T18:28:08.597 INFO:teuthology.orchestra.run.trial070.stdout:====================================================================================== 2026-02-24T18:28:08.597 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T18:28:08.597 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 7.4 M 2026-02-24T18:28:08.598 INFO:teuthology.orchestra.run.trial070.stdout:Installing dependencies: 2026-02-24T18:28:08.598 INFO:teuthology.orchestra.run.trial070.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-24T18:28:08.598 INFO:teuthology.orchestra.run.trial070.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-24T18:28:08.598 INFO:teuthology.orchestra.run.trial070.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-24T18:28:08.598 INFO:teuthology.orchestra.run.trial070.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-24T18:28:08.598 INFO:teuthology.orchestra.run.trial070.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-24T18:28:08.598 INFO:teuthology.orchestra.run.trial070.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-24T18:28:08.598 INFO:teuthology.orchestra.run.trial070.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-24T18:28:08.598 INFO:teuthology.orchestra.run.trial070.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-24T18:28:08.598 INFO:teuthology.orchestra.run.trial070.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-24T18:28:08.598 INFO:teuthology.orchestra.run.trial070.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-24T18:28:08.598 INFO:teuthology.orchestra.run.trial070.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-24T18:28:08.598 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:08.598 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T18:28:08.598 INFO:teuthology.orchestra.run.trial070.stdout:====================================================================================== 2026-02-24T18:28:08.598 INFO:teuthology.orchestra.run.trial070.stdout:Install 12 Packages 2026-02-24T18:28:08.598 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:08.599 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 43 M 2026-02-24T18:28:08.599 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 234 M 2026-02-24T18:28:08.599 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T18:28:09.002 INFO:teuthology.orchestra.run.trial162.stdout:librados-devel-20.2.0-681.g36d388f2.el9.x86_64. 258 kB/s | 126 kB 00:00 2026-02-24T18:28:09.002 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:09.003 INFO:teuthology.orchestra.run.trial162.stdout:Total 258 kB/s | 126 kB 00:00 2026-02-24T18:28:09.003 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T18:28:09.006 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T18:28:09.006 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T18:28:09.036 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T18:28:09.036 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T18:28:09.091 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T18:28:09.108 INFO:teuthology.orchestra.run.trial162.stdout: Installing : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:09.197 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:09.197 INFO:teuthology.orchestra.run.trial026.stdout:(13/14): protobuf-compiler-3.14.0-17.el9.x86_64 364 kB/s | 862 kB 00:02 2026-02-24T18:28:09.260 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:09.260 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:09.260 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T18:28:09.260 INFO:teuthology.orchestra.run.trial162.stdout: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:09.260 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:09.260 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:28:09.288 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install libcephfs2 2026-02-24T18:28:09.486 INFO:teuthology.orchestra.run.trial070.stdout:(1/12): libquadmath-11.5.0-14.el9.x86_64.rpm 260 kB/s | 184 kB 00:00 2026-02-24T18:28:09.569 INFO:teuthology.orchestra.run.trial070.stdout:(2/12): flexiblas-3.0.4-9.el9.x86_64.rpm 360 kB/s | 30 kB 00:00 2026-02-24T18:28:09.604 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:02:01 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:28:09.670 INFO:teuthology.orchestra.run.trial162.stdout:Package libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:09.689 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:28:09.689 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-24T18:28:09.689 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:28:09.711 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install libcephfs-devel 2026-02-24T18:28:09.757 INFO:teuthology.orchestra.run.trial070.stdout:(3/12): flexiblas-netlib-3.0.4-9.el9.x86_64.rpm 16 MB/s | 3.0 MB 00:00 2026-02-24T18:28:09.782 INFO:teuthology.orchestra.run.trial070.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-9.el9.x 590 kB/s | 15 kB 00:00 2026-02-24T18:28:09.807 INFO:teuthology.orchestra.run.trial070.stdout:(5/12): openblas-0.3.29-1.el9.x86_64.rpm 1.6 MB/s | 42 kB 00:00 2026-02-24T18:28:09.875 INFO:teuthology.orchestra.run.trial070.stdout:(6/12): openblas-openmp-0.3.29-1.el9.x86_64.rpm 79 MB/s | 5.3 MB 00:00 2026-02-24T18:28:09.878 INFO:teuthology.orchestra.run.trial103.stdout:ceph-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 597 kB/s | 942 kB 00:01 2026-02-24T18:28:09.879 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:09.879 INFO:teuthology.orchestra.run.trial103.stdout:Total 596 kB/s | 942 kB 00:01 2026-02-24T18:28:09.879 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T18:28:09.884 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T18:28:09.884 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T18:28:09.903 INFO:teuthology.orchestra.run.trial070.stdout:(7/12): python3-devel-3.9.25-3.el9.x86_64.rpm 8.5 MB/s | 244 kB 00:00 2026-02-24T18:28:09.916 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T18:28:09.916 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T18:28:09.969 INFO:teuthology.orchestra.run.trial070.stdout:(8/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 93 MB/s | 6.1 MB 00:00 2026-02-24T18:28:09.998 INFO:teuthology.orchestra.run.trial070.stdout:(9/12): python3-numpy-f2py-1.23.5-2.el9.x86_64. 15 MB/s | 442 kB 00:00 2026-02-24T18:28:10.005 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T18:28:10.023 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:10.026 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:02:02 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:28:10.113 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:28:10.113 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:28:10.113 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-24T18:28:10.113 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:28:10.113 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T18:28:10.113 INFO:teuthology.orchestra.run.trial162.stdout: libcephfs-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 34 k 2026-02-24T18:28:10.113 INFO:teuthology.orchestra.run.trial162.stdout:Installing dependencies: 2026-02-24T18:28:10.113 INFO:teuthology.orchestra.run.trial162.stdout: libcephfs-proxy2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 k 2026-02-24T18:28:10.113 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:10.113 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T18:28:10.113 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:28:10.113 INFO:teuthology.orchestra.run.trial162.stdout:Install 2 Packages 2026-02-24T18:28:10.113 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:10.114 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 58 k 2026-02-24T18:28:10.114 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 207 k 2026-02-24T18:28:10.114 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T18:28:10.194 INFO:teuthology.orchestra.run.trial070.stdout:(10/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 98 MB/s | 19 MB 00:00 2026-02-24T18:28:10.254 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:10.273 INFO:teuthology.orchestra.run.trial070.stdout:(11/12): libgfortran-11.5.0-14.el9.x86_64.rpm 531 kB/s | 794 kB 00:01 2026-02-24T18:28:10.319 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:10.319 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:10.319 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T18:28:10.319 INFO:teuthology.orchestra.run.trial103.stdout: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:10.319 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:10.319 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:28:10.349 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install ceph-volume 2026-02-24T18:28:10.461 INFO:teuthology.orchestra.run.trial162.stdout:(1/2): libcephfs-devel-20.2.0-681.g36d388f2.el9 99 kB/s | 34 kB 00:00 2026-02-24T18:28:10.462 INFO:teuthology.orchestra.run.trial162.stdout:(2/2): libcephfs-proxy2-20.2.0-681.g36d388f2.el 69 kB/s | 24 kB 00:00 2026-02-24T18:28:10.463 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:10.463 INFO:teuthology.orchestra.run.trial162.stdout:Total 167 kB/s | 58 kB 00:00 2026-02-24T18:28:10.464 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T18:28:10.466 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T18:28:10.466 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T18:28:10.497 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T18:28:10.497 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T18:28:10.546 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T18:28:10.547 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:28:10.561 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:28:10.578 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:28:10.642 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:28:10.642 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:28:10.672 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:01:57 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:28:10.703 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:28:10.704 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:10.704 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T18:28:10.704 INFO:teuthology.orchestra.run.trial162.stdout: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:10.704 INFO:teuthology.orchestra.run.trial162.stdout: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:10.704 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:10.704 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:28:10.730 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install librados2 2026-02-24T18:28:10.757 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:28:10.757 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:10.758 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repository Size 2026-02-24T18:28:10.758 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:10.758 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T18:28:10.758 INFO:teuthology.orchestra.run.trial103.stdout: ceph-volume noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 297 k 2026-02-24T18:28:10.758 INFO:teuthology.orchestra.run.trial103.stdout:Installing dependencies: 2026-02-24T18:28:10.758 INFO:teuthology.orchestra.run.trial103.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-24T18:28:10.758 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:10.758 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T18:28:10.758 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:10.759 INFO:teuthology.orchestra.run.trial103.stdout:Install 2 Packages 2026-02-24T18:28:10.759 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:10.759 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 648 k 2026-02-24T18:28:10.759 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 2.2 M 2026-02-24T18:28:10.759 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T18:28:11.045 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:02:03 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:28:11.111 INFO:teuthology.orchestra.run.trial162.stdout:Package librados2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:11.129 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:28:11.130 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-24T18:28:11.130 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:28:11.151 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install librbd1 2026-02-24T18:28:11.468 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:02:03 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:28:11.537 INFO:teuthology.orchestra.run.trial162.stdout:Package librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:11.556 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:28:11.556 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-24T18:28:11.556 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:28:11.579 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install python3-rados 2026-02-24T18:28:11.603 INFO:teuthology.orchestra.run.trial103.stdout:(1/2): ceph-volume-20.2.0-681.g36d388f2.el9.noa 403 kB/s | 297 kB 00:00 2026-02-24T18:28:11.695 INFO:teuthology.orchestra.run.trial103.stdout:(2/2): cryptsetup-2.8.1-3.el9.x86_64.rpm 422 kB/s | 351 kB 00:00 2026-02-24T18:28:11.696 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:11.696 INFO:teuthology.orchestra.run.trial103.stdout:Total 691 kB/s | 648 kB 00:00 2026-02-24T18:28:11.708 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T18:28:11.715 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T18:28:11.715 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T18:28:11.760 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T18:28:11.760 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T18:28:11.840 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T18:28:11.891 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:02:03 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:28:11.903 INFO:teuthology.orchestra.run.trial103.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 1/2 2026-02-24T18:28:11.905 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-24T18:28:11.921 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-24T18:28:11.921 INFO:teuthology.orchestra.run.trial103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:28:11.921 INFO:teuthology.orchestra.run.trial103.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-24T18:28:11.921 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:11.959 INFO:teuthology.orchestra.run.trial162.stdout:Package python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:11.977 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:28:11.978 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-24T18:28:11.978 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:28:11.998 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install python3-rgw 2026-02-24T18:28:12.150 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 1/2 2026-02-24T18:28:12.214 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 2/2 2026-02-24T18:28:12.214 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:12.214 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T18:28:12.214 INFO:teuthology.orchestra.run.trial103.stdout: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch cryptsetup-2.8.1-3.el9.x86_64 2026-02-24T18:28:12.214 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:12.214 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:28:12.243 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install librados-devel 2026-02-24T18:28:12.316 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:02:04 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:28:12.383 INFO:teuthology.orchestra.run.trial162.stdout:Package python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:12.401 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:28:12.402 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-24T18:28:12.402 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:28:12.423 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install python3-cephfs 2026-02-24T18:28:12.569 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:01:59 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:28:12.653 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:28:12.654 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:12.654 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repo Size 2026-02-24T18:28:12.654 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:12.654 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T18:28:12.654 INFO:teuthology.orchestra.run.trial103.stdout: librados-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 126 k 2026-02-24T18:28:12.654 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:12.654 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T18:28:12.654 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:12.655 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T18:28:12.655 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:12.655 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 126 k 2026-02-24T18:28:12.655 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 449 k 2026-02-24T18:28:12.655 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T18:28:12.743 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:02:04 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:28:12.812 INFO:teuthology.orchestra.run.trial162.stdout:Package python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:12.830 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:28:12.831 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-24T18:28:12.831 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:28:12.851 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install python3-rbd 2026-02-24T18:28:12.873 INFO:teuthology.orchestra.run.trial026.stdout:(14/14): ceph-mgr-dashboard-20.2.0-681.g36d388f 1.6 MB/s | 11 MB 00:06 2026-02-24T18:28:12.875 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:12.876 INFO:teuthology.orchestra.run.trial026.stdout:Total 2.3 MB/s | 16 MB 00:06 2026-02-24T18:28:12.915 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T18:28:12.924 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T18:28:12.924 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T18:28:13.021 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T18:28:13.021 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T18:28:13.139 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T18:28:13.147 INFO:teuthology.orchestra.run.trial026.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 1/14 2026-02-24T18:28:13.150 INFO:teuthology.orchestra.run.trial026.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 2/14 2026-02-24T18:28:13.156 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 3/14 2026-02-24T18:28:13.165 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:02:05 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:28:13.167 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 4/14 2026-02-24T18:28:13.169 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 5/14 2026-02-24T18:28:13.196 INFO:teuthology.orchestra.run.trial026.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 6/14 2026-02-24T18:28:13.211 INFO:teuthology.orchestra.run.trial103.stdout:librados-devel-20.2.0-681.g36d388f2.el9.x86_64. 226 kB/s | 126 kB 00:00 2026-02-24T18:28:13.211 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:13.211 INFO:teuthology.orchestra.run.trial103.stdout:Total 225 kB/s | 126 kB 00:00 2026-02-24T18:28:13.211 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T18:28:13.214 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T18:28:13.214 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T18:28:13.231 INFO:teuthology.orchestra.run.trial162.stdout:Package python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:13.241 INFO:teuthology.orchestra.run.trial026.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 7/14 2026-02-24T18:28:13.246 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T18:28:13.246 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T18:28:13.250 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:28:13.250 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-24T18:28:13.250 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:28:13.270 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 8/14 2026-02-24T18:28:13.272 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install rbd-fuse 2026-02-24T18:28:13.279 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 9/14 2026-02-24T18:28:13.286 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/14 2026-02-24T18:28:13.289 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 11/14 2026-02-24T18:28:13.296 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 12/14 2026-02-24T18:28:13.300 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T18:28:13.318 INFO:teuthology.orchestra.run.trial103.stdout: Installing : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:13.405 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:13.468 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:13.469 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:13.469 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T18:28:13.469 INFO:teuthology.orchestra.run.trial103.stdout: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:13.469 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:13.469 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:28:13.498 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install libcephfs2 2026-02-24T18:28:13.586 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:02:05 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:28:13.672 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:28:13.672 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:28:13.673 INFO:teuthology.orchestra.run.trial162.stdout: Package Architecture Version Repository Size 2026-02-24T18:28:13.673 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:28:13.673 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T18:28:13.673 INFO:teuthology.orchestra.run.trial162.stdout: rbd-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 91 k 2026-02-24T18:28:13.673 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:13.673 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T18:28:13.673 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:28:13.673 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T18:28:13.673 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:13.673 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 91 k 2026-02-24T18:28:13.673 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 238 k 2026-02-24T18:28:13.674 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T18:28:13.814 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:02:00 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:28:13.879 INFO:teuthology.orchestra.run.trial103.stdout:Package libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:13.897 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:28:13.898 INFO:teuthology.orchestra.run.trial103.stdout:Nothing to do. 2026-02-24T18:28:13.898 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:28:13.919 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install libcephfs-devel 2026-02-24T18:28:14.137 INFO:teuthology.orchestra.run.trial162.stdout:rbd-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 196 kB/s | 91 kB 00:00 2026-02-24T18:28:14.138 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:14.138 INFO:teuthology.orchestra.run.trial162.stdout:Total 196 kB/s | 91 kB 00:00 2026-02-24T18:28:14.138 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T18:28:14.142 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T18:28:14.142 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T18:28:14.173 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T18:28:14.173 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T18:28:14.224 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T18:28:14.238 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:02:01 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:28:14.241 INFO:teuthology.orchestra.run.trial162.stdout: Installing : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:14.323 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:28:14.324 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:14.324 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repo Size 2026-02-24T18:28:14.324 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:14.324 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T18:28:14.324 INFO:teuthology.orchestra.run.trial103.stdout: libcephfs-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 34 k 2026-02-24T18:28:14.324 INFO:teuthology.orchestra.run.trial103.stdout:Installing dependencies: 2026-02-24T18:28:14.325 INFO:teuthology.orchestra.run.trial103.stdout: libcephfs-proxy2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 k 2026-02-24T18:28:14.325 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:14.325 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T18:28:14.325 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:14.325 INFO:teuthology.orchestra.run.trial103.stdout:Install 2 Packages 2026-02-24T18:28:14.325 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:14.325 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 58 k 2026-02-24T18:28:14.325 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 207 k 2026-02-24T18:28:14.325 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T18:28:14.326 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:14.392 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:14.393 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:14.393 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T18:28:14.393 INFO:teuthology.orchestra.run.trial162.stdout: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:14.393 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:14.393 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:28:14.421 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 13/14 2026-02-24T18:28:14.422 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install rbd-mirror 2026-02-24T18:28:14.425 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-24T18:28:14.632 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 14/14 2026-02-24T18:28:14.632 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9 1/14 2026-02-24T18:28:14.632 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noar 2/14 2026-02-24T18:28:14.632 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9. 3/14 2026-02-24T18:28:14.632 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 4/14 2026-02-24T18:28:14.632 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 5/14 2026-02-24T18:28:14.632 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 6/14 2026-02-24T18:28:14.632 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 7/14 2026-02-24T18:28:14.632 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 8/14 2026-02-24T18:28:14.633 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 9/14 2026-02-24T18:28:14.633 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 10/14 2026-02-24T18:28:14.633 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 11/14 2026-02-24T18:28:14.633 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 12/14 2026-02-24T18:28:14.633 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 13/14 2026-02-24T18:28:14.672 INFO:teuthology.orchestra.run.trial103.stdout:(1/2): libcephfs-devel-20.2.0-681.g36d388f2.el9 99 kB/s | 34 kB 00:00 2026-02-24T18:28:14.674 INFO:teuthology.orchestra.run.trial103.stdout:(2/2): libcephfs-proxy2-20.2.0-681.g36d388f2.el 69 kB/s | 24 kB 00:00 2026-02-24T18:28:14.675 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:14.675 INFO:teuthology.orchestra.run.trial103.stdout:Total 166 kB/s | 58 kB 00:00 2026-02-24T18:28:14.675 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T18:28:14.678 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T18:28:14.679 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T18:28:14.691 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 14/14 2026-02-24T18:28:14.691 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:14.691 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T18:28:14.691 INFO:teuthology.orchestra.run.trial026.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-24T18:28:14.692 INFO:teuthology.orchestra.run.trial026.stdout: ceph-grafana-dashboards-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:28:14.692 INFO:teuthology.orchestra.run.trial026.stdout: ceph-mgr-dashboard-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:28:14.692 INFO:teuthology.orchestra.run.trial026.stdout: ceph-prometheus-alerts-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:28:14.692 INFO:teuthology.orchestra.run.trial026.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-24T18:28:14.692 INFO:teuthology.orchestra.run.trial026.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-24T18:28:14.692 INFO:teuthology.orchestra.run.trial026.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-24T18:28:14.692 INFO:teuthology.orchestra.run.trial026.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-24T18:28:14.692 INFO:teuthology.orchestra.run.trial026.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-24T18:28:14.692 INFO:teuthology.orchestra.run.trial026.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-24T18:28:14.692 INFO:teuthology.orchestra.run.trial026.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-24T18:28:14.692 INFO:teuthology.orchestra.run.trial026.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-24T18:28:14.692 INFO:teuthology.orchestra.run.trial026.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-24T18:28:14.692 INFO:teuthology.orchestra.run.trial026.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-24T18:28:14.692 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:14.692 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:28:14.710 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T18:28:14.710 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T18:28:14.725 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-24T18:28:14.738 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:02:06 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:28:14.760 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T18:28:14.761 INFO:teuthology.orchestra.run.trial103.stdout: Installing : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:28:14.775 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:28:14.792 INFO:teuthology.orchestra.run.trial103.stdout: Installing : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:28:14.823 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:28:14.824 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:28:14.824 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-24T18:28:14.824 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:28:14.824 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T18:28:14.824 INFO:teuthology.orchestra.run.trial162.stdout: rbd-mirror x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.9 M 2026-02-24T18:28:14.825 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:14.825 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T18:28:14.825 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:28:14.825 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T18:28:14.825 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:14.825 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 2.9 M 2026-02-24T18:28:14.825 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 11 M 2026-02-24T18:28:14.825 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T18:28:14.856 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:28:14.856 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:28:14.920 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:28:14.920 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:14.920 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T18:28:14.920 INFO:teuthology.orchestra.run.trial103.stdout: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:14.920 INFO:teuthology.orchestra.run.trial103.stdout: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:14.920 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:14.920 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:28:14.947 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install librados2 2026-02-24T18:28:15.045 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:02:03 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:28:15.076 INFO:teuthology.orchestra.run.trial070.stdout:(12/12): ceph-mgr-diskprediction-local-20.2.0-6 1.2 MB/s | 7.4 MB 00:06 2026-02-24T18:28:15.078 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:15.078 INFO:teuthology.orchestra.run.trial070.stdout:Total 6.6 MB/s | 43 MB 00:06 2026-02-24T18:28:15.128 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:28:15.129 INFO:teuthology.orchestra.run.trial026.stdout:====================================================================================== 2026-02-24T18:28:15.129 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repository Size 2026-02-24T18:28:15.129 INFO:teuthology.orchestra.run.trial026.stdout:====================================================================================== 2026-02-24T18:28:15.129 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T18:28:15.129 INFO:teuthology.orchestra.run.trial026.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 7.4 M 2026-02-24T18:28:15.129 INFO:teuthology.orchestra.run.trial026.stdout:Installing dependencies: 2026-02-24T18:28:15.129 INFO:teuthology.orchestra.run.trial026.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-24T18:28:15.129 INFO:teuthology.orchestra.run.trial026.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-24T18:28:15.129 INFO:teuthology.orchestra.run.trial026.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-24T18:28:15.129 INFO:teuthology.orchestra.run.trial026.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-24T18:28:15.129 INFO:teuthology.orchestra.run.trial026.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-24T18:28:15.129 INFO:teuthology.orchestra.run.trial026.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-24T18:28:15.130 INFO:teuthology.orchestra.run.trial026.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-24T18:28:15.130 INFO:teuthology.orchestra.run.trial026.stdout: python3-devel x86_64 3.9.25-3.el9 appstream 244 k 2026-02-24T18:28:15.130 INFO:teuthology.orchestra.run.trial026.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-24T18:28:15.130 INFO:teuthology.orchestra.run.trial026.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-24T18:28:15.130 INFO:teuthology.orchestra.run.trial026.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-24T18:28:15.130 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:15.130 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T18:28:15.130 INFO:teuthology.orchestra.run.trial026.stdout:====================================================================================== 2026-02-24T18:28:15.130 INFO:teuthology.orchestra.run.trial026.stdout:Install 12 Packages 2026-02-24T18:28:15.130 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:15.131 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 43 M 2026-02-24T18:28:15.131 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 234 M 2026-02-24T18:28:15.131 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T18:28:15.245 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T18:28:15.258 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T18:28:15.258 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T18:28:15.261 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:02:02 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:28:15.327 INFO:teuthology.orchestra.run.trial103.stdout:Package librados2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:15.345 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:28:15.346 INFO:teuthology.orchestra.run.trial103.stdout:Nothing to do. 2026-02-24T18:28:15.346 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:28:15.367 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install librbd1 2026-02-24T18:28:15.459 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T18:28:15.459 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T18:28:15.675 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T18:28:15.678 INFO:teuthology.orchestra.run.trial070.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 1/12 2026-02-24T18:28:15.682 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:02:02 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:28:15.686 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-24T18:28:15.720 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-24T18:28:15.724 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 4/12 2026-02-24T18:28:15.749 INFO:teuthology.orchestra.run.trial103.stdout:Package librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:15.768 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:28:15.769 INFO:teuthology.orchestra.run.trial103.stdout:Nothing to do. 2026-02-24T18:28:15.769 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:28:15.782 INFO:teuthology.orchestra.run.trial070.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-24T18:28:15.785 INFO:teuthology.orchestra.run.trial070.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-24T18:28:15.790 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install python3-rados 2026-02-24T18:28:15.807 INFO:teuthology.orchestra.run.trial070.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 7/12 2026-02-24T18:28:16.045 INFO:teuthology.orchestra.run.trial026.stdout:(1/12): libquadmath-11.5.0-14.el9.x86_64.rpm 232 kB/s | 184 kB 00:00 2026-02-24T18:28:16.106 INFO:teuthology.orchestra.run.trial026.stdout:(2/12): flexiblas-3.0.4-9.el9.x86_64.rpm 494 kB/s | 30 kB 00:00 2026-02-24T18:28:16.106 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:02:03 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:28:16.125 INFO:teuthology.orchestra.run.trial070.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 8/12 2026-02-24T18:28:16.157 INFO:teuthology.orchestra.run.trial026.stdout:(3/12): flexiblas-netlib-3.0.4-9.el9.x86_64.rpm 58 MB/s | 3.0 MB 00:00 2026-02-24T18:28:16.172 INFO:teuthology.orchestra.run.trial103.stdout:Package python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:16.185 INFO:teuthology.orchestra.run.trial026.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-9.el9.x 534 kB/s | 15 kB 00:00 2026-02-24T18:28:16.191 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:28:16.191 INFO:teuthology.orchestra.run.trial103.stdout:Nothing to do. 2026-02-24T18:28:16.192 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:28:16.196 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-24T18:28:16.212 INFO:teuthology.orchestra.run.trial026.stdout:(5/12): openblas-0.3.29-1.el9.x86_64.rpm 1.6 MB/s | 42 kB 00:00 2026-02-24T18:28:16.213 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install python3-rgw 2026-02-24T18:28:16.260 INFO:teuthology.orchestra.run.trial026.stdout:(6/12): openblas-openmp-0.3.29-1.el9.x86_64.rpm 111 MB/s | 5.3 MB 00:00 2026-02-24T18:28:16.291 INFO:teuthology.orchestra.run.trial026.stdout:(7/12): python3-devel-3.9.25-3.el9.x86_64.rpm 7.6 MB/s | 244 kB 00:00 2026-02-24T18:28:16.349 INFO:teuthology.orchestra.run.trial026.stdout:(8/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 105 MB/s | 6.1 MB 00:00 2026-02-24T18:28:16.379 INFO:teuthology.orchestra.run.trial026.stdout:(9/12): python3-numpy-f2py-1.23.5-2.el9.x86_64. 15 MB/s | 442 kB 00:00 2026-02-24T18:28:16.530 INFO:teuthology.orchestra.run.trial026.stdout:(10/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 128 MB/s | 19 MB 00:00 2026-02-24T18:28:16.530 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:02:03 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:28:16.595 INFO:teuthology.orchestra.run.trial103.stdout:Package python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:16.604 INFO:teuthology.orchestra.run.trial026.stdout:(11/12): libgfortran-11.5.0-14.el9.x86_64.rpm 586 kB/s | 794 kB 00:01 2026-02-24T18:28:16.614 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:28:16.614 INFO:teuthology.orchestra.run.trial103.stdout:Nothing to do. 2026-02-24T18:28:16.614 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:28:16.636 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install python3-cephfs 2026-02-24T18:28:16.853 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-24T18:28:16.957 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:02:03 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:28:17.022 INFO:teuthology.orchestra.run.trial103.stdout:Package python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:17.041 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:28:17.042 INFO:teuthology.orchestra.run.trial103.stdout:Nothing to do. 2026-02-24T18:28:17.042 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:28:17.064 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install python3-rbd 2026-02-24T18:28:17.305 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-24T18:28:17.306 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-24T18:28:17.379 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:02:04 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:28:17.445 INFO:teuthology.orchestra.run.trial103.stdout:Package python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:17.464 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:28:17.464 INFO:teuthology.orchestra.run.trial103.stdout:Nothing to do. 2026-02-24T18:28:17.464 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:28:17.485 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install rbd-fuse 2026-02-24T18:28:17.583 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-24T18:28:17.583 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 1/12 2026-02-24T18:28:17.583 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-24T18:28:17.583 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-24T18:28:17.583 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 4/12 2026-02-24T18:28:17.583 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 5/12 2026-02-24T18:28:17.583 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 6/12 2026-02-24T18:28:17.583 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-24T18:28:17.583 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-24T18:28:17.584 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 9/12 2026-02-24T18:28:17.584 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-24T18:28:17.584 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-24T18:28:17.647 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-24T18:28:17.648 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:17.648 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T18:28:17.648 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:28:17.648 INFO:teuthology.orchestra.run.trial070.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-24T18:28:17.648 INFO:teuthology.orchestra.run.trial070.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-24T18:28:17.648 INFO:teuthology.orchestra.run.trial070.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-24T18:28:17.648 INFO:teuthology.orchestra.run.trial070.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-24T18:28:17.648 INFO:teuthology.orchestra.run.trial070.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-24T18:28:17.648 INFO:teuthology.orchestra.run.trial070.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-24T18:28:17.648 INFO:teuthology.orchestra.run.trial070.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-24T18:28:17.648 INFO:teuthology.orchestra.run.trial070.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-24T18:28:17.648 INFO:teuthology.orchestra.run.trial070.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-24T18:28:17.648 INFO:teuthology.orchestra.run.trial070.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-24T18:28:17.648 INFO:teuthology.orchestra.run.trial070.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-24T18:28:17.648 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:17.648 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:28:17.685 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-mgr-rook 2026-02-24T18:28:17.801 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:02:04 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:28:17.886 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:28:17.886 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:17.886 INFO:teuthology.orchestra.run.trial103.stdout: Package Architecture Version Repository Size 2026-02-24T18:28:17.886 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:17.886 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T18:28:17.886 INFO:teuthology.orchestra.run.trial103.stdout: rbd-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 91 k 2026-02-24T18:28:17.886 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:17.886 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T18:28:17.886 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:17.886 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T18:28:17.886 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:17.886 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 91 k 2026-02-24T18:28:17.886 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 238 k 2026-02-24T18:28:17.887 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T18:28:18.001 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:02:13 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:18.086 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:28:18.087 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:18.087 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repository Size 2026-02-24T18:28:18.087 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:18.087 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T18:28:18.087 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-rook noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 50 k 2026-02-24T18:28:18.087 INFO:teuthology.orchestra.run.trial070.stdout:Installing dependencies: 2026-02-24T18:28:18.087 INFO:teuthology.orchestra.run.trial070.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-24T18:28:18.087 INFO:teuthology.orchestra.run.trial070.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-24T18:28:18.087 INFO:teuthology.orchestra.run.trial070.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-24T18:28:18.087 INFO:teuthology.orchestra.run.trial070.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-24T18:28:18.087 INFO:teuthology.orchestra.run.trial070.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-24T18:28:18.087 INFO:teuthology.orchestra.run.trial070.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-24T18:28:18.087 INFO:teuthology.orchestra.run.trial070.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-24T18:28:18.087 INFO:teuthology.orchestra.run.trial070.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-24T18:28:18.087 INFO:teuthology.orchestra.run.trial070.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-24T18:28:18.087 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:18.087 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T18:28:18.087 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:18.087 INFO:teuthology.orchestra.run.trial070.stdout:Install 10 Packages 2026-02-24T18:28:18.087 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:18.088 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 2.0 M 2026-02-24T18:28:18.088 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 25 M 2026-02-24T18:28:18.088 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T18:28:18.302 INFO:teuthology.orchestra.run.trial103.stdout:rbd-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 220 kB/s | 91 kB 00:00 2026-02-24T18:28:18.302 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:18.302 INFO:teuthology.orchestra.run.trial103.stdout:Total 219 kB/s | 91 kB 00:00 2026-02-24T18:28:18.302 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T18:28:18.307 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T18:28:18.307 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T18:28:18.338 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T18:28:18.338 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T18:28:18.390 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T18:28:18.407 INFO:teuthology.orchestra.run.trial103.stdout: Installing : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:18.489 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:18.510 INFO:teuthology.orchestra.run.trial070.stdout:(1/10): python3-pyasn1-0.4.8-7.el9.noarch.rpm 3.1 MB/s | 157 kB 00:00 2026-02-24T18:28:18.517 INFO:teuthology.orchestra.run.trial070.stdout:(2/10): python3-pyasn1-modules-0.4.8-7.el9.noar 4.9 MB/s | 277 kB 00:00 2026-02-24T18:28:18.520 INFO:teuthology.orchestra.run.trial070.stdout:(3/10): python3-requests-oauthlib-1.3.0-12.el9. 5.3 MB/s | 54 kB 00:00 2026-02-24T18:28:18.551 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:18.551 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:18.551 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T18:28:18.551 INFO:teuthology.orchestra.run.trial103.stdout: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:18.551 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:18.551 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:28:18.580 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install rbd-mirror 2026-02-24T18:28:18.736 INFO:teuthology.orchestra.run.trial070.stdout:(4/10): python3-cachetools-4.2.4-1.el9.noarch.r 147 kB/s | 32 kB 00:00 2026-02-24T18:28:18.749 INFO:teuthology.orchestra.run.trial070.stdout:(5/10): python3-certifi-2023.05.07-4.el9.noarch 62 kB/s | 14 kB 00:00 2026-02-24T18:28:18.879 INFO:teuthology.orchestra.run.trial070.stdout:(6/10): ceph-mgr-rook-20.2.0-681.g36d388f2.el9. 120 kB/s | 50 kB 00:00 2026-02-24T18:28:18.899 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:02:05 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:28:18.950 INFO:teuthology.orchestra.run.trial070.stdout:(7/10): python3-google-auth-2.45.0-1.el9.noarch 1.2 MB/s | 254 kB 00:00 2026-02-24T18:28:18.983 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:28:18.984 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:18.984 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repo Size 2026-02-24T18:28:18.984 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:18.984 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T18:28:18.984 INFO:teuthology.orchestra.run.trial103.stdout: rbd-mirror x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.9 M 2026-02-24T18:28:18.984 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:18.985 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T18:28:18.985 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:18.985 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T18:28:18.985 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:18.985 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 2.9 M 2026-02-24T18:28:18.985 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 11 M 2026-02-24T18:28:18.985 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T18:28:19.054 INFO:teuthology.orchestra.run.trial070.stdout:(8/10): python3-websocket-client-1.2.3-2.el9.no 865 kB/s | 90 kB 00:00 2026-02-24T18:28:19.167 INFO:teuthology.orchestra.run.trial070.stdout:(9/10): python3-rsa-4.9-2.el9.noarch.rpm 205 kB/s | 59 kB 00:00 2026-02-24T18:28:19.198 INFO:teuthology.orchestra.run.trial070.stdout:(10/10): python3-kubernetes-26.1.0-3.el9.noarch 2.3 MB/s | 1.0 MB 00:00 2026-02-24T18:28:19.199 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:19.199 INFO:teuthology.orchestra.run.trial070.stdout:Total 1.8 MB/s | 2.0 MB 00:01 2026-02-24T18:28:19.222 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T18:28:19.230 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T18:28:19.230 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T18:28:19.269 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T18:28:19.269 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T18:28:19.343 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T18:28:19.393 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 1/10 2026-02-24T18:28:19.405 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 2/10 2026-02-24T18:28:19.420 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-24T18:28:19.424 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-24T18:28:19.432 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-24T18:28:19.470 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-24T18:28:19.482 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-24T18:28:19.506 INFO:teuthology.orchestra.run.trial162.stdout:rbd-mirror-20.2.0-681.g36d388f2.el9.x86_64.rpm 637 kB/s | 2.9 MB 00:04 2026-02-24T18:28:19.507 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:19.507 INFO:teuthology.orchestra.run.trial162.stdout:Total 637 kB/s | 2.9 MB 00:04 2026-02-24T18:28:19.507 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T18:28:19.512 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T18:28:19.513 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T18:28:19.551 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T18:28:19.551 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T18:28:19.732 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T18:28:19.734 INFO:teuthology.orchestra.run.trial162.stdout: Installing : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:19.756 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:19.756 INFO:teuthology.orchestra.run.trial162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:28:19.756 INFO:teuthology.orchestra.run.trial162.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-24T18:28:19.756 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:28:19.756 INFO:teuthology.orchestra.run.trial162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:28:19.756 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:19.799 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-24T18:28:19.813 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-24T18:28:19.814 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-24T18:28:19.924 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-24T18:28:19.924 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 1/10 2026-02-24T18:28:19.925 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 2/10 2026-02-24T18:28:19.925 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 3/10 2026-02-24T18:28:19.925 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-24T18:28:19.925 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-24T18:28:19.925 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-24T18:28:19.925 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-24T18:28:19.925 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-24T18:28:19.925 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-24T18:28:19.985 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-24T18:28:19.985 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:19.985 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T18:28:19.985 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:28:19.985 INFO:teuthology.orchestra.run.trial070.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-24T18:28:19.985 INFO:teuthology.orchestra.run.trial070.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-24T18:28:19.985 INFO:teuthology.orchestra.run.trial070.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-24T18:28:19.986 INFO:teuthology.orchestra.run.trial070.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-24T18:28:19.986 INFO:teuthology.orchestra.run.trial070.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-24T18:28:19.986 INFO:teuthology.orchestra.run.trial070.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-24T18:28:19.986 INFO:teuthology.orchestra.run.trial070.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-24T18:28:19.986 INFO:teuthology.orchestra.run.trial070.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-24T18:28:19.986 INFO:teuthology.orchestra.run.trial070.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-24T18:28:19.986 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:19.986 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:28:20.015 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-mgr-cephadm 2026-02-24T18:28:20.060 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:20.061 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:20.061 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T18:28:20.061 INFO:teuthology.orchestra.run.trial162.stdout: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:20.061 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:20.061 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:28:20.091 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install rbd-nbd 2026-02-24T18:28:20.331 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:02:15 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:20.412 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:02:12 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:28:20.415 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:28:20.416 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:20.416 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repository Size 2026-02-24T18:28:20.416 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:20.417 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T18:28:20.417 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 173 k 2026-02-24T18:28:20.417 INFO:teuthology.orchestra.run.trial070.stdout:Installing dependencies: 2026-02-24T18:28:20.417 INFO:teuthology.orchestra.run.trial070.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-24T18:28:20.417 INFO:teuthology.orchestra.run.trial070.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-24T18:28:20.417 INFO:teuthology.orchestra.run.trial070.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-24T18:28:20.417 INFO:teuthology.orchestra.run.trial070.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-24T18:28:20.417 INFO:teuthology.orchestra.run.trial070.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-24T18:28:20.417 INFO:teuthology.orchestra.run.trial070.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-24T18:28:20.417 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:20.418 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T18:28:20.418 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:20.418 INFO:teuthology.orchestra.run.trial070.stdout:Install 7 Packages 2026-02-24T18:28:20.418 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:20.418 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 7.1 M 2026-02-24T18:28:20.418 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 33 M 2026-02-24T18:28:20.418 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T18:28:20.498 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:28:20.499 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:28:20.499 INFO:teuthology.orchestra.run.trial162.stdout: Package Architecture Version Repository Size 2026-02-24T18:28:20.499 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:28:20.499 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T18:28:20.499 INFO:teuthology.orchestra.run.trial162.stdout: rbd-nbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 180 k 2026-02-24T18:28:20.499 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:20.499 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T18:28:20.500 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:28:20.500 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T18:28:20.500 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:20.500 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 180 k 2026-02-24T18:28:20.500 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 498 k 2026-02-24T18:28:20.500 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T18:28:20.723 INFO:teuthology.orchestra.run.trial103.stdout:rbd-mirror-20.2.0-681.g36d388f2.el9.x86_64.rpm 1.7 MB/s | 2.9 MB 00:01 2026-02-24T18:28:20.723 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:20.723 INFO:teuthology.orchestra.run.trial103.stdout:Total 1.7 MB/s | 2.9 MB 00:01 2026-02-24T18:28:20.724 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T18:28:20.729 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T18:28:20.729 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T18:28:20.767 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T18:28:20.767 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T18:28:20.950 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T18:28:20.950 INFO:teuthology.orchestra.run.trial162.stdout:rbd-nbd-20.2.0-681.g36d388f2.el9.x86_64.rpm 398 kB/s | 180 kB 00:00 2026-02-24T18:28:20.951 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:20.951 INFO:teuthology.orchestra.run.trial162.stdout:Total 397 kB/s | 180 kB 00:00 2026-02-24T18:28:20.951 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T18:28:20.952 INFO:teuthology.orchestra.run.trial103.stdout: Installing : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:20.956 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T18:28:20.956 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T18:28:20.974 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:20.974 INFO:teuthology.orchestra.run.trial103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:28:20.975 INFO:teuthology.orchestra.run.trial103.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-24T18:28:20.975 INFO:teuthology.orchestra.run.trial103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:28:20.975 INFO:teuthology.orchestra.run.trial103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:28:20.975 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:20.986 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T18:28:20.986 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T18:28:20.998 INFO:teuthology.orchestra.run.trial070.stdout:(1/7): ceph-mgr-cephadm-20.2.0-681.g36d388f2.el 390 kB/s | 173 kB 00:00 2026-02-24T18:28:21.043 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T18:28:21.061 INFO:teuthology.orchestra.run.trial162.stdout: Installing : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:21.146 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:21.208 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:21.208 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:21.208 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T18:28:21.208 INFO:teuthology.orchestra.run.trial162.stdout: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:21.208 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:21.208 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:28:21.237 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-base-debuginfo 2026-02-24T18:28:21.312 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:21.312 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:21.312 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T18:28:21.313 INFO:teuthology.orchestra.run.trial103.stdout: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:21.313 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:21.313 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:28:21.326 INFO:teuthology.orchestra.run.trial070.stdout:(2/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 322 kB/s | 249 kB 00:00 2026-02-24T18:28:21.342 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install rbd-nbd 2026-02-24T18:28:21.361 INFO:teuthology.orchestra.run.trial070.stdout:(3/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 16 MB/s | 548 kB 00:00 2026-02-24T18:28:21.364 INFO:teuthology.orchestra.run.trial070.stdout:(4/7): python3-natsort-7.1.1-5.el9.noarch.rpm 17 MB/s | 58 kB 00:00 2026-02-24T18:28:21.367 INFO:teuthology.orchestra.run.trial070.stdout:(5/7): python3-typing-extensions-4.15.0-1.el9.n 26 MB/s | 86 kB 00:00 2026-02-24T18:28:21.556 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:02:13 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:28:21.565 INFO:teuthology.orchestra.run.trial070.stdout:(6/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 61 kB/s | 35 kB 00:00 2026-02-24T18:28:21.643 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:28:21.643 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:28:21.644 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-24T18:28:21.644 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:28:21.644 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T18:28:21.644 INFO:teuthology.orchestra.run.trial162.stdout: ceph-base-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 107 M 2026-02-24T18:28:21.644 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:21.644 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T18:28:21.644 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:28:21.644 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T18:28:21.645 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:28:21.645 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 107 M 2026-02-24T18:28:21.645 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 664 M 2026-02-24T18:28:21.645 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T18:28:21.666 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:02:08 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:28:21.684 INFO:teuthology.orchestra.run.trial070.stdout:(7/7): python3-babel-2.9.1-2.el9.noarch.rpm 5.3 MB/s | 6.0 MB 00:01 2026-02-24T18:28:21.685 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:21.685 INFO:teuthology.orchestra.run.trial070.stdout:Total 5.6 MB/s | 7.1 MB 00:01 2026-02-24T18:28:21.724 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T18:28:21.731 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T18:28:21.731 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T18:28:21.750 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:28:21.751 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:21.752 INFO:teuthology.orchestra.run.trial103.stdout: Package Architecture Version Repository Size 2026-02-24T18:28:21.752 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:21.752 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T18:28:21.752 INFO:teuthology.orchestra.run.trial103.stdout: rbd-nbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 180 k 2026-02-24T18:28:21.752 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:21.752 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T18:28:21.752 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:21.752 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T18:28:21.752 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:21.752 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 180 k 2026-02-24T18:28:21.752 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 498 k 2026-02-24T18:28:21.753 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T18:28:21.804 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T18:28:21.804 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T18:28:21.894 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T18:28:21.943 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-24T18:28:21.952 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-24T18:28:21.957 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-24T18:28:21.961 INFO:teuthology.orchestra.run.trial026.stdout:(12/12): ceph-mgr-diskprediction-local-20.2.0-6 1.1 MB/s | 7.4 MB 00:06 2026-02-24T18:28:21.963 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:21.964 INFO:teuthology.orchestra.run.trial026.stdout:Total 6.3 MB/s | 43 MB 00:06 2026-02-24T18:28:22.125 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T18:28:22.139 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T18:28:22.140 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T18:28:22.178 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-24T18:28:22.200 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-24T18:28:22.219 INFO:teuthology.orchestra.run.trial103.stdout:rbd-nbd-20.2.0-681.g36d388f2.el9.x86_64.rpm 384 kB/s | 180 kB 00:00 2026-02-24T18:28:22.219 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:22.220 INFO:teuthology.orchestra.run.trial103.stdout:Total 384 kB/s | 180 kB 00:00 2026-02-24T18:28:22.220 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T18:28:22.224 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-24T18:28:22.225 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T18:28:22.226 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T18:28:22.226 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-24T18:28:22.255 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T18:28:22.256 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T18:28:22.312 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T18:28:22.329 INFO:teuthology.orchestra.run.trial103.stdout: Installing : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:22.339 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-24T18:28:22.339 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/7 2026-02-24T18:28:22.340 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-24T18:28:22.340 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-24T18:28:22.340 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-24T18:28:22.340 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-24T18:28:22.340 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-24T18:28:22.341 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T18:28:22.342 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T18:28:22.401 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-24T18:28:22.401 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:22.401 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T18:28:22.401 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:28:22.402 INFO:teuthology.orchestra.run.trial070.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-24T18:28:22.402 INFO:teuthology.orchestra.run.trial070.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-24T18:28:22.402 INFO:teuthology.orchestra.run.trial070.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-24T18:28:22.402 INFO:teuthology.orchestra.run.trial070.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-24T18:28:22.402 INFO:teuthology.orchestra.run.trial070.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-24T18:28:22.402 INFO:teuthology.orchestra.run.trial070.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-24T18:28:22.403 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:22.403 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:28:22.420 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:22.432 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-fuse 2026-02-24T18:28:22.483 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:22.483 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:22.483 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T18:28:22.483 INFO:teuthology.orchestra.run.trial103.stdout: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:22.483 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:22.483 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:28:22.514 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install ceph-base-debuginfo 2026-02-24T18:28:22.559 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T18:28:22.561 INFO:teuthology.orchestra.run.trial026.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 1/12 2026-02-24T18:28:22.568 INFO:teuthology.orchestra.run.trial026.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-24T18:28:22.601 INFO:teuthology.orchestra.run.trial026.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-24T18:28:22.606 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-devel-3.9.25-3.el9.x86_64 4/12 2026-02-24T18:28:22.665 INFO:teuthology.orchestra.run.trial026.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-24T18:28:22.667 INFO:teuthology.orchestra.run.trial026.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-24T18:28:22.688 INFO:teuthology.orchestra.run.trial026.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 7/12 2026-02-24T18:28:22.746 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:02:17 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:22.828 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:02:09 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:28:22.831 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:28:22.831 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:22.832 INFO:teuthology.orchestra.run.trial070.stdout: Package Architecture Version Repository Size 2026-02-24T18:28:22.832 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:22.832 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T18:28:22.832 INFO:teuthology.orchestra.run.trial070.stdout: ceph-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 942 k 2026-02-24T18:28:22.832 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:22.832 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T18:28:22.832 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:22.832 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T18:28:22.832 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:22.832 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 942 k 2026-02-24T18:28:22.832 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 2.7 M 2026-02-24T18:28:22.833 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T18:28:22.911 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:28:22.912 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:22.912 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repo Size 2026-02-24T18:28:22.912 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:22.912 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T18:28:22.912 INFO:teuthology.orchestra.run.trial103.stdout: ceph-base-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 107 M 2026-02-24T18:28:22.912 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:22.912 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T18:28:22.912 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:28:22.912 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T18:28:22.913 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:28:22.913 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 107 M 2026-02-24T18:28:22.913 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 664 M 2026-02-24T18:28:22.913 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T18:28:23.005 INFO:teuthology.orchestra.run.trial026.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 8/12 2026-02-24T18:28:23.076 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-24T18:28:23.731 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-24T18:28:24.184 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-24T18:28:24.185 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-24T18:28:24.492 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 12/12 2026-02-24T18:28:24.493 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388 1/12 2026-02-24T18:28:24.493 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-24T18:28:24.493 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-24T18:28:24.493 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 4/12 2026-02-24T18:28:24.493 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 5/12 2026-02-24T18:28:24.493 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 6/12 2026-02-24T18:28:24.493 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-24T18:28:24.493 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-24T18:28:24.493 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-devel-3.9.25-3.el9.x86_64 9/12 2026-02-24T18:28:24.493 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-24T18:28:24.494 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-24T18:28:24.556 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-24T18:28:24.556 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:24.556 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T18:28:24.556 INFO:teuthology.orchestra.run.trial026.stdout: ceph-mgr-diskprediction-local-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:28:24.556 INFO:teuthology.orchestra.run.trial026.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-24T18:28:24.556 INFO:teuthology.orchestra.run.trial026.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-24T18:28:24.556 INFO:teuthology.orchestra.run.trial026.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-24T18:28:24.556 INFO:teuthology.orchestra.run.trial026.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-24T18:28:24.556 INFO:teuthology.orchestra.run.trial026.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-24T18:28:24.556 INFO:teuthology.orchestra.run.trial026.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-24T18:28:24.556 INFO:teuthology.orchestra.run.trial026.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-24T18:28:24.556 INFO:teuthology.orchestra.run.trial026.stdout: python3-devel-3.9.25-3.el9.x86_64 2026-02-24T18:28:24.556 INFO:teuthology.orchestra.run.trial026.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-24T18:28:24.556 INFO:teuthology.orchestra.run.trial026.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-24T18:28:24.556 INFO:teuthology.orchestra.run.trial026.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-24T18:28:24.556 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:24.556 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:28:24.592 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install ceph-mgr-rook 2026-02-24T18:28:24.661 INFO:teuthology.orchestra.run.trial070.stdout:ceph-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 515 kB/s | 942 kB 00:01 2026-02-24T18:28:24.662 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:24.662 INFO:teuthology.orchestra.run.trial070.stdout:Total 515 kB/s | 942 kB 00:01 2026-02-24T18:28:24.662 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T18:28:24.666 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T18:28:24.666 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T18:28:24.698 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T18:28:24.699 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T18:28:24.787 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T18:28:24.805 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:24.906 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:02:12 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:28:24.991 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:28:24.992 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:24.993 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repository Size 2026-02-24T18:28:24.993 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:24.993 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T18:28:24.993 INFO:teuthology.orchestra.run.trial026.stdout: ceph-mgr-rook noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 50 k 2026-02-24T18:28:24.993 INFO:teuthology.orchestra.run.trial026.stdout:Installing dependencies: 2026-02-24T18:28:24.994 INFO:teuthology.orchestra.run.trial026.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-24T18:28:24.994 INFO:teuthology.orchestra.run.trial026.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-24T18:28:24.994 INFO:teuthology.orchestra.run.trial026.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-24T18:28:24.994 INFO:teuthology.orchestra.run.trial026.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-24T18:28:24.994 INFO:teuthology.orchestra.run.trial026.stdout: python3-pyasn1 noarch 0.4.8-7.el9 appstream 157 k 2026-02-24T18:28:24.994 INFO:teuthology.orchestra.run.trial026.stdout: python3-pyasn1-modules noarch 0.4.8-7.el9 appstream 277 k 2026-02-24T18:28:24.995 INFO:teuthology.orchestra.run.trial026.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-24T18:28:24.995 INFO:teuthology.orchestra.run.trial026.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-24T18:28:24.995 INFO:teuthology.orchestra.run.trial026.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-24T18:28:24.995 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:24.995 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T18:28:24.995 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:24.996 INFO:teuthology.orchestra.run.trial026.stdout:Install 10 Packages 2026-02-24T18:28:24.996 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:24.996 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 2.0 M 2026-02-24T18:28:24.996 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 25 M 2026-02-24T18:28:24.996 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T18:28:25.032 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:25.094 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:25.094 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:25.095 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T18:28:25.095 INFO:teuthology.orchestra.run.trial070.stdout: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:25.095 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:25.095 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:28:25.123 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-volume 2026-02-24T18:28:25.438 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:02:20 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:25.522 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:28:25.523 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:25.523 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repository Size 2026-02-24T18:28:25.523 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:25.523 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T18:28:25.523 INFO:teuthology.orchestra.run.trial070.stdout: ceph-volume noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 297 k 2026-02-24T18:28:25.523 INFO:teuthology.orchestra.run.trial070.stdout:Installing dependencies: 2026-02-24T18:28:25.523 INFO:teuthology.orchestra.run.trial070.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-24T18:28:25.523 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:25.523 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T18:28:25.524 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:25.524 INFO:teuthology.orchestra.run.trial070.stdout:Install 2 Packages 2026-02-24T18:28:25.524 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:25.524 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 648 k 2026-02-24T18:28:25.524 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 2.2 M 2026-02-24T18:28:25.524 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T18:28:25.866 INFO:teuthology.orchestra.run.trial026.stdout:(1/10): ceph-mgr-rook-20.2.0-681.g36d388f2.el9. 122 kB/s | 50 kB 00:00 2026-02-24T18:28:25.900 INFO:teuthology.orchestra.run.trial026.stdout:(2/10): python3-pyasn1-0.4.8-7.el9.noarch.rpm 354 kB/s | 157 kB 00:00 2026-02-24T18:28:25.970 INFO:teuthology.orchestra.run.trial026.stdout:(3/10): python3-pyasn1-modules-0.4.8-7.el9.noar 539 kB/s | 277 kB 00:00 2026-02-24T18:28:25.997 INFO:teuthology.orchestra.run.trial026.stdout:(4/10): python3-cachetools-4.2.4-1.el9.noarch.r 333 kB/s | 32 kB 00:00 2026-02-24T18:28:26.054 INFO:teuthology.orchestra.run.trial026.stdout:(5/10): python3-certifi-2023.05.07-4.el9.noarch 168 kB/s | 14 kB 00:00 2026-02-24T18:28:26.126 INFO:teuthology.orchestra.run.trial026.stdout:(6/10): python3-google-auth-2.45.0-1.el9.noarch 1.9 MB/s | 254 kB 00:00 2026-02-24T18:28:26.160 INFO:teuthology.orchestra.run.trial026.stdout:(7/10): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2026-02-24T18:28:26.192 INFO:teuthology.orchestra.run.trial026.stdout:(8/10): python3-requests-oauthlib-1.3.0-12.el9. 165 kB/s | 54 kB 00:00 2026-02-24T18:28:26.195 INFO:teuthology.orchestra.run.trial026.stdout:(9/10): python3-websocket-client-1.2.3-2.el9.no 2.5 MB/s | 90 kB 00:00 2026-02-24T18:28:26.224 INFO:teuthology.orchestra.run.trial026.stdout:(10/10): python3-kubernetes-26.1.0-3.el9.noarch 6.0 MB/s | 1.0 MB 00:00 2026-02-24T18:28:26.224 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:26.224 INFO:teuthology.orchestra.run.trial026.stdout:Total 1.6 MB/s | 2.0 MB 00:01 2026-02-24T18:28:26.250 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T18:28:26.258 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T18:28:26.258 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T18:28:26.298 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T18:28:26.298 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T18:28:26.372 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T18:28:26.421 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-pyasn1-0.4.8-7.el9.noarch 1/10 2026-02-24T18:28:26.424 INFO:teuthology.orchestra.run.trial070.stdout:(1/2): cryptsetup-2.8.1-3.el9.x86_64.rpm 435 kB/s | 351 kB 00:00 2026-02-24T18:28:26.433 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-pyasn1-modules-0.4.8-7.el9.noarch 2/10 2026-02-24T18:28:26.435 INFO:teuthology.orchestra.run.trial070.stdout:(2/2): ceph-volume-20.2.0-681.g36d388f2.el9.noa 364 kB/s | 297 kB 00:00 2026-02-24T18:28:26.436 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:26.436 INFO:teuthology.orchestra.run.trial070.stdout:Total 710 kB/s | 648 kB 00:00 2026-02-24T18:28:26.445 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T18:28:26.448 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-24T18:28:26.451 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T18:28:26.451 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T18:28:26.452 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-24T18:28:26.460 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-24T18:28:26.494 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T18:28:26.494 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T18:28:26.498 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-24T18:28:26.510 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-24T18:28:26.573 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T18:28:26.635 INFO:teuthology.orchestra.run.trial070.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 1/2 2026-02-24T18:28:26.637 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-24T18:28:26.652 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-24T18:28:26.652 INFO:teuthology.orchestra.run.trial070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:28:26.652 INFO:teuthology.orchestra.run.trial070.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-24T18:28:26.652 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:26.823 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-24T18:28:26.837 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-24T18:28:26.838 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-24T18:28:26.877 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 1/2 2026-02-24T18:28:26.940 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 2/2 2026-02-24T18:28:26.940 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:26.941 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T18:28:26.941 INFO:teuthology.orchestra.run.trial070.stdout: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch cryptsetup-2.8.1-3.el9.x86_64 2026-02-24T18:28:26.941 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:26.941 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:28:26.953 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 10/10 2026-02-24T18:28:26.953 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 1/10 2026-02-24T18:28:26.953 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-pyasn1-0.4.8-7.el9.noarch 2/10 2026-02-24T18:28:26.953 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-pyasn1-modules-0.4.8-7.el9.noarch 3/10 2026-02-24T18:28:26.953 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-24T18:28:26.953 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-24T18:28:26.953 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-24T18:28:26.953 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-24T18:28:26.953 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-24T18:28:26.953 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-24T18:28:26.970 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install librados-devel 2026-02-24T18:28:27.015 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-24T18:28:27.015 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:27.016 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T18:28:27.016 INFO:teuthology.orchestra.run.trial026.stdout: ceph-mgr-rook-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:28:27.016 INFO:teuthology.orchestra.run.trial026.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-24T18:28:27.016 INFO:teuthology.orchestra.run.trial026.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-24T18:28:27.016 INFO:teuthology.orchestra.run.trial026.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-24T18:28:27.016 INFO:teuthology.orchestra.run.trial026.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-24T18:28:27.016 INFO:teuthology.orchestra.run.trial026.stdout: python3-pyasn1-0.4.8-7.el9.noarch 2026-02-24T18:28:27.016 INFO:teuthology.orchestra.run.trial026.stdout: python3-pyasn1-modules-0.4.8-7.el9.noarch 2026-02-24T18:28:27.016 INFO:teuthology.orchestra.run.trial026.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-24T18:28:27.016 INFO:teuthology.orchestra.run.trial026.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-24T18:28:27.017 INFO:teuthology.orchestra.run.trial026.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-24T18:28:27.017 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:27.017 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:28:27.045 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install ceph-mgr-cephadm 2026-02-24T18:28:27.287 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:02:22 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:27.366 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:02:15 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:28:27.371 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:28:27.372 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:27.372 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-24T18:28:27.372 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:27.372 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T18:28:27.372 INFO:teuthology.orchestra.run.trial070.stdout: librados-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 126 k 2026-02-24T18:28:27.372 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:27.372 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T18:28:27.373 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:27.373 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T18:28:27.373 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:27.373 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 126 k 2026-02-24T18:28:27.373 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 449 k 2026-02-24T18:28:27.373 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T18:28:27.450 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:28:27.451 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:27.451 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repository Size 2026-02-24T18:28:27.451 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:27.451 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T18:28:27.451 INFO:teuthology.orchestra.run.trial026.stdout: ceph-mgr-cephadm noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 173 k 2026-02-24T18:28:27.452 INFO:teuthology.orchestra.run.trial026.stdout:Installing dependencies: 2026-02-24T18:28:27.452 INFO:teuthology.orchestra.run.trial026.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-24T18:28:27.452 INFO:teuthology.orchestra.run.trial026.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-24T18:28:27.452 INFO:teuthology.orchestra.run.trial026.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-24T18:28:27.452 INFO:teuthology.orchestra.run.trial026.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-24T18:28:27.452 INFO:teuthology.orchestra.run.trial026.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-24T18:28:27.452 INFO:teuthology.orchestra.run.trial026.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-24T18:28:27.452 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:27.452 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T18:28:27.452 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:27.452 INFO:teuthology.orchestra.run.trial026.stdout:Install 7 Packages 2026-02-24T18:28:27.453 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:27.453 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 7.1 M 2026-02-24T18:28:27.453 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 33 M 2026-02-24T18:28:27.453 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T18:28:27.740 INFO:teuthology.orchestra.run.trial026.stdout:(1/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 1.6 MB/s | 249 kB 00:00 2026-02-24T18:28:27.767 INFO:teuthology.orchestra.run.trial026.stdout:(2/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 1.3 MB/s | 35 kB 00:00 2026-02-24T18:28:27.865 INFO:teuthology.orchestra.run.trial026.stdout:(3/7): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 6.0 MB 00:00 2026-02-24T18:28:27.926 INFO:teuthology.orchestra.run.trial070.stdout:librados-devel-20.2.0-681.g36d388f2.el9.x86_64. 227 kB/s | 126 kB 00:00 2026-02-24T18:28:27.926 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:27.926 INFO:teuthology.orchestra.run.trial070.stdout:Total 227 kB/s | 126 kB 00:00 2026-02-24T18:28:27.927 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T18:28:27.929 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T18:28:27.929 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T18:28:27.960 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T18:28:27.960 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T18:28:28.016 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T18:28:28.022 INFO:teuthology.orchestra.run.trial026.stdout:(4/7): python3-natsort-7.1.1-5.el9.noarch.rpm 367 kB/s | 58 kB 00:00 2026-02-24T18:28:28.033 INFO:teuthology.orchestra.run.trial070.stdout: Installing : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:28.033 INFO:teuthology.orchestra.run.trial026.stdout:(5/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.0 MB/s | 548 kB 00:00 2026-02-24T18:28:28.084 INFO:teuthology.orchestra.run.trial026.stdout:(6/7): python3-typing-extensions-4.15.0-1.el9.n 1.4 MB/s | 86 kB 00:00 2026-02-24T18:28:28.119 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:28.180 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:28.180 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:28.180 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T18:28:28.181 INFO:teuthology.orchestra.run.trial070.stdout: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:28.181 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:28.181 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:28:28.205 INFO:teuthology.orchestra.run.trial026.stdout:(7/7): ceph-mgr-cephadm-20.2.0-681.g36d388f2.el 278 kB/s | 173 kB 00:00 2026-02-24T18:28:28.207 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:28.207 INFO:teuthology.orchestra.run.trial026.stdout:Total 9.4 MB/s | 7.1 MB 00:00 2026-02-24T18:28:28.209 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install libcephfs2 2026-02-24T18:28:28.248 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T18:28:28.255 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T18:28:28.255 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T18:28:28.326 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T18:28:28.326 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T18:28:28.417 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T18:28:28.465 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-24T18:28:28.475 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-24T18:28:28.480 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-24T18:28:28.521 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:02:23 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:28.587 INFO:teuthology.orchestra.run.trial070.stdout:Package libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:28.605 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:28:28.605 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-24T18:28:28.606 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:28:28.628 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install libcephfs-devel 2026-02-24T18:28:28.699 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-24T18:28:28.721 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-24T18:28:28.745 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-24T18:28:28.747 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-24T18:28:28.859 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 7/7 2026-02-24T18:28:28.859 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 1/7 2026-02-24T18:28:28.859 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-24T18:28:28.860 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-24T18:28:28.860 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-24T18:28:28.860 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-24T18:28:28.860 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-24T18:28:28.922 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-24T18:28:28.922 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:28.922 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T18:28:28.922 INFO:teuthology.orchestra.run.trial026.stdout: ceph-mgr-cephadm-2:20.2.0-681.g36d388f2.el9.noarch 2026-02-24T18:28:28.922 INFO:teuthology.orchestra.run.trial026.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-24T18:28:28.923 INFO:teuthology.orchestra.run.trial026.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-24T18:28:28.923 INFO:teuthology.orchestra.run.trial026.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-24T18:28:28.923 INFO:teuthology.orchestra.run.trial026.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-24T18:28:28.923 INFO:teuthology.orchestra.run.trial026.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-24T18:28:28.923 INFO:teuthology.orchestra.run.trial026.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-24T18:28:28.923 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:28.923 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:28:28.942 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:02:23 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:28.956 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install ceph-fuse 2026-02-24T18:28:29.026 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:28:29.027 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:29.028 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-24T18:28:29.028 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:29.028 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T18:28:29.028 INFO:teuthology.orchestra.run.trial070.stdout: libcephfs-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 34 k 2026-02-24T18:28:29.028 INFO:teuthology.orchestra.run.trial070.stdout:Installing dependencies: 2026-02-24T18:28:29.028 INFO:teuthology.orchestra.run.trial070.stdout: libcephfs-proxy2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 k 2026-02-24T18:28:29.028 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:29.028 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T18:28:29.028 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:29.028 INFO:teuthology.orchestra.run.trial070.stdout:Install 2 Packages 2026-02-24T18:28:29.028 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:29.029 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 58 k 2026-02-24T18:28:29.029 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 207 k 2026-02-24T18:28:29.029 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T18:28:29.275 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:02:17 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:28:29.358 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:28:29.358 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:29.358 INFO:teuthology.orchestra.run.trial026.stdout: Package Architecture Version Repository Size 2026-02-24T18:28:29.358 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:29.358 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T18:28:29.358 INFO:teuthology.orchestra.run.trial026.stdout: ceph-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 942 k 2026-02-24T18:28:29.359 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:29.359 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T18:28:29.359 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:29.359 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T18:28:29.359 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:29.359 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 942 k 2026-02-24T18:28:29.359 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 2.7 M 2026-02-24T18:28:29.359 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T18:28:29.382 INFO:teuthology.orchestra.run.trial070.stdout:(1/2): libcephfs-devel-20.2.0-681.g36d388f2.el9 97 kB/s | 34 kB 00:00 2026-02-24T18:28:29.553 INFO:teuthology.orchestra.run.trial070.stdout:(2/2): libcephfs-proxy2-20.2.0-681.g36d388f2.el 46 kB/s | 24 kB 00:00 2026-02-24T18:28:29.554 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:29.554 INFO:teuthology.orchestra.run.trial070.stdout:Total 111 kB/s | 58 kB 00:00 2026-02-24T18:28:29.554 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T18:28:29.557 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T18:28:29.557 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T18:28:29.588 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T18:28:29.589 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T18:28:29.637 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T18:28:29.638 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:28:29.653 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:28:29.670 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:28:29.728 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:28:29.728 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:28:29.788 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:28:29.788 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:29.789 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T18:28:29.789 INFO:teuthology.orchestra.run.trial070.stdout: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:29.789 INFO:teuthology.orchestra.run.trial070.stdout: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:29.789 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:29.789 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:28:29.815 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install librados2 2026-02-24T18:28:30.135 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:02:25 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:30.201 INFO:teuthology.orchestra.run.trial070.stdout:Package librados2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:30.220 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:28:30.221 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-24T18:28:30.221 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:28:30.241 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install librbd1 2026-02-24T18:28:30.556 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:02:25 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:30.623 INFO:teuthology.orchestra.run.trial070.stdout:Package librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:30.641 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:28:30.642 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-24T18:28:30.642 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:28:30.663 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install python3-rados 2026-02-24T18:28:30.876 INFO:teuthology.orchestra.run.trial026.stdout:ceph-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 621 kB/s | 942 kB 00:01 2026-02-24T18:28:30.877 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:30.877 INFO:teuthology.orchestra.run.trial026.stdout:Total 621 kB/s | 942 kB 00:01 2026-02-24T18:28:30.878 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T18:28:30.882 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T18:28:30.882 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T18:28:30.915 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T18:28:30.915 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T18:28:30.979 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:02:25 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:31.004 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T18:28:31.022 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:31.044 INFO:teuthology.orchestra.run.trial070.stdout:Package python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:31.063 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:28:31.064 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-24T18:28:31.064 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:28:31.085 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install python3-rgw 2026-02-24T18:28:31.247 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:31.309 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:31.310 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:31.310 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T18:28:31.310 INFO:teuthology.orchestra.run.trial026.stdout: ceph-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:31.310 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:31.310 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:28:31.338 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install ceph-volume 2026-02-24T18:28:31.399 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:02:26 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:31.465 INFO:teuthology.orchestra.run.trial070.stdout:Package python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:31.483 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:28:31.484 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-24T18:28:31.484 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:28:31.505 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install python3-cephfs 2026-02-24T18:28:31.659 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:02:19 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:28:31.744 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:28:31.744 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:31.744 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repository Size 2026-02-24T18:28:31.745 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:31.745 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T18:28:31.745 INFO:teuthology.orchestra.run.trial026.stdout: ceph-volume noarch 2:20.2.0-681.g36d388f2.el9 ceph-noarch 297 k 2026-02-24T18:28:31.745 INFO:teuthology.orchestra.run.trial026.stdout:Installing dependencies: 2026-02-24T18:28:31.745 INFO:teuthology.orchestra.run.trial026.stdout: cryptsetup x86_64 2.8.1-3.el9 baseos 351 k 2026-02-24T18:28:31.745 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:31.745 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T18:28:31.745 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:31.745 INFO:teuthology.orchestra.run.trial026.stdout:Install 2 Packages 2026-02-24T18:28:31.745 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:31.745 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 648 k 2026-02-24T18:28:31.746 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 2.2 M 2026-02-24T18:28:31.746 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T18:28:31.821 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:02:26 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:31.887 INFO:teuthology.orchestra.run.trial070.stdout:Package python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:31.906 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:28:31.906 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-24T18:28:31.906 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:28:31.928 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install python3-rbd 2026-02-24T18:28:32.240 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:02:27 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:32.304 INFO:teuthology.orchestra.run.trial070.stdout:Package python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:32.323 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:28:32.323 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-24T18:28:32.323 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:28:32.344 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install rbd-fuse 2026-02-24T18:28:32.540 INFO:teuthology.orchestra.run.trial026.stdout:(1/2): ceph-volume-20.2.0-681.g36d388f2.el9.noa 407 kB/s | 297 kB 00:00 2026-02-24T18:28:32.616 INFO:teuthology.orchestra.run.trial026.stdout:(2/2): cryptsetup-2.8.1-3.el9.x86_64.rpm 435 kB/s | 351 kB 00:00 2026-02-24T18:28:32.616 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:32.616 INFO:teuthology.orchestra.run.trial026.stdout:Total 743 kB/s | 648 kB 00:00 2026-02-24T18:28:32.625 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T18:28:32.631 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T18:28:32.631 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T18:28:32.657 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:02:27 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:32.674 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T18:28:32.674 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T18:28:32.741 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:28:32.742 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:32.742 INFO:teuthology.orchestra.run.trial070.stdout: Package Architecture Version Repository Size 2026-02-24T18:28:32.743 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:32.743 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T18:28:32.743 INFO:teuthology.orchestra.run.trial070.stdout: rbd-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 91 k 2026-02-24T18:28:32.743 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:32.743 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T18:28:32.743 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:32.743 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T18:28:32.743 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:32.743 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 91 k 2026-02-24T18:28:32.743 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 238 k 2026-02-24T18:28:32.744 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T18:28:32.755 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T18:28:32.816 INFO:teuthology.orchestra.run.trial026.stdout: Installing : cryptsetup-2.8.1-3.el9.x86_64 1/2 2026-02-24T18:28:32.818 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-24T18:28:32.834 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 2/2 2026-02-24T18:28:32.834 INFO:teuthology.orchestra.run.trial026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:28:32.834 INFO:teuthology.orchestra.run.trial026.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-24T18:28:32.834 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:33.072 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch 1/2 2026-02-24T18:28:33.134 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : cryptsetup-2.8.1-3.el9.x86_64 2/2 2026-02-24T18:28:33.134 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:33.134 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T18:28:33.134 INFO:teuthology.orchestra.run.trial026.stdout: ceph-volume-2:20.2.0-681.g36d388f2.el9.noarch cryptsetup-2.8.1-3.el9.x86_64 2026-02-24T18:28:33.134 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:33.135 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:28:33.163 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install librados-devel 2026-02-24T18:28:33.196 INFO:teuthology.orchestra.run.trial070.stdout:rbd-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 201 kB/s | 91 kB 00:00 2026-02-24T18:28:33.198 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:33.198 INFO:teuthology.orchestra.run.trial070.stdout:Total 200 kB/s | 91 kB 00:00 2026-02-24T18:28:33.198 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T18:28:33.203 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T18:28:33.203 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T18:28:33.233 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T18:28:33.233 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T18:28:33.284 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T18:28:33.301 INFO:teuthology.orchestra.run.trial070.stdout: Installing : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:33.388 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:33.452 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:33.453 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:33.453 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T18:28:33.453 INFO:teuthology.orchestra.run.trial070.stdout: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:33.453 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:33.453 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:28:33.481 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install rbd-mirror 2026-02-24T18:28:33.488 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:02:21 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:28:33.573 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:28:33.573 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:33.573 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repo Size 2026-02-24T18:28:33.573 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:33.574 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T18:28:33.574 INFO:teuthology.orchestra.run.trial026.stdout: librados-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 126 k 2026-02-24T18:28:33.574 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:33.574 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T18:28:33.574 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:33.574 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T18:28:33.574 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:33.574 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 126 k 2026-02-24T18:28:33.575 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 449 k 2026-02-24T18:28:33.575 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T18:28:33.802 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:02:28 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:33.885 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:28:33.886 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:33.886 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-24T18:28:33.886 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:33.886 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T18:28:33.886 INFO:teuthology.orchestra.run.trial070.stdout: rbd-mirror x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.9 M 2026-02-24T18:28:33.886 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:33.886 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T18:28:33.886 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:33.886 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T18:28:33.886 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:33.886 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 2.9 M 2026-02-24T18:28:33.886 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 11 M 2026-02-24T18:28:33.886 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T18:28:34.185 INFO:teuthology.orchestra.run.trial026.stdout:librados-devel-20.2.0-681.g36d388f2.el9.x86_64. 206 kB/s | 126 kB 00:00 2026-02-24T18:28:34.185 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:34.185 INFO:teuthology.orchestra.run.trial026.stdout:Total 205 kB/s | 126 kB 00:00 2026-02-24T18:28:34.185 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T18:28:34.188 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T18:28:34.188 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T18:28:34.218 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T18:28:34.219 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T18:28:34.273 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T18:28:34.290 INFO:teuthology.orchestra.run.trial026.stdout: Installing : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:34.377 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:34.439 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:34.440 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:34.440 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T18:28:34.440 INFO:teuthology.orchestra.run.trial026.stdout: librados-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:34.440 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:34.440 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:28:34.468 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install libcephfs2 2026-02-24T18:28:34.782 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:02:22 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:28:34.847 INFO:teuthology.orchestra.run.trial026.stdout:Package libcephfs2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:34.866 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:28:34.866 INFO:teuthology.orchestra.run.trial026.stdout:Nothing to do. 2026-02-24T18:28:34.866 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:28:34.889 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install libcephfs-devel 2026-02-24T18:28:35.210 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:02:23 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:28:35.294 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:28:35.294 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:35.294 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repo Size 2026-02-24T18:28:35.294 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:35.294 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T18:28:35.294 INFO:teuthology.orchestra.run.trial026.stdout: libcephfs-devel x86_64 2:20.2.0-681.g36d388f2.el9 ceph 34 k 2026-02-24T18:28:35.294 INFO:teuthology.orchestra.run.trial026.stdout:Installing dependencies: 2026-02-24T18:28:35.294 INFO:teuthology.orchestra.run.trial026.stdout: libcephfs-proxy2 x86_64 2:20.2.0-681.g36d388f2.el9 ceph 24 k 2026-02-24T18:28:35.294 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:35.294 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T18:28:35.295 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:35.295 INFO:teuthology.orchestra.run.trial026.stdout:Install 2 Packages 2026-02-24T18:28:35.295 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:35.295 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 58 k 2026-02-24T18:28:35.295 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 207 k 2026-02-24T18:28:35.295 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T18:28:35.650 INFO:teuthology.orchestra.run.trial026.stdout:(1/2): libcephfs-proxy2-20.2.0-681.g36d388f2.el 68 kB/s | 24 kB 00:00 2026-02-24T18:28:35.652 INFO:teuthology.orchestra.run.trial026.stdout:(2/2): libcephfs-devel-20.2.0-681.g36d388f2.el9 96 kB/s | 34 kB 00:00 2026-02-24T18:28:35.653 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:35.653 INFO:teuthology.orchestra.run.trial026.stdout:Total 163 kB/s | 58 kB 00:00 2026-02-24T18:28:35.653 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T18:28:35.657 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T18:28:35.657 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T18:28:35.688 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T18:28:35.688 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T18:28:35.738 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T18:28:35.738 INFO:teuthology.orchestra.run.trial026.stdout: Installing : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:28:35.752 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:28:35.770 INFO:teuthology.orchestra.run.trial026.stdout: Installing : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:28:35.832 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:28:35.833 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 1/2 2026-02-24T18:28:35.896 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2/2 2026-02-24T18:28:35.896 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:35.896 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T18:28:35.896 INFO:teuthology.orchestra.run.trial026.stdout: libcephfs-devel-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:35.896 INFO:teuthology.orchestra.run.trial026.stdout: libcephfs-proxy2-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:35.896 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:35.896 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:28:35.926 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install librados2 2026-02-24T18:28:36.246 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:02:24 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:28:36.311 INFO:teuthology.orchestra.run.trial026.stdout:Package librados2-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:36.330 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:28:36.330 INFO:teuthology.orchestra.run.trial026.stdout:Nothing to do. 2026-02-24T18:28:36.331 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:28:36.353 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install librbd1 2026-02-24T18:28:36.667 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:02:24 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:28:36.732 INFO:teuthology.orchestra.run.trial026.stdout:Package librbd1-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:36.750 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:28:36.751 INFO:teuthology.orchestra.run.trial026.stdout:Nothing to do. 2026-02-24T18:28:36.751 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:28:36.773 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install python3-rados 2026-02-24T18:28:36.961 INFO:teuthology.orchestra.run.trial070.stdout:rbd-mirror-20.2.0-681.g36d388f2.el9.x86_64.rpm 971 kB/s | 2.9 MB 00:03 2026-02-24T18:28:36.961 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:36.962 INFO:teuthology.orchestra.run.trial070.stdout:Total 970 kB/s | 2.9 MB 00:03 2026-02-24T18:28:36.962 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T18:28:36.967 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T18:28:36.967 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T18:28:37.005 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T18:28:37.005 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T18:28:37.097 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:02:25 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:28:37.166 INFO:teuthology.orchestra.run.trial026.stdout:Package python3-rados-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:37.184 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:28:37.185 INFO:teuthology.orchestra.run.trial026.stdout:Nothing to do. 2026-02-24T18:28:37.185 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:28:37.192 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T18:28:37.194 INFO:teuthology.orchestra.run.trial070.stdout: Installing : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:37.207 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install python3-rgw 2026-02-24T18:28:37.216 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:37.216 INFO:teuthology.orchestra.run.trial070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:28:37.216 INFO:teuthology.orchestra.run.trial070.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-24T18:28:37.216 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:28:37.216 INFO:teuthology.orchestra.run.trial070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:28:37.216 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:37.523 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:02:25 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:28:37.546 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:37.546 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:37.546 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T18:28:37.546 INFO:teuthology.orchestra.run.trial070.stdout: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:37.546 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:37.546 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:28:37.574 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install rbd-nbd 2026-02-24T18:28:37.588 INFO:teuthology.orchestra.run.trial026.stdout:Package python3-rgw-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:37.607 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:28:37.607 INFO:teuthology.orchestra.run.trial026.stdout:Nothing to do. 2026-02-24T18:28:37.607 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:28:37.629 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install python3-cephfs 2026-02-24T18:28:37.893 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:02:32 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:37.945 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:02:25 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:28:37.977 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:28:37.978 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:37.978 INFO:teuthology.orchestra.run.trial070.stdout: Package Architecture Version Repository Size 2026-02-24T18:28:37.978 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:37.978 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T18:28:37.978 INFO:teuthology.orchestra.run.trial070.stdout: rbd-nbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 180 k 2026-02-24T18:28:37.978 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:37.979 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T18:28:37.979 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:37.979 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T18:28:37.979 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:37.979 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 180 k 2026-02-24T18:28:37.979 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 498 k 2026-02-24T18:28:37.979 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T18:28:38.010 INFO:teuthology.orchestra.run.trial026.stdout:Package python3-cephfs-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:38.028 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:28:38.029 INFO:teuthology.orchestra.run.trial026.stdout:Nothing to do. 2026-02-24T18:28:38.029 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:28:38.052 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install python3-rbd 2026-02-24T18:28:38.368 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:02:26 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:28:38.419 INFO:teuthology.orchestra.run.trial070.stdout:rbd-nbd-20.2.0-681.g36d388f2.el9.x86_64.rpm 408 kB/s | 180 kB 00:00 2026-02-24T18:28:38.419 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:38.420 INFO:teuthology.orchestra.run.trial070.stdout:Total 407 kB/s | 180 kB 00:00 2026-02-24T18:28:38.420 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T18:28:38.424 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T18:28:38.424 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T18:28:38.433 INFO:teuthology.orchestra.run.trial026.stdout:Package python3-rbd-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T18:28:38.452 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:28:38.452 INFO:teuthology.orchestra.run.trial026.stdout:Nothing to do. 2026-02-24T18:28:38.453 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:28:38.454 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T18:28:38.455 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T18:28:38.474 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install rbd-fuse 2026-02-24T18:28:38.511 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T18:28:38.529 INFO:teuthology.orchestra.run.trial070.stdout: Installing : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:38.611 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:38.672 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:38.673 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:38.673 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T18:28:38.673 INFO:teuthology.orchestra.run.trial070.stdout: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:38.673 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:38.673 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:28:38.701 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-base-debuginfo 2026-02-24T18:28:38.792 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:02:26 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:28:38.876 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:28:38.876 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:38.877 INFO:teuthology.orchestra.run.trial026.stdout: Package Architecture Version Repository Size 2026-02-24T18:28:38.877 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:38.877 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T18:28:38.877 INFO:teuthology.orchestra.run.trial026.stdout: rbd-fuse x86_64 2:20.2.0-681.g36d388f2.el9 ceph 91 k 2026-02-24T18:28:38.877 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:38.877 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T18:28:38.877 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:38.877 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T18:28:38.877 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:38.877 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 91 k 2026-02-24T18:28:38.877 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 238 k 2026-02-24T18:28:38.878 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T18:28:39.021 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:02:34 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:28:39.106 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:28:39.106 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:39.107 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-24T18:28:39.107 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:39.107 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T18:28:39.107 INFO:teuthology.orchestra.run.trial070.stdout: ceph-base-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 107 M 2026-02-24T18:28:39.107 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:39.107 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T18:28:39.107 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:28:39.107 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T18:28:39.107 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:28:39.107 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 107 M 2026-02-24T18:28:39.107 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 664 M 2026-02-24T18:28:39.108 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T18:28:39.277 INFO:teuthology.orchestra.run.trial026.stdout:rbd-fuse-20.2.0-681.g36d388f2.el9.x86_64.rpm 228 kB/s | 91 kB 00:00 2026-02-24T18:28:39.277 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:39.278 INFO:teuthology.orchestra.run.trial026.stdout:Total 227 kB/s | 91 kB 00:00 2026-02-24T18:28:39.278 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T18:28:39.282 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T18:28:39.282 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T18:28:39.313 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T18:28:39.313 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T18:28:39.364 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T18:28:39.382 INFO:teuthology.orchestra.run.trial026.stdout: Installing : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:39.469 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:39.532 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:39.532 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:39.533 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T18:28:39.533 INFO:teuthology.orchestra.run.trial026.stdout: rbd-fuse-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:39.533 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:39.533 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:28:39.561 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install rbd-mirror 2026-02-24T18:28:39.877 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:02:27 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:28:39.962 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:28:39.962 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:39.962 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repo Size 2026-02-24T18:28:39.962 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:39.962 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T18:28:39.962 INFO:teuthology.orchestra.run.trial026.stdout: rbd-mirror x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.9 M 2026-02-24T18:28:39.962 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:39.962 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T18:28:39.963 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:39.963 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T18:28:39.963 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:39.963 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 2.9 M 2026-02-24T18:28:39.963 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 11 M 2026-02-24T18:28:39.963 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T18:28:42.268 INFO:teuthology.orchestra.run.trial026.stdout:rbd-mirror-20.2.0-681.g36d388f2.el9.x86_64.rpm 1.3 MB/s | 2.9 MB 00:02 2026-02-24T18:28:42.268 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:42.269 INFO:teuthology.orchestra.run.trial026.stdout:Total 1.3 MB/s | 2.9 MB 00:02 2026-02-24T18:28:42.269 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T18:28:42.275 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T18:28:42.275 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T18:28:42.313 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T18:28:42.314 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T18:28:42.502 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T18:28:42.503 INFO:teuthology.orchestra.run.trial026.stdout: Installing : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:42.526 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:42.526 INFO:teuthology.orchestra.run.trial026.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-24T18:28:42.526 INFO:teuthology.orchestra.run.trial026.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-24T18:28:42.526 INFO:teuthology.orchestra.run.trial026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:28:42.526 INFO:teuthology.orchestra.run.trial026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-24T18:28:42.526 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:42.875 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:42.875 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:42.875 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T18:28:42.875 INFO:teuthology.orchestra.run.trial026.stdout: rbd-mirror-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:42.875 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:42.875 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:28:42.903 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install rbd-nbd 2026-02-24T18:28:43.221 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:02:31 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:28:43.306 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:28:43.306 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:43.307 INFO:teuthology.orchestra.run.trial026.stdout: Package Architecture Version Repository Size 2026-02-24T18:28:43.307 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:43.307 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T18:28:43.307 INFO:teuthology.orchestra.run.trial026.stdout: rbd-nbd x86_64 2:20.2.0-681.g36d388f2.el9 ceph 180 k 2026-02-24T18:28:43.307 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:43.308 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T18:28:43.308 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:43.308 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T18:28:43.308 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:43.308 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 180 k 2026-02-24T18:28:43.308 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 498 k 2026-02-24T18:28:43.309 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T18:28:44.143 INFO:teuthology.orchestra.run.trial026.stdout:rbd-nbd-20.2.0-681.g36d388f2.el9.x86_64.rpm 215 kB/s | 180 kB 00:00 2026-02-24T18:28:44.143 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:28:44.143 INFO:teuthology.orchestra.run.trial026.stdout:Total 215 kB/s | 180 kB 00:00 2026-02-24T18:28:44.143 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T18:28:44.148 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T18:28:44.148 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T18:28:44.179 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T18:28:44.179 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T18:28:44.236 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T18:28:44.253 INFO:teuthology.orchestra.run.trial026.stdout: Installing : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:44.348 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:44.410 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T18:28:44.410 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:44.410 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T18:28:44.411 INFO:teuthology.orchestra.run.trial026.stdout: rbd-nbd-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:28:44.411 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:44.411 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:28:44.440 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install ceph-base-debuginfo 2026-02-24T18:28:44.761 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:02:32 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:28:44.845 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:28:44.845 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:44.846 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repo Size 2026-02-24T18:28:44.846 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:44.846 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T18:28:44.846 INFO:teuthology.orchestra.run.trial026.stdout: ceph-base-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 107 M 2026-02-24T18:28:44.846 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:44.846 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T18:28:44.846 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:28:44.846 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T18:28:44.846 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:28:44.846 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 107 M 2026-02-24T18:28:44.846 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 664 M 2026-02-24T18:28:44.847 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T18:29:12.872 INFO:teuthology.orchestra.run.trial103.stdout:ceph-base-debuginfo-20.2.0-681.g36d388f2.el9.x8 2.1 MB/s | 107 MB 00:49 2026-02-24T18:29:12.873 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:29:12.873 INFO:teuthology.orchestra.run.trial103.stdout:Total 2.1 MB/s | 107 MB 00:49 2026-02-24T18:29:12.874 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T18:29:12.876 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T18:29:12.876 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T18:29:13.213 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T18:29:13.214 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T18:29:17.514 INFO:teuthology.orchestra.run.trial070.stdout:ceph-base-debuginfo-20.2.0-681.g36d388f2.el9.x8 2.8 MB/s | 107 MB 00:38 2026-02-24T18:29:17.514 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:29:17.514 INFO:teuthology.orchestra.run.trial070.stdout:Total 2.8 MB/s | 107 MB 00:38 2026-02-24T18:29:17.515 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T18:29:17.517 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T18:29:17.517 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T18:29:17.852 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T18:29:17.853 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T18:29:18.334 INFO:teuthology.orchestra.run.trial162.stdout:ceph-base-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.9 MB/s | 107 MB 00:56 2026-02-24T18:29:18.334 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:29:18.334 INFO:teuthology.orchestra.run.trial162.stdout:Total 1.9 MB/s | 107 MB 00:56 2026-02-24T18:29:18.334 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T18:29:18.337 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T18:29:18.337 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T18:29:18.672 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T18:29:18.672 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T18:29:19.214 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T18:29:19.233 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:29:19.752 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:29:19.813 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:29:19.813 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:29:19.814 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T18:29:19.814 INFO:teuthology.orchestra.run.trial103.stdout: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:29:19.814 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:29:19.814 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:29:19.849 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install ceph-common-debuginfo 2026-02-24T18:29:20.165 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:03:07 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:29:20.251 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:29:20.251 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:29:20.252 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repo Size 2026-02-24T18:29:20.252 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:29:20.252 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T18:29:20.252 INFO:teuthology.orchestra.run.trial103.stdout: ceph-common-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 586 M 2026-02-24T18:29:20.252 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:29:20.252 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T18:29:20.252 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:29:20.252 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T18:29:20.252 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:29:20.252 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 586 M 2026-02-24T18:29:20.253 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 3.4 G 2026-02-24T18:29:20.253 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T18:29:23.744 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T18:29:23.763 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:29:24.324 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:29:24.385 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:29:24.385 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:29:24.385 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T18:29:24.385 INFO:teuthology.orchestra.run.trial070.stdout: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:29:24.385 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:29:24.385 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:29:24.422 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-common-debuginfo 2026-02-24T18:29:24.545 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T18:29:24.564 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:29:24.743 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:03:19 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:29:24.828 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:29:24.828 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:29:24.828 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-24T18:29:24.828 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:29:24.828 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T18:29:24.828 INFO:teuthology.orchestra.run.trial070.stdout: ceph-common-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 586 M 2026-02-24T18:29:24.828 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:29:24.829 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T18:29:24.829 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:29:24.829 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T18:29:24.829 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:29:24.829 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 586 M 2026-02-24T18:29:24.829 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 3.4 G 2026-02-24T18:29:24.829 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T18:29:25.098 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:29:25.160 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:29:25.160 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:29:25.160 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T18:29:25.160 INFO:teuthology.orchestra.run.trial162.stdout: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:29:25.160 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:29:25.160 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:29:25.197 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-common-debuginfo 2026-02-24T18:29:25.515 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:03:17 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:29:25.600 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:29:25.601 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:29:25.601 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-24T18:29:25.602 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:29:25.602 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T18:29:25.602 INFO:teuthology.orchestra.run.trial162.stdout: ceph-common-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 586 M 2026-02-24T18:29:25.602 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:29:25.602 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T18:29:25.602 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:29:25.602 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T18:29:25.602 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:29:25.602 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 586 M 2026-02-24T18:29:25.603 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 3.4 G 2026-02-24T18:29:25.603 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T18:30:02.196 INFO:teuthology.orchestra.run.trial026.stdout:ceph-base-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.4 MB/s | 107 MB 01:17 2026-02-24T18:30:02.197 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:30:02.198 INFO:teuthology.orchestra.run.trial026.stdout:Total 1.4 MB/s | 107 MB 01:17 2026-02-24T18:30:02.198 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T18:30:02.200 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T18:30:02.200 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T18:30:02.537 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T18:30:02.538 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T18:30:08.532 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T18:30:08.550 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:30:09.069 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:30:09.130 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T18:30:09.131 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:30:09.131 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T18:30:09.131 INFO:teuthology.orchestra.run.trial026.stdout: ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:30:09.131 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:30:09.131 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:30:09.166 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install ceph-common-debuginfo 2026-02-24T18:30:09.483 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:03:57 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:30:09.566 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:30:09.567 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:30:09.567 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repo Size 2026-02-24T18:30:09.567 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:30:09.567 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T18:30:09.567 INFO:teuthology.orchestra.run.trial026.stdout: ceph-common-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 586 M 2026-02-24T18:30:09.567 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:30:09.567 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T18:30:09.567 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:30:09.567 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T18:30:09.567 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:30:09.567 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 586 M 2026-02-24T18:30:09.567 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 3.4 G 2026-02-24T18:30:09.567 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T18:33:43.942 INFO:teuthology.orchestra.run.trial103.stdout:ceph-common-debuginfo-20.2.0-681.g36d388f2.el9. 2.2 MB/s | 586 MB 04:23 2026-02-24T18:33:43.948 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:33:43.948 INFO:teuthology.orchestra.run.trial103.stdout:Total 2.2 MB/s | 586 MB 04:23 2026-02-24T18:33:43.948 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T18:33:43.948 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T18:33:43.948 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T18:33:45.684 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T18:33:45.684 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T18:34:18.237 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T18:34:18.256 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:34:19.281 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:34:19.344 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:34:19.344 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:34:19.344 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T18:34:19.344 INFO:teuthology.orchestra.run.trial103.stdout: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:34:19.344 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:34:19.344 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:34:19.432 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-24T18:34:19.757 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:08:06 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:34:19.841 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:34:19.841 INFO:teuthology.orchestra.run.trial103.stdout:======================================================================================= 2026-02-24T18:34:19.841 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repo Size 2026-02-24T18:34:19.842 INFO:teuthology.orchestra.run.trial103.stdout:======================================================================================= 2026-02-24T18:34:19.842 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T18:34:19.842 INFO:teuthology.orchestra.run.trial103.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.0 M 2026-02-24T18:34:19.842 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:34:19.842 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T18:34:19.842 INFO:teuthology.orchestra.run.trial103.stdout:======================================================================================= 2026-02-24T18:34:19.842 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T18:34:19.842 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:34:19.842 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 3.0 M 2026-02-24T18:34:19.842 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 15 M 2026-02-24T18:34:19.843 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T18:34:22.122 INFO:teuthology.orchestra.run.trial103.stdout:ceph-immutable-object-cache-debuginfo-20.2.0-68 1.3 MB/s | 3.0 MB 00:02 2026-02-24T18:34:22.122 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:34:22.122 INFO:teuthology.orchestra.run.trial103.stdout:Total 1.3 MB/s | 3.0 MB 00:02 2026-02-24T18:34:22.123 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T18:34:22.124 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T18:34:22.124 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T18:34:22.150 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T18:34:22.150 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T18:34:22.338 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T18:34:22.355 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:34:22.425 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:34:22.487 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:34:22.487 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:34:22.488 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T18:34:22.488 INFO:teuthology.orchestra.run.trial103.stdout: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:34:22.488 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:34:22.488 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:34:22.515 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-24T18:34:22.834 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:08:09 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:34:22.920 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:34:22.920 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:34:22.920 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repo Size 2026-02-24T18:34:22.920 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:34:22.920 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T18:34:22.920 INFO:teuthology.orchestra.run.trial103.stdout: ceph-radosgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 543 M 2026-02-24T18:34:22.920 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:34:22.920 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T18:34:22.921 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:34:22.921 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T18:34:22.921 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:34:22.921 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 543 M 2026-02-24T18:34:22.921 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 0 2026-02-24T18:34:22.921 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T18:35:25.450 INFO:teuthology.orchestra.run.trial026.stdout:ceph-common-debuginfo-20.2.0-681.g36d388f2.el9. 1.9 MB/s | 586 MB 05:15 2026-02-24T18:35:25.450 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:35:25.450 INFO:teuthology.orchestra.run.trial026.stdout:Total 1.9 MB/s | 586 MB 05:15 2026-02-24T18:35:25.451 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T18:35:25.452 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T18:35:25.452 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T18:35:27.190 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T18:35:27.191 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T18:35:59.032 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T18:35:59.050 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:36:01.516 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:36:01.579 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:36:01.579 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:36:01.579 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T18:36:01.579 INFO:teuthology.orchestra.run.trial026.stdout: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:36:01.579 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:36:01.579 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:36:01.666 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-24T18:36:01.991 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:09:49 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:36:02.074 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:36:02.075 INFO:teuthology.orchestra.run.trial026.stdout:======================================================================================= 2026-02-24T18:36:02.075 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repo Size 2026-02-24T18:36:02.075 INFO:teuthology.orchestra.run.trial026.stdout:======================================================================================= 2026-02-24T18:36:02.076 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T18:36:02.076 INFO:teuthology.orchestra.run.trial026.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.0 M 2026-02-24T18:36:02.076 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:36:02.076 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T18:36:02.076 INFO:teuthology.orchestra.run.trial026.stdout:======================================================================================= 2026-02-24T18:36:02.076 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T18:36:02.076 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:36:02.076 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 3.0 M 2026-02-24T18:36:02.076 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 15 M 2026-02-24T18:36:02.076 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T18:36:04.771 INFO:teuthology.orchestra.run.trial026.stdout:ceph-immutable-object-cache-debuginfo-20.2.0-68 1.1 MB/s | 3.0 MB 00:02 2026-02-24T18:36:04.771 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:36:04.771 INFO:teuthology.orchestra.run.trial026.stdout:Total 1.1 MB/s | 3.0 MB 00:02 2026-02-24T18:36:04.771 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T18:36:04.773 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T18:36:04.773 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T18:36:04.799 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T18:36:04.799 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T18:36:04.987 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T18:36:05.003 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:36:05.076 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:36:05.137 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:36:05.138 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:36:05.138 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T18:36:05.138 INFO:teuthology.orchestra.run.trial026.stdout: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:36:05.138 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:36:05.138 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:36:05.166 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-24T18:36:05.486 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:09:53 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:36:05.570 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:36:05.571 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:36:05.571 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repo Size 2026-02-24T18:36:05.571 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:36:05.571 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T18:36:05.571 INFO:teuthology.orchestra.run.trial026.stdout: ceph-radosgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 543 M 2026-02-24T18:36:05.572 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:36:05.572 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T18:36:05.572 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:36:05.572 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T18:36:05.572 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:36:05.572 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 543 M 2026-02-24T18:36:05.572 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 0 2026-02-24T18:36:05.572 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T18:36:08.901 INFO:teuthology.orchestra.run.trial162.stdout:ceph-common-debuginfo-20.2.0-681.g36d388f2.el9. 1.5 MB/s | 586 MB 06:43 2026-02-24T18:36:08.902 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:36:08.902 INFO:teuthology.orchestra.run.trial162.stdout:Total 1.5 MB/s | 586 MB 06:43 2026-02-24T18:36:08.902 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T18:36:08.904 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T18:36:08.904 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T18:36:10.644 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T18:36:10.644 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T18:36:42.622 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T18:36:42.640 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:36:43.917 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:36:43.978 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:36:43.978 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:36:43.978 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T18:36:43.979 INFO:teuthology.orchestra.run.trial162.stdout: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:36:43.979 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:36:43.979 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:36:44.059 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-24T18:36:44.377 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:10:36 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:36:44.463 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:36:44.464 INFO:teuthology.orchestra.run.trial162.stdout:======================================================================================= 2026-02-24T18:36:44.464 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-24T18:36:44.465 INFO:teuthology.orchestra.run.trial162.stdout:======================================================================================= 2026-02-24T18:36:44.465 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T18:36:44.465 INFO:teuthology.orchestra.run.trial162.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.0 M 2026-02-24T18:36:44.465 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:36:44.465 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T18:36:44.465 INFO:teuthology.orchestra.run.trial162.stdout:======================================================================================= 2026-02-24T18:36:44.465 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T18:36:44.465 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:36:44.465 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 3.0 M 2026-02-24T18:36:44.465 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 15 M 2026-02-24T18:36:44.465 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T18:36:46.675 INFO:teuthology.orchestra.run.trial162.stdout:ceph-immutable-object-cache-debuginfo-20.2.0-68 1.4 MB/s | 3.0 MB 00:02 2026-02-24T18:36:46.675 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:36:46.675 INFO:teuthology.orchestra.run.trial162.stdout:Total 1.4 MB/s | 3.0 MB 00:02 2026-02-24T18:36:46.675 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T18:36:46.677 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T18:36:46.677 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T18:36:46.703 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T18:36:46.703 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T18:36:46.891 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T18:36:46.908 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:36:46.976 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:36:47.038 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:36:47.038 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:36:47.038 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T18:36:47.038 INFO:teuthology.orchestra.run.trial162.stdout: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:36:47.038 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:36:47.038 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:36:47.065 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-24T18:36:47.381 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:10:39 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:36:47.469 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:36:47.469 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:36:47.469 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-24T18:36:47.469 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:36:47.469 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T18:36:47.470 INFO:teuthology.orchestra.run.trial162.stdout: ceph-radosgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 543 M 2026-02-24T18:36:47.470 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:36:47.470 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T18:36:47.470 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:36:47.470 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T18:36:47.470 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:36:47.470 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 543 M 2026-02-24T18:36:47.470 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 0 2026-02-24T18:36:47.470 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T18:36:52.415 INFO:teuthology.orchestra.run.trial070.stdout:ceph-common-debuginfo-20.2.0-681.g36d388f2.el9. 1.3 MB/s | 586 MB 07:27 2026-02-24T18:36:52.416 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:36:52.416 INFO:teuthology.orchestra.run.trial070.stdout:Total 1.3 MB/s | 586 MB 07:27 2026-02-24T18:36:52.416 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T18:36:52.419 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T18:36:52.419 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T18:36:54.152 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T18:36:54.152 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T18:37:26.032 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T18:37:26.049 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:37:27.293 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:37:27.355 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T18:37:27.355 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:37:27.355 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T18:37:27.355 INFO:teuthology.orchestra.run.trial070.stdout: ceph-common-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:37:27.355 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:37:27.355 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:37:27.436 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-24T18:37:27.758 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:11:22 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:37:27.843 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:37:27.844 INFO:teuthology.orchestra.run.trial070.stdout:======================================================================================= 2026-02-24T18:37:27.844 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-24T18:37:27.844 INFO:teuthology.orchestra.run.trial070.stdout:======================================================================================= 2026-02-24T18:37:27.844 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T18:37:27.844 INFO:teuthology.orchestra.run.trial070.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 3.0 M 2026-02-24T18:37:27.844 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:37:27.844 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T18:37:27.845 INFO:teuthology.orchestra.run.trial070.stdout:======================================================================================= 2026-02-24T18:37:27.845 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T18:37:27.845 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:37:27.845 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 3.0 M 2026-02-24T18:37:27.845 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 15 M 2026-02-24T18:37:27.845 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T18:37:29.555 INFO:teuthology.orchestra.run.trial070.stdout:ceph-immutable-object-cache-debuginfo-20.2.0-68 1.8 MB/s | 3.0 MB 00:01 2026-02-24T18:37:29.555 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:37:29.555 INFO:teuthology.orchestra.run.trial070.stdout:Total 1.8 MB/s | 3.0 MB 00:01 2026-02-24T18:37:29.555 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T18:37:29.557 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T18:37:29.557 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T18:37:29.582 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T18:37:29.583 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T18:37:29.773 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T18:37:29.791 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:37:29.862 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:37:29.924 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g 1/1 2026-02-24T18:37:29.924 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:37:29.924 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T18:37:29.924 INFO:teuthology.orchestra.run.trial070.stdout: ceph-immutable-object-cache-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:37:29.924 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:37:29.924 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:37:29.952 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-24T18:37:30.276 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:11:25 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:37:30.361 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:37:30.361 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:37:30.362 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-24T18:37:30.362 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:37:30.362 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T18:37:30.362 INFO:teuthology.orchestra.run.trial070.stdout: ceph-radosgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 543 M 2026-02-24T18:37:30.362 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:37:30.362 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T18:37:30.362 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:37:30.362 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T18:37:30.362 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:37:30.362 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 543 M 2026-02-24T18:37:30.363 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 0 2026-02-24T18:37:30.363 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T18:40:15.506 INFO:teuthology.orchestra.run.trial103.stdout:ceph-radosgw-debuginfo-20.2.0-681.g36d388f2.el9 1.5 MB/s | 543 MB 05:52 2026-02-24T18:40:15.507 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:40:15.507 INFO:teuthology.orchestra.run.trial103.stdout:Total 1.5 MB/s | 543 MB 05:52 2026-02-24T18:40:15.507 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T18:40:15.509 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T18:40:15.509 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T18:40:17.130 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T18:40:17.130 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T18:40:49.459 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T18:40:49.476 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:40:50.944 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:40:51.007 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:40:51.007 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:40:51.007 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T18:40:51.007 INFO:teuthology.orchestra.run.trial103.stdout: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:40:51.007 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:40:51.007 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T18:40:51.086 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install ceph-test-debuginfo 2026-02-24T18:40:51.408 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:14:38 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T18:40:51.493 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T18:40:51.493 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:40:51.493 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repo Size 2026-02-24T18:40:51.493 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:40:51.493 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T18:40:51.494 INFO:teuthology.orchestra.run.trial103.stdout: ceph-test-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.7 G 2026-02-24T18:40:51.494 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:40:51.494 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T18:40:51.494 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T18:40:51.494 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T18:40:51.494 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T18:40:51.494 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 1.7 G 2026-02-24T18:40:51.494 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 0 2026-02-24T18:40:51.494 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T18:46:58.731 INFO:teuthology.orchestra.run.trial026.stdout:ceph-radosgw-debuginfo-20.2.0-681.g36d388f2.el9 851 kB/s | 543 MB 10:53 2026-02-24T18:46:58.731 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:46:58.731 INFO:teuthology.orchestra.run.trial026.stdout:Total 851 kB/s | 543 MB 10:53 2026-02-24T18:46:58.731 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T18:46:58.733 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T18:46:58.733 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T18:47:00.346 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T18:47:00.346 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T18:47:33.230 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T18:47:33.248 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:47:34.054 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:47:34.116 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:47:34.116 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:47:34.117 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T18:47:34.117 INFO:teuthology.orchestra.run.trial026.stdout: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:47:34.117 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:47:34.117 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T18:47:34.200 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install ceph-test-debuginfo 2026-02-24T18:47:34.516 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:21:22 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T18:47:34.599 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T18:47:34.600 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:47:34.600 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repo Size 2026-02-24T18:47:34.600 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:47:34.600 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T18:47:34.600 INFO:teuthology.orchestra.run.trial026.stdout: ceph-test-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.7 G 2026-02-24T18:47:34.601 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:47:34.601 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T18:47:34.601 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T18:47:34.601 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T18:47:34.601 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T18:47:34.601 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 1.7 G 2026-02-24T18:47:34.601 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 0 2026-02-24T18:47:34.601 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T18:48:51.699 INFO:teuthology.orchestra.run.trial162.stdout:ceph-radosgw-debuginfo-20.2.0-681.g36d388f2.el9 768 kB/s | 543 MB 12:04 2026-02-24T18:48:51.700 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:48:51.700 INFO:teuthology.orchestra.run.trial162.stdout:Total 768 kB/s | 543 MB 12:04 2026-02-24T18:48:51.700 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T18:48:51.702 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T18:48:51.702 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T18:48:53.314 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T18:48:53.314 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T18:49:25.593 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T18:49:25.611 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:49:27.078 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:49:27.140 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:49:27.140 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:49:27.140 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T18:49:27.140 INFO:teuthology.orchestra.run.trial162.stdout: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:49:27.140 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:49:27.140 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T18:49:27.220 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-test-debuginfo 2026-02-24T18:49:27.539 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:23:19 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T18:49:27.623 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T18:49:27.624 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:49:27.624 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-24T18:49:27.624 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:49:27.624 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T18:49:27.624 INFO:teuthology.orchestra.run.trial162.stdout: ceph-test-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.7 G 2026-02-24T18:49:27.625 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:49:27.625 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T18:49:27.625 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T18:49:27.625 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T18:49:27.625 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T18:49:27.625 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 1.7 G 2026-02-24T18:49:27.625 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 0 2026-02-24T18:49:27.625 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T18:51:13.050 INFO:teuthology.orchestra.run.trial070.stdout:ceph-radosgw-debuginfo-20.2.0-681.g36d388f2.el9 676 kB/s | 543 MB 13:42 2026-02-24T18:51:13.051 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T18:51:13.051 INFO:teuthology.orchestra.run.trial070.stdout:Total 676 kB/s | 543 MB 13:42 2026-02-24T18:51:13.052 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T18:51:13.053 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T18:51:13.054 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T18:51:14.667 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T18:51:14.667 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T18:51:48.096 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T18:51:48.113 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:51:50.305 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:51:50.366 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x8 1/1 2026-02-24T18:51:50.366 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:51:50.366 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T18:51:50.366 INFO:teuthology.orchestra.run.trial070.stdout: ceph-radosgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T18:51:50.366 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:51:50.367 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T18:51:50.443 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-test-debuginfo 2026-02-24T18:51:50.757 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:25:45 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T18:51:50.841 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T18:51:50.842 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:51:50.842 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-24T18:51:50.842 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:51:50.843 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T18:51:50.843 INFO:teuthology.orchestra.run.trial070.stdout: ceph-test-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.7 G 2026-02-24T18:51:50.843 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:51:50.843 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T18:51:50.843 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T18:51:50.843 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T18:51:50.843 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T18:51:50.843 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 1.7 G 2026-02-24T18:51:50.843 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 0 2026-02-24T18:51:50.843 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T19:00:09.651 INFO:teuthology.orchestra.run.trial026.stdout:ceph-test-debuginfo-20.2.0-681.g36d388f2.el9.x8 2.3 MB/s | 1.7 GB 12:35 2026-02-24T19:00:09.652 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:00:09.652 INFO:teuthology.orchestra.run.trial026.stdout:Total 2.3 MB/s | 1.7 GB 12:35 2026-02-24T19:00:09.652 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T19:00:09.655 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T19:00:09.655 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T19:00:14.838 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T19:00:14.838 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T19:01:56.614 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T19:01:56.640 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:01:59.636 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:01:59.698 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:01:59.698 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:01:59.698 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T19:01:59.698 INFO:teuthology.orchestra.run.trial026.stdout: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:01:59.698 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:01:59.698 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T19:01:59.905 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install ceph-base-debuginfo 2026-02-24T19:02:00.224 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:35:48 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T19:02:00.290 INFO:teuthology.orchestra.run.trial026.stdout:Package ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T19:02:00.309 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T19:02:00.310 INFO:teuthology.orchestra.run.trial026.stdout:Nothing to do. 2026-02-24T19:02:00.310 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T19:02:00.332 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install ceph-mgr-debuginfo 2026-02-24T19:02:00.646 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:35:48 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T19:02:00.731 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T19:02:00.731 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:02:00.732 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repo Size 2026-02-24T19:02:00.732 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:02:00.732 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T19:02:00.732 INFO:teuthology.orchestra.run.trial026.stdout: ceph-mgr-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 22 M 2026-02-24T19:02:00.732 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:02:00.732 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T19:02:00.732 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:02:00.732 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T19:02:00.732 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:02:00.732 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 22 M 2026-02-24T19:02:00.733 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 146 M 2026-02-24T19:02:00.733 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T19:02:13.912 INFO:teuthology.orchestra.run.trial026.stdout:ceph-mgr-debuginfo-20.2.0-681.g36d388f2.el9.x86 1.7 MB/s | 22 MB 00:13 2026-02-24T19:02:13.913 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:02:13.913 INFO:teuthology.orchestra.run.trial026.stdout:Total 1.7 MB/s | 22 MB 00:13 2026-02-24T19:02:13.913 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T19:02:13.915 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T19:02:13.915 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T19:02:13.997 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T19:02:13.998 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T19:02:15.292 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T19:02:15.309 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:02:15.474 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:02:15.536 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:02:15.537 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:02:15.537 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T19:02:15.537 INFO:teuthology.orchestra.run.trial026.stdout: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:02:15.537 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:02:15.537 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T19:02:15.565 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install ceph-mds-debuginfo 2026-02-24T19:02:15.885 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:36:03 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T19:02:15.970 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T19:02:15.970 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:02:15.971 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repo Size 2026-02-24T19:02:15.971 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:02:15.971 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T19:02:15.971 INFO:teuthology.orchestra.run.trial026.stdout: ceph-mds-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 54 M 2026-02-24T19:02:15.971 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:02:15.971 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T19:02:15.971 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:02:15.971 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T19:02:15.971 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:02:15.972 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 54 M 2026-02-24T19:02:15.972 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 221 M 2026-02-24T19:02:15.972 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T19:03:03.502 INFO:teuthology.orchestra.run.trial026.stdout:ceph-mds-debuginfo-20.2.0-681.g36d388f2.el9.x86 1.1 MB/s | 54 MB 00:47 2026-02-24T19:03:03.503 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:03:03.503 INFO:teuthology.orchestra.run.trial026.stdout:Total 1.1 MB/s | 54 MB 00:47 2026-02-24T19:03:03.503 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T19:03:03.504 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T19:03:03.505 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T19:03:03.682 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T19:03:03.683 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T19:03:06.388 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T19:03:06.405 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:03:06.625 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:03:06.688 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:03:06.689 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:03:06.689 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T19:03:06.689 INFO:teuthology.orchestra.run.trial026.stdout: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:03:06.689 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:03:06.689 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T19:03:06.723 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install ceph-mon-debuginfo 2026-02-24T19:03:07.039 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:36:55 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T19:03:07.124 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T19:03:07.125 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:03:07.125 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repo Size 2026-02-24T19:03:07.125 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:03:07.125 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T19:03:07.125 INFO:teuthology.orchestra.run.trial026.stdout: ceph-mon-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 130 M 2026-02-24T19:03:07.125 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:03:07.125 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T19:03:07.125 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:03:07.125 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T19:03:07.125 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:03:07.126 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 130 M 2026-02-24T19:03:07.126 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 643 M 2026-02-24T19:03:07.126 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T19:04:15.628 INFO:teuthology.orchestra.run.trial026.stdout:ceph-mon-debuginfo-20.2.0-681.g36d388f2.el9.x86 1.9 MB/s | 130 MB 01:08 2026-02-24T19:04:15.629 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:04:15.629 INFO:teuthology.orchestra.run.trial026.stdout:Total 1.9 MB/s | 130 MB 01:08 2026-02-24T19:04:15.629 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T19:04:15.631 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T19:04:15.631 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T19:04:16.031 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T19:04:16.032 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T19:04:22.867 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T19:04:22.885 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:04:23.417 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:04:23.480 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:04:23.480 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:04:23.480 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T19:04:23.480 INFO:teuthology.orchestra.run.trial026.stdout: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:04:23.480 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:04:23.480 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T19:04:23.520 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install ceph-osd-debuginfo 2026-02-24T19:04:23.844 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:38:11 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T19:04:23.928 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T19:04:23.929 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:04:23.929 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repo Size 2026-02-24T19:04:23.929 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:04:23.929 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T19:04:23.929 INFO:teuthology.orchestra.run.trial026.stdout: ceph-osd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 343 M 2026-02-24T19:04:23.929 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:04:23.929 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T19:04:23.929 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:04:23.929 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T19:04:23.929 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:04:23.930 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 343 M 2026-02-24T19:04:23.930 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 1.6 G 2026-02-24T19:04:23.930 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T19:05:13.806 INFO:teuthology.orchestra.run.trial103.stdout:ceph-test-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.2 MB/s | 1.7 GB 24:22 2026-02-24T19:05:13.807 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:05:13.807 INFO:teuthology.orchestra.run.trial103.stdout:Total 1.2 MB/s | 1.7 GB 24:22 2026-02-24T19:05:13.807 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T19:05:13.811 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T19:05:13.811 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T19:05:19.014 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T19:05:19.014 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T19:06:35.410 INFO:teuthology.orchestra.run.trial026.stdout:ceph-osd-debuginfo-20.2.0-681.g36d388f2.el9.x86 2.6 MB/s | 343 MB 02:11 2026-02-24T19:06:35.411 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:06:35.411 INFO:teuthology.orchestra.run.trial026.stdout:Total 2.6 MB/s | 343 MB 02:11 2026-02-24T19:06:35.411 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T19:06:35.413 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T19:06:35.413 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T19:06:36.440 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T19:06:36.440 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T19:06:54.174 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T19:06:54.191 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:06:55.428 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:06:55.491 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:06:55.491 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:06:55.492 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T19:06:55.492 INFO:teuthology.orchestra.run.trial026.stdout: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:06:55.492 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:06:55.492 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T19:06:55.549 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install ceph-fuse-debuginfo 2026-02-24T19:06:55.863 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:40:43 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T19:06:55.946 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T19:06:55.947 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:06:55.947 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repo Size 2026-02-24T19:06:55.947 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:06:55.947 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T19:06:55.947 INFO:teuthology.orchestra.run.trial026.stdout: ceph-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 10 M 2026-02-24T19:06:55.947 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:06:55.947 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T19:06:55.948 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:06:55.948 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T19:06:55.948 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:06:55.948 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 10 M 2026-02-24T19:06:55.948 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 51 M 2026-02-24T19:06:55.948 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T19:06:59.113 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T19:06:59.133 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:07:02.238 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:07:02.300 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:07:02.300 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:07:02.300 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T19:07:02.300 INFO:teuthology.orchestra.run.trial103.stdout: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:07:02.300 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:07:02.300 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T19:07:02.502 INFO:teuthology.orchestra.run.trial026.stdout:ceph-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.6 MB/s | 10 MB 00:06 2026-02-24T19:07:02.503 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:07:02.503 INFO:teuthology.orchestra.run.trial026.stdout:Total 1.6 MB/s | 10 MB 00:06 2026-02-24T19:07:02.503 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T19:07:02.505 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install ceph-base-debuginfo 2026-02-24T19:07:02.506 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T19:07:02.506 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T19:07:02.552 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T19:07:02.552 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T19:07:02.834 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:40:49 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T19:07:02.901 INFO:teuthology.orchestra.run.trial103.stdout:Package ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T19:07:02.920 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T19:07:02.920 INFO:teuthology.orchestra.run.trial103.stdout:Nothing to do. 2026-02-24T19:07:02.920 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T19:07:02.944 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install ceph-mgr-debuginfo 2026-02-24T19:07:03.103 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T19:07:03.121 INFO:teuthology.orchestra.run.trial026.stdout: Installing : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:07:03.216 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:07:03.266 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:40:50 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T19:07:03.278 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:07:03.278 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:07:03.278 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T19:07:03.278 INFO:teuthology.orchestra.run.trial026.stdout: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:07:03.278 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:07:03.279 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T19:07:03.307 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install librados-devel-debuginfo 2026-02-24T19:07:03.351 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T19:07:03.352 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:07:03.352 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repo Size 2026-02-24T19:07:03.352 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:07:03.352 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T19:07:03.352 INFO:teuthology.orchestra.run.trial103.stdout: ceph-mgr-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 22 M 2026-02-24T19:07:03.352 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:07:03.353 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T19:07:03.353 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:07:03.353 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T19:07:03.353 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:07:03.353 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 22 M 2026-02-24T19:07:03.353 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 146 M 2026-02-24T19:07:03.353 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T19:07:03.623 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:40:51 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T19:07:03.706 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T19:07:03.707 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:07:03.707 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repo Size 2026-02-24T19:07:03.707 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:07:03.707 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T19:07:03.707 INFO:teuthology.orchestra.run.trial026.stdout: librados-devel-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 144 k 2026-02-24T19:07:03.707 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:07:03.707 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T19:07:03.707 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:07:03.707 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T19:07:03.707 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:07:03.708 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 144 k 2026-02-24T19:07:03.708 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 802 k 2026-02-24T19:07:03.708 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T19:07:04.175 INFO:teuthology.orchestra.run.trial026.stdout:librados-devel-debuginfo-20.2.0-681.g36d388f2.e 307 kB/s | 144 kB 00:00 2026-02-24T19:07:04.176 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:07:04.176 INFO:teuthology.orchestra.run.trial026.stdout:Total 306 kB/s | 144 kB 00:00 2026-02-24T19:07:04.176 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T19:07:04.178 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T19:07:04.178 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T19:07:04.196 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T19:07:04.196 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T19:07:04.237 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T19:07:04.254 INFO:teuthology.orchestra.run.trial026.stdout: Installing : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:07:04.314 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:07:04.377 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:07:04.377 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:07:04.377 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T19:07:04.377 INFO:teuthology.orchestra.run.trial026.stdout: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:07:04.377 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:07:04.377 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T19:07:04.404 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install libcephfs2-debuginfo 2026-02-24T19:07:04.717 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:40:52 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T19:07:04.800 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T19:07:04.801 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:07:04.801 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repo Size 2026-02-24T19:07:04.801 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:07:04.801 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T19:07:04.801 INFO:teuthology.orchestra.run.trial026.stdout: libcephfs2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 9.1 M 2026-02-24T19:07:04.802 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:07:04.802 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T19:07:04.802 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:07:04.802 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T19:07:04.802 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:07:04.802 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 9.1 M 2026-02-24T19:07:04.802 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 46 M 2026-02-24T19:07:04.802 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T19:07:09.270 INFO:teuthology.orchestra.run.trial026.stdout:libcephfs2-debuginfo-20.2.0-681.g36d388f2.el9.x 2.0 MB/s | 9.1 MB 00:04 2026-02-24T19:07:09.270 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:07:09.271 INFO:teuthology.orchestra.run.trial026.stdout:Total 2.0 MB/s | 9.1 MB 00:04 2026-02-24T19:07:09.271 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T19:07:09.272 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T19:07:09.272 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T19:07:09.316 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T19:07:09.316 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T19:07:09.811 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T19:07:09.829 INFO:teuthology.orchestra.run.trial026.stdout: Installing : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:07:09.919 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:07:09.980 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:07:09.981 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:07:09.981 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T19:07:09.981 INFO:teuthology.orchestra.run.trial026.stdout: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:07:09.981 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:07:09.981 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T19:07:10.009 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install librados2-debuginfo 2026-02-24T19:07:10.325 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:40:58 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T19:07:10.408 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T19:07:10.408 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:07:10.409 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repo Size 2026-02-24T19:07:10.409 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:07:10.409 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T19:07:10.409 INFO:teuthology.orchestra.run.trial026.stdout: librados2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 63 M 2026-02-24T19:07:10.409 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:07:10.409 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T19:07:10.409 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:07:10.409 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T19:07:10.409 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:07:10.410 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 63 M 2026-02-24T19:07:10.410 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 397 M 2026-02-24T19:07:10.410 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T19:07:12.350 INFO:teuthology.orchestra.run.trial103.stdout:ceph-mgr-debuginfo-20.2.0-681.g36d388f2.el9.x86 2.4 MB/s | 22 MB 00:08 2026-02-24T19:07:12.351 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:07:12.351 INFO:teuthology.orchestra.run.trial103.stdout:Total 2.4 MB/s | 22 MB 00:08 2026-02-24T19:07:12.351 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T19:07:12.353 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T19:07:12.353 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T19:07:12.434 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T19:07:12.435 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T19:07:13.744 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T19:07:13.761 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:07:13.927 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:07:13.988 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:07:13.988 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:07:13.989 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T19:07:13.989 INFO:teuthology.orchestra.run.trial103.stdout: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:07:13.989 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:07:13.989 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T19:07:14.018 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install ceph-mds-debuginfo 2026-02-24T19:07:14.333 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:41:01 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T19:07:14.418 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T19:07:14.419 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:07:14.419 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repo Size 2026-02-24T19:07:14.419 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:07:14.420 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T19:07:14.420 INFO:teuthology.orchestra.run.trial103.stdout: ceph-mds-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 54 M 2026-02-24T19:07:14.420 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:07:14.420 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T19:07:14.420 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:07:14.420 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T19:07:14.420 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:07:14.420 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 54 M 2026-02-24T19:07:14.420 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 221 M 2026-02-24T19:07:14.420 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T19:07:29.416 INFO:teuthology.orchestra.run.trial103.stdout:ceph-mds-debuginfo-20.2.0-681.g36d388f2.el9.x86 3.6 MB/s | 54 MB 00:14 2026-02-24T19:07:29.417 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:07:29.417 INFO:teuthology.orchestra.run.trial103.stdout:Total 3.6 MB/s | 54 MB 00:14 2026-02-24T19:07:29.417 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T19:07:29.419 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T19:07:29.419 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T19:07:29.596 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T19:07:29.596 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T19:07:32.243 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T19:07:32.261 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:07:32.486 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:07:32.549 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:07:32.549 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:07:32.549 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T19:07:32.550 INFO:teuthology.orchestra.run.trial103.stdout: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:07:32.550 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:07:32.550 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T19:07:32.583 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install ceph-mon-debuginfo 2026-02-24T19:07:32.899 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:41:19 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T19:07:32.984 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T19:07:32.985 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:07:32.985 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repo Size 2026-02-24T19:07:32.985 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:07:32.985 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T19:07:32.985 INFO:teuthology.orchestra.run.trial103.stdout: ceph-mon-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 130 M 2026-02-24T19:07:32.986 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:07:32.986 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T19:07:32.986 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:07:32.986 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T19:07:32.986 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:07:32.986 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 130 M 2026-02-24T19:07:32.986 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 643 M 2026-02-24T19:07:32.986 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T19:07:46.892 INFO:teuthology.orchestra.run.trial026.stdout:librados2-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.7 MB/s | 63 MB 00:36 2026-02-24T19:07:46.893 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:07:46.893 INFO:teuthology.orchestra.run.trial026.stdout:Total 1.7 MB/s | 63 MB 00:36 2026-02-24T19:07:46.893 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T19:07:46.895 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T19:07:46.895 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T19:07:47.102 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T19:07:47.103 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T19:07:50.661 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T19:07:50.678 INFO:teuthology.orchestra.run.trial026.stdout: Installing : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:07:51.019 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:07:51.081 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:07:51.081 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:07:51.081 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T19:07:51.081 INFO:teuthology.orchestra.run.trial026.stdout: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:07:51.081 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:07:51.081 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T19:07:51.113 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install librbd1-debuginfo 2026-02-24T19:07:51.430 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:41:39 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T19:07:51.513 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T19:07:51.514 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:07:51.514 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repo Size 2026-02-24T19:07:51.514 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:07:51.514 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T19:07:51.514 INFO:teuthology.orchestra.run.trial026.stdout: librbd1-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 80 M 2026-02-24T19:07:51.514 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:07:51.514 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T19:07:51.515 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:07:51.515 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T19:07:51.515 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:07:51.515 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 80 M 2026-02-24T19:07:51.515 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 406 M 2026-02-24T19:07:51.515 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T19:08:15.387 INFO:teuthology.orchestra.run.trial103.stdout:ceph-mon-debuginfo-20.2.0-681.g36d388f2.el9.x86 3.1 MB/s | 130 MB 00:42 2026-02-24T19:08:15.388 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:08:15.388 INFO:teuthology.orchestra.run.trial103.stdout:Total 3.1 MB/s | 130 MB 00:42 2026-02-24T19:08:15.388 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T19:08:15.390 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T19:08:15.390 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T19:08:15.790 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T19:08:15.790 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T19:08:22.420 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T19:08:22.437 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:08:22.954 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:08:23.017 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:08:23.017 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:08:23.017 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T19:08:23.017 INFO:teuthology.orchestra.run.trial103.stdout: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:08:23.017 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:08:23.018 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T19:08:23.056 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install ceph-osd-debuginfo 2026-02-24T19:08:23.376 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:42:10 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T19:08:23.462 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T19:08:23.463 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:08:23.463 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repo Size 2026-02-24T19:08:23.463 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:08:23.463 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T19:08:23.464 INFO:teuthology.orchestra.run.trial103.stdout: ceph-osd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 343 M 2026-02-24T19:08:23.464 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:08:23.464 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T19:08:23.464 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:08:23.464 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T19:08:23.464 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:08:23.464 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 343 M 2026-02-24T19:08:23.464 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 1.6 G 2026-02-24T19:08:23.464 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T19:08:26.339 INFO:teuthology.orchestra.run.trial026.stdout:librbd1-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 2.3 MB/s | 80 MB 00:34 2026-02-24T19:08:26.340 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:08:26.340 INFO:teuthology.orchestra.run.trial026.stdout:Total 2.3 MB/s | 80 MB 00:34 2026-02-24T19:08:26.340 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T19:08:26.342 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T19:08:26.342 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T19:08:26.599 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T19:08:26.600 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T19:08:30.764 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T19:08:30.782 INFO:teuthology.orchestra.run.trial026.stdout: Installing : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:08:31.142 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:08:31.205 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:08:31.205 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:08:31.205 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T19:08:31.206 INFO:teuthology.orchestra.run.trial026.stdout: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:08:31.206 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:08:31.206 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T19:08:31.240 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install python3-cephfs-debuginfo 2026-02-24T19:08:31.556 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:42:19 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T19:08:31.640 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T19:08:31.640 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:08:31.641 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repo Size 2026-02-24T19:08:31.641 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:08:31.641 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T19:08:31.641 INFO:teuthology.orchestra.run.trial026.stdout: python3-cephfs-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 645 k 2026-02-24T19:08:31.641 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:08:31.641 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T19:08:31.641 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:08:31.641 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T19:08:31.641 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:08:31.641 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 645 k 2026-02-24T19:08:31.641 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 2.3 M 2026-02-24T19:08:31.642 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T19:08:33.001 INFO:teuthology.orchestra.run.trial026.stdout:python3-cephfs-debuginfo-20.2.0-681.g36d388f2.e 474 kB/s | 645 kB 00:01 2026-02-24T19:08:33.001 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:08:33.001 INFO:teuthology.orchestra.run.trial026.stdout:Total 474 kB/s | 645 kB 00:01 2026-02-24T19:08:33.001 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T19:08:33.003 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T19:08:33.003 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T19:08:33.023 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T19:08:33.023 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T19:08:33.088 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T19:08:33.105 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:08:33.165 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:08:33.227 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:08:33.227 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:08:33.228 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T19:08:33.228 INFO:teuthology.orchestra.run.trial026.stdout: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:08:33.228 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:08:33.228 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T19:08:33.255 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install python3-rados-debuginfo 2026-02-24T19:08:33.571 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:42:21 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T19:08:33.653 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T19:08:33.654 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:08:33.654 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repo Size 2026-02-24T19:08:33.654 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:08:33.655 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T19:08:33.655 INFO:teuthology.orchestra.run.trial026.stdout: python3-rados-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 802 k 2026-02-24T19:08:33.655 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:08:33.655 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T19:08:33.655 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:08:33.655 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T19:08:33.655 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:08:33.655 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 802 k 2026-02-24T19:08:33.655 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 3.1 M 2026-02-24T19:08:33.655 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T19:08:34.796 INFO:teuthology.orchestra.run.trial026.stdout:python3-rados-debuginfo-20.2.0-681.g36d388f2.el 703 kB/s | 802 kB 00:01 2026-02-24T19:08:34.797 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:08:34.797 INFO:teuthology.orchestra.run.trial026.stdout:Total 702 kB/s | 802 kB 00:01 2026-02-24T19:08:34.797 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T19:08:34.799 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T19:08:34.799 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T19:08:34.820 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T19:08:34.820 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T19:08:34.896 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T19:08:34.913 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:08:34.974 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:08:35.036 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:08:35.036 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:08:35.036 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T19:08:35.036 INFO:teuthology.orchestra.run.trial026.stdout: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:08:35.036 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:08:35.036 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T19:08:35.063 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install python3-rbd-debuginfo 2026-02-24T19:08:35.378 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:42:23 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T19:08:35.460 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T19:08:35.461 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:08:35.461 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repo Size 2026-02-24T19:08:35.461 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:08:35.461 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T19:08:35.461 INFO:teuthology.orchestra.run.trial026.stdout: python3-rbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.2 M 2026-02-24T19:08:35.462 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:08:35.462 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T19:08:35.462 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:08:35.462 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T19:08:35.462 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:08:35.462 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 1.2 M 2026-02-24T19:08:35.462 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 4.7 M 2026-02-24T19:08:35.462 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T19:08:36.869 INFO:teuthology.orchestra.run.trial026.stdout:python3-rbd-debuginfo-20.2.0-681.g36d388f2.el9. 847 kB/s | 1.2 MB 00:01 2026-02-24T19:08:36.870 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:08:36.870 INFO:teuthology.orchestra.run.trial026.stdout:Total 846 kB/s | 1.2 MB 00:01 2026-02-24T19:08:36.870 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T19:08:36.873 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T19:08:36.873 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T19:08:36.893 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T19:08:36.894 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T19:08:36.986 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T19:08:37.003 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:08:37.064 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:08:37.126 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:08:37.126 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:08:37.126 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T19:08:37.126 INFO:teuthology.orchestra.run.trial026.stdout: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:08:37.127 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:08:37.127 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T19:08:37.151 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install python3-rgw-debuginfo 2026-02-24T19:08:37.458 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:42:25 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T19:08:37.541 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T19:08:37.542 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:08:37.542 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repo Size 2026-02-24T19:08:37.542 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:08:37.542 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T19:08:37.543 INFO:teuthology.orchestra.run.trial026.stdout: python3-rgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 350 k 2026-02-24T19:08:37.543 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:08:37.543 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T19:08:37.543 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:08:37.543 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T19:08:37.543 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:08:37.543 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 350 k 2026-02-24T19:08:37.543 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 1.1 M 2026-02-24T19:08:37.543 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T19:08:38.293 INFO:teuthology.orchestra.run.trial026.stdout:python3-rgw-debuginfo-20.2.0-681.g36d388f2.el9. 467 kB/s | 350 kB 00:00 2026-02-24T19:08:38.293 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:08:38.294 INFO:teuthology.orchestra.run.trial026.stdout:Total 466 kB/s | 350 kB 00:00 2026-02-24T19:08:38.294 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T19:08:38.295 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T19:08:38.296 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T19:08:38.315 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T19:08:38.316 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T19:08:38.366 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T19:08:38.383 INFO:teuthology.orchestra.run.trial026.stdout: Installing : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:08:38.442 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:08:38.505 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:08:38.505 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:08:38.505 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T19:08:38.505 INFO:teuthology.orchestra.run.trial026.stdout: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:08:38.505 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:08:38.505 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T19:08:38.532 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install rbd-fuse-debuginfo 2026-02-24T19:08:38.845 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:42:26 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T19:08:38.929 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T19:08:38.929 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:08:38.930 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repo Size 2026-02-24T19:08:38.930 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:08:38.930 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T19:08:38.930 INFO:teuthology.orchestra.run.trial026.stdout: rbd-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.5 M 2026-02-24T19:08:38.930 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:08:38.930 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T19:08:38.930 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:08:38.930 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T19:08:38.930 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:08:38.930 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 1.5 M 2026-02-24T19:08:38.931 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 7.9 M 2026-02-24T19:08:38.931 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T19:08:40.346 INFO:teuthology.orchestra.run.trial026.stdout:rbd-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x86 1.1 MB/s | 1.5 MB 00:01 2026-02-24T19:08:40.347 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:08:40.347 INFO:teuthology.orchestra.run.trial026.stdout:Total 1.1 MB/s | 1.5 MB 00:01 2026-02-24T19:08:40.347 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T19:08:40.349 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T19:08:40.349 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T19:08:40.372 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T19:08:40.373 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T19:08:40.485 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T19:08:40.502 INFO:teuthology.orchestra.run.trial026.stdout: Installing : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:08:40.567 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:08:40.629 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:08:40.630 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:08:40.630 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T19:08:40.630 INFO:teuthology.orchestra.run.trial026.stdout: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:08:40.630 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:08:40.630 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T19:08:40.656 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install rbd-mirror-debuginfo 2026-02-24T19:08:40.969 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:42:28 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T19:08:41.053 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T19:08:41.054 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:08:41.054 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repo Size 2026-02-24T19:08:41.054 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:08:41.054 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T19:08:41.054 INFO:teuthology.orchestra.run.trial026.stdout: rbd-mirror-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 79 M 2026-02-24T19:08:41.054 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:08:41.054 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T19:08:41.054 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:08:41.054 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T19:08:41.054 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:08:41.055 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 79 M 2026-02-24T19:08:41.055 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 375 M 2026-02-24T19:08:41.055 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T19:09:17.852 INFO:teuthology.orchestra.run.trial026.stdout:rbd-mirror-debuginfo-20.2.0-681.g36d388f2.el9.x 2.2 MB/s | 79 MB 00:36 2026-02-24T19:09:17.853 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:09:17.853 INFO:teuthology.orchestra.run.trial026.stdout:Total 2.2 MB/s | 79 MB 00:36 2026-02-24T19:09:17.853 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T19:09:17.854 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T19:09:17.855 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T19:09:18.106 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T19:09:18.106 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T19:09:22.176 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T19:09:22.194 INFO:teuthology.orchestra.run.trial026.stdout: Installing : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:09:22.522 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:09:22.585 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:09:22.585 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:09:22.585 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T19:09:22.585 INFO:teuthology.orchestra.run.trial026.stdout: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:09:22.586 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:09:22.586 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T19:09:22.619 DEBUG:teuthology.orchestra.run.trial026:> sudo yum -y install rbd-nbd-debuginfo 2026-02-24T19:09:22.928 INFO:teuthology.orchestra.run.trial026.stdout:Last metadata expiration check: 0:43:10 ago on Tue 24 Feb 2026 06:26:12 PM UTC. 2026-02-24T19:09:23.010 INFO:teuthology.orchestra.run.trial026.stdout:Dependencies resolved. 2026-02-24T19:09:23.011 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:09:23.011 INFO:teuthology.orchestra.run.trial026.stdout: Package Arch Version Repo Size 2026-02-24T19:09:23.011 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:09:23.011 INFO:teuthology.orchestra.run.trial026.stdout:Installing: 2026-02-24T19:09:23.011 INFO:teuthology.orchestra.run.trial026.stdout: rbd-nbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.4 M 2026-02-24T19:09:23.011 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:09:23.011 INFO:teuthology.orchestra.run.trial026.stdout:Transaction Summary 2026-02-24T19:09:23.011 INFO:teuthology.orchestra.run.trial026.stdout:================================================================================ 2026-02-24T19:09:23.011 INFO:teuthology.orchestra.run.trial026.stdout:Install 1 Package 2026-02-24T19:09:23.011 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:09:23.011 INFO:teuthology.orchestra.run.trial026.stdout:Total download size: 2.4 M 2026-02-24T19:09:23.011 INFO:teuthology.orchestra.run.trial026.stdout:Installed size: 12 M 2026-02-24T19:09:23.011 INFO:teuthology.orchestra.run.trial026.stdout:Downloading Packages: 2026-02-24T19:09:25.322 INFO:teuthology.orchestra.run.trial026.stdout:rbd-nbd-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 1.1 MB/s | 2.4 MB 00:02 2026-02-24T19:09:25.322 INFO:teuthology.orchestra.run.trial026.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:09:25.323 INFO:teuthology.orchestra.run.trial026.stdout:Total 1.1 MB/s | 2.4 MB 00:02 2026-02-24T19:09:25.323 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction check 2026-02-24T19:09:25.324 INFO:teuthology.orchestra.run.trial026.stdout:Transaction check succeeded. 2026-02-24T19:09:25.324 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction test 2026-02-24T19:09:25.349 INFO:teuthology.orchestra.run.trial026.stdout:Transaction test succeeded. 2026-02-24T19:09:25.350 INFO:teuthology.orchestra.run.trial026.stdout:Running transaction 2026-02-24T19:09:25.509 INFO:teuthology.orchestra.run.trial026.stdout: Preparing : 1/1 2026-02-24T19:09:25.528 INFO:teuthology.orchestra.run.trial026.stdout: Installing : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:09:25.597 INFO:teuthology.orchestra.run.trial026.stdout: Running scriptlet: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:09:25.661 INFO:teuthology.orchestra.run.trial026.stdout: Verifying : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:09:25.661 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:09:25.661 INFO:teuthology.orchestra.run.trial026.stdout:Installed: 2026-02-24T19:09:25.661 INFO:teuthology.orchestra.run.trial026.stdout: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:09:25.661 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:09:25.661 INFO:teuthology.orchestra.run.trial026.stdout:Complete! 2026-02-24T19:09:25.696 DEBUG:teuthology.parallel:result is None 2026-02-24T19:10:37.604 INFO:teuthology.orchestra.run.trial103.stdout:ceph-osd-debuginfo-20.2.0-681.g36d388f2.el9.x86 2.6 MB/s | 343 MB 02:14 2026-02-24T19:10:37.605 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:10:37.605 INFO:teuthology.orchestra.run.trial103.stdout:Total 2.6 MB/s | 343 MB 02:14 2026-02-24T19:10:37.605 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T19:10:37.607 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T19:10:37.607 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T19:10:38.633 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T19:10:38.633 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T19:10:56.687 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T19:10:56.704 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:10:57.925 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:10:57.988 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:10:57.988 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:10:57.989 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T19:10:57.989 INFO:teuthology.orchestra.run.trial103.stdout: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:10:57.989 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:10:57.989 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T19:10:58.053 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install ceph-fuse-debuginfo 2026-02-24T19:10:58.368 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:44:45 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T19:10:58.452 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T19:10:58.452 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:10:58.453 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repo Size 2026-02-24T19:10:58.453 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:10:58.453 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T19:10:58.453 INFO:teuthology.orchestra.run.trial103.stdout: ceph-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 10 M 2026-02-24T19:10:58.453 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:10:58.453 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T19:10:58.453 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:10:58.453 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T19:10:58.453 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:10:58.453 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 10 M 2026-02-24T19:10:58.454 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 51 M 2026-02-24T19:10:58.454 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T19:11:04.665 INFO:teuthology.orchestra.run.trial103.stdout:ceph-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.6 MB/s | 10 MB 00:06 2026-02-24T19:11:04.666 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:11:04.666 INFO:teuthology.orchestra.run.trial103.stdout:Total 1.6 MB/s | 10 MB 00:06 2026-02-24T19:11:04.666 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T19:11:04.668 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T19:11:04.668 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T19:11:04.714 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T19:11:04.715 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T19:11:05.264 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T19:11:05.281 INFO:teuthology.orchestra.run.trial103.stdout: Installing : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:11:05.375 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:11:05.438 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:11:05.438 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:11:05.439 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T19:11:05.439 INFO:teuthology.orchestra.run.trial103.stdout: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:11:05.439 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:11:05.439 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T19:11:05.467 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install librados-devel-debuginfo 2026-02-24T19:11:05.784 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:44:52 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T19:11:05.867 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T19:11:05.868 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:11:05.868 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repo Size 2026-02-24T19:11:05.868 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:11:05.868 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T19:11:05.868 INFO:teuthology.orchestra.run.trial103.stdout: librados-devel-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 144 k 2026-02-24T19:11:05.868 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:11:05.868 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T19:11:05.869 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:11:05.869 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T19:11:05.869 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:11:05.869 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 144 k 2026-02-24T19:11:05.869 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 802 k 2026-02-24T19:11:05.869 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T19:11:06.299 INFO:teuthology.orchestra.run.trial103.stdout:librados-devel-debuginfo-20.2.0-681.g36d388f2.e 334 kB/s | 144 kB 00:00 2026-02-24T19:11:06.300 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:11:06.300 INFO:teuthology.orchestra.run.trial103.stdout:Total 333 kB/s | 144 kB 00:00 2026-02-24T19:11:06.300 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T19:11:06.302 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T19:11:06.302 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T19:11:06.320 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T19:11:06.320 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T19:11:06.361 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T19:11:06.378 INFO:teuthology.orchestra.run.trial103.stdout: Installing : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:11:06.443 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:11:06.506 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:11:06.506 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:11:06.506 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T19:11:06.506 INFO:teuthology.orchestra.run.trial103.stdout: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:11:06.506 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:11:06.507 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T19:11:06.533 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install libcephfs2-debuginfo 2026-02-24T19:11:06.848 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:44:53 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T19:11:06.931 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T19:11:06.931 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:11:06.932 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repo Size 2026-02-24T19:11:06.932 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:11:06.932 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T19:11:06.932 INFO:teuthology.orchestra.run.trial103.stdout: libcephfs2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 9.1 M 2026-02-24T19:11:06.932 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:11:06.932 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T19:11:06.932 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:11:06.932 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T19:11:06.932 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:11:06.932 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 9.1 M 2026-02-24T19:11:06.933 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 46 M 2026-02-24T19:11:06.933 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T19:11:10.206 INFO:teuthology.orchestra.run.trial103.stdout:libcephfs2-debuginfo-20.2.0-681.g36d388f2.el9.x 2.8 MB/s | 9.1 MB 00:03 2026-02-24T19:11:10.207 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:11:10.207 INFO:teuthology.orchestra.run.trial103.stdout:Total 2.8 MB/s | 9.1 MB 00:03 2026-02-24T19:11:10.207 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T19:11:10.208 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T19:11:10.209 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T19:11:10.252 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T19:11:10.253 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T19:11:10.750 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T19:11:10.768 INFO:teuthology.orchestra.run.trial103.stdout: Installing : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:11:10.859 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:11:10.921 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:11:10.922 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:11:10.922 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T19:11:10.922 INFO:teuthology.orchestra.run.trial103.stdout: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:11:10.922 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:11:10.922 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T19:11:10.950 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install librados2-debuginfo 2026-02-24T19:11:11.268 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:44:58 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T19:11:11.351 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T19:11:11.351 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:11:11.352 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repo Size 2026-02-24T19:11:11.352 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:11:11.352 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T19:11:11.352 INFO:teuthology.orchestra.run.trial103.stdout: librados2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 63 M 2026-02-24T19:11:11.352 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:11:11.352 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T19:11:11.352 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:11:11.352 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T19:11:11.352 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:11:11.352 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 63 M 2026-02-24T19:11:11.353 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 397 M 2026-02-24T19:11:11.353 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T19:11:27.537 INFO:teuthology.orchestra.run.trial103.stdout:librados2-debuginfo-20.2.0-681.g36d388f2.el9.x8 3.9 MB/s | 63 MB 00:16 2026-02-24T19:11:27.538 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:11:27.538 INFO:teuthology.orchestra.run.trial103.stdout:Total 3.9 MB/s | 63 MB 00:16 2026-02-24T19:11:27.538 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T19:11:27.540 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T19:11:27.540 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T19:11:27.745 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T19:11:27.745 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T19:11:31.245 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T19:11:31.263 INFO:teuthology.orchestra.run.trial103.stdout: Installing : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:11:31.618 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:11:31.681 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:11:31.681 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:11:31.682 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T19:11:31.682 INFO:teuthology.orchestra.run.trial103.stdout: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:11:31.682 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:11:31.682 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T19:11:31.714 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install librbd1-debuginfo 2026-02-24T19:11:32.031 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:45:19 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T19:11:32.114 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T19:11:32.115 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:11:32.115 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repo Size 2026-02-24T19:11:32.116 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:11:32.116 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T19:11:32.116 INFO:teuthology.orchestra.run.trial103.stdout: librbd1-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 80 M 2026-02-24T19:11:32.116 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:11:32.116 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T19:11:32.116 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:11:32.116 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T19:11:32.116 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:11:32.116 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 80 M 2026-02-24T19:11:32.116 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 406 M 2026-02-24T19:11:32.116 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T19:11:59.845 INFO:teuthology.orchestra.run.trial103.stdout:librbd1-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 2.9 MB/s | 80 MB 00:27 2026-02-24T19:11:59.846 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:11:59.846 INFO:teuthology.orchestra.run.trial103.stdout:Total 2.9 MB/s | 80 MB 00:27 2026-02-24T19:11:59.846 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T19:11:59.848 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T19:11:59.848 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T19:12:00.103 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T19:12:00.104 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T19:12:00.684 INFO:teuthology.orchestra.run.trial162.stdout:ceph-test-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.3 MB/s | 1.7 GB 22:33 2026-02-24T19:12:00.684 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:00.685 INFO:teuthology.orchestra.run.trial162.stdout:Total 1.3 MB/s | 1.7 GB 22:33 2026-02-24T19:12:00.685 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T19:12:00.688 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T19:12:00.688 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T19:12:04.263 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T19:12:04.280 INFO:teuthology.orchestra.run.trial103.stdout: Installing : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:12:04.626 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:12:04.688 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:12:04.688 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:04.688 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T19:12:04.688 INFO:teuthology.orchestra.run.trial103.stdout: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:04.689 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:04.689 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T19:12:04.722 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install python3-cephfs-debuginfo 2026-02-24T19:12:05.042 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:45:52 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T19:12:05.125 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T19:12:05.126 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:12:05.126 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repo Size 2026-02-24T19:12:05.126 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:12:05.126 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T19:12:05.126 INFO:teuthology.orchestra.run.trial103.stdout: python3-cephfs-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 645 k 2026-02-24T19:12:05.126 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:05.126 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T19:12:05.126 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:12:05.126 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T19:12:05.127 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:05.127 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 645 k 2026-02-24T19:12:05.127 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 2.3 M 2026-02-24T19:12:05.127 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T19:12:05.850 INFO:teuthology.orchestra.run.trial103.stdout:python3-cephfs-debuginfo-20.2.0-681.g36d388f2.e 890 kB/s | 645 kB 00:00 2026-02-24T19:12:05.851 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:05.851 INFO:teuthology.orchestra.run.trial103.stdout:Total 889 kB/s | 645 kB 00:00 2026-02-24T19:12:05.851 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T19:12:05.853 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T19:12:05.853 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T19:12:05.872 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T19:12:05.872 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T19:12:05.899 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T19:12:05.899 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T19:12:05.937 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T19:12:05.954 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:12:06.013 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:12:06.076 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:12:06.076 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:06.076 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T19:12:06.076 INFO:teuthology.orchestra.run.trial103.stdout: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:06.077 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:06.077 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T19:12:06.104 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install python3-rados-debuginfo 2026-02-24T19:12:06.423 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:45:53 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T19:12:06.506 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T19:12:06.507 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:12:06.507 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repo Size 2026-02-24T19:12:06.507 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:12:06.507 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T19:12:06.508 INFO:teuthology.orchestra.run.trial103.stdout: python3-rados-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 802 k 2026-02-24T19:12:06.508 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:06.508 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T19:12:06.508 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:12:06.508 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T19:12:06.508 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:06.508 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 802 k 2026-02-24T19:12:06.508 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 3.1 M 2026-02-24T19:12:06.508 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T19:12:07.293 INFO:teuthology.orchestra.run.trial103.stdout:python3-rados-debuginfo-20.2.0-681.g36d388f2.el 1.0 MB/s | 802 kB 00:00 2026-02-24T19:12:07.293 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:07.293 INFO:teuthology.orchestra.run.trial103.stdout:Total 1.0 MB/s | 802 kB 00:00 2026-02-24T19:12:07.294 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T19:12:07.295 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T19:12:07.295 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T19:12:07.315 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T19:12:07.315 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T19:12:07.388 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T19:12:07.405 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:12:07.466 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:12:07.529 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:12:07.529 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:07.529 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T19:12:07.529 INFO:teuthology.orchestra.run.trial103.stdout: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:07.529 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:07.529 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T19:12:07.558 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install python3-rbd-debuginfo 2026-02-24T19:12:07.875 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:45:54 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T19:12:07.960 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T19:12:07.961 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:12:07.961 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repo Size 2026-02-24T19:12:07.961 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:12:07.961 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T19:12:07.961 INFO:teuthology.orchestra.run.trial103.stdout: python3-rbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.2 M 2026-02-24T19:12:07.961 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:07.961 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T19:12:07.961 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:12:07.962 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T19:12:07.962 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:07.962 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 1.2 M 2026-02-24T19:12:07.962 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 4.7 M 2026-02-24T19:12:07.962 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T19:12:08.690 INFO:teuthology.orchestra.run.trial103.stdout:python3-rbd-debuginfo-20.2.0-681.g36d388f2.el9. 1.6 MB/s | 1.2 MB 00:00 2026-02-24T19:12:08.691 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:08.691 INFO:teuthology.orchestra.run.trial103.stdout:Total 1.6 MB/s | 1.2 MB 00:00 2026-02-24T19:12:08.691 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T19:12:08.693 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T19:12:08.693 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T19:12:08.715 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T19:12:08.715 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T19:12:08.808 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T19:12:08.825 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:12:08.887 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:12:08.949 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:12:08.949 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:08.949 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T19:12:08.949 INFO:teuthology.orchestra.run.trial103.stdout: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:08.949 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:08.949 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T19:12:08.977 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install python3-rgw-debuginfo 2026-02-24T19:12:09.294 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:45:56 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T19:12:09.378 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T19:12:09.378 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:12:09.379 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repo Size 2026-02-24T19:12:09.379 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:12:09.379 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T19:12:09.379 INFO:teuthology.orchestra.run.trial103.stdout: python3-rgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 350 k 2026-02-24T19:12:09.379 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:09.379 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T19:12:09.379 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:12:09.379 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T19:12:09.379 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:09.379 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 350 k 2026-02-24T19:12:09.379 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 1.1 M 2026-02-24T19:12:09.380 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T19:12:09.787 INFO:teuthology.orchestra.run.trial103.stdout:python3-rgw-debuginfo-20.2.0-681.g36d388f2.el9. 857 kB/s | 350 kB 00:00 2026-02-24T19:12:09.788 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:09.788 INFO:teuthology.orchestra.run.trial103.stdout:Total 855 kB/s | 350 kB 00:00 2026-02-24T19:12:09.788 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T19:12:09.790 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T19:12:09.790 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T19:12:09.808 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T19:12:09.808 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T19:12:09.858 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T19:12:09.875 INFO:teuthology.orchestra.run.trial103.stdout: Installing : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:12:09.936 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:12:09.999 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:12:09.999 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:09.999 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T19:12:09.999 INFO:teuthology.orchestra.run.trial103.stdout: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:09.999 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:10.000 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T19:12:10.029 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install rbd-fuse-debuginfo 2026-02-24T19:12:10.350 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:45:57 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T19:12:10.433 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T19:12:10.434 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:12:10.434 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repo Size 2026-02-24T19:12:10.435 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:12:10.435 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T19:12:10.435 INFO:teuthology.orchestra.run.trial103.stdout: rbd-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.5 M 2026-02-24T19:12:10.435 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:10.435 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T19:12:10.435 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:12:10.435 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T19:12:10.435 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:10.435 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 1.5 M 2026-02-24T19:12:10.435 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 7.9 M 2026-02-24T19:12:10.436 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T19:12:11.264 INFO:teuthology.orchestra.run.trial103.stdout:rbd-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x86 1.8 MB/s | 1.5 MB 00:00 2026-02-24T19:12:11.265 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:11.265 INFO:teuthology.orchestra.run.trial103.stdout:Total 1.8 MB/s | 1.5 MB 00:00 2026-02-24T19:12:11.265 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T19:12:11.267 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T19:12:11.267 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T19:12:11.289 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T19:12:11.289 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T19:12:11.400 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T19:12:11.417 INFO:teuthology.orchestra.run.trial103.stdout: Installing : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:12:11.485 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:12:11.548 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:12:11.548 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:11.549 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T19:12:11.549 INFO:teuthology.orchestra.run.trial103.stdout: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:11.549 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:11.549 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T19:12:11.577 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install rbd-mirror-debuginfo 2026-02-24T19:12:11.893 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:45:58 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T19:12:11.976 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T19:12:11.977 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:12:11.977 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repo Size 2026-02-24T19:12:11.977 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:12:11.978 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T19:12:11.978 INFO:teuthology.orchestra.run.trial103.stdout: rbd-mirror-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 79 M 2026-02-24T19:12:11.978 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:11.978 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T19:12:11.978 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:12:11.978 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T19:12:11.978 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:11.978 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 79 M 2026-02-24T19:12:11.978 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 375 M 2026-02-24T19:12:11.978 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T19:12:29.754 INFO:teuthology.orchestra.run.trial070.stdout:ceph-test-debuginfo-20.2.0-681.g36d388f2.el9.x8 1.4 MB/s | 1.7 GB 20:38 2026-02-24T19:12:29.755 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:29.755 INFO:teuthology.orchestra.run.trial070.stdout:Total 1.4 MB/s | 1.7 GB 20:38 2026-02-24T19:12:29.755 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T19:12:29.758 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T19:12:29.758 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T19:12:34.464 INFO:teuthology.orchestra.run.trial103.stdout:rbd-mirror-debuginfo-20.2.0-681.g36d388f2.el9.x 3.5 MB/s | 79 MB 00:22 2026-02-24T19:12:34.465 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:34.465 INFO:teuthology.orchestra.run.trial103.stdout:Total 3.5 MB/s | 79 MB 00:22 2026-02-24T19:12:34.465 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T19:12:34.467 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T19:12:34.467 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T19:12:34.718 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T19:12:34.718 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T19:12:34.947 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T19:12:34.948 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T19:12:38.763 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T19:12:38.781 INFO:teuthology.orchestra.run.trial103.stdout: Installing : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:12:39.120 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:12:39.182 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:12:39.182 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:39.182 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T19:12:39.182 INFO:teuthology.orchestra.run.trial103.stdout: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:39.182 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:39.182 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T19:12:39.216 DEBUG:teuthology.orchestra.run.trial103:> sudo yum -y install rbd-nbd-debuginfo 2026-02-24T19:12:39.534 INFO:teuthology.orchestra.run.trial103.stdout:Last metadata expiration check: 0:46:26 ago on Tue 24 Feb 2026 06:26:13 PM UTC. 2026-02-24T19:12:39.621 INFO:teuthology.orchestra.run.trial103.stdout:Dependencies resolved. 2026-02-24T19:12:39.622 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:12:39.622 INFO:teuthology.orchestra.run.trial103.stdout: Package Arch Version Repo Size 2026-02-24T19:12:39.622 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:12:39.622 INFO:teuthology.orchestra.run.trial103.stdout:Installing: 2026-02-24T19:12:39.622 INFO:teuthology.orchestra.run.trial103.stdout: rbd-nbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.4 M 2026-02-24T19:12:39.622 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:39.622 INFO:teuthology.orchestra.run.trial103.stdout:Transaction Summary 2026-02-24T19:12:39.622 INFO:teuthology.orchestra.run.trial103.stdout:================================================================================ 2026-02-24T19:12:39.622 INFO:teuthology.orchestra.run.trial103.stdout:Install 1 Package 2026-02-24T19:12:39.622 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:39.623 INFO:teuthology.orchestra.run.trial103.stdout:Total download size: 2.4 M 2026-02-24T19:12:39.623 INFO:teuthology.orchestra.run.trial103.stdout:Installed size: 12 M 2026-02-24T19:12:39.623 INFO:teuthology.orchestra.run.trial103.stdout:Downloading Packages: 2026-02-24T19:12:40.084 INFO:teuthology.orchestra.run.trial103.stdout:rbd-nbd-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 5.3 MB/s | 2.4 MB 00:00 2026-02-24T19:12:40.085 INFO:teuthology.orchestra.run.trial103.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:12:40.085 INFO:teuthology.orchestra.run.trial103.stdout:Total 5.3 MB/s | 2.4 MB 00:00 2026-02-24T19:12:40.085 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction check 2026-02-24T19:12:40.086 INFO:teuthology.orchestra.run.trial103.stdout:Transaction check succeeded. 2026-02-24T19:12:40.086 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction test 2026-02-24T19:12:40.111 INFO:teuthology.orchestra.run.trial103.stdout:Transaction test succeeded. 2026-02-24T19:12:40.112 INFO:teuthology.orchestra.run.trial103.stdout:Running transaction 2026-02-24T19:12:40.271 INFO:teuthology.orchestra.run.trial103.stdout: Preparing : 1/1 2026-02-24T19:12:40.289 INFO:teuthology.orchestra.run.trial103.stdout: Installing : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:12:40.361 INFO:teuthology.orchestra.run.trial103.stdout: Running scriptlet: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:12:40.425 INFO:teuthology.orchestra.run.trial103.stdout: Verifying : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:12:40.426 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:40.426 INFO:teuthology.orchestra.run.trial103.stdout:Installed: 2026-02-24T19:12:40.426 INFO:teuthology.orchestra.run.trial103.stdout: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:12:40.426 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:12:40.426 INFO:teuthology.orchestra.run.trial103.stdout:Complete! 2026-02-24T19:12:40.460 DEBUG:teuthology.parallel:result is None 2026-02-24T19:13:46.372 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T19:13:46.393 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:13:49.500 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:13:49.562 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:13:49.563 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:13:49.563 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T19:13:49.563 INFO:teuthology.orchestra.run.trial162.stdout: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:49.563 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:13:49.563 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T19:13:49.765 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-base-debuginfo 2026-02-24T19:13:50.085 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:47:42 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T19:13:50.151 INFO:teuthology.orchestra.run.trial162.stdout:Package ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T19:13:50.170 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T19:13:50.171 INFO:teuthology.orchestra.run.trial162.stdout:Nothing to do. 2026-02-24T19:13:50.171 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T19:13:50.193 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-mgr-debuginfo 2026-02-24T19:13:50.511 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:47:42 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T19:13:50.595 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T19:13:50.596 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:13:50.596 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-24T19:13:50.596 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:13:50.597 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T19:13:50.597 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 22 M 2026-02-24T19:13:50.597 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:13:50.597 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T19:13:50.597 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:13:50.597 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T19:13:50.597 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:13:50.597 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 22 M 2026-02-24T19:13:50.597 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 146 M 2026-02-24T19:13:50.597 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T19:13:52.558 INFO:teuthology.orchestra.run.trial162.stdout:ceph-mgr-debuginfo-20.2.0-681.g36d388f2.el9.x86 11 MB/s | 22 MB 00:01 2026-02-24T19:13:52.559 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:52.559 INFO:teuthology.orchestra.run.trial162.stdout:Total 11 MB/s | 22 MB 00:01 2026-02-24T19:13:52.559 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T19:13:52.561 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T19:13:52.561 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T19:13:52.643 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T19:13:52.643 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T19:13:53.916 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T19:13:53.934 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:54.100 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:54.162 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:54.162 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:13:54.162 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T19:13:54.162 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:54.162 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:13:54.162 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T19:13:54.191 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-mds-debuginfo 2026-02-24T19:13:54.509 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:47:46 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T19:13:54.596 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T19:13:54.597 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:13:54.597 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-24T19:13:54.597 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:13:54.597 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T19:13:54.597 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mds-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 54 M 2026-02-24T19:13:54.597 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:13:54.597 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T19:13:54.597 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:13:54.597 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T19:13:54.598 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:13:54.598 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 54 M 2026-02-24T19:13:54.598 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 221 M 2026-02-24T19:13:54.598 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T19:13:56.314 INFO:teuthology.orchestra.run.trial162.stdout:ceph-mds-debuginfo-20.2.0-681.g36d388f2.el9.x86 31 MB/s | 54 MB 00:01 2026-02-24T19:13:56.315 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:13:56.315 INFO:teuthology.orchestra.run.trial162.stdout:Total 31 MB/s | 54 MB 00:01 2026-02-24T19:13:56.315 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T19:13:56.317 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T19:13:56.317 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T19:13:56.502 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T19:13:56.502 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T19:13:59.158 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T19:13:59.176 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:59.394 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:59.455 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:13:59.455 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:13:59.456 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T19:13:59.456 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:13:59.456 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:13:59.456 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T19:13:59.489 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-mon-debuginfo 2026-02-24T19:13:59.803 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:47:51 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T19:13:59.888 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T19:13:59.889 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:13:59.889 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-24T19:13:59.889 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:13:59.890 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T19:13:59.890 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mon-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 130 M 2026-02-24T19:13:59.890 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:13:59.890 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T19:13:59.890 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:13:59.890 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T19:13:59.890 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:13:59.890 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 130 M 2026-02-24T19:13:59.890 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 643 M 2026-02-24T19:13:59.890 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T19:14:15.233 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T19:14:15.253 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:14:18.361 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:14:18.422 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:14:18.422 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:14:18.423 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T19:14:18.423 INFO:teuthology.orchestra.run.trial070.stdout: ceph-test-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:18.423 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:14:18.423 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T19:14:18.630 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-base-debuginfo 2026-02-24T19:14:18.948 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:48:13 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:14:19.013 INFO:teuthology.orchestra.run.trial070.stdout:Package ceph-base-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 is already installed. 2026-02-24T19:14:19.032 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T19:14:19.033 INFO:teuthology.orchestra.run.trial070.stdout:Nothing to do. 2026-02-24T19:14:19.033 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T19:14:19.055 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-mgr-debuginfo 2026-02-24T19:14:19.375 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:48:14 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:14:19.460 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T19:14:19.461 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:14:19.461 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-24T19:14:19.462 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:14:19.462 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T19:14:19.462 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 22 M 2026-02-24T19:14:19.462 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:14:19.462 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T19:14:19.462 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:14:19.462 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T19:14:19.462 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:14:19.462 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 22 M 2026-02-24T19:14:19.462 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 146 M 2026-02-24T19:14:19.463 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T19:14:24.041 INFO:teuthology.orchestra.run.trial070.stdout:ceph-mgr-debuginfo-20.2.0-681.g36d388f2.el9.x86 4.8 MB/s | 22 MB 00:04 2026-02-24T19:14:24.042 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:14:24.042 INFO:teuthology.orchestra.run.trial070.stdout:Total 4.8 MB/s | 22 MB 00:04 2026-02-24T19:14:24.043 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T19:14:24.044 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T19:14:24.044 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T19:14:24.125 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T19:14:24.125 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T19:14:25.380 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T19:14:25.398 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:25.564 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:25.625 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:25.625 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:14:25.625 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T19:14:25.625 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mgr-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:25.625 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:14:25.626 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T19:14:25.654 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-mds-debuginfo 2026-02-24T19:14:25.968 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:48:20 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:14:26.051 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T19:14:26.052 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:14:26.052 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-24T19:14:26.053 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:14:26.053 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T19:14:26.053 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mds-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 54 M 2026-02-24T19:14:26.053 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:14:26.053 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T19:14:26.053 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:14:26.053 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T19:14:26.053 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:14:26.053 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 54 M 2026-02-24T19:14:26.053 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 221 M 2026-02-24T19:14:26.053 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T19:14:29.763 INFO:teuthology.orchestra.run.trial162.stdout:ceph-mon-debuginfo-20.2.0-681.g36d388f2.el9.x86 4.3 MB/s | 130 MB 00:29 2026-02-24T19:14:29.764 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:14:29.764 INFO:teuthology.orchestra.run.trial162.stdout:Total 4.3 MB/s | 130 MB 00:29 2026-02-24T19:14:29.764 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T19:14:29.766 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T19:14:29.766 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T19:14:30.165 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T19:14:30.165 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T19:14:36.812 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T19:14:36.830 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:37.360 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:37.422 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:37.422 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:14:37.422 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T19:14:37.422 INFO:teuthology.orchestra.run.trial162.stdout: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:37.422 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:14:37.422 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T19:14:37.461 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-osd-debuginfo 2026-02-24T19:14:37.778 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:48:29 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T19:14:37.863 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T19:14:37.864 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:14:37.864 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-24T19:14:37.864 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:14:37.864 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T19:14:37.864 INFO:teuthology.orchestra.run.trial162.stdout: ceph-osd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 343 M 2026-02-24T19:14:37.864 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:14:37.864 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T19:14:37.864 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:14:37.864 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T19:14:37.864 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:14:37.864 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 343 M 2026-02-24T19:14:37.864 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 1.6 G 2026-02-24T19:14:37.864 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T19:14:44.643 INFO:teuthology.orchestra.run.trial070.stdout:ceph-mds-debuginfo-20.2.0-681.g36d388f2.el9.x86 2.9 MB/s | 54 MB 00:18 2026-02-24T19:14:44.644 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:14:44.644 INFO:teuthology.orchestra.run.trial070.stdout:Total 2.9 MB/s | 54 MB 00:18 2026-02-24T19:14:44.644 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T19:14:44.645 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T19:14:44.646 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T19:14:44.822 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T19:14:44.822 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T19:14:47.469 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T19:14:47.487 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:47.704 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:47.766 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:14:47.766 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:14:47.766 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T19:14:47.766 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mds-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:14:47.766 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:14:47.766 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T19:14:47.797 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-mon-debuginfo 2026-02-24T19:14:48.110 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:48:43 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:14:48.195 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T19:14:48.196 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:14:48.196 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-24T19:14:48.196 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:14:48.196 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T19:14:48.196 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mon-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 130 M 2026-02-24T19:14:48.196 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:14:48.196 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T19:14:48.196 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:14:48.197 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T19:14:48.197 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:14:48.197 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 130 M 2026-02-24T19:14:48.197 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 643 M 2026-02-24T19:14:48.197 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T19:14:58.767 INFO:teuthology.orchestra.run.trial070.stdout:ceph-mon-debuginfo-20.2.0-681.g36d388f2.el9.x86 12 MB/s | 130 MB 00:10 2026-02-24T19:14:58.768 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:14:58.768 INFO:teuthology.orchestra.run.trial070.stdout:Total 12 MB/s | 130 MB 00:10 2026-02-24T19:14:58.768 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T19:14:58.770 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T19:14:58.770 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T19:14:59.170 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T19:14:59.171 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T19:15:02.401 INFO:teuthology.orchestra.run.trial162.stdout:ceph-osd-debuginfo-20.2.0-681.g36d388f2.el9.x86 14 MB/s | 343 MB 00:24 2026-02-24T19:15:02.402 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:02.402 INFO:teuthology.orchestra.run.trial162.stdout:Total 14 MB/s | 343 MB 00:24 2026-02-24T19:15:02.402 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T19:15:02.404 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T19:15:02.404 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T19:15:03.427 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T19:15:03.427 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T19:15:05.821 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T19:15:05.839 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:06.368 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:06.431 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:06.431 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:15:06.431 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T19:15:06.431 INFO:teuthology.orchestra.run.trial070.stdout: ceph-mon-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:06.431 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:15:06.431 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T19:15:06.472 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-osd-debuginfo 2026-02-24T19:15:06.790 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:49:01 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:15:06.874 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T19:15:06.875 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:15:06.875 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-24T19:15:06.875 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:15:06.875 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T19:15:06.876 INFO:teuthology.orchestra.run.trial070.stdout: ceph-osd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 343 M 2026-02-24T19:15:06.876 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:15:06.876 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T19:15:06.876 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:15:06.876 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T19:15:06.876 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:15:06.876 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 343 M 2026-02-24T19:15:06.876 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 1.6 G 2026-02-24T19:15:06.876 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T19:15:20.661 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T19:15:20.679 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:21.910 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:21.971 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:21.971 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:21.972 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T19:15:21.972 INFO:teuthology.orchestra.run.trial162.stdout: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:21.972 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:21.972 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T19:15:22.032 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install ceph-fuse-debuginfo 2026-02-24T19:15:22.353 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:49:14 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T19:15:22.439 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T19:15:22.439 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:22.440 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-24T19:15:22.440 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:22.440 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T19:15:22.440 INFO:teuthology.orchestra.run.trial162.stdout: ceph-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 10 M 2026-02-24T19:15:22.440 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:22.440 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T19:15:22.440 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:22.440 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T19:15:22.440 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:22.440 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 10 M 2026-02-24T19:15:22.441 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 51 M 2026-02-24T19:15:22.441 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T19:15:23.711 INFO:teuthology.orchestra.run.trial162.stdout:ceph-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x8 8.0 MB/s | 10 MB 00:01 2026-02-24T19:15:23.712 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:23.712 INFO:teuthology.orchestra.run.trial162.stdout:Total 8.0 MB/s | 10 MB 00:01 2026-02-24T19:15:23.712 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T19:15:23.714 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T19:15:23.715 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T19:15:23.761 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T19:15:23.761 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T19:15:24.322 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T19:15:24.339 INFO:teuthology.orchestra.run.trial162.stdout: Installing : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:15:24.436 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:15:24.497 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:15:24.498 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:24.498 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T19:15:24.498 INFO:teuthology.orchestra.run.trial162.stdout: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:24.498 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:24.498 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T19:15:24.524 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install librados-devel-debuginfo 2026-02-24T19:15:24.834 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:49:16 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T19:15:24.917 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T19:15:24.917 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:24.918 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-24T19:15:24.918 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:24.918 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T19:15:24.918 INFO:teuthology.orchestra.run.trial162.stdout: librados-devel-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 144 k 2026-02-24T19:15:24.918 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:24.918 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T19:15:24.918 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:24.918 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T19:15:24.918 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:24.918 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 144 k 2026-02-24T19:15:24.919 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 802 k 2026-02-24T19:15:24.919 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T19:15:25.275 INFO:teuthology.orchestra.run.trial162.stdout:librados-devel-debuginfo-20.2.0-681.g36d388f2.e 402 kB/s | 144 kB 00:00 2026-02-24T19:15:25.276 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:25.276 INFO:teuthology.orchestra.run.trial162.stdout:Total 401 kB/s | 144 kB 00:00 2026-02-24T19:15:25.276 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T19:15:25.278 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T19:15:25.278 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T19:15:25.296 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T19:15:25.296 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T19:15:25.336 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T19:15:25.353 INFO:teuthology.orchestra.run.trial162.stdout: Installing : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:15:25.411 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:15:25.472 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:15:25.472 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:25.473 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T19:15:25.473 INFO:teuthology.orchestra.run.trial162.stdout: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:25.473 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:25.473 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T19:15:25.498 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install libcephfs2-debuginfo 2026-02-24T19:15:25.811 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:49:17 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T19:15:25.895 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T19:15:25.896 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:25.896 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-24T19:15:25.896 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:25.896 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T19:15:25.896 INFO:teuthology.orchestra.run.trial162.stdout: libcephfs2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 9.1 M 2026-02-24T19:15:25.896 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:25.896 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T19:15:25.896 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:25.896 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T19:15:25.897 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:25.897 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 9.1 M 2026-02-24T19:15:25.897 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 46 M 2026-02-24T19:15:25.897 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T19:15:26.958 INFO:teuthology.orchestra.run.trial162.stdout:libcephfs2-debuginfo-20.2.0-681.g36d388f2.el9.x 8.6 MB/s | 9.1 MB 00:01 2026-02-24T19:15:26.959 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:26.959 INFO:teuthology.orchestra.run.trial162.stdout:Total 8.6 MB/s | 9.1 MB 00:01 2026-02-24T19:15:26.959 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T19:15:26.961 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T19:15:26.961 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T19:15:27.004 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T19:15:27.005 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T19:15:27.501 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T19:15:27.518 INFO:teuthology.orchestra.run.trial162.stdout: Installing : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:15:27.611 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:15:27.673 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:15:27.674 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:27.674 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T19:15:27.674 INFO:teuthology.orchestra.run.trial162.stdout: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:27.674 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:27.674 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T19:15:27.701 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install librados2-debuginfo 2026-02-24T19:15:28.013 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:49:20 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T19:15:28.099 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T19:15:28.099 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:28.100 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-24T19:15:28.100 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:28.100 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T19:15:28.100 INFO:teuthology.orchestra.run.trial162.stdout: librados2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 63 M 2026-02-24T19:15:28.100 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:28.100 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T19:15:28.100 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:28.100 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T19:15:28.100 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:28.100 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 63 M 2026-02-24T19:15:28.101 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 397 M 2026-02-24T19:15:28.101 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T19:15:32.555 INFO:teuthology.orchestra.run.trial162.stdout:librados2-debuginfo-20.2.0-681.g36d388f2.el9.x8 14 MB/s | 63 MB 00:04 2026-02-24T19:15:32.556 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:32.556 INFO:teuthology.orchestra.run.trial162.stdout:Total 14 MB/s | 63 MB 00:04 2026-02-24T19:15:32.556 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T19:15:32.558 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T19:15:32.558 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T19:15:32.764 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T19:15:32.764 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T19:15:36.276 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T19:15:36.293 INFO:teuthology.orchestra.run.trial162.stdout: Installing : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:15:36.431 INFO:teuthology.orchestra.run.trial070.stdout:ceph-osd-debuginfo-20.2.0-681.g36d388f2.el9.x86 12 MB/s | 343 MB 00:29 2026-02-24T19:15:36.432 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:36.432 INFO:teuthology.orchestra.run.trial070.stdout:Total 12 MB/s | 343 MB 00:29 2026-02-24T19:15:36.432 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T19:15:36.434 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T19:15:36.434 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T19:15:36.637 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:15:36.699 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:15:36.699 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:36.700 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T19:15:36.700 INFO:teuthology.orchestra.run.trial162.stdout: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:36.700 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:36.700 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T19:15:36.733 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install librbd1-debuginfo 2026-02-24T19:15:37.051 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:49:29 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T19:15:37.135 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T19:15:37.135 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:37.135 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-24T19:15:37.135 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:37.135 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T19:15:37.135 INFO:teuthology.orchestra.run.trial162.stdout: librbd1-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 80 M 2026-02-24T19:15:37.135 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:37.135 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T19:15:37.135 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:37.135 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T19:15:37.135 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:37.136 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 80 M 2026-02-24T19:15:37.137 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 406 M 2026-02-24T19:15:37.137 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T19:15:37.455 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T19:15:37.455 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T19:15:39.228 INFO:teuthology.orchestra.run.trial162.stdout:librbd1-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 38 MB/s | 80 MB 00:02 2026-02-24T19:15:39.229 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:39.229 INFO:teuthology.orchestra.run.trial162.stdout:Total 38 MB/s | 80 MB 00:02 2026-02-24T19:15:39.230 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T19:15:39.231 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T19:15:39.231 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T19:15:39.486 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T19:15:39.486 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T19:15:43.792 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T19:15:43.810 INFO:teuthology.orchestra.run.trial162.stdout: Installing : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:44.169 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:44.230 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:44.230 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:44.230 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T19:15:44.230 INFO:teuthology.orchestra.run.trial162.stdout: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:44.230 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:44.230 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T19:15:44.262 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install python3-cephfs-debuginfo 2026-02-24T19:15:44.581 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:49:36 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T19:15:44.665 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T19:15:44.666 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:44.666 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-24T19:15:44.666 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:44.666 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T19:15:44.666 INFO:teuthology.orchestra.run.trial162.stdout: python3-cephfs-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 645 k 2026-02-24T19:15:44.666 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:44.666 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T19:15:44.667 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:44.667 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T19:15:44.667 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:44.667 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 645 k 2026-02-24T19:15:44.667 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 2.3 M 2026-02-24T19:15:44.667 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T19:15:44.776 INFO:teuthology.orchestra.run.trial162.stdout:python3-cephfs-debuginfo-20.2.0-681.g36d388f2.e 5.7 MB/s | 645 kB 00:00 2026-02-24T19:15:44.776 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:44.777 INFO:teuthology.orchestra.run.trial162.stdout:Total 5.7 MB/s | 645 kB 00:00 2026-02-24T19:15:44.777 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T19:15:44.778 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T19:15:44.779 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T19:15:44.798 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T19:15:44.798 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T19:15:44.865 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T19:15:44.882 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:15:44.942 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:15:45.004 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:15:45.004 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:45.004 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T19:15:45.005 INFO:teuthology.orchestra.run.trial162.stdout: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:45.005 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:45.005 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T19:15:45.032 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install python3-rados-debuginfo 2026-02-24T19:15:45.345 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:49:37 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T19:15:45.428 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T19:15:45.429 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:45.429 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-24T19:15:45.429 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:45.429 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T19:15:45.429 INFO:teuthology.orchestra.run.trial162.stdout: python3-rados-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 802 k 2026-02-24T19:15:45.430 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:45.430 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T19:15:45.430 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:45.430 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T19:15:45.430 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:45.430 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 802 k 2026-02-24T19:15:45.430 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 3.1 M 2026-02-24T19:15:45.430 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T19:15:48.150 INFO:teuthology.orchestra.run.trial162.stdout:python3-rados-debuginfo-20.2.0-681.g36d388f2.el 295 kB/s | 802 kB 00:02 2026-02-24T19:15:48.151 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:48.151 INFO:teuthology.orchestra.run.trial162.stdout:Total 295 kB/s | 802 kB 00:02 2026-02-24T19:15:48.151 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T19:15:48.153 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T19:15:48.153 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T19:15:48.173 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T19:15:48.173 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T19:15:48.245 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T19:15:48.262 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:15:48.323 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:15:48.385 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:15:48.385 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:48.385 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T19:15:48.385 INFO:teuthology.orchestra.run.trial162.stdout: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:48.385 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:48.385 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T19:15:48.412 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install python3-rbd-debuginfo 2026-02-24T19:15:48.724 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:49:40 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T19:15:48.809 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T19:15:48.809 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:48.810 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-24T19:15:48.810 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:48.810 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T19:15:48.810 INFO:teuthology.orchestra.run.trial162.stdout: python3-rbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.2 M 2026-02-24T19:15:48.810 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:48.810 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T19:15:48.810 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:48.810 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T19:15:48.810 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:48.810 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 1.2 M 2026-02-24T19:15:48.811 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 4.7 M 2026-02-24T19:15:48.811 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T19:15:48.929 INFO:teuthology.orchestra.run.trial162.stdout:python3-rbd-debuginfo-20.2.0-681.g36d388f2.el9. 9.8 MB/s | 1.2 MB 00:00 2026-02-24T19:15:48.930 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:48.930 INFO:teuthology.orchestra.run.trial162.stdout:Total 9.7 MB/s | 1.2 MB 00:00 2026-02-24T19:15:48.930 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T19:15:48.931 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T19:15:48.931 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T19:15:48.953 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T19:15:48.953 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T19:15:49.044 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T19:15:49.061 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:15:49.124 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:15:49.187 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:15:49.188 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:49.188 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T19:15:49.188 INFO:teuthology.orchestra.run.trial162.stdout: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:49.188 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:49.188 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T19:15:49.216 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install python3-rgw-debuginfo 2026-02-24T19:15:49.528 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:49:41 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T19:15:49.612 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T19:15:49.612 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:49.612 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-24T19:15:49.612 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:49.612 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T19:15:49.612 INFO:teuthology.orchestra.run.trial162.stdout: python3-rgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 350 k 2026-02-24T19:15:49.612 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:49.612 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T19:15:49.612 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:49.612 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T19:15:49.612 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:49.613 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 350 k 2026-02-24T19:15:49.613 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 1.1 M 2026-02-24T19:15:49.613 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T19:15:49.709 INFO:teuthology.orchestra.run.trial162.stdout:python3-rgw-debuginfo-20.2.0-681.g36d388f2.el9. 3.5 MB/s | 350 kB 00:00 2026-02-24T19:15:49.710 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:49.710 INFO:teuthology.orchestra.run.trial162.stdout:Total 3.5 MB/s | 350 kB 00:00 2026-02-24T19:15:49.710 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T19:15:49.712 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T19:15:49.712 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T19:15:49.730 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T19:15:49.730 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T19:15:49.779 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T19:15:49.796 INFO:teuthology.orchestra.run.trial162.stdout: Installing : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:15:49.862 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:15:49.925 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:15:49.925 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:49.925 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T19:15:49.925 INFO:teuthology.orchestra.run.trial162.stdout: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:49.925 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:49.925 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T19:15:49.952 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install rbd-fuse-debuginfo 2026-02-24T19:15:50.263 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:49:42 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T19:15:50.349 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T19:15:50.349 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:50.349 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-24T19:15:50.349 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:50.349 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T19:15:50.349 INFO:teuthology.orchestra.run.trial162.stdout: rbd-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.5 M 2026-02-24T19:15:50.349 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:50.349 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T19:15:50.349 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:50.349 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T19:15:50.349 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:50.349 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 1.5 M 2026-02-24T19:15:50.349 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 7.9 M 2026-02-24T19:15:50.349 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T19:15:50.845 INFO:teuthology.orchestra.run.trial162.stdout:rbd-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x86 3.1 MB/s | 1.5 MB 00:00 2026-02-24T19:15:50.846 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:50.846 INFO:teuthology.orchestra.run.trial162.stdout:Total 3.1 MB/s | 1.5 MB 00:00 2026-02-24T19:15:50.846 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T19:15:50.848 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T19:15:50.848 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T19:15:50.870 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T19:15:50.870 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T19:15:50.984 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T19:15:51.001 INFO:teuthology.orchestra.run.trial162.stdout: Installing : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:51.064 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:51.126 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:51.126 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:51.126 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T19:15:51.126 INFO:teuthology.orchestra.run.trial162.stdout: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:51.126 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:51.126 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T19:15:51.154 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install rbd-mirror-debuginfo 2026-02-24T19:15:51.471 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:49:43 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T19:15:51.556 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T19:15:51.556 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:51.557 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-24T19:15:51.557 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:51.557 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T19:15:51.557 INFO:teuthology.orchestra.run.trial162.stdout: rbd-mirror-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 79 M 2026-02-24T19:15:51.557 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:51.557 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T19:15:51.557 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:51.557 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T19:15:51.557 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:51.557 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 79 M 2026-02-24T19:15:51.557 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 375 M 2026-02-24T19:15:51.558 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T19:15:53.579 INFO:teuthology.orchestra.run.trial162.stdout:rbd-mirror-debuginfo-20.2.0-681.g36d388f2.el9.x 39 MB/s | 79 MB 00:02 2026-02-24T19:15:53.580 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:53.580 INFO:teuthology.orchestra.run.trial162.stdout:Total 39 MB/s | 79 MB 00:02 2026-02-24T19:15:53.580 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T19:15:53.582 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T19:15:53.582 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T19:15:53.833 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T19:15:53.833 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T19:15:55.453 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T19:15:55.470 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:56.709 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:56.770 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:56.770 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:15:56.770 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T19:15:56.770 INFO:teuthology.orchestra.run.trial070.stdout: ceph-osd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:56.770 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:15:56.770 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T19:15:56.828 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install ceph-fuse-debuginfo 2026-02-24T19:15:57.139 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:49:52 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:15:57.222 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T19:15:57.223 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:15:57.223 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-24T19:15:57.223 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:15:57.223 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T19:15:57.223 INFO:teuthology.orchestra.run.trial070.stdout: ceph-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 10 M 2026-02-24T19:15:57.223 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:15:57.223 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T19:15:57.224 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:15:57.224 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T19:15:57.224 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:15:57.224 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 10 M 2026-02-24T19:15:57.224 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 51 M 2026-02-24T19:15:57.224 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T19:15:57.886 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T19:15:57.903 INFO:teuthology.orchestra.run.trial162.stdout: Installing : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:15:58.230 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:15:58.292 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:15:58.292 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:58.292 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T19:15:58.292 INFO:teuthology.orchestra.run.trial162.stdout: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:58.292 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:58.292 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T19:15:58.328 DEBUG:teuthology.orchestra.run.trial162:> sudo yum -y install rbd-nbd-debuginfo 2026-02-24T19:15:58.390 INFO:teuthology.orchestra.run.trial070.stdout:ceph-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x8 8.7 MB/s | 10 MB 00:01 2026-02-24T19:15:58.391 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:58.391 INFO:teuthology.orchestra.run.trial070.stdout:Total 8.7 MB/s | 10 MB 00:01 2026-02-24T19:15:58.391 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T19:15:58.392 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T19:15:58.392 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T19:15:58.440 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T19:15:58.441 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T19:15:58.641 INFO:teuthology.orchestra.run.trial162.stdout:Last metadata expiration check: 0:49:50 ago on Tue 24 Feb 2026 06:26:08 PM UTC. 2026-02-24T19:15:58.725 INFO:teuthology.orchestra.run.trial162.stdout:Dependencies resolved. 2026-02-24T19:15:58.726 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:58.726 INFO:teuthology.orchestra.run.trial162.stdout: Package Arch Version Repo Size 2026-02-24T19:15:58.726 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:58.726 INFO:teuthology.orchestra.run.trial162.stdout:Installing: 2026-02-24T19:15:58.727 INFO:teuthology.orchestra.run.trial162.stdout: rbd-nbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.4 M 2026-02-24T19:15:58.727 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:58.727 INFO:teuthology.orchestra.run.trial162.stdout:Transaction Summary 2026-02-24T19:15:58.727 INFO:teuthology.orchestra.run.trial162.stdout:================================================================================ 2026-02-24T19:15:58.727 INFO:teuthology.orchestra.run.trial162.stdout:Install 1 Package 2026-02-24T19:15:58.727 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:58.727 INFO:teuthology.orchestra.run.trial162.stdout:Total download size: 2.4 M 2026-02-24T19:15:58.727 INFO:teuthology.orchestra.run.trial162.stdout:Installed size: 12 M 2026-02-24T19:15:58.727 INFO:teuthology.orchestra.run.trial162.stdout:Downloading Packages: 2026-02-24T19:15:58.927 INFO:teuthology.orchestra.run.trial162.stdout:rbd-nbd-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 12 MB/s | 2.4 MB 00:00 2026-02-24T19:15:58.928 INFO:teuthology.orchestra.run.trial162.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:58.928 INFO:teuthology.orchestra.run.trial162.stdout:Total 12 MB/s | 2.4 MB 00:00 2026-02-24T19:15:58.928 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction check 2026-02-24T19:15:58.929 INFO:teuthology.orchestra.run.trial162.stdout:Transaction check succeeded. 2026-02-24T19:15:58.929 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction test 2026-02-24T19:15:58.954 INFO:teuthology.orchestra.run.trial162.stdout:Transaction test succeeded. 2026-02-24T19:15:58.955 INFO:teuthology.orchestra.run.trial162.stdout:Running transaction 2026-02-24T19:15:58.990 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T19:15:59.008 INFO:teuthology.orchestra.run.trial070.stdout: Installing : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:15:59.104 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:15:59.113 INFO:teuthology.orchestra.run.trial162.stdout: Preparing : 1/1 2026-02-24T19:15:59.130 INFO:teuthology.orchestra.run.trial162.stdout: Installing : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:59.165 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:15:59.165 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:15:59.166 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T19:15:59.166 INFO:teuthology.orchestra.run.trial070.stdout: ceph-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:59.166 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:15:59.166 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T19:15:59.193 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install librados-devel-debuginfo 2026-02-24T19:15:59.200 INFO:teuthology.orchestra.run.trial162.stdout: Running scriptlet: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:59.262 INFO:teuthology.orchestra.run.trial162.stdout: Verifying : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:15:59.263 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:59.263 INFO:teuthology.orchestra.run.trial162.stdout:Installed: 2026-02-24T19:15:59.263 INFO:teuthology.orchestra.run.trial162.stdout: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:59.263 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:15:59.263 INFO:teuthology.orchestra.run.trial162.stdout:Complete! 2026-02-24T19:15:59.295 DEBUG:teuthology.parallel:result is None 2026-02-24T19:15:59.508 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:49:54 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:15:59.590 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T19:15:59.591 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:15:59.591 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-24T19:15:59.591 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:15:59.591 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T19:15:59.591 INFO:teuthology.orchestra.run.trial070.stdout: librados-devel-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 144 k 2026-02-24T19:15:59.592 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:15:59.592 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T19:15:59.592 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:15:59.592 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T19:15:59.592 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:15:59.592 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 144 k 2026-02-24T19:15:59.592 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 802 k 2026-02-24T19:15:59.592 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T19:15:59.677 INFO:teuthology.orchestra.run.trial070.stdout:librados-devel-debuginfo-20.2.0-681.g36d388f2.e 1.6 MB/s | 144 kB 00:00 2026-02-24T19:15:59.678 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:15:59.678 INFO:teuthology.orchestra.run.trial070.stdout:Total 1.6 MB/s | 144 kB 00:00 2026-02-24T19:15:59.678 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T19:15:59.679 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T19:15:59.679 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T19:15:59.698 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T19:15:59.698 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T19:15:59.738 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T19:15:59.755 INFO:teuthology.orchestra.run.trial070.stdout: Installing : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:15:59.813 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:15:59.874 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:15:59.875 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:15:59.875 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T19:15:59.875 INFO:teuthology.orchestra.run.trial070.stdout: librados-devel-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:15:59.875 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:15:59.875 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T19:15:59.901 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install libcephfs2-debuginfo 2026-02-24T19:16:00.212 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:49:55 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:16:00.295 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T19:16:00.296 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:00.296 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-24T19:16:00.296 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:00.297 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T19:16:00.297 INFO:teuthology.orchestra.run.trial070.stdout: libcephfs2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 9.1 M 2026-02-24T19:16:00.297 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:00.297 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T19:16:00.297 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:00.297 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T19:16:00.297 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:00.297 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 9.1 M 2026-02-24T19:16:00.297 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 46 M 2026-02-24T19:16:00.297 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T19:16:00.576 INFO:teuthology.orchestra.run.trial070.stdout:libcephfs2-debuginfo-20.2.0-681.g36d388f2.el9.x 33 MB/s | 9.1 MB 00:00 2026-02-24T19:16:00.577 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:16:00.577 INFO:teuthology.orchestra.run.trial070.stdout:Total 32 MB/s | 9.1 MB 00:00 2026-02-24T19:16:00.577 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T19:16:00.579 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T19:16:00.579 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T19:16:00.623 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T19:16:00.623 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T19:16:01.143 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T19:16:01.160 INFO:teuthology.orchestra.run.trial070.stdout: Installing : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:16:01.254 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:16:01.315 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:16:01.315 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:01.315 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T19:16:01.315 INFO:teuthology.orchestra.run.trial070.stdout: libcephfs2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:16:01.315 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:01.315 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T19:16:01.343 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install librados2-debuginfo 2026-02-24T19:16:01.654 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:49:56 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:16:01.737 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T19:16:01.738 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:01.738 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-24T19:16:01.739 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:01.739 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T19:16:01.739 INFO:teuthology.orchestra.run.trial070.stdout: librados2-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 63 M 2026-02-24T19:16:01.739 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:01.739 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T19:16:01.739 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:01.739 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T19:16:01.739 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:01.739 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 63 M 2026-02-24T19:16:01.739 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 397 M 2026-02-24T19:16:01.740 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T19:16:03.917 INFO:teuthology.orchestra.run.trial070.stdout:librados2-debuginfo-20.2.0-681.g36d388f2.el9.x8 29 MB/s | 63 MB 00:02 2026-02-24T19:16:03.917 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:16:03.918 INFO:teuthology.orchestra.run.trial070.stdout:Total 29 MB/s | 63 MB 00:02 2026-02-24T19:16:03.918 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T19:16:03.919 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T19:16:03.920 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T19:16:04.125 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T19:16:04.125 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T19:16:07.692 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T19:16:07.710 INFO:teuthology.orchestra.run.trial070.stdout: Installing : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:16:08.050 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:16:08.112 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_6 1/1 2026-02-24T19:16:08.112 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:08.112 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T19:16:08.112 INFO:teuthology.orchestra.run.trial070.stdout: librados2-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:16:08.112 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:08.112 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T19:16:08.144 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install librbd1-debuginfo 2026-02-24T19:16:08.448 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:50:03 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:16:08.531 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T19:16:08.532 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:08.532 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-24T19:16:08.532 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:08.532 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T19:16:08.532 INFO:teuthology.orchestra.run.trial070.stdout: librbd1-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 80 M 2026-02-24T19:16:08.532 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:08.532 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T19:16:08.532 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:08.533 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T19:16:08.533 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:08.533 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 80 M 2026-02-24T19:16:08.533 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 406 M 2026-02-24T19:16:08.533 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T19:16:11.872 INFO:teuthology.orchestra.run.trial070.stdout:librbd1-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 24 MB/s | 80 MB 00:03 2026-02-24T19:16:11.872 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:16:11.873 INFO:teuthology.orchestra.run.trial070.stdout:Total 24 MB/s | 80 MB 00:03 2026-02-24T19:16:11.873 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T19:16:11.875 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T19:16:11.875 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T19:16:12.130 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T19:16:12.130 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T19:16:16.421 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T19:16:16.439 INFO:teuthology.orchestra.run.trial070.stdout: Installing : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:16:16.795 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:16:16.856 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:16:16.856 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:16.856 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T19:16:16.856 INFO:teuthology.orchestra.run.trial070.stdout: librbd1-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:16:16.856 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:16.856 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T19:16:16.890 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install python3-cephfs-debuginfo 2026-02-24T19:16:17.206 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:50:12 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:16:17.288 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T19:16:17.288 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:17.289 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-24T19:16:17.289 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:17.289 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T19:16:17.289 INFO:teuthology.orchestra.run.trial070.stdout: python3-cephfs-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 645 k 2026-02-24T19:16:17.289 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:17.289 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T19:16:17.289 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:17.289 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T19:16:17.289 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:17.289 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 645 k 2026-02-24T19:16:17.289 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 2.3 M 2026-02-24T19:16:17.289 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T19:16:17.440 INFO:teuthology.orchestra.run.trial070.stdout:python3-cephfs-debuginfo-20.2.0-681.g36d388f2.e 4.2 MB/s | 645 kB 00:00 2026-02-24T19:16:17.441 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:16:17.441 INFO:teuthology.orchestra.run.trial070.stdout:Total 4.1 MB/s | 645 kB 00:00 2026-02-24T19:16:17.441 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T19:16:17.443 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T19:16:17.443 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T19:16:17.462 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T19:16:17.462 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T19:16:17.527 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T19:16:17.544 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:16:17.604 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:16:17.665 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9. 1/1 2026-02-24T19:16:17.665 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:17.665 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T19:16:17.666 INFO:teuthology.orchestra.run.trial070.stdout: python3-cephfs-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:16:17.666 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:17.666 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T19:16:17.691 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install python3-rados-debuginfo 2026-02-24T19:16:18.007 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:50:13 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:16:18.091 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T19:16:18.091 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:18.092 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-24T19:16:18.092 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:18.092 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T19:16:18.092 INFO:teuthology.orchestra.run.trial070.stdout: python3-rados-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 802 k 2026-02-24T19:16:18.092 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:18.092 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T19:16:18.092 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:18.092 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T19:16:18.092 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:18.092 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 802 k 2026-02-24T19:16:18.092 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 3.1 M 2026-02-24T19:16:18.092 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T19:16:18.223 INFO:teuthology.orchestra.run.trial070.stdout:python3-rados-debuginfo-20.2.0-681.g36d388f2.el 6.0 MB/s | 802 kB 00:00 2026-02-24T19:16:18.224 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:16:18.224 INFO:teuthology.orchestra.run.trial070.stdout:Total 5.9 MB/s | 802 kB 00:00 2026-02-24T19:16:18.224 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T19:16:18.226 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T19:16:18.226 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T19:16:18.245 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T19:16:18.245 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T19:16:18.318 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T19:16:18.335 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:16:18.393 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:16:18.455 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x 1/1 2026-02-24T19:16:18.455 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:18.455 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T19:16:18.455 INFO:teuthology.orchestra.run.trial070.stdout: python3-rados-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:16:18.456 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:18.456 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T19:16:18.481 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install python3-rbd-debuginfo 2026-02-24T19:16:18.794 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:50:13 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:16:18.880 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T19:16:18.880 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:18.880 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-24T19:16:18.880 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:18.880 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T19:16:18.880 INFO:teuthology.orchestra.run.trial070.stdout: python3-rbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.2 M 2026-02-24T19:16:18.880 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:18.881 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T19:16:18.881 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:18.881 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T19:16:18.881 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:18.881 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 1.2 M 2026-02-24T19:16:18.881 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 4.7 M 2026-02-24T19:16:18.881 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T19:16:19.032 INFO:teuthology.orchestra.run.trial070.stdout:python3-rbd-debuginfo-20.2.0-681.g36d388f2.el9. 7.7 MB/s | 1.2 MB 00:00 2026-02-24T19:16:19.032 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:16:19.032 INFO:teuthology.orchestra.run.trial070.stdout:Total 7.7 MB/s | 1.2 MB 00:00 2026-02-24T19:16:19.032 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T19:16:19.034 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T19:16:19.034 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T19:16:19.055 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T19:16:19.055 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T19:16:19.146 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T19:16:19.163 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:16:19.224 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:16:19.286 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:16:19.286 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:19.286 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T19:16:19.286 INFO:teuthology.orchestra.run.trial070.stdout: python3-rbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:16:19.286 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:19.286 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T19:16:19.313 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install python3-rgw-debuginfo 2026-02-24T19:16:19.629 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:50:14 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:16:19.713 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T19:16:19.714 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:19.714 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-24T19:16:19.714 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:19.714 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T19:16:19.714 INFO:teuthology.orchestra.run.trial070.stdout: python3-rgw-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 350 k 2026-02-24T19:16:19.715 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:19.715 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T19:16:19.715 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:19.715 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T19:16:19.715 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:19.715 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 350 k 2026-02-24T19:16:19.715 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 1.1 M 2026-02-24T19:16:19.715 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T19:16:19.812 INFO:teuthology.orchestra.run.trial070.stdout:python3-rgw-debuginfo-20.2.0-681.g36d388f2.el9. 3.5 MB/s | 350 kB 00:00 2026-02-24T19:16:19.812 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:16:19.812 INFO:teuthology.orchestra.run.trial070.stdout:Total 3.5 MB/s | 350 kB 00:00 2026-02-24T19:16:19.813 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T19:16:19.814 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T19:16:19.814 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T19:16:19.833 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T19:16:19.833 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T19:16:19.885 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T19:16:19.902 INFO:teuthology.orchestra.run.trial070.stdout: Installing : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:16:19.960 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:16:20.021 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86 1/1 2026-02-24T19:16:20.021 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:20.021 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T19:16:20.021 INFO:teuthology.orchestra.run.trial070.stdout: python3-rgw-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:16:20.021 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:20.021 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T19:16:20.047 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install rbd-fuse-debuginfo 2026-02-24T19:16:20.358 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:50:15 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:16:20.442 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T19:16:20.442 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:20.443 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-24T19:16:20.443 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:20.443 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T19:16:20.443 INFO:teuthology.orchestra.run.trial070.stdout: rbd-fuse-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 1.5 M 2026-02-24T19:16:20.443 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:20.443 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T19:16:20.443 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:20.443 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T19:16:20.443 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:20.444 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 1.5 M 2026-02-24T19:16:20.444 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 7.9 M 2026-02-24T19:16:20.444 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T19:16:21.346 INFO:teuthology.orchestra.run.trial070.stdout:rbd-fuse-debuginfo-20.2.0-681.g36d388f2.el9.x86 1.7 MB/s | 1.5 MB 00:00 2026-02-24T19:16:21.348 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:16:21.348 INFO:teuthology.orchestra.run.trial070.stdout:Total 1.7 MB/s | 1.5 MB 00:00 2026-02-24T19:16:21.348 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T19:16:21.350 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T19:16:21.351 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T19:16:21.372 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T19:16:21.372 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T19:16:21.484 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T19:16:21.501 INFO:teuthology.orchestra.run.trial070.stdout: Installing : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:16:21.565 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:16:21.626 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:16:21.626 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:21.626 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T19:16:21.626 INFO:teuthology.orchestra.run.trial070.stdout: rbd-fuse-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:16:21.626 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:21.627 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T19:16:21.652 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install rbd-mirror-debuginfo 2026-02-24T19:16:21.968 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:50:16 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:16:22.052 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T19:16:22.052 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:22.053 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-24T19:16:22.053 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:22.053 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T19:16:22.053 INFO:teuthology.orchestra.run.trial070.stdout: rbd-mirror-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 79 M 2026-02-24T19:16:22.053 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:22.053 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T19:16:22.053 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:22.053 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T19:16:22.053 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:22.053 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 79 M 2026-02-24T19:16:22.054 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 375 M 2026-02-24T19:16:22.054 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T19:16:23.630 INFO:teuthology.orchestra.run.trial070.stdout:rbd-mirror-debuginfo-20.2.0-681.g36d388f2.el9.x 50 MB/s | 79 MB 00:01 2026-02-24T19:16:23.630 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:16:23.631 INFO:teuthology.orchestra.run.trial070.stdout:Total 50 MB/s | 79 MB 00:01 2026-02-24T19:16:23.631 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T19:16:23.633 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T19:16:23.633 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T19:16:23.884 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T19:16:23.884 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T19:16:28.080 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T19:16:28.097 INFO:teuthology.orchestra.run.trial070.stdout: Installing : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:16:28.426 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:16:28.489 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_ 1/1 2026-02-24T19:16:28.489 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:28.490 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T19:16:28.490 INFO:teuthology.orchestra.run.trial070.stdout: rbd-mirror-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:16:28.490 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:28.490 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T19:16:28.521 DEBUG:teuthology.orchestra.run.trial070:> sudo yum -y install rbd-nbd-debuginfo 2026-02-24T19:16:28.831 INFO:teuthology.orchestra.run.trial070.stdout:Last metadata expiration check: 0:50:23 ago on Tue 24 Feb 2026 06:26:05 PM UTC. 2026-02-24T19:16:28.915 INFO:teuthology.orchestra.run.trial070.stdout:Dependencies resolved. 2026-02-24T19:16:28.916 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:28.916 INFO:teuthology.orchestra.run.trial070.stdout: Package Arch Version Repo Size 2026-02-24T19:16:28.917 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:28.917 INFO:teuthology.orchestra.run.trial070.stdout:Installing: 2026-02-24T19:16:28.917 INFO:teuthology.orchestra.run.trial070.stdout: rbd-nbd-debuginfo x86_64 2:20.2.0-681.g36d388f2.el9 ceph 2.4 M 2026-02-24T19:16:28.917 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:28.917 INFO:teuthology.orchestra.run.trial070.stdout:Transaction Summary 2026-02-24T19:16:28.917 INFO:teuthology.orchestra.run.trial070.stdout:================================================================================ 2026-02-24T19:16:28.917 INFO:teuthology.orchestra.run.trial070.stdout:Install 1 Package 2026-02-24T19:16:28.917 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:28.917 INFO:teuthology.orchestra.run.trial070.stdout:Total download size: 2.4 M 2026-02-24T19:16:28.917 INFO:teuthology.orchestra.run.trial070.stdout:Installed size: 12 M 2026-02-24T19:16:28.918 INFO:teuthology.orchestra.run.trial070.stdout:Downloading Packages: 2026-02-24T19:16:29.056 INFO:teuthology.orchestra.run.trial070.stdout:rbd-nbd-debuginfo-20.2.0-681.g36d388f2.el9.x86_ 18 MB/s | 2.4 MB 00:00 2026-02-24T19:16:29.056 INFO:teuthology.orchestra.run.trial070.stdout:-------------------------------------------------------------------------------- 2026-02-24T19:16:29.057 INFO:teuthology.orchestra.run.trial070.stdout:Total 17 MB/s | 2.4 MB 00:00 2026-02-24T19:16:29.057 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction check 2026-02-24T19:16:29.058 INFO:teuthology.orchestra.run.trial070.stdout:Transaction check succeeded. 2026-02-24T19:16:29.058 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction test 2026-02-24T19:16:29.083 INFO:teuthology.orchestra.run.trial070.stdout:Transaction test succeeded. 2026-02-24T19:16:29.083 INFO:teuthology.orchestra.run.trial070.stdout:Running transaction 2026-02-24T19:16:29.240 INFO:teuthology.orchestra.run.trial070.stdout: Preparing : 1/1 2026-02-24T19:16:29.257 INFO:teuthology.orchestra.run.trial070.stdout: Installing : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:16:29.325 INFO:teuthology.orchestra.run.trial070.stdout: Running scriptlet: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:16:29.386 INFO:teuthology.orchestra.run.trial070.stdout: Verifying : rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 1/1 2026-02-24T19:16:29.386 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:29.386 INFO:teuthology.orchestra.run.trial070.stdout:Installed: 2026-02-24T19:16:29.386 INFO:teuthology.orchestra.run.trial070.stdout: rbd-nbd-debuginfo-2:20.2.0-681.g36d388f2.el9.x86_64 2026-02-24T19:16:29.387 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:29.387 INFO:teuthology.orchestra.run.trial070.stdout:Complete! 2026-02-24T19:16:29.414 DEBUG:teuthology.parallel:result is None 2026-02-24T19:16:29.414 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T19:16:29.536 DEBUG:teuthology.orchestra.run.trial026:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T19:16:29.558 INFO:teuthology.orchestra.run.trial026.stdout:20.2.0-681.g36d388f2.el9 2026-02-24T19:16:29.559 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-681.g36d388f2.el9 2026-02-24T19:16:29.559 INFO:teuthology.task.install:The correct ceph version 20.2.0-681.g36d388f2 is installed. 2026-02-24T19:16:29.560 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T19:16:29.675 DEBUG:teuthology.orchestra.run.trial070:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T19:16:29.696 INFO:teuthology.orchestra.run.trial070.stdout:20.2.0-681.g36d388f2.el9 2026-02-24T19:16:29.696 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-681.g36d388f2.el9 2026-02-24T19:16:29.696 INFO:teuthology.task.install:The correct ceph version 20.2.0-681.g36d388f2 is installed. 2026-02-24T19:16:29.697 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T19:16:29.816 DEBUG:teuthology.orchestra.run.trial103:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T19:16:29.836 INFO:teuthology.orchestra.run.trial103.stdout:20.2.0-681.g36d388f2.el9 2026-02-24T19:16:29.837 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-681.g36d388f2.el9 2026-02-24T19:16:29.837 INFO:teuthology.task.install:The correct ceph version 20.2.0-681.g36d388f2 is installed. 2026-02-24T19:16:29.839 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T19:16:29.980 DEBUG:teuthology.orchestra.run.trial162:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-24T19:16:30.001 INFO:teuthology.orchestra.run.trial162.stdout:20.2.0-681.g36d388f2.el9 2026-02-24T19:16:30.001 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-681.g36d388f2.el9 2026-02-24T19:16:30.001 INFO:teuthology.task.install:The correct ceph version 20.2.0-681.g36d388f2 is installed. 2026-02-24T19:16:30.002 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-24T19:16:30.002 DEBUG:teuthology.orchestra.run.trial026:> set -ex 2026-02-24T19:16:30.002 DEBUG:teuthology.orchestra.run.trial026:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T19:16:30.028 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-24T19:16:30.028 DEBUG:teuthology.orchestra.run.trial070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T19:16:30.053 DEBUG:teuthology.orchestra.run.trial103:> set -ex 2026-02-24T19:16:30.054 DEBUG:teuthology.orchestra.run.trial103:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T19:16:30.079 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-24T19:16:30.079 DEBUG:teuthology.orchestra.run.trial162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-24T19:16:30.105 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-24T19:16:30.105 DEBUG:teuthology.orchestra.run.trial026:> set -ex 2026-02-24T19:16:30.105 DEBUG:teuthology.orchestra.run.trial026:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T19:16:30.130 DEBUG:teuthology.orchestra.run.trial026:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T19:16:30.194 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-24T19:16:30.194 DEBUG:teuthology.orchestra.run.trial070:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T19:16:30.219 DEBUG:teuthology.orchestra.run.trial070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T19:16:30.282 DEBUG:teuthology.orchestra.run.trial103:> set -ex 2026-02-24T19:16:30.282 DEBUG:teuthology.orchestra.run.trial103:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T19:16:30.308 DEBUG:teuthology.orchestra.run.trial103:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T19:16:30.372 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-24T19:16:30.373 DEBUG:teuthology.orchestra.run.trial162:> sudo dd of=/usr/bin/daemon-helper 2026-02-24T19:16:30.399 DEBUG:teuthology.orchestra.run.trial162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-24T19:16:30.462 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-24T19:16:30.463 DEBUG:teuthology.orchestra.run.trial026:> set -ex 2026-02-24T19:16:30.463 DEBUG:teuthology.orchestra.run.trial026:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T19:16:30.489 DEBUG:teuthology.orchestra.run.trial026:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T19:16:30.552 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-24T19:16:30.552 DEBUG:teuthology.orchestra.run.trial070:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T19:16:30.576 DEBUG:teuthology.orchestra.run.trial070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T19:16:30.640 DEBUG:teuthology.orchestra.run.trial103:> set -ex 2026-02-24T19:16:30.640 DEBUG:teuthology.orchestra.run.trial103:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T19:16:30.664 DEBUG:teuthology.orchestra.run.trial103:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T19:16:30.726 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-24T19:16:30.726 DEBUG:teuthology.orchestra.run.trial162:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-24T19:16:30.751 DEBUG:teuthology.orchestra.run.trial162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-24T19:16:30.814 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-24T19:16:30.814 DEBUG:teuthology.orchestra.run.trial026:> set -ex 2026-02-24T19:16:30.814 DEBUG:teuthology.orchestra.run.trial026:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T19:16:30.838 DEBUG:teuthology.orchestra.run.trial026:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T19:16:30.901 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-24T19:16:30.901 DEBUG:teuthology.orchestra.run.trial070:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T19:16:30.926 DEBUG:teuthology.orchestra.run.trial070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T19:16:30.990 DEBUG:teuthology.orchestra.run.trial103:> set -ex 2026-02-24T19:16:30.990 DEBUG:teuthology.orchestra.run.trial103:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T19:16:31.013 DEBUG:teuthology.orchestra.run.trial103:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T19:16:31.077 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-24T19:16:31.077 DEBUG:teuthology.orchestra.run.trial162:> sudo dd of=/usr/bin/stdin-killer 2026-02-24T19:16:31.100 DEBUG:teuthology.orchestra.run.trial162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-24T19:16:31.163 INFO:teuthology.run_tasks:Running task ceph... 2026-02-24T19:16:31.236 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-24T19:16:31.236 DEBUG:teuthology.orchestra.run.trial026:> sudo chmod 777 /var/log/ceph 2026-02-24T19:16:31.238 DEBUG:teuthology.orchestra.run.trial070:> sudo chmod 777 /var/log/ceph 2026-02-24T19:16:31.240 DEBUG:teuthology.orchestra.run.trial103:> sudo chmod 777 /var/log/ceph 2026-02-24T19:16:31.241 DEBUG:teuthology.orchestra.run.trial162:> sudo chmod 777 /var/log/ceph 2026-02-24T19:16:31.266 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-24T19:16:31.266 DEBUG:teuthology.orchestra.run.trial026:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-24T19:16:31.301 DEBUG:teuthology.orchestra.run.trial070:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-24T19:16:31.303 DEBUG:teuthology.orchestra.run.trial103:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-24T19:16:31.305 DEBUG:teuthology.orchestra.run.trial162:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-24T19:16:31.330 INFO:tasks.ceph:Creating extra log directories... 2026-02-24T19:16:31.330 DEBUG:teuthology.orchestra.run.trial026:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-24T19:16:31.365 DEBUG:teuthology.orchestra.run.trial070:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-24T19:16:31.366 DEBUG:teuthology.orchestra.run.trial103:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-24T19:16:31.368 DEBUG:teuthology.orchestra.run.trial162:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-24T19:16:31.401 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-24T19:16:31.401 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'rados replica read policy': 'balance'}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'btree', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'crush location': 'root=default host=host-$id', 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request', 'OSD bench result', 'OSD_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2026-02-24T19:16:31.401 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68687', 'branch': 'wip-yuri3-testing-2026-02-19-1610-tentacle', 'description': 'rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{btree} base mem$/{normal-2} onode-segment$/{none} write$/{random/{compr$/{no$/{no}} random}}}} rados read-affinity/balance tasks/rados_api_tests validater/valgrind}', 'email': None, 'first_in_suite': False, 'flavor': 'default', 'job_id': '68687', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri3-testing-2026-02-19-1610-tentacle'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'rados replica read policy': 'balance'}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'btree', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'crush location': 'root=default host=host-$id', 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request', 'OSD bench result', 'OSD_DOWN'], 'mon_bind_msgr2': False, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'stop-daemons-timeout': 1200, 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri3-testing-2026-02-19-1610-tentacle', 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155'}}, 'owner': 'scheduled_jayaprakash@soko04.front.sepia.ceph.com', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'], ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'], ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'], ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0']], 'seed': 6877, 'sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri3-testing-2026-02-19-1610-tentacle', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_36d388f27052dd940bdbaf543bb05bdba0acc155/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '36d388f27052dd940bdbaf543bb05bdba0acc155', 'targets': {'trial026.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBNqbk4j1X70T1HbeJ2qOq4ZzBl7xOtp6cfhGI0Dg2pIYUxCS3L4sfwzgX+owJ1776/VYEsDPUxZve8Q2xrwrm0=', 'trial070.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA8t79+FsG232zBP/FmRKiW6KmNE9rJBNllOQSHEhiSFx+W2FI2j6Sq1OUD8i9Jz7T9gXl8BvUBYtDcza5uLWNw=', 'trial103.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFHOfZZRGtOBOBmlkS3yJ6fxAvPZEWXYGmFeocs/6fzdFnSlTy1/Vq5bfl5ms8MBByogcuM4bxd6esU/T9lQXCc=', 'trial162.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBzbFSyOm3fJdOPPxcFfzE+mFJhgge62cW1RiNNYpG7SeYIWFTzRO7CiSasq9XG7owOFsjRC73zl2ymusgDsDj0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'workunit': {'clients': {'client.0': ['rados/test.sh']}, 'env': {'ALLOW_TIMEOUTS': '1'}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["-- Don't run this test on tiny clusters\nif py_len(yaml.roles) < 4 then reject() end\n"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'fa17720d0088c3ac28e473468bfc79eeaff5cd38', 'timestamp': '2026-02-24_16:27:17', 'tube': 'trial', 'user': 'jayaprakash', 'verbose': False, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.904699'} 2026-02-24T19:16:31.401 DEBUG:teuthology.orchestra.run.trial026:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-24T19:16:31.429 DEBUG:teuthology.orchestra.run.trial070:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-24T19:16:31.430 DEBUG:teuthology.orchestra.run.trial103:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-24T19:16:31.431 DEBUG:teuthology.orchestra.run.trial162:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-24T19:16:31.449 DEBUG:teuthology.orchestra.run.trial026:> sudo install -d -m0777 -- /var/run/ceph 2026-02-24T19:16:31.483 DEBUG:teuthology.orchestra.run.trial070:> sudo install -d -m0777 -- /var/run/ceph 2026-02-24T19:16:31.485 DEBUG:teuthology.orchestra.run.trial103:> sudo install -d -m0777 -- /var/run/ceph 2026-02-24T19:16:31.486 DEBUG:teuthology.orchestra.run.trial162:> sudo install -d -m0777 -- /var/run/ceph 2026-02-24T19:16:31.512 DEBUG:teuthology.orchestra.run.trial026:> set -ex 2026-02-24T19:16:31.512 DEBUG:teuthology.orchestra.run.trial026:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T19:16:31.561 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T19:16:31.561 DEBUG:teuthology.orchestra.run.trial026:> stat /dev/vg_nvme/lv_1 2026-02-24T19:16:31.617 INFO:teuthology.orchestra.run.trial026.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T19:16:31.617 INFO:teuthology.orchestra.run.trial026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:31.617 INFO:teuthology.orchestra.run.trial026.stdout:Device: 6h/6d Inode: 910 Links: 1 2026-02-24T19:16:31.617 INFO:teuthology.orchestra.run.trial026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:31.617 INFO:teuthology.orchestra.run.trial026.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:31.617 INFO:teuthology.orchestra.run.trial026.stdout:Access: 2026-02-24 18:28:42.666363402 +0000 2026-02-24T19:16:31.617 INFO:teuthology.orchestra.run.trial026.stdout:Modify: 2026-02-24 18:25:34.004482236 +0000 2026-02-24T19:16:31.617 INFO:teuthology.orchestra.run.trial026.stdout:Change: 2026-02-24 18:25:34.004482236 +0000 2026-02-24T19:16:31.617 INFO:teuthology.orchestra.run.trial026.stdout: Birth: 2026-02-24 18:25:34.004482236 +0000 2026-02-24T19:16:31.617 DEBUG:teuthology.orchestra.run.trial026:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T19:16:31.679 INFO:teuthology.orchestra.run.trial026.stderr:1+0 records in 2026-02-24T19:16:31.679 INFO:teuthology.orchestra.run.trial026.stderr:1+0 records out 2026-02-24T19:16:31.679 INFO:teuthology.orchestra.run.trial026.stderr:512 bytes copied, 0.000159916 s, 3.2 MB/s 2026-02-24T19:16:31.680 DEBUG:teuthology.orchestra.run.trial026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T19:16:31.737 DEBUG:teuthology.orchestra.run.trial026:> stat /dev/vg_nvme/lv_2 2026-02-24T19:16:31.794 INFO:teuthology.orchestra.run.trial026.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T19:16:31.794 INFO:teuthology.orchestra.run.trial026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:31.794 INFO:teuthology.orchestra.run.trial026.stdout:Device: 6h/6d Inode: 938 Links: 1 2026-02-24T19:16:31.794 INFO:teuthology.orchestra.run.trial026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:31.794 INFO:teuthology.orchestra.run.trial026.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:31.794 INFO:teuthology.orchestra.run.trial026.stdout:Access: 2026-02-24 18:28:42.667363376 +0000 2026-02-24T19:16:31.794 INFO:teuthology.orchestra.run.trial026.stdout:Modify: 2026-02-24 18:25:34.233476524 +0000 2026-02-24T19:16:31.794 INFO:teuthology.orchestra.run.trial026.stdout:Change: 2026-02-24 18:25:34.233476524 +0000 2026-02-24T19:16:31.794 INFO:teuthology.orchestra.run.trial026.stdout: Birth: 2026-02-24 18:25:34.233476524 +0000 2026-02-24T19:16:31.794 DEBUG:teuthology.orchestra.run.trial026:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T19:16:31.856 INFO:teuthology.orchestra.run.trial026.stderr:1+0 records in 2026-02-24T19:16:31.856 INFO:teuthology.orchestra.run.trial026.stderr:1+0 records out 2026-02-24T19:16:31.856 INFO:teuthology.orchestra.run.trial026.stderr:512 bytes copied, 0.000130712 s, 3.9 MB/s 2026-02-24T19:16:31.857 DEBUG:teuthology.orchestra.run.trial026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T19:16:31.913 DEBUG:teuthology.orchestra.run.trial026:> stat /dev/vg_nvme/lv_3 2026-02-24T19:16:31.968 INFO:teuthology.orchestra.run.trial026.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T19:16:31.969 INFO:teuthology.orchestra.run.trial026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:31.969 INFO:teuthology.orchestra.run.trial026.stdout:Device: 6h/6d Inode: 967 Links: 1 2026-02-24T19:16:31.969 INFO:teuthology.orchestra.run.trial026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:31.969 INFO:teuthology.orchestra.run.trial026.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:31.969 INFO:teuthology.orchestra.run.trial026.stdout:Access: 2026-02-24 18:28:42.667363376 +0000 2026-02-24T19:16:31.969 INFO:teuthology.orchestra.run.trial026.stdout:Modify: 2026-02-24 18:25:34.473470537 +0000 2026-02-24T19:16:31.969 INFO:teuthology.orchestra.run.trial026.stdout:Change: 2026-02-24 18:25:34.473470537 +0000 2026-02-24T19:16:31.969 INFO:teuthology.orchestra.run.trial026.stdout: Birth: 2026-02-24 18:25:34.473470537 +0000 2026-02-24T19:16:31.969 DEBUG:teuthology.orchestra.run.trial026:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T19:16:32.030 INFO:teuthology.orchestra.run.trial026.stderr:1+0 records in 2026-02-24T19:16:32.031 INFO:teuthology.orchestra.run.trial026.stderr:1+0 records out 2026-02-24T19:16:32.031 INFO:teuthology.orchestra.run.trial026.stderr:512 bytes copied, 0.000178491 s, 2.9 MB/s 2026-02-24T19:16:32.032 DEBUG:teuthology.orchestra.run.trial026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T19:16:32.088 DEBUG:teuthology.orchestra.run.trial026:> stat /dev/vg_nvme/lv_4 2026-02-24T19:16:32.144 INFO:teuthology.orchestra.run.trial026.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T19:16:32.144 INFO:teuthology.orchestra.run.trial026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:32.144 INFO:teuthology.orchestra.run.trial026.stdout:Device: 6h/6d Inode: 995 Links: 1 2026-02-24T19:16:32.144 INFO:teuthology.orchestra.run.trial026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:32.144 INFO:teuthology.orchestra.run.trial026.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:32.144 INFO:teuthology.orchestra.run.trial026.stdout:Access: 2026-02-24 18:28:42.667363376 +0000 2026-02-24T19:16:32.144 INFO:teuthology.orchestra.run.trial026.stdout:Modify: 2026-02-24 18:25:34.686465224 +0000 2026-02-24T19:16:32.144 INFO:teuthology.orchestra.run.trial026.stdout:Change: 2026-02-24 18:25:34.686465224 +0000 2026-02-24T19:16:32.144 INFO:teuthology.orchestra.run.trial026.stdout: Birth: 2026-02-24 18:25:34.686465224 +0000 2026-02-24T19:16:32.144 DEBUG:teuthology.orchestra.run.trial026:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T19:16:32.206 INFO:teuthology.orchestra.run.trial026.stderr:1+0 records in 2026-02-24T19:16:32.206 INFO:teuthology.orchestra.run.trial026.stderr:1+0 records out 2026-02-24T19:16:32.206 INFO:teuthology.orchestra.run.trial026.stderr:512 bytes copied, 0.000183771 s, 2.8 MB/s 2026-02-24T19:16:32.207 DEBUG:teuthology.orchestra.run.trial026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T19:16:32.262 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:32.262 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-24T19:16:32.263 DEBUG:teuthology.orchestra.run.trial070:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T19:16:32.279 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T19:16:32.279 DEBUG:teuthology.orchestra.run.trial070:> stat /dev/vg_nvme/lv_1 2026-02-24T19:16:32.335 INFO:teuthology.orchestra.run.trial070.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T19:16:32.335 INFO:teuthology.orchestra.run.trial070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:32.335 INFO:teuthology.orchestra.run.trial070.stdout:Device: 6h/6d Inode: 911 Links: 1 2026-02-24T19:16:32.335 INFO:teuthology.orchestra.run.trial070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:32.335 INFO:teuthology.orchestra.run.trial070.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:32.335 INFO:teuthology.orchestra.run.trial070.stdout:Access: 2026-02-24 18:28:37.360681039 +0000 2026-02-24T19:16:32.335 INFO:teuthology.orchestra.run.trial070.stdout:Modify: 2026-02-24 18:25:36.985361465 +0000 2026-02-24T19:16:32.335 INFO:teuthology.orchestra.run.trial070.stdout:Change: 2026-02-24 18:25:36.985361465 +0000 2026-02-24T19:16:32.335 INFO:teuthology.orchestra.run.trial070.stdout: Birth: 2026-02-24 18:25:36.985361465 +0000 2026-02-24T19:16:32.335 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T19:16:32.396 INFO:teuthology.orchestra.run.trial070.stderr:1+0 records in 2026-02-24T19:16:32.396 INFO:teuthology.orchestra.run.trial070.stderr:1+0 records out 2026-02-24T19:16:32.396 INFO:teuthology.orchestra.run.trial070.stderr:512 bytes copied, 0.000159819 s, 3.2 MB/s 2026-02-24T19:16:32.397 DEBUG:teuthology.orchestra.run.trial070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T19:16:32.454 DEBUG:teuthology.orchestra.run.trial070:> stat /dev/vg_nvme/lv_2 2026-02-24T19:16:32.509 INFO:teuthology.orchestra.run.trial070.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T19:16:32.509 INFO:teuthology.orchestra.run.trial070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:32.509 INFO:teuthology.orchestra.run.trial070.stdout:Device: 6h/6d Inode: 936 Links: 1 2026-02-24T19:16:32.509 INFO:teuthology.orchestra.run.trial070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:32.509 INFO:teuthology.orchestra.run.trial070.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:32.509 INFO:teuthology.orchestra.run.trial070.stdout:Access: 2026-02-24 18:28:37.360681039 +0000 2026-02-24T19:16:32.509 INFO:teuthology.orchestra.run.trial070.stdout:Modify: 2026-02-24 18:25:37.208365723 +0000 2026-02-24T19:16:32.509 INFO:teuthology.orchestra.run.trial070.stdout:Change: 2026-02-24 18:25:37.208365723 +0000 2026-02-24T19:16:32.509 INFO:teuthology.orchestra.run.trial070.stdout: Birth: 2026-02-24 18:25:37.208365723 +0000 2026-02-24T19:16:32.509 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T19:16:32.570 INFO:teuthology.orchestra.run.trial070.stderr:1+0 records in 2026-02-24T19:16:32.570 INFO:teuthology.orchestra.run.trial070.stderr:1+0 records out 2026-02-24T19:16:32.570 INFO:teuthology.orchestra.run.trial070.stderr:512 bytes copied, 0.000150062 s, 3.4 MB/s 2026-02-24T19:16:32.571 DEBUG:teuthology.orchestra.run.trial070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T19:16:32.628 DEBUG:teuthology.orchestra.run.trial070:> stat /dev/vg_nvme/lv_3 2026-02-24T19:16:32.682 INFO:teuthology.orchestra.run.trial070.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T19:16:32.683 INFO:teuthology.orchestra.run.trial070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:32.683 INFO:teuthology.orchestra.run.trial070.stdout:Device: 6h/6d Inode: 966 Links: 1 2026-02-24T19:16:32.683 INFO:teuthology.orchestra.run.trial070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:32.683 INFO:teuthology.orchestra.run.trial070.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:32.683 INFO:teuthology.orchestra.run.trial070.stdout:Access: 2026-02-24 18:28:37.361681028 +0000 2026-02-24T19:16:32.683 INFO:teuthology.orchestra.run.trial070.stdout:Modify: 2026-02-24 18:25:37.468370689 +0000 2026-02-24T19:16:32.683 INFO:teuthology.orchestra.run.trial070.stdout:Change: 2026-02-24 18:25:37.468370689 +0000 2026-02-24T19:16:32.683 INFO:teuthology.orchestra.run.trial070.stdout: Birth: 2026-02-24 18:25:37.468370689 +0000 2026-02-24T19:16:32.683 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T19:16:32.744 INFO:teuthology.orchestra.run.trial070.stderr:1+0 records in 2026-02-24T19:16:32.744 INFO:teuthology.orchestra.run.trial070.stderr:1+0 records out 2026-02-24T19:16:32.744 INFO:teuthology.orchestra.run.trial070.stderr:512 bytes copied, 0.000147377 s, 3.5 MB/s 2026-02-24T19:16:32.745 DEBUG:teuthology.orchestra.run.trial070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T19:16:32.803 DEBUG:teuthology.orchestra.run.trial070:> stat /dev/vg_nvme/lv_4 2026-02-24T19:16:32.858 INFO:teuthology.orchestra.run.trial070.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T19:16:32.858 INFO:teuthology.orchestra.run.trial070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:32.858 INFO:teuthology.orchestra.run.trial070.stdout:Device: 6h/6d Inode: 994 Links: 1 2026-02-24T19:16:32.858 INFO:teuthology.orchestra.run.trial070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:32.858 INFO:teuthology.orchestra.run.trial070.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:32.858 INFO:teuthology.orchestra.run.trial070.stdout:Access: 2026-02-24 18:28:37.361681028 +0000 2026-02-24T19:16:32.858 INFO:teuthology.orchestra.run.trial070.stdout:Modify: 2026-02-24 18:25:37.716375425 +0000 2026-02-24T19:16:32.858 INFO:teuthology.orchestra.run.trial070.stdout:Change: 2026-02-24 18:25:37.716375425 +0000 2026-02-24T19:16:32.858 INFO:teuthology.orchestra.run.trial070.stdout: Birth: 2026-02-24 18:25:37.716375425 +0000 2026-02-24T19:16:32.858 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T19:16:32.920 INFO:teuthology.orchestra.run.trial070.stderr:1+0 records in 2026-02-24T19:16:32.920 INFO:teuthology.orchestra.run.trial070.stderr:1+0 records out 2026-02-24T19:16:32.920 INFO:teuthology.orchestra.run.trial070.stderr:512 bytes copied, 0.00014403 s, 3.6 MB/s 2026-02-24T19:16:32.921 DEBUG:teuthology.orchestra.run.trial070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T19:16:32.976 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:32.976 DEBUG:teuthology.orchestra.run.trial103:> set -ex 2026-02-24T19:16:32.977 DEBUG:teuthology.orchestra.run.trial103:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T19:16:32.994 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T19:16:32.994 DEBUG:teuthology.orchestra.run.trial103:> stat /dev/vg_nvme/lv_1 2026-02-24T19:16:33.049 INFO:teuthology.orchestra.run.trial103.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T19:16:33.049 INFO:teuthology.orchestra.run.trial103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:33.049 INFO:teuthology.orchestra.run.trial103.stdout:Device: 6h/6d Inode: 911 Links: 1 2026-02-24T19:16:33.049 INFO:teuthology.orchestra.run.trial103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:33.049 INFO:teuthology.orchestra.run.trial103.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:33.049 INFO:teuthology.orchestra.run.trial103.stdout:Access: 2026-02-24 18:28:21.121505830 +0000 2026-02-24T19:16:33.049 INFO:teuthology.orchestra.run.trial103.stdout:Modify: 2026-02-24 18:25:34.200889376 +0000 2026-02-24T19:16:33.049 INFO:teuthology.orchestra.run.trial103.stdout:Change: 2026-02-24 18:25:34.200889376 +0000 2026-02-24T19:16:33.049 INFO:teuthology.orchestra.run.trial103.stdout: Birth: 2026-02-24 18:25:34.200889376 +0000 2026-02-24T19:16:33.049 DEBUG:teuthology.orchestra.run.trial103:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T19:16:33.112 INFO:teuthology.orchestra.run.trial103.stderr:1+0 records in 2026-02-24T19:16:33.112 INFO:teuthology.orchestra.run.trial103.stderr:1+0 records out 2026-02-24T19:16:33.112 INFO:teuthology.orchestra.run.trial103.stderr:512 bytes copied, 0.000154035 s, 3.3 MB/s 2026-02-24T19:16:33.113 DEBUG:teuthology.orchestra.run.trial103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T19:16:33.170 DEBUG:teuthology.orchestra.run.trial103:> stat /dev/vg_nvme/lv_2 2026-02-24T19:16:33.226 INFO:teuthology.orchestra.run.trial103.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T19:16:33.226 INFO:teuthology.orchestra.run.trial103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:33.226 INFO:teuthology.orchestra.run.trial103.stdout:Device: 6h/6d Inode: 936 Links: 1 2026-02-24T19:16:33.226 INFO:teuthology.orchestra.run.trial103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:33.226 INFO:teuthology.orchestra.run.trial103.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:33.226 INFO:teuthology.orchestra.run.trial103.stdout:Access: 2026-02-24 18:28:21.122505795 +0000 2026-02-24T19:16:33.226 INFO:teuthology.orchestra.run.trial103.stdout:Modify: 2026-02-24 18:25:34.448879759 +0000 2026-02-24T19:16:33.226 INFO:teuthology.orchestra.run.trial103.stdout:Change: 2026-02-24 18:25:34.448879759 +0000 2026-02-24T19:16:33.226 INFO:teuthology.orchestra.run.trial103.stdout: Birth: 2026-02-24 18:25:34.448879759 +0000 2026-02-24T19:16:33.226 DEBUG:teuthology.orchestra.run.trial103:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T19:16:33.288 INFO:teuthology.orchestra.run.trial103.stderr:1+0 records in 2026-02-24T19:16:33.288 INFO:teuthology.orchestra.run.trial103.stderr:1+0 records out 2026-02-24T19:16:33.288 INFO:teuthology.orchestra.run.trial103.stderr:512 bytes copied, 0.000137204 s, 3.7 MB/s 2026-02-24T19:16:33.289 DEBUG:teuthology.orchestra.run.trial103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T19:16:33.345 DEBUG:teuthology.orchestra.run.trial103:> stat /dev/vg_nvme/lv_3 2026-02-24T19:16:33.401 INFO:teuthology.orchestra.run.trial103.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T19:16:33.401 INFO:teuthology.orchestra.run.trial103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:33.401 INFO:teuthology.orchestra.run.trial103.stdout:Device: 6h/6d Inode: 967 Links: 1 2026-02-24T19:16:33.401 INFO:teuthology.orchestra.run.trial103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:33.401 INFO:teuthology.orchestra.run.trial103.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:33.401 INFO:teuthology.orchestra.run.trial103.stdout:Access: 2026-02-24 18:28:21.122505795 +0000 2026-02-24T19:16:33.401 INFO:teuthology.orchestra.run.trial103.stdout:Modify: 2026-02-24 18:25:34.677870879 +0000 2026-02-24T19:16:33.401 INFO:teuthology.orchestra.run.trial103.stdout:Change: 2026-02-24 18:25:34.677870879 +0000 2026-02-24T19:16:33.401 INFO:teuthology.orchestra.run.trial103.stdout: Birth: 2026-02-24 18:25:34.677870879 +0000 2026-02-24T19:16:33.401 DEBUG:teuthology.orchestra.run.trial103:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T19:16:33.463 INFO:teuthology.orchestra.run.trial103.stderr:1+0 records in 2026-02-24T19:16:33.463 INFO:teuthology.orchestra.run.trial103.stderr:1+0 records out 2026-02-24T19:16:33.463 INFO:teuthology.orchestra.run.trial103.stderr:512 bytes copied, 0.000172991 s, 3.0 MB/s 2026-02-24T19:16:33.464 DEBUG:teuthology.orchestra.run.trial103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T19:16:33.519 DEBUG:teuthology.orchestra.run.trial103:> stat /dev/vg_nvme/lv_4 2026-02-24T19:16:33.575 INFO:teuthology.orchestra.run.trial103.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T19:16:33.575 INFO:teuthology.orchestra.run.trial103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:33.575 INFO:teuthology.orchestra.run.trial103.stdout:Device: 6h/6d Inode: 991 Links: 1 2026-02-24T19:16:33.575 INFO:teuthology.orchestra.run.trial103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:33.575 INFO:teuthology.orchestra.run.trial103.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:33.575 INFO:teuthology.orchestra.run.trial103.stdout:Access: 2026-02-24 18:28:21.122505795 +0000 2026-02-24T19:16:33.575 INFO:teuthology.orchestra.run.trial103.stdout:Modify: 2026-02-24 18:25:34.918861533 +0000 2026-02-24T19:16:33.575 INFO:teuthology.orchestra.run.trial103.stdout:Change: 2026-02-24 18:25:34.918861533 +0000 2026-02-24T19:16:33.575 INFO:teuthology.orchestra.run.trial103.stdout: Birth: 2026-02-24 18:25:34.918861533 +0000 2026-02-24T19:16:33.575 DEBUG:teuthology.orchestra.run.trial103:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T19:16:33.637 INFO:teuthology.orchestra.run.trial103.stderr:1+0 records in 2026-02-24T19:16:33.637 INFO:teuthology.orchestra.run.trial103.stderr:1+0 records out 2026-02-24T19:16:33.637 INFO:teuthology.orchestra.run.trial103.stderr:512 bytes copied, 0.000133407 s, 3.8 MB/s 2026-02-24T19:16:33.638 DEBUG:teuthology.orchestra.run.trial103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T19:16:33.695 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:33.695 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-24T19:16:33.695 DEBUG:teuthology.orchestra.run.trial162:> dd if=/scratch_devs of=/dev/stdout 2026-02-24T19:16:33.712 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-24T19:16:33.712 DEBUG:teuthology.orchestra.run.trial162:> stat /dev/vg_nvme/lv_1 2026-02-24T19:16:33.769 INFO:teuthology.orchestra.run.trial162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-24T19:16:33.769 INFO:teuthology.orchestra.run.trial162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:33.769 INFO:teuthology.orchestra.run.trial162.stdout:Device: 6h/6d Inode: 909 Links: 1 2026-02-24T19:16:33.769 INFO:teuthology.orchestra.run.trial162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:33.769 INFO:teuthology.orchestra.run.trial162.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:33.769 INFO:teuthology.orchestra.run.trial162.stdout:Access: 2026-02-24 18:28:19.901345127 +0000 2026-02-24T19:16:33.769 INFO:teuthology.orchestra.run.trial162.stdout:Modify: 2026-02-24 18:25:33.988431110 +0000 2026-02-24T19:16:33.769 INFO:teuthology.orchestra.run.trial162.stdout:Change: 2026-02-24 18:25:33.988431110 +0000 2026-02-24T19:16:33.769 INFO:teuthology.orchestra.run.trial162.stdout: Birth: 2026-02-24 18:25:33.988431110 +0000 2026-02-24T19:16:33.769 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-24T19:16:33.830 INFO:teuthology.orchestra.run.trial162.stderr:1+0 records in 2026-02-24T19:16:33.830 INFO:teuthology.orchestra.run.trial162.stderr:1+0 records out 2026-02-24T19:16:33.830 INFO:teuthology.orchestra.run.trial162.stderr:512 bytes copied, 0.000156951 s, 3.3 MB/s 2026-02-24T19:16:33.831 DEBUG:teuthology.orchestra.run.trial162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-24T19:16:33.887 DEBUG:teuthology.orchestra.run.trial162:> stat /dev/vg_nvme/lv_2 2026-02-24T19:16:33.943 INFO:teuthology.orchestra.run.trial162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-24T19:16:33.943 INFO:teuthology.orchestra.run.trial162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:33.943 INFO:teuthology.orchestra.run.trial162.stdout:Device: 6h/6d Inode: 936 Links: 1 2026-02-24T19:16:33.943 INFO:teuthology.orchestra.run.trial162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:33.943 INFO:teuthology.orchestra.run.trial162.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:33.943 INFO:teuthology.orchestra.run.trial162.stdout:Access: 2026-02-24 18:28:19.901345127 +0000 2026-02-24T19:16:33.943 INFO:teuthology.orchestra.run.trial162.stdout:Modify: 2026-02-24 18:25:34.207423706 +0000 2026-02-24T19:16:33.943 INFO:teuthology.orchestra.run.trial162.stdout:Change: 2026-02-24 18:25:34.207423706 +0000 2026-02-24T19:16:33.943 INFO:teuthology.orchestra.run.trial162.stdout: Birth: 2026-02-24 18:25:34.207423706 +0000 2026-02-24T19:16:33.943 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-24T19:16:34.006 INFO:teuthology.orchestra.run.trial162.stderr:1+0 records in 2026-02-24T19:16:34.006 INFO:teuthology.orchestra.run.trial162.stderr:1+0 records out 2026-02-24T19:16:34.006 INFO:teuthology.orchestra.run.trial162.stderr:512 bytes copied, 0.000136954 s, 3.7 MB/s 2026-02-24T19:16:34.007 DEBUG:teuthology.orchestra.run.trial162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-24T19:16:34.064 DEBUG:teuthology.orchestra.run.trial162:> stat /dev/vg_nvme/lv_3 2026-02-24T19:16:34.120 INFO:teuthology.orchestra.run.trial162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-24T19:16:34.120 INFO:teuthology.orchestra.run.trial162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:34.120 INFO:teuthology.orchestra.run.trial162.stdout:Device: 6h/6d Inode: 965 Links: 1 2026-02-24T19:16:34.120 INFO:teuthology.orchestra.run.trial162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:34.120 INFO:teuthology.orchestra.run.trial162.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:34.120 INFO:teuthology.orchestra.run.trial162.stdout:Access: 2026-02-24 18:28:19.902345114 +0000 2026-02-24T19:16:34.120 INFO:teuthology.orchestra.run.trial162.stdout:Modify: 2026-02-24 18:25:34.455415322 +0000 2026-02-24T19:16:34.120 INFO:teuthology.orchestra.run.trial162.stdout:Change: 2026-02-24 18:25:34.455415322 +0000 2026-02-24T19:16:34.120 INFO:teuthology.orchestra.run.trial162.stdout: Birth: 2026-02-24 18:25:34.455415322 +0000 2026-02-24T19:16:34.120 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-24T19:16:34.182 INFO:teuthology.orchestra.run.trial162.stderr:1+0 records in 2026-02-24T19:16:34.182 INFO:teuthology.orchestra.run.trial162.stderr:1+0 records out 2026-02-24T19:16:34.182 INFO:teuthology.orchestra.run.trial162.stderr:512 bytes copied, 0.000172811 s, 3.0 MB/s 2026-02-24T19:16:34.183 DEBUG:teuthology.orchestra.run.trial162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-24T19:16:34.240 DEBUG:teuthology.orchestra.run.trial162:> stat /dev/vg_nvme/lv_4 2026-02-24T19:16:34.296 INFO:teuthology.orchestra.run.trial162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-24T19:16:34.296 INFO:teuthology.orchestra.run.trial162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-24T19:16:34.296 INFO:teuthology.orchestra.run.trial162.stdout:Device: 6h/6d Inode: 994 Links: 1 2026-02-24T19:16:34.296 INFO:teuthology.orchestra.run.trial162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-24T19:16:34.296 INFO:teuthology.orchestra.run.trial162.stdout:Context: system_u:object_r:device_t:s0 2026-02-24T19:16:34.296 INFO:teuthology.orchestra.run.trial162.stdout:Access: 2026-02-24 18:28:19.902345114 +0000 2026-02-24T19:16:34.296 INFO:teuthology.orchestra.run.trial162.stdout:Modify: 2026-02-24 18:25:34.689407610 +0000 2026-02-24T19:16:34.296 INFO:teuthology.orchestra.run.trial162.stdout:Change: 2026-02-24 18:25:34.689407610 +0000 2026-02-24T19:16:34.296 INFO:teuthology.orchestra.run.trial162.stdout: Birth: 2026-02-24 18:25:34.689407610 +0000 2026-02-24T19:16:34.296 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-24T19:16:34.357 INFO:teuthology.orchestra.run.trial162.stderr:1+0 records in 2026-02-24T19:16:34.358 INFO:teuthology.orchestra.run.trial162.stderr:1+0 records out 2026-02-24T19:16:34.358 INFO:teuthology.orchestra.run.trial162.stderr:512 bytes copied, 0.000167851 s, 3.1 MB/s 2026-02-24T19:16:34.359 DEBUG:teuthology.orchestra.run.trial162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-24T19:16:34.415 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:34.415 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial026.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial070.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial103.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial162.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2026-02-24T19:16:34.415 INFO:tasks.ceph:Generating config... 2026-02-24T19:16:34.416 INFO:tasks.ceph:[client] debug monc = 20 2026-02-24T19:16:34.416 INFO:tasks.ceph:[client] debug ms = 1 2026-02-24T19:16:34.416 INFO:tasks.ceph:[client] debug objecter = 20 2026-02-24T19:16:34.416 INFO:tasks.ceph:[client] debug rados = 20 2026-02-24T19:16:34.416 INFO:tasks.ceph:[client] rados replica read policy = balance 2026-02-24T19:16:34.416 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-24T19:16:34.416 INFO:tasks.ceph:[global] mon election default strategy = 3 2026-02-24T19:16:34.416 INFO:tasks.ceph:[global] ms bind msgr2 = False 2026-02-24T19:16:34.416 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2026-02-24T19:16:34.416 INFO:tasks.ceph:[global] ms type = async 2026-02-24T19:16:34.416 INFO:tasks.ceph:[global] osd heartbeat grace = 160 2026-02-24T19:16:34.416 INFO:tasks.ceph:[global] osd op thread timeout = 150 2026-02-24T19:16:34.416 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-24T19:16:34.416 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-24T19:16:34.416 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-24T19:16:34.416 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-24T19:16:34.416 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-24T19:16:34.416 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2026-02-24T19:16:34.416 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2026-02-24T19:16:34.416 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-24T19:16:34.416 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-24T19:16:34.416 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-24T19:16:34.416 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-24T19:16:34.416 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2026-02-24T19:16:34.416 INFO:tasks.ceph:[mon] paxos service trim min = 10 2026-02-24T19:16:34.416 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-24T19:16:34.416 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-24T19:16:34.416 INFO:tasks.ceph:[osd] bluestore allocator = btree 2026-02-24T19:16:34.416 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-24T19:16:34.416 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-24T19:16:34.416 INFO:tasks.ceph:[osd] bluestore onode segment size = 0 2026-02-24T19:16:34.416 INFO:tasks.ceph:[osd] bluestore write v2 random = True 2026-02-24T19:16:34.416 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-24T19:16:34.416 INFO:tasks.ceph:[osd] crush location = root=default host=host-$id 2026-02-24T19:16:34.416 INFO:tasks.ceph:[osd] debug bluefs = 1 2026-02-24T19:16:34.416 INFO:tasks.ceph:[osd] debug bluestore = 1 2026-02-24T19:16:34.416 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-24T19:16:34.416 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-24T19:16:34.416 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-24T19:16:34.416 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-24T19:16:34.416 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-24T19:16:34.417 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-24T19:16:34.417 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-24T19:16:34.417 INFO:tasks.ceph:[osd] osd class default list = * 2026-02-24T19:16:34.417 INFO:tasks.ceph:[osd] osd class load list = * 2026-02-24T19:16:34.417 INFO:tasks.ceph:[osd] osd client watch timeout = 240 2026-02-24T19:16:34.417 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-24T19:16:34.417 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-24T19:16:34.417 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-24T19:16:34.417 INFO:tasks.ceph:[osd] osd fast shutdown = False 2026-02-24T19:16:34.417 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-24T19:16:34.417 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-24T19:16:34.417 INFO:tasks.ceph:[osd] osd mclock skip benchmark = True 2026-02-24T19:16:34.417 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-24T19:16:34.417 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-24T19:16:34.417 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-24T19:16:34.417 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-24T19:16:34.417 INFO:tasks.ceph:Setting up mon.a... 2026-02-24T19:16:34.417 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-24T19:16:34.452 INFO:teuthology.orchestra.run.trial026.stdout:creating /etc/ceph/ceph.keyring 2026-02-24T19:16:34.454 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-24T19:16:34.528 DEBUG:teuthology.orchestra.run.trial026:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-24T19:16:34.591 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:10.20.193.26:6789]'), ('mon.b', '[v1:10.20.193.70:6789]'), ('mon.c', '[v1:10.20.193.103:6789]')] 2026-02-24T19:16:34.591 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:10.20.193.26:6789],[v1:10.20.193.70:6789],[v1:10.20.193.103:6789]', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'btree', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'crush location': 'root=default host=host-$id', 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'rados replica read policy': 'balance'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}} 2026-02-24T19:16:34.591 DEBUG:teuthology.orchestra.run.trial026:> set -ex 2026-02-24T19:16:34.591 DEBUG:teuthology.orchestra.run.trial026:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-24T19:16:34.646 DEBUG:teuthology.orchestra.run.trial026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:10.20.193.26:6789]' --addv b '[v1:10.20.193.70:6789]' --addv c '[v1:10.20.193.103:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:34.719 INFO:teuthology.orchestra.run.trial026.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:34.719 INFO:teuthology.orchestra.run.trial026.stdout:monmaptool: generated fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:16:34.719 INFO:teuthology.orchestra.run.trial026.stdout:setting min_mon_release = tentacle 2026-02-24T19:16:34.719 INFO:teuthology.orchestra.run.trial026.stdout:epoch 0 2026-02-24T19:16:34.720 INFO:teuthology.orchestra.run.trial026.stdout:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:16:34.720 INFO:teuthology.orchestra.run.trial026.stdout:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:16:34.720 INFO:teuthology.orchestra.run.trial026.stdout:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:16:34.720 INFO:teuthology.orchestra.run.trial026.stdout:min_mon_release 20 (tentacle) 2026-02-24T19:16:34.720 INFO:teuthology.orchestra.run.trial026.stdout:election_strategy: 3 2026-02-24T19:16:34.720 INFO:teuthology.orchestra.run.trial026.stdout:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:16:34.720 INFO:teuthology.orchestra.run.trial026.stdout:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:16:34.720 INFO:teuthology.orchestra.run.trial026.stdout:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:16:34.720 INFO:teuthology.orchestra.run.trial026.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-24T19:16:34.721 DEBUG:teuthology.orchestra.run.trial026:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-24T19:16:34.776 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 33b2b598-dbc5-4d7a-8df7-657f0501fe9e... 2026-02-24T19:16:34.776 DEBUG:teuthology.orchestra.run.trial026:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-24T19:16:34.817 DEBUG:teuthology.orchestra.run.trial070:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-24T19:16:34.819 DEBUG:teuthology.orchestra.run.trial103:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-24T19:16:34.821 DEBUG:teuthology.orchestra.run.trial162:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout:[global] 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: chdir = "" 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: auth supported = cephx 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: filestore xattr use omap = true 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: mon clock drift allowed = 1.000 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: osd crush chooseleaf type = 0 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: auth debug = true 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: ms die on old message = true 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: ms die on bug = true 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: mon pg warn max object skew = 0 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: # disable pg_autoscaler by default for new pools 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: osd pool default size = 2 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: mon osd allow primary affinity = true 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: mon osd allow pg remap = true 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: mon warn on legacy crush tunables = false 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: mon warn on crush straw calc version zero = false 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: mon warn on no sortbitwise = false 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: mon warn on osd down out interval zero = false 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: mon warn on too few osds = false 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: mon_allow_pool_size_one = true 2026-02-24T19:16:34.856 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: osd default data pool replay window = 5 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: mon allow pool delete = true 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: mon cluster log file level = debug 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: debug asserts on shutdown = true 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: mon health detail to clog = false 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: mon host = "[v1:10.20.193.26:6789],[v1:10.20.193.70:6789],[v1:10.20.193.103:6789]" 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: mon client directed command retry = 5 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: mon election default strategy = 3 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: ms bind msgr2 = False 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: ms inject socket failures = 5000 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: ms type = async 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: osd heartbeat grace = 160 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: osd op thread timeout = 150 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: fsid = 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout:[osd] 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: osd journal size = 100 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: osd scrub load threshold = 5.0 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: osd scrub max interval = 600 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: osd mclock profile = high_recovery_ops 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: osd mclock skip benchmark = True 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: osd recover clone overlap = true 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: osd recovery max chunk = 1048576 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: osd debug shutdown = true 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: osd debug op order = true 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: osd debug verify stray on activate = true 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: osd debug trim objects = true 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: osd open classes on start = true 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: osd debug pg log writeout = true 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: osd deep scrub update digest min age = 30 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: osd map max advance = 10 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: journal zero on create = true 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: filestore ondisk finisher threads = 3 2026-02-24T19:16:34.857 INFO:teuthology.orchestra.run.trial026.stdout: filestore apply finisher threads = 3 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: bdev debug aio = true 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: osd debug misdirected ops = true 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: bdev async discard = True 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: bdev enable discard = True 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: bluestore allocator = btree 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: bluestore block size = 96636764160 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: bluestore fsck on mount = True 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: bluestore onode segment size = 0 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: bluestore write v2 random = True 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: bluestore zero block detection = True 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: crush location = root=default host=host-$id 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: debug bluefs = 1 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: debug bluestore = 1 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: debug monc = 20 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: debug ms = 1 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: debug osd = 20 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: debug rocksdb = 10 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: mon osd backfillfull_ratio = 0.85 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: mon osd full ratio = 0.9 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: mon osd nearfull ratio = 0.8 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: osd class default list = * 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: osd class load list = * 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: osd client watch timeout = 240 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: osd debug verify cached snaps = True 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: osd debug verify missing on start = True 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: osd failsafe full ratio = 0.95 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: osd fast shutdown = False 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: osd mclock override recovery settings = True 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: osd objectstore = bluestore 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: osd op queue = debug_random 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: osd op queue cut off = debug_random 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: osd shutdown pgref assert = True 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout:[mgr] 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: debug ms = 1 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: debug mgr = 20 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: debug mon = 20 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: debug auth = 20 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: mon reweight min pgs per osd = 4 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: mon reweight min bytes per osd = 10 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: mgr/telemetry/nag = false 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout:[mon] 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: debug ms = 1 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: debug mon = 20 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: debug paxos = 20 2026-02-24T19:16:34.858 INFO:teuthology.orchestra.run.trial026.stdout: debug auth = 20 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: mon data avail warn = 5 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: mon mgr mkfs grace = 240 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: mon reweight min pgs per osd = 4 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: mon osd reporter subtree level = osd 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: mon osd prime pg temp = true 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: mon reweight min bytes per osd = 10 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: auth mon ticket ttl = 660 # 11m 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: auth service ticket ttl = 240 # 4m 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: # don't complain about insecure global_id in the test suite 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: # 1m isn't quite enough 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: mon_down_mkfs_grace = 2m 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: mon_warn_on_filestore_osds = false 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: mon min osdmap epochs = 50 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: mon osd crush smoke test = False 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: mon osdmap full prune interval = 2 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: mon osdmap full prune min = 15 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: mon osdmap full prune txsize = 2 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: mon scrub interval = 300 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: mon warn on pool no app = False 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: paxos service trim min = 10 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout:[client] 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: rgw cache enabled = true 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: rgw enable ops log = true 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: rgw enable usage log = true 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: debug monc = 20 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: debug ms = 1 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: debug objecter = 20 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: debug rados = 20 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout: rados replica read policy = balance 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout:[mon.a] 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout:[mon.b] 2026-02-24T19:16:34.859 INFO:teuthology.orchestra.run.trial026.stdout:[mon.c] 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout:[global] 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: chdir = "" 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: auth supported = cephx 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: filestore xattr use omap = true 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: mon clock drift allowed = 1.000 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: osd crush chooseleaf type = 0 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: auth debug = true 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: ms die on old message = true 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: ms die on bug = true 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: mon pg warn max object skew = 0 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: # disable pg_autoscaler by default for new pools 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: osd pool default size = 2 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: mon osd allow primary affinity = true 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: mon osd allow pg remap = true 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: mon warn on legacy crush tunables = false 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: mon warn on crush straw calc version zero = false 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: mon warn on no sortbitwise = false 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: mon warn on osd down out interval zero = false 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: mon warn on too few osds = false 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: mon_allow_pool_size_one = true 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: osd default data pool replay window = 5 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: mon allow pool delete = true 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: mon cluster log file level = debug 2026-02-24T19:16:34.860 INFO:teuthology.orchestra.run.trial070.stdout: debug asserts on shutdown = true 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: mon health detail to clog = false 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: mon host = "[v1:10.20.193.26:6789],[v1:10.20.193.70:6789],[v1:10.20.193.103:6789]" 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: mon client directed command retry = 5 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: mon election default strategy = 3 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: ms bind msgr2 = False 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: ms inject socket failures = 5000 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: ms type = async 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: osd heartbeat grace = 160 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: osd op thread timeout = 150 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: fsid = 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout:[osd] 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: osd journal size = 100 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: osd scrub load threshold = 5.0 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: osd scrub max interval = 600 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: osd mclock profile = high_recovery_ops 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: osd mclock skip benchmark = True 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: osd recover clone overlap = true 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: osd recovery max chunk = 1048576 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: osd debug shutdown = true 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: osd debug op order = true 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: osd debug verify stray on activate = true 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: osd debug trim objects = true 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: osd open classes on start = true 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: osd debug pg log writeout = true 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: osd deep scrub update digest min age = 30 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: osd map max advance = 10 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: journal zero on create = true 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: filestore ondisk finisher threads = 3 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: filestore apply finisher threads = 3 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: bdev debug aio = true 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: osd debug misdirected ops = true 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: bdev async discard = True 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: bdev enable discard = True 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: bluestore allocator = btree 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: bluestore block size = 96636764160 2026-02-24T19:16:34.861 INFO:teuthology.orchestra.run.trial070.stdout: bluestore fsck on mount = True 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: bluestore onode segment size = 0 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: bluestore write v2 random = True 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: bluestore zero block detection = True 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: crush location = root=default host=host-$id 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: debug bluefs = 1 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: debug bluestore = 1 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: debug monc = 20 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: debug ms = 1 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: debug osd = 20 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: debug rocksdb = 10 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: mon osd backfillfull_ratio = 0.85 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: mon osd full ratio = 0.9 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: mon osd nearfull ratio = 0.8 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: osd class default list = * 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: osd class load list = * 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: osd client watch timeout = 240 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: osd debug verify cached snaps = True 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: osd debug verify missing on start = True 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: osd failsafe full ratio = 0.95 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: osd fast shutdown = False 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: osd mclock override recovery settings = True 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: osd objectstore = bluestore 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: osd op queue = debug_random 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: osd op queue cut off = debug_random 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: osd shutdown pgref assert = True 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout:[mgr] 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: debug ms = 1 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: debug mgr = 20 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: debug mon = 20 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: debug auth = 20 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: mon reweight min pgs per osd = 4 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: mon reweight min bytes per osd = 10 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: mgr/telemetry/nag = false 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout:[mon] 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: debug ms = 1 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: debug mon = 20 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: debug paxos = 20 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: debug auth = 20 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: mon data avail warn = 5 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: mon mgr mkfs grace = 240 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: mon reweight min pgs per osd = 4 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: mon osd reporter subtree level = osd 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: mon osd prime pg temp = true 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: mon reweight min bytes per osd = 10 2026-02-24T19:16:34.862 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: auth mon ticket ttl = 660 # 11m 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: auth service ticket ttl = 240 # 4m 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: # don't complain about insecure global_id in the test suite 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: # 1m isn't quite enough 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: mon_down_mkfs_grace = 2m 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: mon_warn_on_filestore_osds = false 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: mon min osdmap epochs = 50 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: mon osd crush smoke test = False 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: mon osdmap full prune interval = 2 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: mon osdmap full prune min = 15 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: mon osdmap full prune txsize = 2 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: mon scrub interval = 300 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: mon warn on pool no app = False 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: paxos service trim min = 10 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout:[client] 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: rgw cache enabled = true 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: rgw enable ops log = true 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: rgw enable usage log = true 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: debug monc = 20 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: debug ms = 1 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: debug objecter = 20 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: debug rados = 20 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout: rados replica read policy = balance 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout:[mon.a] 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout:[mon.b] 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial070.stdout:[mon.c] 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial103.stdout:[global] 2026-02-24T19:16:34.863 INFO:teuthology.orchestra.run.trial103.stdout: chdir = "" 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: auth supported = cephx 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: filestore xattr use omap = true 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: mon clock drift allowed = 1.000 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: osd crush chooseleaf type = 0 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: auth debug = true 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: ms die on old message = true 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: ms die on bug = true 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: mon pg warn max object skew = 0 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: # disable pg_autoscaler by default for new pools 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: osd pool default size = 2 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: mon osd allow primary affinity = true 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: mon osd allow pg remap = true 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: mon warn on legacy crush tunables = false 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: mon warn on crush straw calc version zero = false 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: mon warn on no sortbitwise = false 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: mon warn on osd down out interval zero = false 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: mon warn on too few osds = false 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: mon_allow_pool_size_one = true 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: osd default data pool replay window = 5 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: mon allow pool delete = true 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: mon cluster log file level = debug 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: debug asserts on shutdown = true 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: mon health detail to clog = false 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: mon host = "[v1:10.20.193.26:6789],[v1:10.20.193.70:6789],[v1:10.20.193.103:6789]" 2026-02-24T19:16:34.864 INFO:teuthology.orchestra.run.trial103.stdout: mon client directed command retry = 5 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: mon election default strategy = 3 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: ms bind msgr2 = False 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: ms inject socket failures = 5000 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: ms type = async 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: osd heartbeat grace = 160 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: osd op thread timeout = 150 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: fsid = 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout:[osd] 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: osd journal size = 100 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: osd scrub load threshold = 5.0 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: osd scrub max interval = 600 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: osd mclock profile = high_recovery_ops 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: osd mclock skip benchmark = True 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: osd recover clone overlap = true 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: osd recovery max chunk = 1048576 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: osd debug shutdown = true 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: osd debug op order = true 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: osd debug verify stray on activate = true 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: osd debug trim objects = true 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: osd open classes on start = true 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: osd debug pg log writeout = true 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: osd deep scrub update digest min age = 30 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: osd map max advance = 10 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: journal zero on create = true 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: filestore ondisk finisher threads = 3 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: filestore apply finisher threads = 3 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: bdev debug aio = true 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: osd debug misdirected ops = true 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: bdev async discard = True 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: bdev enable discard = True 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: bluestore allocator = btree 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: bluestore block size = 96636764160 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: bluestore fsck on mount = True 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: bluestore onode segment size = 0 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: bluestore write v2 random = True 2026-02-24T19:16:34.865 INFO:teuthology.orchestra.run.trial103.stdout: bluestore zero block detection = True 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: crush location = root=default host=host-$id 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: debug bluefs = 1 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: debug bluestore = 1 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: debug monc = 20 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: debug ms = 1 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: debug osd = 20 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: debug rocksdb = 10 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: mon osd backfillfull_ratio = 0.85 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: mon osd full ratio = 0.9 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: mon osd nearfull ratio = 0.8 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: osd class default list = * 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: osd class load list = * 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: osd client watch timeout = 240 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: osd debug verify cached snaps = True 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: osd debug verify missing on start = True 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: osd failsafe full ratio = 0.95 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: osd fast shutdown = False 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: osd mclock override recovery settings = True 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: osd objectstore = bluestore 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: osd op queue = debug_random 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: osd op queue cut off = debug_random 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: osd shutdown pgref assert = True 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout:[mgr] 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: debug ms = 1 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: debug mgr = 20 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: debug mon = 20 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: debug auth = 20 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: mon reweight min pgs per osd = 4 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: mon reweight min bytes per osd = 10 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: mgr/telemetry/nag = false 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout:[mon] 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: debug ms = 1 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: debug mon = 20 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: debug paxos = 20 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: debug auth = 20 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: mon data avail warn = 5 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: mon mgr mkfs grace = 240 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: mon reweight min pgs per osd = 4 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: mon osd reporter subtree level = osd 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: mon osd prime pg temp = true 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: mon reweight min bytes per osd = 10 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: auth mon ticket ttl = 660 # 11m 2026-02-24T19:16:34.866 INFO:teuthology.orchestra.run.trial103.stdout: auth service ticket ttl = 240 # 4m 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: # don't complain about insecure global_id in the test suite 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: # 1m isn't quite enough 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: mon_down_mkfs_grace = 2m 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: mon_warn_on_filestore_osds = false 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: mon min osdmap epochs = 50 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: mon osd crush smoke test = False 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: mon osdmap full prune interval = 2 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: mon osdmap full prune min = 15 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: mon osdmap full prune txsize = 2 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: mon scrub interval = 300 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: mon warn on pool no app = False 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: paxos service trim min = 10 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout:[client] 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: rgw cache enabled = true 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: rgw enable ops log = true 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: rgw enable usage log = true 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: debug monc = 20 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: debug ms = 1 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: debug objecter = 20 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: debug rados = 20 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout: rados replica read policy = balance 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout:[mon.a] 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout:[mon.b] 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial103.stdout:[mon.c] 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial162.stdout:[global] 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial162.stdout: chdir = "" 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial162.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial162.stdout: auth supported = cephx 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial162.stdout: filestore xattr use omap = true 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial162.stdout: mon clock drift allowed = 1.000 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial162.stdout: osd crush chooseleaf type = 0 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial162.stdout: auth debug = true 2026-02-24T19:16:34.867 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: ms die on old message = true 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: ms die on bug = true 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: mon pg warn max object skew = 0 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: # disable pg_autoscaler by default for new pools 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: osd pool default size = 2 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: mon osd allow primary affinity = true 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: mon osd allow pg remap = true 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: mon warn on legacy crush tunables = false 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: mon warn on crush straw calc version zero = false 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: mon warn on no sortbitwise = false 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: mon warn on osd down out interval zero = false 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: mon warn on too few osds = false 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: mon_allow_pool_size_one = true 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: osd default data pool replay window = 5 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: mon allow pool delete = true 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: mon cluster log file level = debug 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: debug asserts on shutdown = true 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: mon health detail to clog = false 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: mon host = "[v1:10.20.193.26:6789],[v1:10.20.193.70:6789],[v1:10.20.193.103:6789]" 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: mon client directed command retry = 5 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: mon election default strategy = 3 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: ms bind msgr2 = False 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: ms inject socket failures = 5000 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: ms type = async 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: osd heartbeat grace = 160 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: osd op thread timeout = 150 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: fsid = 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout:[osd] 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: osd journal size = 100 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: osd scrub load threshold = 5.0 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: osd scrub max interval = 600 2026-02-24T19:16:34.868 INFO:teuthology.orchestra.run.trial162.stdout: osd mclock profile = high_recovery_ops 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: osd mclock skip benchmark = True 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: osd recover clone overlap = true 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: osd recovery max chunk = 1048576 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: osd debug shutdown = true 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: osd debug op order = true 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: osd debug verify stray on activate = true 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: osd debug trim objects = true 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: osd open classes on start = true 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: osd debug pg log writeout = true 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: osd deep scrub update digest min age = 30 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: osd map max advance = 10 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: journal zero on create = true 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: filestore ondisk finisher threads = 3 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: filestore apply finisher threads = 3 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: bdev debug aio = true 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: osd debug misdirected ops = true 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: bdev async discard = True 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: bdev enable discard = True 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: bluestore allocator = btree 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: bluestore block size = 96636764160 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: bluestore fsck on mount = True 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: bluestore onode segment size = 0 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: bluestore write v2 random = True 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: bluestore zero block detection = True 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: crush location = root=default host=host-$id 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: debug bluefs = 1 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: debug bluestore = 1 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: debug monc = 20 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: debug ms = 1 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: debug osd = 20 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: debug rocksdb = 10 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: mon osd backfillfull_ratio = 0.85 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: mon osd full ratio = 0.9 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: mon osd nearfull ratio = 0.8 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: osd class default list = * 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: osd class load list = * 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: osd client watch timeout = 240 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: osd debug verify cached snaps = True 2026-02-24T19:16:34.869 INFO:teuthology.orchestra.run.trial162.stdout: osd debug verify missing on start = True 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: osd failsafe full ratio = 0.95 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: osd fast shutdown = False 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: osd mclock override recovery settings = True 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: osd objectstore = bluestore 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: osd op queue = debug_random 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: osd op queue cut off = debug_random 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: osd shutdown pgref assert = True 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout:[mgr] 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: debug ms = 1 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: debug mgr = 20 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: debug mon = 20 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: debug auth = 20 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: mon reweight min pgs per osd = 4 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: mon reweight min bytes per osd = 10 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: mgr/telemetry/nag = false 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout:[mon] 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: debug ms = 1 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: debug mon = 20 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: debug paxos = 20 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: debug auth = 20 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: mon data avail warn = 5 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: mon mgr mkfs grace = 240 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: mon reweight min pgs per osd = 4 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: mon osd reporter subtree level = osd 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: mon osd prime pg temp = true 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: mon reweight min bytes per osd = 10 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: auth mon ticket ttl = 660 # 11m 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: auth service ticket ttl = 240 # 4m 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: # don't complain about insecure global_id in the test suite 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: # 1m isn't quite enough 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: mon_down_mkfs_grace = 2m 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: mon_warn_on_filestore_osds = false 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: mon min osdmap epochs = 50 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: mon osd crush smoke test = False 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: mon osdmap full prune interval = 2 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: mon osdmap full prune min = 15 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: mon osdmap full prune txsize = 2 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: mon scrub interval = 300 2026-02-24T19:16:34.870 INFO:teuthology.orchestra.run.trial162.stdout: mon warn on pool no app = False 2026-02-24T19:16:34.871 INFO:teuthology.orchestra.run.trial162.stdout: paxos service trim min = 10 2026-02-24T19:16:34.871 INFO:teuthology.orchestra.run.trial162.stdout: 2026-02-24T19:16:34.871 INFO:teuthology.orchestra.run.trial162.stdout:[client] 2026-02-24T19:16:34.871 INFO:teuthology.orchestra.run.trial162.stdout: rgw cache enabled = true 2026-02-24T19:16:34.871 INFO:teuthology.orchestra.run.trial162.stdout: rgw enable ops log = true 2026-02-24T19:16:34.871 INFO:teuthology.orchestra.run.trial162.stdout: rgw enable usage log = true 2026-02-24T19:16:34.871 INFO:teuthology.orchestra.run.trial162.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-24T19:16:34.871 INFO:teuthology.orchestra.run.trial162.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-24T19:16:34.871 INFO:teuthology.orchestra.run.trial162.stdout: debug monc = 20 2026-02-24T19:16:34.871 INFO:teuthology.orchestra.run.trial162.stdout: debug ms = 1 2026-02-24T19:16:34.871 INFO:teuthology.orchestra.run.trial162.stdout: debug objecter = 20 2026-02-24T19:16:34.871 INFO:teuthology.orchestra.run.trial162.stdout: debug rados = 20 2026-02-24T19:16:34.871 INFO:teuthology.orchestra.run.trial162.stdout: rados replica read policy = balance 2026-02-24T19:16:34.871 INFO:teuthology.orchestra.run.trial162.stdout:[mon.a] 2026-02-24T19:16:34.871 INFO:teuthology.orchestra.run.trial162.stdout:[mon.b] 2026-02-24T19:16:34.871 INFO:teuthology.orchestra.run.trial162.stdout:[mon.c] 2026-02-24T19:16:34.872 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-24T19:16:34.872 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-24T19:16:34.953 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-24T19:16:34.953 DEBUG:teuthology.orchestra.run.trial026:> set -ex 2026-02-24T19:16:34.953 DEBUG:teuthology.orchestra.run.trial026:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-24T19:16:35.008 DEBUG:teuthology.orchestra.run.trial026:> set -ex 2026-02-24T19:16:35.008 DEBUG:teuthology.orchestra.run.trial026:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-24T19:16:35.066 INFO:tasks.ceph:Sending monmap to node ubuntu@trial026.front.sepia.ceph.com 2026-02-24T19:16:35.066 DEBUG:teuthology.orchestra.run.trial026:> set -ex 2026-02-24T19:16:35.066 DEBUG:teuthology.orchestra.run.trial026:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-24T19:16:35.066 DEBUG:teuthology.orchestra.run.trial026:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-24T19:16:35.137 DEBUG:teuthology.orchestra.run.trial026:> set -ex 2026-02-24T19:16:35.137 DEBUG:teuthology.orchestra.run.trial026:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:35.192 INFO:tasks.ceph:Sending monmap to node ubuntu@trial070.front.sepia.ceph.com 2026-02-24T19:16:35.192 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-24T19:16:35.192 DEBUG:teuthology.orchestra.run.trial070:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-24T19:16:35.192 DEBUG:teuthology.orchestra.run.trial070:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-24T19:16:35.226 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-24T19:16:35.226 DEBUG:teuthology.orchestra.run.trial070:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:35.281 INFO:tasks.ceph:Sending monmap to node ubuntu@trial103.front.sepia.ceph.com 2026-02-24T19:16:35.281 DEBUG:teuthology.orchestra.run.trial103:> set -ex 2026-02-24T19:16:35.282 DEBUG:teuthology.orchestra.run.trial103:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-24T19:16:35.282 DEBUG:teuthology.orchestra.run.trial103:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-24T19:16:35.316 DEBUG:teuthology.orchestra.run.trial103:> set -ex 2026-02-24T19:16:35.316 DEBUG:teuthology.orchestra.run.trial103:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:35.374 INFO:tasks.ceph:Sending monmap to node ubuntu@trial162.front.sepia.ceph.com 2026-02-24T19:16:35.375 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-24T19:16:35.375 DEBUG:teuthology.orchestra.run.trial162:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-24T19:16:35.375 DEBUG:teuthology.orchestra.run.trial162:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-24T19:16:35.410 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-24T19:16:35.411 DEBUG:teuthology.orchestra.run.trial162:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:35.468 INFO:tasks.ceph:Setting up mon nodes... 2026-02-24T19:16:35.469 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-24T19:16:35.469 DEBUG:teuthology.orchestra.run.trial026:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2026-02-24T19:16:35.513 INFO:teuthology.orchestra.run.trial026.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2026-02-24T19:16:35.515 DEBUG:teuthology.orchestra.run.trial162:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-24T19:16:35.559 INFO:teuthology.orchestra.run.trial162.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-24T19:16:35.561 INFO:tasks.ceph:Setting up mds nodes... 2026-02-24T19:16:35.561 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-24T19:16:35.561 DEBUG:teuthology.orchestra.run.trial162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-24T19:16:35.594 INFO:teuthology.orchestra.run.trial162.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-24T19:16:35.605 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-24T19:16:35.605 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial026.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial070.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial103.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial162.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2026-02-24T19:16:35.606 DEBUG:teuthology.orchestra.run.trial026:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-24T19:16:35.629 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:35.630 INFO:tasks.ceph:role: osd.0 2026-02-24T19:16:35.630 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial026.front.sepia.ceph.com 2026-02-24T19:16:35.630 DEBUG:teuthology.orchestra.run.trial026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-24T19:16:35.694 INFO:teuthology.orchestra.run.trial026.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:35.694 INFO:teuthology.orchestra.run.trial026.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:35.694 INFO:teuthology.orchestra.run.trial026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:35.694 INFO:teuthology.orchestra.run.trial026.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:35.694 INFO:teuthology.orchestra.run.trial026.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:35.694 INFO:teuthology.orchestra.run.trial026.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:35.694 INFO:teuthology.orchestra.run.trial026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:35.694 INFO:teuthology.orchestra.run.trial026.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:35.694 INFO:teuthology.orchestra.run.trial026.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:35.694 INFO:teuthology.orchestra.run.trial026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:36.275 INFO:teuthology.orchestra.run.trial026.stdout:Discarding blocks...Done. 2026-02-24T19:16:36.277 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial026.front.sepia.ceph.com -o noatime 2026-02-24T19:16:36.278 DEBUG:teuthology.orchestra.run.trial026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-24T19:16:36.347 DEBUG:teuthology.orchestra.run.trial026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-24T19:16:36.414 DEBUG:teuthology.orchestra.run.trial026:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-24T19:16:36.478 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:36.478 INFO:tasks.ceph:role: osd.4 2026-02-24T19:16:36.478 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial026.front.sepia.ceph.com 2026-02-24T19:16:36.478 DEBUG:teuthology.orchestra.run.trial026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-24T19:16:36.543 INFO:teuthology.orchestra.run.trial026.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:36.543 INFO:teuthology.orchestra.run.trial026.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:36.544 INFO:teuthology.orchestra.run.trial026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:36.544 INFO:teuthology.orchestra.run.trial026.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:36.544 INFO:teuthology.orchestra.run.trial026.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:36.544 INFO:teuthology.orchestra.run.trial026.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:36.544 INFO:teuthology.orchestra.run.trial026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:36.544 INFO:teuthology.orchestra.run.trial026.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:36.544 INFO:teuthology.orchestra.run.trial026.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:36.544 INFO:teuthology.orchestra.run.trial026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:37.114 INFO:teuthology.orchestra.run.trial026.stdout:Discarding blocks...Done. 2026-02-24T19:16:37.116 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial026.front.sepia.ceph.com -o noatime 2026-02-24T19:16:37.116 DEBUG:teuthology.orchestra.run.trial026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2026-02-24T19:16:37.185 DEBUG:teuthology.orchestra.run.trial026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2026-02-24T19:16:37.251 DEBUG:teuthology.orchestra.run.trial026:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2026-02-24T19:16:37.315 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:37.315 INFO:tasks.ceph:role: osd.8 2026-02-24T19:16:37.315 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial026.front.sepia.ceph.com 2026-02-24T19:16:37.315 DEBUG:teuthology.orchestra.run.trial026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-24T19:16:37.379 INFO:teuthology.orchestra.run.trial026.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:37.380 INFO:teuthology.orchestra.run.trial026.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:37.380 INFO:teuthology.orchestra.run.trial026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:37.380 INFO:teuthology.orchestra.run.trial026.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:37.380 INFO:teuthology.orchestra.run.trial026.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:37.380 INFO:teuthology.orchestra.run.trial026.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:37.380 INFO:teuthology.orchestra.run.trial026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:37.380 INFO:teuthology.orchestra.run.trial026.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:37.380 INFO:teuthology.orchestra.run.trial026.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:37.380 INFO:teuthology.orchestra.run.trial026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:37.990 INFO:teuthology.orchestra.run.trial026.stdout:Discarding blocks...Done. 2026-02-24T19:16:37.992 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial026.front.sepia.ceph.com -o noatime 2026-02-24T19:16:37.992 DEBUG:teuthology.orchestra.run.trial026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2026-02-24T19:16:38.060 DEBUG:teuthology.orchestra.run.trial026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2026-02-24T19:16:38.127 DEBUG:teuthology.orchestra.run.trial026:> sudo mkdir -p /var/lib/ceph/osd/ceph-12 2026-02-24T19:16:38.191 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:38.191 INFO:tasks.ceph:role: osd.12 2026-02-24T19:16:38.191 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial026.front.sepia.ceph.com 2026-02-24T19:16:38.192 DEBUG:teuthology.orchestra.run.trial026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-24T19:16:38.256 INFO:teuthology.orchestra.run.trial026.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:38.256 INFO:teuthology.orchestra.run.trial026.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:38.256 INFO:teuthology.orchestra.run.trial026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:38.256 INFO:teuthology.orchestra.run.trial026.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:38.256 INFO:teuthology.orchestra.run.trial026.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:38.256 INFO:teuthology.orchestra.run.trial026.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:38.256 INFO:teuthology.orchestra.run.trial026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:38.256 INFO:teuthology.orchestra.run.trial026.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:38.256 INFO:teuthology.orchestra.run.trial026.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:38.256 INFO:teuthology.orchestra.run.trial026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:38.810 INFO:teuthology.orchestra.run.trial026.stdout:Discarding blocks...Done. 2026-02-24T19:16:38.812 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial026.front.sepia.ceph.com -o noatime 2026-02-24T19:16:38.813 DEBUG:teuthology.orchestra.run.trial026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-12 2026-02-24T19:16:38.888 DEBUG:teuthology.orchestra.run.trial026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-12 2026-02-24T19:16:38.955 DEBUG:teuthology.orchestra.run.trial026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:39.034 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:16:39.033+0000 7f8d2c40c900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-24T19:16:39.035 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:16:39.033+0000 7f8d2c40c900 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-24T19:16:39.035 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:16:39.033+0000 7f8d2c40c900 -1 bdev(0x55b44b2c3800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:39.035 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:16:39.033+0000 7f8d2c40c900 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-24T19:16:39.504 DEBUG:teuthology.orchestra.run.trial026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-24T19:16:39.569 DEBUG:teuthology.orchestra.run.trial026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:39.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:16:39.647+0000 7f0c6204d900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-24T19:16:39.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:16:39.647+0000 7f0c6204d900 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-24T19:16:39.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:16:39.647+0000 7f0c6204d900 -1 bdev(0x561ee17c7800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:39.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:16:39.647+0000 7f0c6204d900 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-24T19:16:40.122 DEBUG:teuthology.orchestra.run.trial026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-24T19:16:40.187 DEBUG:teuthology.orchestra.run.trial026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:40.264 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:16:40.263+0000 7fa5865f0900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2026-02-24T19:16:40.265 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:16:40.264+0000 7fa5865f0900 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2026-02-24T19:16:40.265 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:16:40.264+0000 7fa5865f0900 -1 bdev(0x55e022dbb800 /var/lib/ceph/osd/ceph-8/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:40.265 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:16:40.264+0000 7fa5865f0900 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2026-02-24T19:16:40.772 DEBUG:teuthology.orchestra.run.trial026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2026-02-24T19:16:40.838 DEBUG:teuthology.orchestra.run.trial026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 12 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:40.916 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:16:40.914+0000 7f06b16d9900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-12/keyring: can't open /var/lib/ceph/osd/ceph-12/keyring: (2) No such file or directory 2026-02-24T19:16:40.916 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:16:40.914+0000 7f06b16d9900 -1 created new key in keyring /var/lib/ceph/osd/ceph-12/keyring 2026-02-24T19:16:40.916 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:16:40.914+0000 7f06b16d9900 -1 bdev(0x5644c9355800 /var/lib/ceph/osd/ceph-12/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:40.916 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:16:40.915+0000 7f06b16d9900 -1 bluestore(/var/lib/ceph/osd/ceph-12) _read_fsid unparsable uuid 2026-02-24T19:16:41.456 DEBUG:teuthology.orchestra.run.trial026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-12 2026-02-24T19:16:41.522 DEBUG:teuthology.orchestra.run.trial070:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-24T19:16:41.547 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:41.547 INFO:tasks.ceph:role: osd.1 2026-02-24T19:16:41.547 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial070.front.sepia.ceph.com 2026-02-24T19:16:41.548 DEBUG:teuthology.orchestra.run.trial070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-24T19:16:41.612 INFO:teuthology.orchestra.run.trial070.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:41.612 INFO:teuthology.orchestra.run.trial070.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:41.612 INFO:teuthology.orchestra.run.trial070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:41.612 INFO:teuthology.orchestra.run.trial070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:41.612 INFO:teuthology.orchestra.run.trial070.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:41.612 INFO:teuthology.orchestra.run.trial070.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:41.612 INFO:teuthology.orchestra.run.trial070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:41.612 INFO:teuthology.orchestra.run.trial070.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:41.613 INFO:teuthology.orchestra.run.trial070.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:41.613 INFO:teuthology.orchestra.run.trial070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:42.186 INFO:teuthology.orchestra.run.trial070.stdout:Discarding blocks...Done. 2026-02-24T19:16:42.188 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial070.front.sepia.ceph.com -o noatime 2026-02-24T19:16:42.189 DEBUG:teuthology.orchestra.run.trial070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2026-02-24T19:16:42.257 DEBUG:teuthology.orchestra.run.trial070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-24T19:16:42.324 DEBUG:teuthology.orchestra.run.trial070:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-24T19:16:42.387 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:42.387 INFO:tasks.ceph:role: osd.5 2026-02-24T19:16:42.388 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial070.front.sepia.ceph.com 2026-02-24T19:16:42.388 DEBUG:teuthology.orchestra.run.trial070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-24T19:16:42.451 INFO:teuthology.orchestra.run.trial070.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:42.451 INFO:teuthology.orchestra.run.trial070.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:42.451 INFO:teuthology.orchestra.run.trial070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:42.451 INFO:teuthology.orchestra.run.trial070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:42.451 INFO:teuthology.orchestra.run.trial070.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:42.451 INFO:teuthology.orchestra.run.trial070.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:42.451 INFO:teuthology.orchestra.run.trial070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:42.451 INFO:teuthology.orchestra.run.trial070.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:42.452 INFO:teuthology.orchestra.run.trial070.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:42.452 INFO:teuthology.orchestra.run.trial070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:43.010 INFO:teuthology.orchestra.run.trial070.stdout:Discarding blocks...Done. 2026-02-24T19:16:43.012 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial070.front.sepia.ceph.com -o noatime 2026-02-24T19:16:43.013 DEBUG:teuthology.orchestra.run.trial070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2026-02-24T19:16:43.080 DEBUG:teuthology.orchestra.run.trial070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2026-02-24T19:16:43.146 DEBUG:teuthology.orchestra.run.trial070:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2026-02-24T19:16:43.210 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:43.210 INFO:tasks.ceph:role: osd.9 2026-02-24T19:16:43.210 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial070.front.sepia.ceph.com 2026-02-24T19:16:43.210 DEBUG:teuthology.orchestra.run.trial070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-24T19:16:43.275 INFO:teuthology.orchestra.run.trial070.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:43.275 INFO:teuthology.orchestra.run.trial070.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:43.275 INFO:teuthology.orchestra.run.trial070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:43.275 INFO:teuthology.orchestra.run.trial070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:43.275 INFO:teuthology.orchestra.run.trial070.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:43.275 INFO:teuthology.orchestra.run.trial070.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:43.275 INFO:teuthology.orchestra.run.trial070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:43.275 INFO:teuthology.orchestra.run.trial070.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:43.276 INFO:teuthology.orchestra.run.trial070.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:43.276 INFO:teuthology.orchestra.run.trial070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:43.835 INFO:teuthology.orchestra.run.trial070.stdout:Discarding blocks...Done. 2026-02-24T19:16:43.837 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial070.front.sepia.ceph.com -o noatime 2026-02-24T19:16:43.837 DEBUG:teuthology.orchestra.run.trial070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-9 2026-02-24T19:16:43.905 DEBUG:teuthology.orchestra.run.trial070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2026-02-24T19:16:43.971 DEBUG:teuthology.orchestra.run.trial070:> sudo mkdir -p /var/lib/ceph/osd/ceph-13 2026-02-24T19:16:44.036 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:44.037 INFO:tasks.ceph:role: osd.13 2026-02-24T19:16:44.037 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial070.front.sepia.ceph.com 2026-02-24T19:16:44.037 DEBUG:teuthology.orchestra.run.trial070:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-24T19:16:44.101 INFO:teuthology.orchestra.run.trial070.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:44.101 INFO:teuthology.orchestra.run.trial070.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:44.102 INFO:teuthology.orchestra.run.trial070.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:44.102 INFO:teuthology.orchestra.run.trial070.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:44.102 INFO:teuthology.orchestra.run.trial070.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:44.102 INFO:teuthology.orchestra.run.trial070.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:44.102 INFO:teuthology.orchestra.run.trial070.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:44.102 INFO:teuthology.orchestra.run.trial070.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:44.102 INFO:teuthology.orchestra.run.trial070.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:44.102 INFO:teuthology.orchestra.run.trial070.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:44.657 INFO:teuthology.orchestra.run.trial070.stdout:Discarding blocks...Done. 2026-02-24T19:16:44.659 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial070.front.sepia.ceph.com -o noatime 2026-02-24T19:16:44.659 DEBUG:teuthology.orchestra.run.trial070:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-13 2026-02-24T19:16:44.735 DEBUG:teuthology.orchestra.run.trial070:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-13 2026-02-24T19:16:44.801 DEBUG:teuthology.orchestra.run.trial070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:44.880 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-24T19:16:44.878+0000 7f7074988900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-24T19:16:44.880 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-24T19:16:44.878+0000 7f7074988900 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-24T19:16:44.881 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-24T19:16:44.878+0000 7f7074988900 -1 bdev(0x560ccf95d800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:44.881 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-24T19:16:44.878+0000 7f7074988900 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-24T19:16:45.350 DEBUG:teuthology.orchestra.run.trial070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-24T19:16:45.415 DEBUG:teuthology.orchestra.run.trial070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:45.492 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-24T19:16:45.490+0000 7f7715e05900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-24T19:16:45.493 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-24T19:16:45.491+0000 7f7715e05900 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-24T19:16:45.493 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-24T19:16:45.491+0000 7f7715e05900 -1 bdev(0x564226d13800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:45.494 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-24T19:16:45.491+0000 7f7715e05900 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-24T19:16:45.979 DEBUG:teuthology.orchestra.run.trial070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-24T19:16:46.044 DEBUG:teuthology.orchestra.run.trial070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:46.123 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-24T19:16:46.121+0000 7fbe8bb5d900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2026-02-24T19:16:46.124 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-24T19:16:46.122+0000 7fbe8bb5d900 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2026-02-24T19:16:46.124 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-24T19:16:46.122+0000 7fbe8bb5d900 -1 bdev(0x55a11b9cb800 /var/lib/ceph/osd/ceph-9/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:46.124 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-24T19:16:46.122+0000 7fbe8bb5d900 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2026-02-24T19:16:46.618 DEBUG:teuthology.orchestra.run.trial070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2026-02-24T19:16:46.684 DEBUG:teuthology.orchestra.run.trial070:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 13 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:46.763 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-24T19:16:46.760+0000 7f78bfd46900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-13/keyring: can't open /var/lib/ceph/osd/ceph-13/keyring: (2) No such file or directory 2026-02-24T19:16:46.763 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-24T19:16:46.760+0000 7f78bfd46900 -1 created new key in keyring /var/lib/ceph/osd/ceph-13/keyring 2026-02-24T19:16:46.763 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-24T19:16:46.760+0000 7f78bfd46900 -1 bdev(0x561d1ab05800 /var/lib/ceph/osd/ceph-13/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:46.763 INFO:teuthology.orchestra.run.trial070.stderr:2026-02-24T19:16:46.761+0000 7f78bfd46900 -1 bluestore(/var/lib/ceph/osd/ceph-13) _read_fsid unparsable uuid 2026-02-24T19:16:47.230 DEBUG:teuthology.orchestra.run.trial070:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-13 2026-02-24T19:16:47.296 DEBUG:teuthology.orchestra.run.trial103:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-24T19:16:47.321 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:47.321 INFO:tasks.ceph:role: osd.2 2026-02-24T19:16:47.321 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial103.front.sepia.ceph.com 2026-02-24T19:16:47.322 DEBUG:teuthology.orchestra.run.trial103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-24T19:16:47.387 INFO:teuthology.orchestra.run.trial103.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:47.387 INFO:teuthology.orchestra.run.trial103.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:47.387 INFO:teuthology.orchestra.run.trial103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:47.387 INFO:teuthology.orchestra.run.trial103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:47.387 INFO:teuthology.orchestra.run.trial103.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:47.387 INFO:teuthology.orchestra.run.trial103.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:47.387 INFO:teuthology.orchestra.run.trial103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:47.388 INFO:teuthology.orchestra.run.trial103.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:47.388 INFO:teuthology.orchestra.run.trial103.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:47.388 INFO:teuthology.orchestra.run.trial103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:47.962 INFO:teuthology.orchestra.run.trial103.stdout:Discarding blocks...Done. 2026-02-24T19:16:47.964 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial103.front.sepia.ceph.com -o noatime 2026-02-24T19:16:47.964 DEBUG:teuthology.orchestra.run.trial103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2026-02-24T19:16:48.032 DEBUG:teuthology.orchestra.run.trial103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-24T19:16:48.098 DEBUG:teuthology.orchestra.run.trial103:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2026-02-24T19:16:48.163 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:48.163 INFO:tasks.ceph:role: osd.6 2026-02-24T19:16:48.163 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial103.front.sepia.ceph.com 2026-02-24T19:16:48.163 DEBUG:teuthology.orchestra.run.trial103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-24T19:16:48.227 INFO:teuthology.orchestra.run.trial103.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:48.228 INFO:teuthology.orchestra.run.trial103.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:48.228 INFO:teuthology.orchestra.run.trial103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:48.228 INFO:teuthology.orchestra.run.trial103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:48.228 INFO:teuthology.orchestra.run.trial103.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:48.228 INFO:teuthology.orchestra.run.trial103.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:48.228 INFO:teuthology.orchestra.run.trial103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:48.228 INFO:teuthology.orchestra.run.trial103.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:48.228 INFO:teuthology.orchestra.run.trial103.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:48.228 INFO:teuthology.orchestra.run.trial103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:48.789 INFO:teuthology.orchestra.run.trial103.stdout:Discarding blocks...Done. 2026-02-24T19:16:48.791 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial103.front.sepia.ceph.com -o noatime 2026-02-24T19:16:48.791 DEBUG:teuthology.orchestra.run.trial103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2026-02-24T19:16:48.859 DEBUG:teuthology.orchestra.run.trial103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2026-02-24T19:16:48.925 DEBUG:teuthology.orchestra.run.trial103:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2026-02-24T19:16:48.989 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:48.989 INFO:tasks.ceph:role: osd.10 2026-02-24T19:16:48.990 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial103.front.sepia.ceph.com 2026-02-24T19:16:48.990 DEBUG:teuthology.orchestra.run.trial103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-24T19:16:49.055 INFO:teuthology.orchestra.run.trial103.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:49.055 INFO:teuthology.orchestra.run.trial103.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:49.055 INFO:teuthology.orchestra.run.trial103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:49.055 INFO:teuthology.orchestra.run.trial103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:49.055 INFO:teuthology.orchestra.run.trial103.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:49.055 INFO:teuthology.orchestra.run.trial103.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:49.055 INFO:teuthology.orchestra.run.trial103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:49.055 INFO:teuthology.orchestra.run.trial103.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:49.056 INFO:teuthology.orchestra.run.trial103.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:49.056 INFO:teuthology.orchestra.run.trial103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:49.616 INFO:teuthology.orchestra.run.trial103.stdout:Discarding blocks...Done. 2026-02-24T19:16:49.617 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial103.front.sepia.ceph.com -o noatime 2026-02-24T19:16:49.618 DEBUG:teuthology.orchestra.run.trial103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-10 2026-02-24T19:16:49.686 DEBUG:teuthology.orchestra.run.trial103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2026-02-24T19:16:49.753 DEBUG:teuthology.orchestra.run.trial103:> sudo mkdir -p /var/lib/ceph/osd/ceph-14 2026-02-24T19:16:49.817 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:49.817 INFO:tasks.ceph:role: osd.14 2026-02-24T19:16:49.817 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial103.front.sepia.ceph.com 2026-02-24T19:16:49.817 DEBUG:teuthology.orchestra.run.trial103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-24T19:16:49.881 INFO:teuthology.orchestra.run.trial103.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:49.881 INFO:teuthology.orchestra.run.trial103.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:49.881 INFO:teuthology.orchestra.run.trial103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:49.881 INFO:teuthology.orchestra.run.trial103.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:49.881 INFO:teuthology.orchestra.run.trial103.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:49.881 INFO:teuthology.orchestra.run.trial103.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:49.882 INFO:teuthology.orchestra.run.trial103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:49.882 INFO:teuthology.orchestra.run.trial103.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:49.882 INFO:teuthology.orchestra.run.trial103.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:49.882 INFO:teuthology.orchestra.run.trial103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:50.438 INFO:teuthology.orchestra.run.trial103.stdout:Discarding blocks...Done. 2026-02-24T19:16:50.440 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial103.front.sepia.ceph.com -o noatime 2026-02-24T19:16:50.440 DEBUG:teuthology.orchestra.run.trial103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-14 2026-02-24T19:16:50.517 DEBUG:teuthology.orchestra.run.trial103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-14 2026-02-24T19:16:50.583 DEBUG:teuthology.orchestra.run.trial103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:50.663 INFO:teuthology.orchestra.run.trial103.stderr:2026-02-24T19:16:50.662+0000 7f7a21f2d900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-24T19:16:50.663 INFO:teuthology.orchestra.run.trial103.stderr:2026-02-24T19:16:50.662+0000 7f7a21f2d900 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-24T19:16:50.664 INFO:teuthology.orchestra.run.trial103.stderr:2026-02-24T19:16:50.662+0000 7f7a21f2d900 -1 bdev(0x5584daf21800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:50.664 INFO:teuthology.orchestra.run.trial103.stderr:2026-02-24T19:16:50.662+0000 7f7a21f2d900 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-24T19:16:51.135 DEBUG:teuthology.orchestra.run.trial103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-24T19:16:51.202 DEBUG:teuthology.orchestra.run.trial103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:51.282 INFO:teuthology.orchestra.run.trial103.stderr:2026-02-24T19:16:51.281+0000 7f5b9b813900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2026-02-24T19:16:51.282 INFO:teuthology.orchestra.run.trial103.stderr:2026-02-24T19:16:51.281+0000 7f5b9b813900 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2026-02-24T19:16:51.282 INFO:teuthology.orchestra.run.trial103.stderr:2026-02-24T19:16:51.281+0000 7f5b9b813900 -1 bdev(0x55aaee1bb800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:51.283 INFO:teuthology.orchestra.run.trial103.stderr:2026-02-24T19:16:51.281+0000 7f5b9b813900 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2026-02-24T19:16:51.760 DEBUG:teuthology.orchestra.run.trial103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2026-02-24T19:16:51.825 DEBUG:teuthology.orchestra.run.trial103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:51.902 INFO:teuthology.orchestra.run.trial103.stderr:2026-02-24T19:16:51.902+0000 7fb2565cd900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2026-02-24T19:16:51.903 INFO:teuthology.orchestra.run.trial103.stderr:2026-02-24T19:16:51.902+0000 7fb2565cd900 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2026-02-24T19:16:51.903 INFO:teuthology.orchestra.run.trial103.stderr:2026-02-24T19:16:51.902+0000 7fb2565cd900 -1 bdev(0x5555f4fb1800 /var/lib/ceph/osd/ceph-10/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:51.904 INFO:teuthology.orchestra.run.trial103.stderr:2026-02-24T19:16:51.902+0000 7fb2565cd900 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2026-02-24T19:16:52.380 DEBUG:teuthology.orchestra.run.trial103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2026-02-24T19:16:52.445 DEBUG:teuthology.orchestra.run.trial103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 14 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:52.522 INFO:teuthology.orchestra.run.trial103.stderr:2026-02-24T19:16:52.521+0000 7fa5c6756900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-14/keyring: can't open /var/lib/ceph/osd/ceph-14/keyring: (2) No such file or directory 2026-02-24T19:16:52.523 INFO:teuthology.orchestra.run.trial103.stderr:2026-02-24T19:16:52.521+0000 7fa5c6756900 -1 created new key in keyring /var/lib/ceph/osd/ceph-14/keyring 2026-02-24T19:16:52.523 INFO:teuthology.orchestra.run.trial103.stderr:2026-02-24T19:16:52.521+0000 7fa5c6756900 -1 bdev(0x55cd1c3d9800 /var/lib/ceph/osd/ceph-14/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:52.523 INFO:teuthology.orchestra.run.trial103.stderr:2026-02-24T19:16:52.522+0000 7fa5c6756900 -1 bluestore(/var/lib/ceph/osd/ceph-14) _read_fsid unparsable uuid 2026-02-24T19:16:53.005 DEBUG:teuthology.orchestra.run.trial103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-14 2026-02-24T19:16:53.070 DEBUG:teuthology.orchestra.run.trial162:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-24T19:16:53.096 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:53.096 INFO:tasks.ceph:role: osd.3 2026-02-24T19:16:53.096 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial162.front.sepia.ceph.com 2026-02-24T19:16:53.096 DEBUG:teuthology.orchestra.run.trial162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-24T19:16:53.161 INFO:teuthology.orchestra.run.trial162.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:53.161 INFO:teuthology.orchestra.run.trial162.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:53.161 INFO:teuthology.orchestra.run.trial162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:53.162 INFO:teuthology.orchestra.run.trial162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:53.162 INFO:teuthology.orchestra.run.trial162.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:53.162 INFO:teuthology.orchestra.run.trial162.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:53.162 INFO:teuthology.orchestra.run.trial162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:53.162 INFO:teuthology.orchestra.run.trial162.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:53.162 INFO:teuthology.orchestra.run.trial162.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:53.162 INFO:teuthology.orchestra.run.trial162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:53.733 INFO:teuthology.orchestra.run.trial162.stdout:Discarding blocks...Done. 2026-02-24T19:16:53.735 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial162.front.sepia.ceph.com -o noatime 2026-02-24T19:16:53.735 DEBUG:teuthology.orchestra.run.trial162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2026-02-24T19:16:53.804 DEBUG:teuthology.orchestra.run.trial162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-24T19:16:53.872 DEBUG:teuthology.orchestra.run.trial162:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2026-02-24T19:16:53.935 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:53.935 INFO:tasks.ceph:role: osd.7 2026-02-24T19:16:53.935 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial162.front.sepia.ceph.com 2026-02-24T19:16:53.936 DEBUG:teuthology.orchestra.run.trial162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-24T19:16:54.000 INFO:teuthology.orchestra.run.trial162.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:54.000 INFO:teuthology.orchestra.run.trial162.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:54.000 INFO:teuthology.orchestra.run.trial162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:54.001 INFO:teuthology.orchestra.run.trial162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:54.001 INFO:teuthology.orchestra.run.trial162.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:54.001 INFO:teuthology.orchestra.run.trial162.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:54.001 INFO:teuthology.orchestra.run.trial162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:54.001 INFO:teuthology.orchestra.run.trial162.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:54.001 INFO:teuthology.orchestra.run.trial162.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:54.001 INFO:teuthology.orchestra.run.trial162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:54.558 INFO:teuthology.orchestra.run.trial162.stdout:Discarding blocks...Done. 2026-02-24T19:16:54.561 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial162.front.sepia.ceph.com -o noatime 2026-02-24T19:16:54.561 DEBUG:teuthology.orchestra.run.trial162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-7 2026-02-24T19:16:54.629 DEBUG:teuthology.orchestra.run.trial162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2026-02-24T19:16:54.696 DEBUG:teuthology.orchestra.run.trial162:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2026-02-24T19:16:54.761 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:54.761 INFO:tasks.ceph:role: osd.11 2026-02-24T19:16:54.761 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial162.front.sepia.ceph.com 2026-02-24T19:16:54.762 DEBUG:teuthology.orchestra.run.trial162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-24T19:16:54.826 INFO:teuthology.orchestra.run.trial162.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:54.826 INFO:teuthology.orchestra.run.trial162.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:54.826 INFO:teuthology.orchestra.run.trial162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:54.826 INFO:teuthology.orchestra.run.trial162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:54.826 INFO:teuthology.orchestra.run.trial162.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:54.826 INFO:teuthology.orchestra.run.trial162.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:54.826 INFO:teuthology.orchestra.run.trial162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:54.827 INFO:teuthology.orchestra.run.trial162.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:54.827 INFO:teuthology.orchestra.run.trial162.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:54.827 INFO:teuthology.orchestra.run.trial162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:55.387 INFO:teuthology.orchestra.run.trial162.stdout:Discarding blocks...Done. 2026-02-24T19:16:55.389 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial162.front.sepia.ceph.com -o noatime 2026-02-24T19:16:55.390 DEBUG:teuthology.orchestra.run.trial162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-11 2026-02-24T19:16:55.458 DEBUG:teuthology.orchestra.run.trial162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2026-02-24T19:16:55.525 DEBUG:teuthology.orchestra.run.trial162:> sudo mkdir -p /var/lib/ceph/osd/ceph-15 2026-02-24T19:16:55.589 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-24T19:16:55.589 INFO:tasks.ceph:role: osd.15 2026-02-24T19:16:55.589 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial162.front.sepia.ceph.com 2026-02-24T19:16:55.590 DEBUG:teuthology.orchestra.run.trial162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-24T19:16:55.654 INFO:teuthology.orchestra.run.trial162.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-24T19:16:55.654 INFO:teuthology.orchestra.run.trial162.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-24T19:16:55.654 INFO:teuthology.orchestra.run.trial162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-24T19:16:55.654 INFO:teuthology.orchestra.run.trial162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-24T19:16:55.654 INFO:teuthology.orchestra.run.trial162.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-24T19:16:55.655 INFO:teuthology.orchestra.run.trial162.stdout: = sunit=0 swidth=0 blks 2026-02-24T19:16:55.655 INFO:teuthology.orchestra.run.trial162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-24T19:16:55.655 INFO:teuthology.orchestra.run.trial162.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-24T19:16:55.655 INFO:teuthology.orchestra.run.trial162.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-24T19:16:55.655 INFO:teuthology.orchestra.run.trial162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-24T19:16:56.211 INFO:teuthology.orchestra.run.trial162.stdout:Discarding blocks...Done. 2026-02-24T19:16:56.213 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial162.front.sepia.ceph.com -o noatime 2026-02-24T19:16:56.214 DEBUG:teuthology.orchestra.run.trial162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-15 2026-02-24T19:16:56.286 DEBUG:teuthology.orchestra.run.trial162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-15 2026-02-24T19:16:56.352 DEBUG:teuthology.orchestra.run.trial162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:56.433 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:16:56.431+0000 7f9797f20900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-24T19:16:56.433 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:16:56.431+0000 7f9797f20900 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-24T19:16:56.434 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:16:56.431+0000 7f9797f20900 -1 bdev(0x55e8eaffd800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:56.434 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:16:56.431+0000 7f9797f20900 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-24T19:16:56.903 DEBUG:teuthology.orchestra.run.trial162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-24T19:16:56.968 DEBUG:teuthology.orchestra.run.trial162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:57.045 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:16:57.043+0000 7fa2c7621900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2026-02-24T19:16:57.046 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:16:57.044+0000 7fa2c7621900 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2026-02-24T19:16:57.046 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:16:57.044+0000 7fa2c7621900 -1 bdev(0x555ac71e5800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:57.046 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:16:57.044+0000 7fa2c7621900 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2026-02-24T19:16:57.538 DEBUG:teuthology.orchestra.run.trial162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2026-02-24T19:16:57.603 DEBUG:teuthology.orchestra.run.trial162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:57.681 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:16:57.679+0000 7f18c4b83900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2026-02-24T19:16:57.681 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:16:57.679+0000 7f18c4b83900 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2026-02-24T19:16:57.682 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:16:57.679+0000 7f18c4b83900 -1 bdev(0x563d553b1800 /var/lib/ceph/osd/ceph-11/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:57.682 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:16:57.679+0000 7f18c4b83900 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2026-02-24T19:16:58.181 DEBUG:teuthology.orchestra.run.trial162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2026-02-24T19:16:58.248 DEBUG:teuthology.orchestra.run.trial162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 15 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:16:58.327 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:16:58.325+0000 7f7436f93900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-15/keyring: can't open /var/lib/ceph/osd/ceph-15/keyring: (2) No such file or directory 2026-02-24T19:16:58.327 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:16:58.325+0000 7f7436f93900 -1 created new key in keyring /var/lib/ceph/osd/ceph-15/keyring 2026-02-24T19:16:58.328 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:16:58.325+0000 7f7436f93900 -1 bdev(0x56175bf4f800 /var/lib/ceph/osd/ceph-15/block) open stat got: (1) Operation not permitted 2026-02-24T19:16:58.328 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:16:58.325+0000 7f7436f93900 -1 bluestore(/var/lib/ceph/osd/ceph-15) _read_fsid unparsable uuid 2026-02-24T19:16:58.798 DEBUG:teuthology.orchestra.run.trial162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-15 2026-02-24T19:16:58.863 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-24T19:16:58.863 DEBUG:teuthology.orchestra.run.trial026:> set -ex 2026-02-24T19:16:58.864 DEBUG:teuthology.orchestra.run.trial026:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2026-02-24T19:16:58.890 DEBUG:teuthology.orchestra.run.trial026:> set -ex 2026-02-24T19:16:58.890 DEBUG:teuthology.orchestra.run.trial026:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-24T19:16:58.955 DEBUG:teuthology.orchestra.run.trial026:> set -ex 2026-02-24T19:16:58.955 DEBUG:teuthology.orchestra.run.trial026:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-24T19:16:59.019 DEBUG:teuthology.orchestra.run.trial026:> set -ex 2026-02-24T19:16:59.019 DEBUG:teuthology.orchestra.run.trial026:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2026-02-24T19:16:59.083 DEBUG:teuthology.orchestra.run.trial026:> set -ex 2026-02-24T19:16:59.083 DEBUG:teuthology.orchestra.run.trial026:> sudo dd if=/var/lib/ceph/osd/ceph-12/keyring of=/dev/stdout 2026-02-24T19:16:59.148 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-24T19:16:59.148 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-24T19:16:59.175 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-24T19:16:59.175 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-24T19:16:59.239 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-24T19:16:59.240 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2026-02-24T19:16:59.303 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-24T19:16:59.303 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/var/lib/ceph/osd/ceph-13/keyring of=/dev/stdout 2026-02-24T19:16:59.368 DEBUG:teuthology.orchestra.run.trial103:> set -ex 2026-02-24T19:16:59.368 DEBUG:teuthology.orchestra.run.trial103:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-24T19:16:59.393 DEBUG:teuthology.orchestra.run.trial103:> set -ex 2026-02-24T19:16:59.393 DEBUG:teuthology.orchestra.run.trial103:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2026-02-24T19:16:59.457 DEBUG:teuthology.orchestra.run.trial103:> set -ex 2026-02-24T19:16:59.458 DEBUG:teuthology.orchestra.run.trial103:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2026-02-24T19:16:59.521 DEBUG:teuthology.orchestra.run.trial103:> set -ex 2026-02-24T19:16:59.521 DEBUG:teuthology.orchestra.run.trial103:> sudo dd if=/var/lib/ceph/osd/ceph-14/keyring of=/dev/stdout 2026-02-24T19:16:59.584 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-24T19:16:59.585 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-24T19:16:59.611 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-24T19:16:59.611 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-24T19:16:59.675 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-24T19:16:59.675 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2026-02-24T19:16:59.739 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-24T19:16:59.740 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2026-02-24T19:16:59.804 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-24T19:16:59.804 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/var/lib/ceph/osd/ceph-15/keyring of=/dev/stdout 2026-02-24T19:16:59.868 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-24T19:16:59.868 DEBUG:teuthology.orchestra.run.trial162:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-24T19:16:59.924 INFO:tasks.ceph:Adding keys to all mons... 2026-02-24T19:16:59.924 DEBUG:teuthology.orchestra.run.trial026:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-24T19:16:59.927 DEBUG:teuthology.orchestra.run.trial070:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-24T19:16:59.929 DEBUG:teuthology.orchestra.run.trial103:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-24T19:16:59.948 INFO:teuthology.orchestra.run.trial026.stdout:[mgr.y] 2026-02-24T19:16:59.948 INFO:teuthology.orchestra.run.trial026.stdout: key = AQAT+Z1pJ5iYHhAAbG9eSzHQ0gJVR4nR1jEzcw== 2026-02-24T19:16:59.949 INFO:teuthology.orchestra.run.trial026.stdout:[osd.0] 2026-02-24T19:16:59.949 INFO:teuthology.orchestra.run.trial026.stdout: key = AQAX+Z1pNN8HAhAA+VPQ+1XtCkvC52C+9LCIog== 2026-02-24T19:16:59.949 INFO:teuthology.orchestra.run.trial026.stdout:[osd.4] 2026-02-24T19:16:59.949 INFO:teuthology.orchestra.run.trial026.stdout: key = AQAX+Z1p4WWeJhAA6cAwmZhbjl4EffUVRT1oHg== 2026-02-24T19:16:59.949 INFO:teuthology.orchestra.run.trial026.stdout:[osd.8] 2026-02-24T19:16:59.949 INFO:teuthology.orchestra.run.trial026.stdout: key = AQAY+Z1ptPTDDxAAwVdXMfPr/3A35K6w5BIPyA== 2026-02-24T19:16:59.949 INFO:teuthology.orchestra.run.trial026.stdout:[osd.12] 2026-02-24T19:16:59.949 INFO:teuthology.orchestra.run.trial026.stdout: key = AQAY+Z1pPBCQNhAA5qkK4Vfe2CRYH0SMBhLzeg== 2026-02-24T19:16:59.949 INFO:teuthology.orchestra.run.trial026.stdout:[osd.1] 2026-02-24T19:16:59.949 INFO:teuthology.orchestra.run.trial026.stdout: key = AQAc+Z1pDh5dNBAAV55npzOlf4HxfImmvmXRDg== 2026-02-24T19:16:59.949 INFO:teuthology.orchestra.run.trial026.stdout:[osd.5] 2026-02-24T19:16:59.950 INFO:teuthology.orchestra.run.trial026.stdout: key = AQAd+Z1pOThLHRAAa0FQdg06hYkWbpXrtXUfMQ== 2026-02-24T19:16:59.950 INFO:teuthology.orchestra.run.trial026.stdout:[osd.9] 2026-02-24T19:16:59.950 INFO:teuthology.orchestra.run.trial026.stdout: key = AQAe+Z1p+ndKBxAAHxxykudQQk2ZC7Kx9pioag== 2026-02-24T19:16:59.950 INFO:teuthology.orchestra.run.trial026.stdout:[osd.13] 2026-02-24T19:16:59.950 INFO:teuthology.orchestra.run.trial026.stdout: key = AQAe+Z1pyARdLRAAb2tEVU/iH5Kz/KlzXxFeqA== 2026-02-24T19:16:59.950 INFO:teuthology.orchestra.run.trial026.stdout:[osd.2] 2026-02-24T19:16:59.950 INFO:teuthology.orchestra.run.trial026.stdout: key = AQAi+Z1pbEh9JxAA29f67DFHLlaprPyUroOxsQ== 2026-02-24T19:16:59.950 INFO:teuthology.orchestra.run.trial026.stdout:[osd.6] 2026-02-24T19:16:59.950 INFO:teuthology.orchestra.run.trial026.stdout: key = AQAj+Z1pIMHIEBAAaeXYKCPcTibORENFiu81ZA== 2026-02-24T19:16:59.950 INFO:teuthology.orchestra.run.trial026.stdout:[osd.10] 2026-02-24T19:16:59.950 INFO:teuthology.orchestra.run.trial026.stdout: key = AQAj+Z1p6DfINRAAyVkkHuPqO3IwzCCasMnZ7w== 2026-02-24T19:16:59.950 INFO:teuthology.orchestra.run.trial026.stdout:[osd.14] 2026-02-24T19:16:59.951 INFO:teuthology.orchestra.run.trial026.stdout: key = AQAk+Z1pnmYZHxAAaN/jIY+Inx40UAgYAv9skA== 2026-02-24T19:16:59.951 INFO:teuthology.orchestra.run.trial026.stdout:[mgr.x] 2026-02-24T19:16:59.951 INFO:teuthology.orchestra.run.trial026.stdout: key = AQAT+Z1pN01RIRAA4wtdhNoG+lO//nYBqnppJA== 2026-02-24T19:16:59.951 INFO:teuthology.orchestra.run.trial026.stdout:[osd.3] 2026-02-24T19:16:59.951 INFO:teuthology.orchestra.run.trial026.stdout: key = AQAo+Z1pjTfIGRAADlkSnwFb6dLs+G74Y3BWWQ== 2026-02-24T19:16:59.951 INFO:teuthology.orchestra.run.trial026.stdout:[osd.7] 2026-02-24T19:16:59.951 INFO:teuthology.orchestra.run.trial026.stdout: key = AQAp+Z1p/sCzAhAAsC4dE21ZaIMXiSq03JIqbg== 2026-02-24T19:16:59.951 INFO:teuthology.orchestra.run.trial026.stdout:[osd.11] 2026-02-24T19:16:59.951 INFO:teuthology.orchestra.run.trial026.stdout: key = AQAp+Z1pPBOVKBAAiNAw2ppWDqgCE1JdDOJZDQ== 2026-02-24T19:16:59.951 INFO:teuthology.orchestra.run.trial026.stdout:[osd.15] 2026-02-24T19:16:59.951 INFO:teuthology.orchestra.run.trial026.stdout: key = AQAq+Z1puyN4ExAAN0Ra7zfLDzxkuRzP3NV9yA== 2026-02-24T19:16:59.952 INFO:teuthology.orchestra.run.trial026.stdout:[client.0] 2026-02-24T19:16:59.952 INFO:teuthology.orchestra.run.trial026.stdout: key = AQAT+Z1p961xIxAAD0VNb/KUzpYDnzLNc1FSJw== 2026-02-24T19:16:59.953 INFO:teuthology.orchestra.run.trial070.stdout:[mgr.y] 2026-02-24T19:16:59.954 INFO:teuthology.orchestra.run.trial070.stdout: key = AQAT+Z1pJ5iYHhAAbG9eSzHQ0gJVR4nR1jEzcw== 2026-02-24T19:16:59.954 INFO:teuthology.orchestra.run.trial070.stdout:[osd.0] 2026-02-24T19:16:59.954 INFO:teuthology.orchestra.run.trial070.stdout: key = AQAX+Z1pNN8HAhAA+VPQ+1XtCkvC52C+9LCIog== 2026-02-24T19:16:59.954 INFO:teuthology.orchestra.run.trial070.stdout:[osd.4] 2026-02-24T19:16:59.954 INFO:teuthology.orchestra.run.trial070.stdout: key = AQAX+Z1p4WWeJhAA6cAwmZhbjl4EffUVRT1oHg== 2026-02-24T19:16:59.954 INFO:teuthology.orchestra.run.trial070.stdout:[osd.8] 2026-02-24T19:16:59.954 INFO:teuthology.orchestra.run.trial070.stdout: key = AQAY+Z1ptPTDDxAAwVdXMfPr/3A35K6w5BIPyA== 2026-02-24T19:16:59.954 INFO:teuthology.orchestra.run.trial070.stdout:[osd.12] 2026-02-24T19:16:59.954 INFO:teuthology.orchestra.run.trial070.stdout: key = AQAY+Z1pPBCQNhAA5qkK4Vfe2CRYH0SMBhLzeg== 2026-02-24T19:16:59.954 INFO:teuthology.orchestra.run.trial070.stdout:[osd.1] 2026-02-24T19:16:59.955 INFO:teuthology.orchestra.run.trial070.stdout: key = AQAc+Z1pDh5dNBAAV55npzOlf4HxfImmvmXRDg== 2026-02-24T19:16:59.955 INFO:teuthology.orchestra.run.trial070.stdout:[osd.5] 2026-02-24T19:16:59.955 INFO:teuthology.orchestra.run.trial070.stdout: key = AQAd+Z1pOThLHRAAa0FQdg06hYkWbpXrtXUfMQ== 2026-02-24T19:16:59.955 INFO:teuthology.orchestra.run.trial070.stdout:[osd.9] 2026-02-24T19:16:59.955 INFO:teuthology.orchestra.run.trial070.stdout: key = AQAe+Z1p+ndKBxAAHxxykudQQk2ZC7Kx9pioag== 2026-02-24T19:16:59.955 INFO:teuthology.orchestra.run.trial070.stdout:[osd.13] 2026-02-24T19:16:59.955 INFO:teuthology.orchestra.run.trial070.stdout: key = AQAe+Z1pyARdLRAAb2tEVU/iH5Kz/KlzXxFeqA== 2026-02-24T19:16:59.955 INFO:teuthology.orchestra.run.trial070.stdout:[osd.2] 2026-02-24T19:16:59.955 INFO:teuthology.orchestra.run.trial070.stdout: key = AQAi+Z1pbEh9JxAA29f67DFHLlaprPyUroOxsQ== 2026-02-24T19:16:59.955 INFO:teuthology.orchestra.run.trial070.stdout:[osd.6] 2026-02-24T19:16:59.955 INFO:teuthology.orchestra.run.trial070.stdout: key = AQAj+Z1pIMHIEBAAaeXYKCPcTibORENFiu81ZA== 2026-02-24T19:16:59.955 INFO:teuthology.orchestra.run.trial070.stdout:[osd.10] 2026-02-24T19:16:59.956 INFO:teuthology.orchestra.run.trial070.stdout: key = AQAj+Z1p6DfINRAAyVkkHuPqO3IwzCCasMnZ7w== 2026-02-24T19:16:59.956 INFO:teuthology.orchestra.run.trial070.stdout:[osd.14] 2026-02-24T19:16:59.956 INFO:teuthology.orchestra.run.trial070.stdout: key = AQAk+Z1pnmYZHxAAaN/jIY+Inx40UAgYAv9skA== 2026-02-24T19:16:59.956 INFO:teuthology.orchestra.run.trial070.stdout:[mgr.x] 2026-02-24T19:16:59.956 INFO:teuthology.orchestra.run.trial070.stdout: key = AQAT+Z1pN01RIRAA4wtdhNoG+lO//nYBqnppJA== 2026-02-24T19:16:59.956 INFO:teuthology.orchestra.run.trial070.stdout:[osd.3] 2026-02-24T19:16:59.956 INFO:teuthology.orchestra.run.trial070.stdout: key = AQAo+Z1pjTfIGRAADlkSnwFb6dLs+G74Y3BWWQ== 2026-02-24T19:16:59.956 INFO:teuthology.orchestra.run.trial070.stdout:[osd.7] 2026-02-24T19:16:59.956 INFO:teuthology.orchestra.run.trial070.stdout: key = AQAp+Z1p/sCzAhAAsC4dE21ZaIMXiSq03JIqbg== 2026-02-24T19:16:59.956 INFO:teuthology.orchestra.run.trial070.stdout:[osd.11] 2026-02-24T19:16:59.956 INFO:teuthology.orchestra.run.trial070.stdout: key = AQAp+Z1pPBOVKBAAiNAw2ppWDqgCE1JdDOJZDQ== 2026-02-24T19:16:59.956 INFO:teuthology.orchestra.run.trial070.stdout:[osd.15] 2026-02-24T19:16:59.957 INFO:teuthology.orchestra.run.trial070.stdout: key = AQAq+Z1puyN4ExAAN0Ra7zfLDzxkuRzP3NV9yA== 2026-02-24T19:16:59.957 INFO:teuthology.orchestra.run.trial070.stdout:[client.0] 2026-02-24T19:16:59.957 INFO:teuthology.orchestra.run.trial070.stdout: key = AQAT+Z1p961xIxAAD0VNb/KUzpYDnzLNc1FSJw== 2026-02-24T19:16:59.958 INFO:teuthology.orchestra.run.trial103.stdout:[mgr.y] 2026-02-24T19:16:59.958 INFO:teuthology.orchestra.run.trial103.stdout: key = AQAT+Z1pJ5iYHhAAbG9eSzHQ0gJVR4nR1jEzcw== 2026-02-24T19:16:59.958 INFO:teuthology.orchestra.run.trial103.stdout:[osd.0] 2026-02-24T19:16:59.958 INFO:teuthology.orchestra.run.trial103.stdout: key = AQAX+Z1pNN8HAhAA+VPQ+1XtCkvC52C+9LCIog== 2026-02-24T19:16:59.958 INFO:teuthology.orchestra.run.trial103.stdout:[osd.4] 2026-02-24T19:16:59.958 INFO:teuthology.orchestra.run.trial103.stdout: key = AQAX+Z1p4WWeJhAA6cAwmZhbjl4EffUVRT1oHg== 2026-02-24T19:16:59.958 INFO:teuthology.orchestra.run.trial103.stdout:[osd.8] 2026-02-24T19:16:59.959 INFO:teuthology.orchestra.run.trial103.stdout: key = AQAY+Z1ptPTDDxAAwVdXMfPr/3A35K6w5BIPyA== 2026-02-24T19:16:59.959 INFO:teuthology.orchestra.run.trial103.stdout:[osd.12] 2026-02-24T19:16:59.959 INFO:teuthology.orchestra.run.trial103.stdout: key = AQAY+Z1pPBCQNhAA5qkK4Vfe2CRYH0SMBhLzeg== 2026-02-24T19:16:59.959 INFO:teuthology.orchestra.run.trial103.stdout:[osd.1] 2026-02-24T19:16:59.959 INFO:teuthology.orchestra.run.trial103.stdout: key = AQAc+Z1pDh5dNBAAV55npzOlf4HxfImmvmXRDg== 2026-02-24T19:16:59.959 INFO:teuthology.orchestra.run.trial103.stdout:[osd.5] 2026-02-24T19:16:59.959 INFO:teuthology.orchestra.run.trial103.stdout: key = AQAd+Z1pOThLHRAAa0FQdg06hYkWbpXrtXUfMQ== 2026-02-24T19:16:59.959 INFO:teuthology.orchestra.run.trial103.stdout:[osd.9] 2026-02-24T19:16:59.959 INFO:teuthology.orchestra.run.trial103.stdout: key = AQAe+Z1p+ndKBxAAHxxykudQQk2ZC7Kx9pioag== 2026-02-24T19:16:59.959 INFO:teuthology.orchestra.run.trial103.stdout:[osd.13] 2026-02-24T19:16:59.959 INFO:teuthology.orchestra.run.trial103.stdout: key = AQAe+Z1pyARdLRAAb2tEVU/iH5Kz/KlzXxFeqA== 2026-02-24T19:16:59.959 INFO:teuthology.orchestra.run.trial103.stdout:[osd.2] 2026-02-24T19:16:59.959 INFO:teuthology.orchestra.run.trial103.stdout: key = AQAi+Z1pbEh9JxAA29f67DFHLlaprPyUroOxsQ== 2026-02-24T19:16:59.960 INFO:teuthology.orchestra.run.trial103.stdout:[osd.6] 2026-02-24T19:16:59.960 INFO:teuthology.orchestra.run.trial103.stdout: key = AQAj+Z1pIMHIEBAAaeXYKCPcTibORENFiu81ZA== 2026-02-24T19:16:59.960 INFO:teuthology.orchestra.run.trial103.stdout:[osd.10] 2026-02-24T19:16:59.960 INFO:teuthology.orchestra.run.trial103.stdout: key = AQAj+Z1p6DfINRAAyVkkHuPqO3IwzCCasMnZ7w== 2026-02-24T19:16:59.960 INFO:teuthology.orchestra.run.trial103.stdout:[osd.14] 2026-02-24T19:16:59.960 INFO:teuthology.orchestra.run.trial103.stdout: key = AQAk+Z1pnmYZHxAAaN/jIY+Inx40UAgYAv9skA== 2026-02-24T19:16:59.960 INFO:teuthology.orchestra.run.trial103.stdout:[mgr.x] 2026-02-24T19:16:59.960 INFO:teuthology.orchestra.run.trial103.stdout: key = AQAT+Z1pN01RIRAA4wtdhNoG+lO//nYBqnppJA== 2026-02-24T19:16:59.960 INFO:teuthology.orchestra.run.trial103.stdout:[osd.3] 2026-02-24T19:16:59.960 INFO:teuthology.orchestra.run.trial103.stdout: key = AQAo+Z1pjTfIGRAADlkSnwFb6dLs+G74Y3BWWQ== 2026-02-24T19:16:59.960 INFO:teuthology.orchestra.run.trial103.stdout:[osd.7] 2026-02-24T19:16:59.960 INFO:teuthology.orchestra.run.trial103.stdout: key = AQAp+Z1p/sCzAhAAsC4dE21ZaIMXiSq03JIqbg== 2026-02-24T19:16:59.960 INFO:teuthology.orchestra.run.trial103.stdout:[osd.11] 2026-02-24T19:16:59.961 INFO:teuthology.orchestra.run.trial103.stdout: key = AQAp+Z1pPBOVKBAAiNAw2ppWDqgCE1JdDOJZDQ== 2026-02-24T19:16:59.961 INFO:teuthology.orchestra.run.trial103.stdout:[osd.15] 2026-02-24T19:16:59.961 INFO:teuthology.orchestra.run.trial103.stdout: key = AQAq+Z1puyN4ExAAN0Ra7zfLDzxkuRzP3NV9yA== 2026-02-24T19:16:59.961 INFO:teuthology.orchestra.run.trial103.stdout:[client.0] 2026-02-24T19:16:59.961 INFO:teuthology.orchestra.run.trial103.stdout: key = AQAT+Z1p961xIxAAD0VNb/KUzpYDnzLNc1FSJw== 2026-02-24T19:16:59.961 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-24T19:16:59.996 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-24T19:16:59.998 DEBUG:teuthology.orchestra.run.trial103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-24T19:17:00.039 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.075 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.078 DEBUG:teuthology.orchestra.run.trial103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.118 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.156 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.160 DEBUG:teuthology.orchestra.run.trial103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.200 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.236 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.240 DEBUG:teuthology.orchestra.run.trial103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.281 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.317 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.322 DEBUG:teuthology.orchestra.run.trial103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.361 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.397 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.402 DEBUG:teuthology.orchestra.run.trial103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.442 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.476 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.482 DEBUG:teuthology.orchestra.run.trial103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.522 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.555 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.562 DEBUG:teuthology.orchestra.run.trial103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.602 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.634 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.642 DEBUG:teuthology.orchestra.run.trial103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.683 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.713 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.721 DEBUG:teuthology.orchestra.run.trial103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.762 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.793 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.800 DEBUG:teuthology.orchestra.run.trial103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.841 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.873 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.879 DEBUG:teuthology.orchestra.run.trial103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.921 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.952 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:00.960 DEBUG:teuthology.orchestra.run.trial103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:01.000 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-24T19:17:01.033 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-24T19:17:01.040 DEBUG:teuthology.orchestra.run.trial103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-24T19:17:01.081 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:01.111 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:01.119 DEBUG:teuthology.orchestra.run.trial103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:01.161 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:01.190 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:01.199 DEBUG:teuthology.orchestra.run.trial103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:01.242 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:01.269 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:01.278 DEBUG:teuthology.orchestra.run.trial103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:01.322 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:01.348 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:01.358 DEBUG:teuthology.orchestra.run.trial103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-24T19:17:01.403 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-24T19:17:01.427 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-24T19:17:01.438 DEBUG:teuthology.orchestra.run.trial103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-24T19:17:01.483 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-24T19:17:01.484 DEBUG:teuthology.orchestra.run.trial026:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-24T19:17:01.530 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-24T19:17:01.618 DEBUG:teuthology.orchestra.run.trial026:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-24T19:17:01.642 DEBUG:teuthology.orchestra.run.trial070:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-24T19:17:01.668 DEBUG:teuthology.orchestra.run.trial070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-24T19:17:01.754 DEBUG:teuthology.orchestra.run.trial070:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-24T19:17:01.779 DEBUG:teuthology.orchestra.run.trial103:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-24T19:17:01.805 DEBUG:teuthology.orchestra.run.trial103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-24T19:17:01.892 DEBUG:teuthology.orchestra.run.trial103:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-24T19:17:01.916 DEBUG:teuthology.orchestra.run.trial026:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:17:01.919 DEBUG:teuthology.orchestra.run.trial070:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:17:01.922 DEBUG:teuthology.orchestra.run.trial103:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-24T19:17:01.972 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-24T19:17:01.973 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-24T19:17:01.973 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-24T19:17:01.974 DEBUG:teuthology.orchestra.run.trial026:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2026-02-24T19:17:01.976 INFO:tasks.ceph.mon.a:Started 2026-02-24T19:17:01.976 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-24T19:17:01.977 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-24T19:17:01.977 DEBUG:teuthology.orchestra.run.trial070:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2026-02-24T19:17:01.979 INFO:tasks.ceph.mon.b:Started 2026-02-24T19:17:01.979 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-24T19:17:01.980 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-24T19:17:01.980 DEBUG:teuthology.orchestra.run.trial103:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2026-02-24T19:17:02.015 INFO:tasks.ceph.mon.c:Started 2026-02-24T19:17:02.015 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-24T19:17:02.015 INFO:tasks.ceph.mgr.y:Restarting daemon 2026-02-24T19:17:02.015 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2026-02-24T19:17:02.018 INFO:tasks.ceph.mgr.y:Started 2026-02-24T19:17:02.018 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-24T19:17:02.018 DEBUG:teuthology.orchestra.run.trial162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2026-02-24T19:17:02.021 INFO:tasks.ceph.mgr.x:Started 2026-02-24T19:17:02.021 DEBUG:tasks.ceph:set 0 configs 2026-02-24T19:17:02.021 DEBUG:teuthology.orchestra.run.trial026:> sudo ceph --cluster ceph config dump 2026-02-24T19:17:02.085 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:02.083+0000 7fb548bd9640 10 monclient: get_monmap_and_config 2026-02-24T19:17:02.085 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:02.083+0000 7fb548bd9640 10 monclient: build_initial_monmap 2026-02-24T19:17:02.086 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:02.083+0000 7fb548bd9640 10 monclient: monmap: 2026-02-24T19:17:02.086 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:17:02.086 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:02.086 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:17:02.085350+0000 2026-02-24T19:17:02.086 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:17:02.085350+0000 2026-02-24T19:17:02.086 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:02.086 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:17:02.086 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:02.086 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:02.086 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:02.086 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:17:02.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:02.083+0000 7fb548bd9640 1 Processor -- start 2026-02-24T19:17:02.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:02.084+0000 7fb548bd9640 1 -- start start 2026-02-24T19:17:02.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:02.084+0000 7fb548bd9640 10 monclient: init 2026-02-24T19:17:02.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:02.084+0000 7fb548bd9640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:02.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:02.084+0000 7fb548bd9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:02.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:02.084+0000 7fb548bd9640 10 monclient(hunting): picked mon.noname-a con 0x7fb544058da0 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:02.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:02.084+0000 7fb548bd9640 10 monclient(hunting): picked mon.noname-c con 0x7fb5440b0410 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:02.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:02.084+0000 7fb548bd9640 10 monclient(hunting): picked mon.noname-b con 0x7fb5441626a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:02.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:02.084+0000 7fb548bd9640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5441655c0 con 0x7fb544058da0 2026-02-24T19:17:02.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:02.084+0000 7fb548bd9640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5440b12b0 con 0x7fb5441626a0 2026-02-24T19:17:02.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:02.084+0000 7fb548bd9640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5440b1590 con 0x7fb5440b0410 2026-02-24T19:17:02.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:02.084+0000 7fb548bd9640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:02.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:02.084+0000 7fb548bd9640 10 monclient(hunting): authenticate will time out at 3604.767523s 2026-02-24T19:17:02.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:02.084+0000 7fb542575640 1 -- >> v1:10.20.193.26:6789/0 conn(0x7fb544058da0 legacy=0x7fb5441647a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.26:6789/0 2026-02-24T19:17:02.096 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:02.094+0000 7fb541d74640 1 -- >> v1:10.20.193.103:6789/0 conn(0x7fb5440b0410 legacy=0x7fb544164eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.103:6789/0 2026-02-24T19:17:02.096 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:02.094+0000 7fb542d76640 1 -- >> v1:10.20.193.70:6789/0 conn(0x7fb5441626a0 legacy=0x7fb5441c6d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.70:6789/0 2026-02-24T19:17:02.287 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:02.285+0000 7fb542575640 1 -- >> v1:10.20.193.26:6789/0 conn(0x7fb544058da0 legacy=0x7fb5441647a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.26:6789/0 2026-02-24T19:17:02.297 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:02.295+0000 7fb542d76640 1 -- >> v1:10.20.193.70:6789/0 conn(0x7fb5441626a0 legacy=0x7fb5441c6d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.70:6789/0 2026-02-24T19:17:02.297 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:02.295+0000 7fb541d74640 1 -- >> v1:10.20.193.103:6789/0 conn(0x7fb5440b0410 legacy=0x7fb544164eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.103:6789/0 2026-02-24T19:17:02.688 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:02.686+0000 7fb542575640 1 -- >> v1:10.20.193.26:6789/0 conn(0x7fb544058da0 legacy=0x7fb5441647a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.26:6789/0 2026-02-24T19:17:02.698 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:02.696+0000 7fb542d76640 1 -- >> v1:10.20.193.70:6789/0 conn(0x7fb5441626a0 legacy=0x7fb5441c6d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.70:6789/0 2026-02-24T19:17:02.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:02.696+0000 7fb541d74640 1 -- >> v1:10.20.193.103:6789/0 conn(0x7fb5440b0410 legacy=0x7fb544164eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.103:6789/0 2026-02-24T19:17:03.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:03.487+0000 7fb542575640 1 -- >> v1:10.20.193.26:6789/0 conn(0x7fb544058da0 legacy=0x7fb5441647a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.26:6789/0 2026-02-24T19:17:03.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:03.497+0000 7fb541d74640 1 -- >> v1:10.20.193.103:6789/0 conn(0x7fb5440b0410 legacy=0x7fb544164eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.103:6789/0 2026-02-24T19:17:03.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:03.497+0000 7fb542d76640 1 -- >> v1:10.20.193.70:6789/0 conn(0x7fb5441626a0 legacy=0x7fb5441c6d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.70:6789/0 2026-02-24T19:17:04.052 INFO:tasks.ceph.mon.b.trial070.stderr:--00:00:00:02.023 44262-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/1e/3d21c9a1f16a7f75d984e00627141ae686aefc.debug 2026-02-24T19:17:04.056 INFO:tasks.ceph.mon.a.trial026.stderr:--00:00:00:02.030 44480-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/1e/3d21c9a1f16a7f75d984e00627141ae686aefc.debug 2026-02-24T19:17:04.111 INFO:tasks.ceph.mon.c.trial103.stderr:--00:00:00:02.047 44374-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/1e/3d21c9a1f16a7f75d984e00627141ae686aefc.debug 2026-02-24T19:17:05.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:05.084+0000 7fb52bfff640 10 monclient(hunting): tick 2026-02-24T19:17:05.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:05.084+0000 7fb52bfff640 10 monclient(hunting): _check_auth_tickets 2026-02-24T19:17:05.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:05.084+0000 7fb52bfff640 1 monclient(hunting): continuing hunt 2026-02-24T19:17:05.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:05.084+0000 7fb52bfff640 10 monclient(hunting): _reopen_session rank -1 2026-02-24T19:17:05.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:05.084+0000 7fb52bfff640 1 -- >> v1:10.20.193.103:6789/0 conn(0x7fb5440b0410 legacy=0x7fb544164eb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:17:05.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:05.084+0000 7fb52bfff640 1 -- >> v1:10.20.193.70:6789/0 conn(0x7fb5441626a0 legacy=0x7fb5441c6d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:17:05.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:05.084+0000 7fb52bfff640 1 -- >> v1:10.20.193.26:6789/0 conn(0x7fb544058da0 legacy=0x7fb5441647a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:17:05.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:05.084+0000 7fb52bfff640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:05.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:05.084+0000 7fb52bfff640 10 monclient(hunting): picked mon.noname-b con 0x7fb5441626a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:05.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:05.084+0000 7fb52bfff640 10 monclient(hunting): picked mon.noname-c con 0x7fb5440b0410 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:05.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:05.084+0000 7fb52bfff640 10 monclient(hunting): picked mon.noname-a con 0x7fb544058da0 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:05.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:05.084+0000 7fb52bfff640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5440b1870 con 0x7fb544058da0 2026-02-24T19:17:05.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:05.084+0000 7fb52bfff640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5441655c0 con 0x7fb5441626a0 2026-02-24T19:17:05.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:05.084+0000 7fb542d76640 1 -- >> v1:10.20.193.26:6789/0 conn(0x7fb544058da0 legacy=0x7fb520066880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.26:6789/0 2026-02-24T19:17:05.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:05.084+0000 7fb52bfff640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5440b12b0 con 0x7fb5440b0410 2026-02-24T19:17:05.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:05.084+0000 7fb52bfff640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:05.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:05.084+0000 7fb542575640 1 -- >> v1:10.20.193.70:6789/0 conn(0x7fb5441626a0 legacy=0x7fb5200237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.70:6789/0 2026-02-24T19:17:05.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:05.084+0000 7fb541d74640 1 -- >> v1:10.20.193.103:6789/0 conn(0x7fb5440b0410 legacy=0x7fb520044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.103:6789/0 2026-02-24T19:17:05.288 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:05.285+0000 7fb542d76640 1 -- >> v1:10.20.193.26:6789/0 conn(0x7fb544058da0 legacy=0x7fb520066880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.26:6789/0 2026-02-24T19:17:05.288 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:05.285+0000 7fb541d74640 1 -- >> v1:10.20.193.103:6789/0 conn(0x7fb5440b0410 legacy=0x7fb520044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.103:6789/0 2026-02-24T19:17:05.288 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:05.286+0000 7fb542575640 1 -- >> v1:10.20.193.70:6789/0 conn(0x7fb5441626a0 legacy=0x7fb5200237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.70:6789/0 2026-02-24T19:17:05.688 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:05.686+0000 7fb542d76640 1 -- >> v1:10.20.193.26:6789/0 conn(0x7fb544058da0 legacy=0x7fb520066880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.26:6789/0 2026-02-24T19:17:05.688 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:05.686+0000 7fb541d74640 1 -- >> v1:10.20.193.103:6789/0 conn(0x7fb5440b0410 legacy=0x7fb520044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.103:6789/0 2026-02-24T19:17:05.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:05.687+0000 7fb542575640 1 -- >> v1:10.20.193.70:6789/0 conn(0x7fb5441626a0 legacy=0x7fb5200237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.70:6789/0 2026-02-24T19:17:06.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:06.487+0000 7fb542d76640 1 -- >> v1:10.20.193.26:6789/0 conn(0x7fb544058da0 legacy=0x7fb520066880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.26:6789/0 2026-02-24T19:17:06.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:06.487+0000 7fb541d74640 1 -- >> v1:10.20.193.103:6789/0 conn(0x7fb5440b0410 legacy=0x7fb520044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.103:6789/0 2026-02-24T19:17:06.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:06.488+0000 7fb542575640 1 -- >> v1:10.20.193.70:6789/0 conn(0x7fb5441626a0 legacy=0x7fb5200237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.70:6789/0 2026-02-24T19:17:08.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:08.085+0000 7fb52bfff640 10 monclient(hunting): tick 2026-02-24T19:17:08.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:08.085+0000 7fb52bfff640 10 monclient(hunting): _check_auth_tickets 2026-02-24T19:17:08.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:08.085+0000 7fb52bfff640 1 monclient(hunting): continuing hunt 2026-02-24T19:17:08.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:08.085+0000 7fb52bfff640 10 monclient(hunting): _reopen_session rank -1 2026-02-24T19:17:08.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:08.085+0000 7fb52bfff640 1 -- >> v1:10.20.193.103:6789/0 conn(0x7fb5440b0410 legacy=0x7fb520044f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:17:08.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:08.085+0000 7fb52bfff640 1 -- >> v1:10.20.193.70:6789/0 conn(0x7fb5441626a0 legacy=0x7fb5200237c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:17:08.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:08.085+0000 7fb52bfff640 1 -- >> v1:10.20.193.26:6789/0 conn(0x7fb544058da0 legacy=0x7fb520066880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:17:08.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:08.085+0000 7fb52bfff640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:08.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:08.085+0000 7fb52bfff640 10 monclient(hunting): picked mon.noname-c con 0x7fb5440b0410 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:08.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:08.085+0000 7fb52bfff640 10 monclient(hunting): picked mon.noname-b con 0x7fb5441626a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:08.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:08.085+0000 7fb52bfff640 10 monclient(hunting): picked mon.noname-a con 0x7fb544058da0 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:08.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:08.085+0000 7fb52bfff640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5440b1590 con 0x7fb544058da0 2026-02-24T19:17:08.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:08.085+0000 7fb52bfff640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5440b1870 con 0x7fb5441626a0 2026-02-24T19:17:08.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:08.085+0000 7fb52bfff640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5441655c0 con 0x7fb5440b0410 2026-02-24T19:17:08.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:08.085+0000 7fb52bfff640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:08.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:08.085+0000 7fb542d76640 1 -- >> v1:10.20.193.26:6789/0 conn(0x7fb544058da0 legacy=0x7fb520066880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.26:6789/0 2026-02-24T19:17:08.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:08.085+0000 7fb542575640 1 -- >> v1:10.20.193.103:6789/0 conn(0x7fb5440b0410 legacy=0x7fb520044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.103:6789/0 2026-02-24T19:17:08.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:08.085+0000 7fb541d74640 1 -- >> v1:10.20.193.70:6789/0 conn(0x7fb5441626a0 legacy=0x7fb520023720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.70:6789/0 2026-02-24T19:17:08.287 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:08.286+0000 7fb542d76640 1 -- >> v1:10.20.193.26:6789/0 conn(0x7fb544058da0 legacy=0x7fb520066880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.26:6789/0 2026-02-24T19:17:08.287 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:08.286+0000 7fb542575640 1 -- >> v1:10.20.193.103:6789/0 conn(0x7fb5440b0410 legacy=0x7fb520044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.103:6789/0 2026-02-24T19:17:08.287 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:08.286+0000 7fb541d74640 1 -- >> v1:10.20.193.70:6789/0 conn(0x7fb5441626a0 legacy=0x7fb520023720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.70:6789/0 2026-02-24T19:17:08.299 INFO:tasks.ceph.mon.b.trial070.stderr:--00:00:00:06.270 44262-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/b7/b7bf14e7464905da65890c8b4fe846bf738441.debug 2026-02-24T19:17:08.310 INFO:tasks.ceph.mon.a.trial026.stderr:--00:00:00:06.285 44480-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/b7/b7bf14e7464905da65890c8b4fe846bf738441.debug 2026-02-24T19:17:08.388 INFO:tasks.ceph.mon.c.trial103.stderr:--00:00:00:06.325 44374-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/b7/b7bf14e7464905da65890c8b4fe846bf738441.debug 2026-02-24T19:17:08.688 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:08.687+0000 7fb542d76640 1 -- >> v1:10.20.193.26:6789/0 conn(0x7fb544058da0 legacy=0x7fb520066880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.26:6789/0 2026-02-24T19:17:08.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:08.687+0000 7fb542575640 1 -- >> v1:10.20.193.103:6789/0 conn(0x7fb5440b0410 legacy=0x7fb520044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.103:6789/0 2026-02-24T19:17:08.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:08.687+0000 7fb541d74640 1 -- >> v1:10.20.193.70:6789/0 conn(0x7fb5441626a0 legacy=0x7fb520023720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.70:6789/0 2026-02-24T19:17:09.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:09.488+0000 7fb542d76640 1 -- >> v1:10.20.193.26:6789/0 conn(0x7fb544058da0 legacy=0x7fb520066880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.26:6789/0 2026-02-24T19:17:09.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:09.488+0000 7fb542575640 1 -- >> v1:10.20.193.103:6789/0 conn(0x7fb5440b0410 legacy=0x7fb520044f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.103:6789/0 2026-02-24T19:17:09.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:09.488+0000 7fb541d74640 1 -- >> v1:10.20.193.70:6789/0 conn(0x7fb5441626a0 legacy=0x7fb520023720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.70:6789/0 2026-02-24T19:17:09.805 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:00:07.776 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:09.810 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:00:07.784 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:09.896 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:00:07.833 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:09.953 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:00:07.925 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:09.959 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:00:07.934 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:10.046 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:00:07.983 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:17:11.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:11.085+0000 7fb52bfff640 10 monclient(hunting): tick 2026-02-24T19:17:11.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:11.085+0000 7fb52bfff640 10 monclient(hunting): _check_auth_tickets 2026-02-24T19:17:11.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:11.085+0000 7fb52bfff640 1 monclient(hunting): continuing hunt 2026-02-24T19:17:11.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:11.085+0000 7fb52bfff640 10 monclient(hunting): _reopen_session rank -1 2026-02-24T19:17:11.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:11.085+0000 7fb52bfff640 1 -- >> v1:10.20.193.103:6789/0 conn(0x7fb5440b0410 legacy=0x7fb520044f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:17:11.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:11.085+0000 7fb52bfff640 1 -- >> v1:10.20.193.70:6789/0 conn(0x7fb5441626a0 legacy=0x7fb520023720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:17:11.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:11.085+0000 7fb52bfff640 1 -- >> v1:10.20.193.26:6789/0 conn(0x7fb544058da0 legacy=0x7fb520066880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-24T19:17:11.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:11.085+0000 7fb52bfff640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:11.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:11.085+0000 7fb52bfff640 10 monclient(hunting): picked mon.noname-b con 0x7fb5441626a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:11.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:11.085+0000 7fb52bfff640 10 monclient(hunting): picked mon.noname-c con 0x7fb5440b0410 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:11.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:11.085+0000 7fb52bfff640 10 monclient(hunting): picked mon.noname-a con 0x7fb544058da0 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:11.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:11.085+0000 7fb52bfff640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5440b12b0 con 0x7fb544058da0 2026-02-24T19:17:11.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:11.085+0000 7fb52bfff640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5440b1590 con 0x7fb5441626a0 2026-02-24T19:17:11.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:11.085+0000 7fb52bfff640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5440b1870 con 0x7fb5440b0410 2026-02-24T19:17:11.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:11.085+0000 7fb52bfff640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:11.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:11.086+0000 7fb542d76640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fb544058da0 0x7fb520066800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:36840/0 (socket says 10.20.193.26:36840) 2026-02-24T19:17:11.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:11.086+0000 7fb542d76640 1 -- 10.20.193.26:0/4184804894 learned_addr learned my addr 10.20.193.26:0/4184804894 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:17:14.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:14.085+0000 7fb52bfff640 10 monclient(hunting): tick 2026-02-24T19:17:14.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:14.085+0000 7fb52bfff640 10 monclient(hunting): _check_auth_tickets 2026-02-24T19:17:14.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:14.085+0000 7fb52bfff640 1 monclient(hunting): continuing hunt 2026-02-24T19:17:14.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:14.085+0000 7fb52bfff640 10 monclient(hunting): _reopen_session rank -1 2026-02-24T19:17:14.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:14.085+0000 7fb52bfff640 1 -- 10.20.193.26:0/4184804894 >> v1:10.20.193.103:6789/0 conn(0x7fb5440b0410 legacy=0x7fb520044f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:14.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:14.086+0000 7fb52bfff640 1 -- 10.20.193.26:0/4184804894 >> v1:10.20.193.70:6789/0 conn(0x7fb5441626a0 legacy=0x7fb520023720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:14.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:14.086+0000 7fb52bfff640 1 -- 10.20.193.26:0/4184804894 >> v1:10.20.193.26:6789/0 conn(0x7fb544058da0 legacy=0x7fb520066800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:14.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:14.086+0000 7fb52bfff640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:14.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:14.086+0000 7fb52bfff640 10 monclient(hunting): picked mon.noname-a con 0x7fb544058da0 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:14.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:14.086+0000 7fb52bfff640 10 monclient(hunting): picked mon.noname-c con 0x7fb5440b0410 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:14.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:14.086+0000 7fb52bfff640 10 monclient(hunting): picked mon.noname-b con 0x7fb5441626a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:14.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:14.086+0000 7fb52bfff640 1 -- 10.20.193.26:0/4184804894 --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5441655c0 con 0x7fb544058da0 2026-02-24T19:17:14.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:14.086+0000 7fb52bfff640 1 -- 10.20.193.26:0/4184804894 --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb520067190 con 0x7fb5441626a0 2026-02-24T19:17:14.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:14.086+0000 7fb52bfff640 1 -- 10.20.193.26:0/4184804894 --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb520067420 con 0x7fb5440b0410 2026-02-24T19:17:14.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:14.086+0000 7fb52bfff640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:17.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:17.086+0000 7fb52bfff640 10 monclient(hunting): tick 2026-02-24T19:17:17.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:17.086+0000 7fb52bfff640 10 monclient(hunting): _check_auth_tickets 2026-02-24T19:17:17.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:17.086+0000 7fb52bfff640 1 monclient(hunting): continuing hunt 2026-02-24T19:17:17.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:17.086+0000 7fb52bfff640 10 monclient(hunting): _reopen_session rank -1 2026-02-24T19:17:17.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:17.086+0000 7fb52bfff640 1 -- 10.20.193.26:0/4184804894 >> v1:10.20.193.103:6789/0 conn(0x7fb5440b0410 legacy=0x7fb520044f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:17.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:17.086+0000 7fb52bfff640 1 -- 10.20.193.26:0/4184804894 >> v1:10.20.193.70:6789/0 conn(0x7fb5441626a0 legacy=0x7fb520023720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:17.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:17.086+0000 7fb52bfff640 1 -- 10.20.193.26:0/4184804894 >> v1:10.20.193.26:6789/0 conn(0x7fb544058da0 legacy=0x7fb520066800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:17.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:17.086+0000 7fb52bfff640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:17.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:17.086+0000 7fb52bfff640 10 monclient(hunting): picked mon.noname-a con 0x7fb5200678e0 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:17.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:17.086+0000 7fb52bfff640 10 monclient(hunting): picked mon.noname-c con 0x7fb5440b0410 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:17.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:17.086+0000 7fb52bfff640 10 monclient(hunting): picked mon.noname-b con 0x7fb5441626a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:17.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:17.086+0000 7fb52bfff640 1 -- 10.20.193.26:0/4184804894 --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5200676b0 con 0x7fb5200678e0 2026-02-24T19:17:17.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:17.086+0000 7fb52bfff640 1 -- 10.20.193.26:0/4184804894 --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb520067de0 con 0x7fb5441626a0 2026-02-24T19:17:17.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:17.086+0000 7fb52bfff640 1 -- 10.20.193.26:0/4184804894 --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb52006a820 con 0x7fb5440b0410 2026-02-24T19:17:17.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:17.086+0000 7fb52bfff640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:20.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:20.086+0000 7fb52bfff640 10 monclient(hunting): tick 2026-02-24T19:17:20.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:20.086+0000 7fb52bfff640 10 monclient(hunting): _check_auth_tickets 2026-02-24T19:17:20.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:20.086+0000 7fb52bfff640 1 monclient(hunting): continuing hunt 2026-02-24T19:17:20.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:20.086+0000 7fb52bfff640 10 monclient(hunting): _reopen_session rank -1 2026-02-24T19:17:20.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:20.086+0000 7fb52bfff640 1 -- 10.20.193.26:0/4184804894 >> v1:10.20.193.103:6789/0 conn(0x7fb5440b0410 legacy=0x7fb520066800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:20.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:20.086+0000 7fb52bfff640 1 -- 10.20.193.26:0/4184804894 >> v1:10.20.193.70:6789/0 conn(0x7fb5441626a0 legacy=0x7fb520023720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:20.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:20.086+0000 7fb52bfff640 1 -- 10.20.193.26:0/4184804894 >> v1:10.20.193.26:6789/0 conn(0x7fb5200678e0 legacy=0x7fb520068050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:20.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:20.086+0000 7fb52bfff640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:20.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:20.086+0000 7fb52bfff640 10 monclient(hunting): picked mon.noname-c con 0x7fb5440b0410 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:20.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:20.086+0000 7fb52bfff640 10 monclient(hunting): picked mon.noname-b con 0x7fb5441626a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:20.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:20.086+0000 7fb52bfff640 10 monclient(hunting): picked mon.noname-a con 0x7fb5200678e0 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:20.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:20.086+0000 7fb52bfff640 1 -- 10.20.193.26:0/4184804894 --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb52006aab0 con 0x7fb5200678e0 2026-02-24T19:17:20.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:20.086+0000 7fb52bfff640 1 -- 10.20.193.26:0/4184804894 --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb52006ad20 con 0x7fb5441626a0 2026-02-24T19:17:20.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:20.086+0000 7fb52bfff640 1 -- 10.20.193.26:0/4184804894 --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb520069060 con 0x7fb5440b0410 2026-02-24T19:17:20.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:20.086+0000 7fb52bfff640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:22.298 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.297+0000 7fb541573640 1 -- 10.20.193.26:0/4184804894 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1364324884 0 0) 0x7fb52006aab0 con 0x7fb5200678e0 2026-02-24T19:17:22.298 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.297+0000 7fb541573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:22.298 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.297+0000 7fb541573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:22.298 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.297+0000 7fb541573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:22.298 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.297+0000 7fb541573640 10 monclient(hunting): my global_id is 4101 2026-02-24T19:17:22.298 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.297+0000 7fb541573640 1 -- 10.20.193.26:0/4184804894 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb530003610 con 0x7fb5200678e0 2026-02-24T19:17:22.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.304+0000 7fb541573640 1 -- 10.20.193.26:0/4184804894 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3607490745 0 0) 0x7fb52006ad20 con 0x7fb5441626a0 2026-02-24T19:17:22.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.304+0000 7fb541573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:22.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.304+0000 7fb541573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:22.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.304+0000 7fb541573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:22.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.304+0000 7fb541573640 10 monclient(hunting): my global_id is 4105 2026-02-24T19:17:22.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.304+0000 7fb541573640 1 -- 10.20.193.26:0/4184804894 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb52006aab0 con 0x7fb5441626a0 2026-02-24T19:17:22.317 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.316+0000 7fb541573640 1 -- 10.20.193.26:0/4184804894 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2116074395 0 0) 0x7fb520069060 con 0x7fb5440b0410 2026-02-24T19:17:22.318 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.316+0000 7fb541573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:22.318 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.316+0000 7fb541573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:22.318 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.316+0000 7fb541573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:22.318 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.316+0000 7fb541573640 10 monclient(hunting): my global_id is 4106 2026-02-24T19:17:22.318 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.316+0000 7fb541573640 1 -- 10.20.193.26:0/4184804894 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb52006ad20 con 0x7fb5440b0410 2026-02-24T19:17:22.326 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.325+0000 7fb541573640 1 -- 10.20.193.26:0/4184804894 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 124448069 0 0) 0x7fb530003610 con 0x7fb5200678e0 2026-02-24T19:17:22.326 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.325+0000 7fb541573640 1 -- 10.20.193.26:0/4184804894 >> v1:10.20.193.103:6789/0 conn(0x7fb5440b0410 legacy=0x7fb520066800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:22.326 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.325+0000 7fb541573640 1 -- 10.20.193.26:0/4184804894 >> v1:10.20.193.70:6789/0 conn(0x7fb5441626a0 legacy=0x7fb520023720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:22.326 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.325+0000 7fb541573640 10 monclient: _finish_hunting 0 2026-02-24T19:17:22.326 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.325+0000 7fb541573640 1 monclient: found mon.noname-a 2026-02-24T19:17:22.326 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.325+0000 7fb541573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:22.326 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.325+0000 7fb541573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:17:22.327 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.325+0000 7fb541573640 1 -- 10.20.193.26:0/4184804894 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb520069230 con 0x7fb5200678e0 2026-02-24T19:17:22.327 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.325+0000 7fb541573640 10 monclient: _finish_auth 0 2026-02-24T19:17:22.327 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.325+0000 7fb541573640 10 monclient: _check_auth_tickets 2026-02-24T19:17:22.327 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.325+0000 7fb541573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:22.327 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.325+0000 7fb541573640 1 -- 10.20.193.26:0/4184804894 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fb534004420 con 0x7fb5200678e0 2026-02-24T19:17:22.327 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.325+0000 7fb548bd9640 5 monclient: authenticate success, global_id 4101 2026-02-24T19:17:22.327 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.325+0000 7fb548bd9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:22.327 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.325+0000 7fb541573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:22.327 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.325+0000 7fb541573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:22.327 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.325+0000 7fb541573640 10 monclient: dump: 2026-02-24T19:17:22.327 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:17:22.327 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:22.327 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:22.327 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:22.327 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:22.327 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:17:22.327 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:22.327 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:22.327 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:22.327 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:17:22.327 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.325+0000 7fb548bd9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:22.375 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.371+0000 7fb541573640 1 -- 10.20.193.26:0/4184804894 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb534004660 con 0x7fb5200678e0 2026-02-24T19:17:22.375 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.371+0000 7fb541573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:22.375 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.371+0000 7fb541573640 1 -- 10.20.193.26:0/4184804894 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fb534004a70 con 0x7fb5200678e0 2026-02-24T19:17:22.375 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.371+0000 7fb541573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:22.375 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.371+0000 7fb541573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:22.375 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.371+0000 7fb541573640 10 monclient: dump: 2026-02-24T19:17:22.376 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:17:22.376 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:22.376 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:22.376 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:22.376 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:22.376 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:17:22.376 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:22.376 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:22.376 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:22.376 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:17:22.376 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.371+0000 7fb548bd9640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:22.377 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.371+0000 7fb548bd9640 4 set_mon_vals no callback set 2026-02-24T19:17:22.377 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.371+0000 7fb548bd9640 10 monclient: shutdown 2026-02-24T19:17:22.377 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.371+0000 7fb548bd9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:22.377 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.371+0000 7fb548bd9640 1 -- 10.20.193.26:0/4184804894 >> v1:10.20.193.26:6789/0 conn(0x7fb5200678e0 legacy=0x7fb520044f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:22.377 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.372+0000 7fb548bd9640 1 -- 10.20.193.26:0/4184804894 shutdown_connections 2026-02-24T19:17:22.377 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.372+0000 7fb548bd9640 1 -- 10.20.193.26:0/4184804894 >> 10.20.193.26:0/4184804894 conn(0x7fb5440b65f0 msgr2=0x7fb5440b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:22.377 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.372+0000 7fb548bd9640 1 -- 10.20.193.26:0/4184804894 shutdown_connections 2026-02-24T19:17:22.377 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.372+0000 7fb548bd9640 1 -- 10.20.193.26:0/4184804894 wait complete. 2026-02-24T19:17:22.377 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.372+0000 7fb548bd9640 10 monclient: build_initial_monmap 2026-02-24T19:17:22.377 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.372+0000 7fb548bd9640 10 monclient: monmap: 2026-02-24T19:17:22.377 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:17:22.377 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:22.378 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:17:22.378 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:17:22.378 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:22.378 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:17:22.378 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:22.378 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:22.378 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:22.378 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:17:22.378 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.372+0000 7fb548bd9640 1 librados: starting msgr at 2026-02-24T19:17:22.378 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.372+0000 7fb548bd9640 1 librados: starting objecter 2026-02-24T19:17:22.378 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.372+0000 7fb548bd9640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:22.378 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.372+0000 7fb548bd9640 1 Processor -- start 2026-02-24T19:17:22.378 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.372+0000 7fb548bd9640 1 -- start start 2026-02-24T19:17:22.379 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.372+0000 7fb548bd9640 1 librados: setting wanted keys 2026-02-24T19:17:22.379 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.372+0000 7fb548bd9640 1 librados: calling monclient init 2026-02-24T19:17:22.379 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.372+0000 7fb548bd9640 10 monclient: init 2026-02-24T19:17:22.379 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.373+0000 7fb548bd9640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:22.379 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.373+0000 7fb548bd9640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:22.379 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.373+0000 7fb548bd9640 10 monclient(hunting): picked mon.noname-c con 0x7fb5200678e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:22.379 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.373+0000 7fb548bd9640 10 monclient(hunting): picked mon.noname-b con 0x7fb5440b0410 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:22.379 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.373+0000 7fb548bd9640 10 monclient(hunting): picked mon.noname-a con 0x7fb5441626a0 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:22.379 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.373+0000 7fb548bd9640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb544138e10 con 0x7fb5441626a0 2026-02-24T19:17:22.379 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.373+0000 7fb548bd9640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5441390f0 con 0x7fb5440b0410 2026-02-24T19:17:22.379 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.373+0000 7fb548bd9640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5441393d0 con 0x7fb5200678e0 2026-02-24T19:17:22.379 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.373+0000 7fb548bd9640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:22.380 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.373+0000 7fb548bd9640 10 monclient(hunting): authenticate will time out at 3625.055330s 2026-02-24T19:17:22.381 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.380+0000 7fb542575640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fb5200678e0 0x7fb5440a8b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58104/0 (socket says 10.20.193.26:58104) 2026-02-24T19:17:22.382 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.380+0000 7fb542575640 1 -- 10.20.193.26:0/2024139339 learned_addr learned my addr 10.20.193.26:0/2024139339 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:17:22.382 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.381+0000 7fb52affd640 10 client.?.objecter ms_handle_connect 0x7fb5200678e0 2026-02-24T19:17:22.382 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.381+0000 7fb52affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:22.382 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.381+0000 7fb52affd640 10 client.?.objecter ms_handle_connect 0x7fb5440b0410 2026-02-24T19:17:22.382 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.381+0000 7fb52affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:22.387 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.386+0000 7fb52affd640 10 client.?.objecter ms_handle_connect 0x7fb5441626a0 2026-02-24T19:17:22.387 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.386+0000 7fb52affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:22.391 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.389+0000 7fb52affd640 1 -- 10.20.193.26:0/2024139339 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 601124793 0 0) 0x7fb544138e10 con 0x7fb5441626a0 2026-02-24T19:17:22.391 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.389+0000 7fb52affd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:22.391 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.389+0000 7fb52affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:22.391 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.389+0000 7fb52affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:22.391 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.389+0000 7fb52affd640 10 monclient(hunting): my global_id is 4110 2026-02-24T19:17:22.391 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.389+0000 7fb52affd640 1 -- 10.20.193.26:0/2024139339 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb510003610 con 0x7fb5441626a0 2026-02-24T19:17:22.403 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.402+0000 7fb52affd640 1 -- 10.20.193.26:0/2024139339 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 708839514 0 0) 0x7fb510003610 con 0x7fb5441626a0 2026-02-24T19:17:22.404 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.402+0000 7fb52affd640 1 -- 10.20.193.26:0/2024139339 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb544138e10 con 0x7fb5441626a0 2026-02-24T19:17:22.404 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.402+0000 7fb52affd640 1 -- 10.20.193.26:0/2024139339 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fb534004810 con 0x7fb5441626a0 2026-02-24T19:17:22.404 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.402+0000 7fb52affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:22.404 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.402+0000 7fb52affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:22.404 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.402+0000 7fb52affd640 10 monclient(hunting): dump: 2026-02-24T19:17:22.404 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:17:22.404 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:22.404 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:22.404 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:22.404 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:22.404 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:17:22.404 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:22.405 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:22.405 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:22.405 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:17:22.405 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.402+0000 7fb52affd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:22.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.429+0000 7fb52affd640 1 -- 10.20.193.26:0/2024139339 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4222109635 0 0) 0x7fb544138e10 con 0x7fb5441626a0 2026-02-24T19:17:22.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.429+0000 7fb52affd640 1 -- 10.20.193.26:0/2024139339 >> v1:10.20.193.103:6789/0 conn(0x7fb5200678e0 legacy=0x7fb5440a8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:22.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.429+0000 7fb52affd640 1 -- 10.20.193.26:0/2024139339 >> v1:10.20.193.70:6789/0 conn(0x7fb5440b0410 legacy=0x7fb544138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:22.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.429+0000 7fb52affd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:22.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.429+0000 7fb52affd640 1 monclient: found mon.a 2026-02-24T19:17:22.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.429+0000 7fb52affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:22.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.429+0000 7fb52affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:22.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.429+0000 7fb52affd640 1 -- 10.20.193.26:0/2024139339 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5441396b0 con 0x7fb5441626a0 2026-02-24T19:17:22.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.429+0000 7fb52affd640 10 monclient: _finish_auth 0 2026-02-24T19:17:22.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.429+0000 7fb52affd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:22.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.429+0000 7fb52affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:22.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.429+0000 7fb548bd9640 5 monclient: authenticate success, global_id 4110 2026-02-24T19:17:22.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.429+0000 7fb548bd9640 10 monclient: _renew_subs 2026-02-24T19:17:22.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.429+0000 7fb548bd9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:22.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.429+0000 7fb548bd9640 1 -- 10.20.193.26:0/2024139339 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb544139990 con 0x7fb5441626a0 2026-02-24T19:17:22.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.429+0000 7fb548bd9640 10 client.4110.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:22.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.429+0000 7fb548bd9640 10 monclient: _renew_subs 2026-02-24T19:17:22.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.429+0000 7fb548bd9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:22.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.429+0000 7fb548bd9640 1 -- 10.20.193.26:0/2024139339 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb5441fd140 con 0x7fb5441626a0 2026-02-24T19:17:22.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.429+0000 7fb548bd9640 1 librados: init done 2026-02-24T19:17:22.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.430+0000 7fb548bd9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:22.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.430+0000 7fb548bd9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:22.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.430+0000 7fb548bd9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:22.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.430+0000 7fb548bd9640 1 -- 10.20.193.26:0/2024139339 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb54415ebb0 con 0x7fb5441626a0 2026-02-24T19:17:22.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.523+0000 7fb52affd640 1 -- 10.20.193.26:0/2024139339 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb534004ca0 con 0x7fb5441626a0 2026-02-24T19:17:22.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.523+0000 7fb52affd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:22.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.523+0000 7fb52affd640 1 -- 10.20.193.26:0/2024139339 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fb5340050b0 con 0x7fb5441626a0 2026-02-24T19:17:22.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.523+0000 7fb52affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:22.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.523+0000 7fb52affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:22.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.523+0000 7fb540d72640 4 set_mon_vals no callback set 2026-02-24T19:17:22.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.523+0000 7fb52affd640 10 monclient: dump: 2026-02-24T19:17:22.526 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:17:22.526 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:22.526 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:22.526 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:22.526 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:22.526 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:17:22.526 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:22.526 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:22.526 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:22.526 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:17:22.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.523+0000 7fb52affd640 1 -- 10.20.193.26:0/2024139339 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fb5340056a0 con 0x7fb5441626a0 2026-02-24T19:17:22.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.523+0000 7fb52affd640 1 -- 10.20.193.26:0/2024139339 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (unknown 3563521648 0 0) 0x7fb534004610 con 0x7fb5441626a0 2026-02-24T19:17:22.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.523+0000 7fb52affd640 10 client.4110.objecter ms_dispatch2 0x7fb544000b90 osd_map(1..1 src has 1..1) 2026-02-24T19:17:22.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.523+0000 7fb52affd640 3 client.4110.objecter handle_osd_map got epochs [1,1] > 0 2026-02-24T19:17:22.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.523+0000 7fb52affd640 3 client.4110.objecter handle_osd_map decoding full epoch 1 2026-02-24T19:17:22.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.523+0000 7fb52affd640 20 client.4110.objecter dump_active .. 0 homeless 2026-02-24T19:17:22.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.523+0000 7fb52affd640 1 -- 10.20.193.26:0/2024139339 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7fb520067de0 con 0x7fb5441626a0 2026-02-24T19:17:22.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.523+0000 7fb52affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:22.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.523+0000 7fb52affd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:22.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.552+0000 7fb548bd9640 10 start_mon_command cmd=[{"prefix": "config dump"}] 2026-02-24T19:17:22.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.552+0000 7fb548bd9640 10 monclient: _send_command 2 [{"prefix": "config dump"}] 2026-02-24T19:17:22.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.552+0000 7fb548bd9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:22.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.552+0000 7fb548bd9640 1 -- 10.20.193.26:0/2024139339 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "config dump"} v 0) -- 0x7fb5440b2840 con 0x7fb5441626a0 2026-02-24T19:17:22.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.571+0000 7fb52affd640 1 -- 10.20.193.26:0/2024139339 <== mon.0 v1:10.20.193.26:6789/0 10 ==== mon_command_ack([{"prefix": "config dump"}]=0 v1) ==== 59+0+36 (unknown 4069917974 0 2919340917) 0x7fb534005ba0 con 0x7fb5441626a0 2026-02-24T19:17:22.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.571+0000 7fb52affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config dump"}] 2026-02-24T19:17:22.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.571+0000 7fb52affd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:22.572 INFO:teuthology.orchestra.run.trial026.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-24T19:17:22.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.571+0000 7fb548bd9640 10 librados: watch_flush enter 2026-02-24T19:17:22.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.571+0000 7fb548bd9640 10 librados: watch_flush exit 2026-02-24T19:17:22.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.571+0000 7fb548bd9640 20 client.4110.objecter shutdown clearing up homeless session... 2026-02-24T19:17:22.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.571+0000 7fb548bd9640 10 client.4110.objecter successfully canceled tick 2026-02-24T19:17:22.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.571+0000 7fb548bd9640 10 monclient: shutdown 2026-02-24T19:17:22.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.571+0000 7fb548bd9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:22.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.571+0000 7fb548bd9640 1 -- 10.20.193.26:0/2024139339 >> v1:10.20.193.26:6789/0 conn(0x7fb5441626a0 legacy=0x7fb5441fc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:22.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.571+0000 7fb548bd9640 1 -- 10.20.193.26:0/2024139339 shutdown_connections 2026-02-24T19:17:22.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.571+0000 7fb548bd9640 1 -- 10.20.193.26:0/2024139339 >> 10.20.193.26:0/2024139339 conn(0x7fb5440b65f0 msgr2=0x7fb54413ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:22.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.571+0000 7fb548bd9640 1 -- 10.20.193.26:0/2024139339 shutdown_connections 2026-02-24T19:17:22.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.571+0000 7fb548bd9640 1 -- 10.20.193.26:0/2024139339 wait complete. 2026-02-24T19:17:22.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.572+0000 7fb548bd9640 1 librados: shutdown 2026-02-24T19:17:22.581 INFO:tasks.ceph:Setting crush tunables to default 2026-02-24T19:17:22.581 DEBUG:teuthology.orchestra.run.trial026:> sudo ceph --cluster ceph osd crush tunables default 2026-02-24T19:17:22.646 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.645+0000 7f2981f44640 10 monclient: get_monmap_and_config 2026-02-24T19:17:22.647 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.645+0000 7f2981f44640 10 monclient: build_initial_monmap 2026-02-24T19:17:22.647 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.645+0000 7f2981f44640 10 monclient: monmap: 2026-02-24T19:17:22.647 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:17:22.647 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:22.647 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:17:22.646571+0000 2026-02-24T19:17:22.647 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:17:22.646571+0000 2026-02-24T19:17:22.647 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:22.647 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:17:22.647 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:22.647 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:22.648 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:22.648 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:17:22.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.646+0000 7f2981f44640 1 Processor -- start 2026-02-24T19:17:22.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.646+0000 7f2981f44640 1 -- start start 2026-02-24T19:17:22.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.646+0000 7f2981f44640 10 monclient: init 2026-02-24T19:17:22.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.646+0000 7f2981f44640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:22.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.646+0000 7f2981f44640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:22.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.646+0000 7f2981f44640 10 monclient(hunting): picked mon.noname-b con 0x7f297c0b9f80 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:22.650 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.646+0000 7f2981f44640 10 monclient(hunting): picked mon.noname-a con 0x7f297c0ba350 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:22.650 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.646+0000 7f2981f44640 10 monclient(hunting): picked mon.noname-c con 0x7f297c0585e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:22.650 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.647+0000 7f2981f44640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f297c163930 con 0x7f297c0ba350 2026-02-24T19:17:22.650 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.647+0000 7f2981f44640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f297c163bb0 con 0x7f297c0b9f80 2026-02-24T19:17:22.650 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.647+0000 7f2981f44640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f297c163e90 con 0x7f297c0585e0 2026-02-24T19:17:22.650 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.647+0000 7f2981f44640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:22.650 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.647+0000 7f2981f44640 10 monclient(hunting): authenticate will time out at 3625.329028s 2026-02-24T19:17:22.650 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.647+0000 7f297b7fe640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f297c0b9f80 0x7f297c163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:38782/0 (socket says 10.20.193.26:38782) 2026-02-24T19:17:22.650 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.647+0000 7f297b7fe640 1 -- 10.20.193.26:0/2478685043 learned_addr learned my addr 10.20.193.26:0/2478685043 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:17:22.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.667+0000 7f297a7fc640 1 -- 10.20.193.26:0/2478685043 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3663253970 0 0) 0x7f296c002910 con 0x7f297c0ba350 2026-02-24T19:17:22.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.667+0000 7f297a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:22.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.667+0000 7f297a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:22.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.667+0000 7f297a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:22.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.667+0000 7f297a7fc640 10 monclient(hunting): my global_id is 4116 2026-02-24T19:17:22.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.667+0000 7f297a7fc640 1 -- 10.20.193.26:0/2478685043 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2960003610 con 0x7f297c0ba350 2026-02-24T19:17:22.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.669+0000 7f297a7fc640 1 -- 10.20.193.26:0/2478685043 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3479792362 0 0) 0x7f2960003610 con 0x7f297c0ba350 2026-02-24T19:17:22.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.669+0000 7f297a7fc640 1 -- 10.20.193.26:0/2478685043 >> v1:10.20.193.103:6789/0 conn(0x7f297c0585e0 legacy=0x7f297c166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:22.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.669+0000 7f297a7fc640 1 -- 10.20.193.26:0/2478685043 >> v1:10.20.193.70:6789/0 conn(0x7f297c0b9f80 legacy=0x7f297c163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:22.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.669+0000 7f297a7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:22.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.669+0000 7f297a7fc640 1 monclient: found mon.noname-a 2026-02-24T19:17:22.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.669+0000 7f297a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:22.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.669+0000 7f297a7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:17:22.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.669+0000 7f297a7fc640 1 -- 10.20.193.26:0/2478685043 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f297c0573f0 con 0x7f297c0ba350 2026-02-24T19:17:22.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.669+0000 7f297a7fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:22.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.669+0000 7f297a7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:22.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.669+0000 7f297a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:22.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.669+0000 7f297a7fc640 1 -- 10.20.193.26:0/2478685043 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f296c002fc0 con 0x7f297c0ba350 2026-02-24T19:17:22.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.669+0000 7f297a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:22.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.669+0000 7f297a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:22.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.669+0000 7f297a7fc640 10 monclient: dump: 2026-02-24T19:17:22.672 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:17:22.672 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:22.672 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:22.672 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:22.672 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:22.672 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:17:22.672 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:22.672 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:22.672 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:22.672 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:17:22.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.669+0000 7f2981f44640 5 monclient: authenticate success, global_id 4116 2026-02-24T19:17:22.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.669+0000 7f2981f44640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:22.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.670+0000 7f297a7fc640 1 -- 10.20.193.26:0/2478685043 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f296c0031d0 con 0x7f297c0ba350 2026-02-24T19:17:22.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.670+0000 7f297a7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:22.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.670+0000 7f297a7fc640 1 -- 10.20.193.26:0/2478685043 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f296c003700 con 0x7f297c0ba350 2026-02-24T19:17:22.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.670+0000 7f297a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:22.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.670+0000 7f297a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:22.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.670+0000 7f297a7fc640 10 monclient: dump: 2026-02-24T19:17:22.676 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:17:22.676 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:22.676 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:22.676 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:22.676 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:22.677 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:17:22.677 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:22.677 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:22.677 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:22.677 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:17:22.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.670+0000 7f2981f44640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:22.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.670+0000 7f2981f44640 4 set_mon_vals no callback set 2026-02-24T19:17:22.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.670+0000 7f2981f44640 10 monclient: shutdown 2026-02-24T19:17:22.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.670+0000 7f2981f44640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:22.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.670+0000 7f2981f44640 1 -- 10.20.193.26:0/2478685043 >> v1:10.20.193.26:6789/0 conn(0x7f297c0ba350 legacy=0x7f297c057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:22.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.670+0000 7f2981f44640 1 -- 10.20.193.26:0/2478685043 shutdown_connections 2026-02-24T19:17:22.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.670+0000 7f2981f44640 1 -- 10.20.193.26:0/2478685043 >> 10.20.193.26:0/2478685043 conn(0x7f297c0b7990 msgr2=0x7f297c0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:22.678 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.670+0000 7f2981f44640 1 -- 10.20.193.26:0/2478685043 shutdown_connections 2026-02-24T19:17:22.678 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.670+0000 7f2981f44640 1 -- 10.20.193.26:0/2478685043 wait complete. 2026-02-24T19:17:22.678 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.671+0000 7f2981f44640 10 monclient: build_initial_monmap 2026-02-24T19:17:22.678 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.671+0000 7f2981f44640 10 monclient: monmap: 2026-02-24T19:17:22.678 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:17:22.678 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:22.678 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:17:22.678 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:17:22.678 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:22.678 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:17:22.678 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:22.678 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:22.678 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:22.679 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:17:22.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.671+0000 7f2981f44640 1 librados: starting msgr at 2026-02-24T19:17:22.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.671+0000 7f2981f44640 1 librados: starting objecter 2026-02-24T19:17:22.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.671+0000 7f2981f44640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:22.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.671+0000 7f2981f44640 1 Processor -- start 2026-02-24T19:17:22.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.671+0000 7f2981f44640 1 -- start start 2026-02-24T19:17:22.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.671+0000 7f2981f44640 1 librados: setting wanted keys 2026-02-24T19:17:22.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.671+0000 7f2981f44640 1 librados: calling monclient init 2026-02-24T19:17:22.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.671+0000 7f2981f44640 10 monclient: init 2026-02-24T19:17:22.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.672+0000 7f2981f44640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:22.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.672+0000 7f2981f44640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:22.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.672+0000 7f2981f44640 10 monclient(hunting): picked mon.noname-a con 0x7f297c0585e0 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:22.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.672+0000 7f2981f44640 10 monclient(hunting): picked mon.noname-b con 0x7f297c0b9f80 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:22.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.672+0000 7f2981f44640 10 monclient(hunting): picked mon.noname-c con 0x7f297c0ba350 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:22.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.672+0000 7f2981f44640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f297c1fccc0 con 0x7f297c0585e0 2026-02-24T19:17:22.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.672+0000 7f2981f44640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f297c1fbed0 con 0x7f297c0b9f80 2026-02-24T19:17:22.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.672+0000 7f2981f44640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f297c13a5d0 con 0x7f297c0ba350 2026-02-24T19:17:22.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.672+0000 7f2981f44640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:22.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.672+0000 7f2981f44640 10 monclient(hunting): authenticate will time out at 3625.354159s 2026-02-24T19:17:22.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.672+0000 7f297b7fe640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f297c0585e0 0x7f297c1fc5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:50782/0 (socket says 10.20.193.26:50782) 2026-02-24T19:17:22.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.672+0000 7f297b7fe640 1 -- 10.20.193.26:0/578121557 learned_addr learned my addr 10.20.193.26:0/578121557 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:17:22.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.672+0000 7f2957fff640 10 client.?.objecter ms_handle_connect 0x7f297c0585e0 2026-02-24T19:17:22.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.672+0000 7f2957fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:22.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.673+0000 7f2957fff640 1 -- 10.20.193.26:0/578121557 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 398486864 0 0) 0x7f297c1fccc0 con 0x7f297c0585e0 2026-02-24T19:17:22.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.673+0000 7f2957fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:22.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.673+0000 7f2957fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:22.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.673+0000 7f2957fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:22.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.673+0000 7f2957fff640 10 monclient(hunting): my global_id is 4119 2026-02-24T19:17:22.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.673+0000 7f2957fff640 1 -- 10.20.193.26:0/578121557 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f294c003610 con 0x7f297c0585e0 2026-02-24T19:17:22.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.675+0000 7f2957fff640 10 client.?.objecter ms_handle_connect 0x7f297c0b9f80 2026-02-24T19:17:22.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.675+0000 7f2957fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:22.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.676+0000 7f2957fff640 10 client.?.objecter ms_handle_connect 0x7f297c0ba350 2026-02-24T19:17:22.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.676+0000 7f2957fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:22.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.677+0000 7f2957fff640 1 -- 10.20.193.26:0/578121557 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1910228675 0 0) 0x7f294c003610 con 0x7f297c0585e0 2026-02-24T19:17:22.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.677+0000 7f2957fff640 1 -- 10.20.193.26:0/578121557 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f297c1fccc0 con 0x7f297c0585e0 2026-02-24T19:17:22.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.677+0000 7f2957fff640 1 -- 10.20.193.26:0/578121557 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2968003010 con 0x7f297c0585e0 2026-02-24T19:17:22.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.677+0000 7f2957fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:22.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.677+0000 7f2957fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:22.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.677+0000 7f2957fff640 10 monclient(hunting): dump: 2026-02-24T19:17:22.684 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:17:22.684 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:22.684 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:22.684 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:22.684 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:22.684 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:17:22.684 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:22.684 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:22.684 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:22.685 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:17:22.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.677+0000 7f2957fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:22.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.680+0000 7f2957fff640 1 -- 10.20.193.26:0/578121557 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3424593365 0 0) 0x7f297c1fccc0 con 0x7f297c0585e0 2026-02-24T19:17:22.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.680+0000 7f2957fff640 1 -- 10.20.193.26:0/578121557 >> v1:10.20.193.103:6789/0 conn(0x7f297c0ba350 legacy=0x7f297c1557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:22.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.680+0000 7f2957fff640 1 -- 10.20.193.26:0/578121557 >> v1:10.20.193.70:6789/0 conn(0x7f297c0b9f80 legacy=0x7f297c165720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:22.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.680+0000 7f2957fff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:22.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.680+0000 7f2957fff640 1 monclient: found mon.a 2026-02-24T19:17:22.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.680+0000 7f2957fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:22.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.680+0000 7f2957fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:22.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.680+0000 7f2957fff640 1 -- 10.20.193.26:0/578121557 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f297c13a8b0 con 0x7f297c0585e0 2026-02-24T19:17:22.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.680+0000 7f2957fff640 10 monclient: _finish_auth 0 2026-02-24T19:17:22.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.680+0000 7f2957fff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:22.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.680+0000 7f2957fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:22.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.680+0000 7f2981f44640 5 monclient: authenticate success, global_id 4119 2026-02-24T19:17:22.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.680+0000 7f2981f44640 10 monclient: _renew_subs 2026-02-24T19:17:22.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.680+0000 7f2981f44640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:22.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.680+0000 7f2981f44640 1 -- 10.20.193.26:0/578121557 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f297c13ab90 con 0x7f297c0585e0 2026-02-24T19:17:22.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.680+0000 7f2981f44640 10 client.4119.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:22.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.680+0000 7f2981f44640 10 monclient: _renew_subs 2026-02-24T19:17:22.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.680+0000 7f2981f44640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:22.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.680+0000 7f2981f44640 1 -- 10.20.193.26:0/578121557 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f297c13b670 con 0x7f297c0585e0 2026-02-24T19:17:22.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.680+0000 7f2981f44640 1 librados: init done 2026-02-24T19:17:22.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.681+0000 7f2981f44640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:22.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.681+0000 7f2981f44640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:22.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.681+0000 7f2981f44640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:22.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.681+0000 7f2981f44640 1 -- 10.20.193.26:0/578121557 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f297c0b64c0 con 0x7f297c0585e0 2026-02-24T19:17:22.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.736+0000 7f2957fff640 1 -- 10.20.193.26:0/578121557 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f29680048d0 con 0x7f297c0585e0 2026-02-24T19:17:22.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.736+0000 7f2957fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:22.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.736+0000 7f2957fff640 1 -- 10.20.193.26:0/578121557 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2968004b40 con 0x7f297c0585e0 2026-02-24T19:17:22.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.736+0000 7f2957fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:22.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.736+0000 7f2957fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:22.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.736+0000 7f2979ffb640 4 set_mon_vals no callback set 2026-02-24T19:17:22.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.736+0000 7f2957fff640 10 monclient: dump: 2026-02-24T19:17:22.738 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:17:22.738 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:22.739 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:22.739 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:22.739 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:22.739 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:17:22.739 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:22.739 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:22.739 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:22.739 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:17:22.739 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.736+0000 7f2957fff640 1 -- 10.20.193.26:0/578121557 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f2968005130 con 0x7f297c0585e0 2026-02-24T19:17:22.739 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.736+0000 7f2957fff640 1 -- 10.20.193.26:0/578121557 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (unknown 3563521648 0 0) 0x7f2968006c70 con 0x7f297c0585e0 2026-02-24T19:17:22.739 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.736+0000 7f2957fff640 10 client.4119.objecter ms_dispatch2 0x7f297c000b90 osd_map(1..1 src has 1..1) 2026-02-24T19:17:22.739 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.736+0000 7f2957fff640 3 client.4119.objecter handle_osd_map got epochs [1,1] > 0 2026-02-24T19:17:22.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.736+0000 7f2957fff640 3 client.4119.objecter handle_osd_map decoding full epoch 1 2026-02-24T19:17:22.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.736+0000 7f2957fff640 20 client.4119.objecter dump_active .. 0 homeless 2026-02-24T19:17:22.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.736+0000 7f2957fff640 1 -- 10.20.193.26:0/578121557 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f2968007030 con 0x7f297c0585e0 2026-02-24T19:17:22.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.736+0000 7f2957fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:22.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.736+0000 7f2957fff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:22.768 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.767+0000 7f2981f44640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-24T19:17:22.768 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.767+0000 7f2981f44640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-24T19:17:22.768 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.767+0000 7f2981f44640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:22.768 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.767+0000 7f2981f44640 1 -- 10.20.193.26:0/578121557 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f297c159580 con 0x7f297c0585e0 2026-02-24T19:17:22.850 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.848+0000 7f2957fff640 1 -- 10.20.193.26:0/578121557 <== mon.0 v1:10.20.193.26:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (unknown 2277712955 0 0) 0x7f29680055e0 con 0x7f297c0585e0 2026-02-24T19:17:22.850 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.849+0000 7f2957fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-24T19:17:22.850 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.849+0000 7f2957fff640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2026-02-24T19:17:22.850 INFO:teuthology.orchestra.run.trial026.stderr:adjusted tunables profile to default 2026-02-24T19:17:22.851 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.849+0000 7f2981f44640 10 librados: watch_flush enter 2026-02-24T19:17:22.852 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.849+0000 7f2981f44640 10 librados: watch_flush exit 2026-02-24T19:17:22.852 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.849+0000 7f2981f44640 20 client.4119.objecter shutdown clearing up homeless session... 2026-02-24T19:17:22.852 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.849+0000 7f2981f44640 10 client.4119.objecter successfully canceled tick 2026-02-24T19:17:22.852 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.849+0000 7f2981f44640 10 monclient: shutdown 2026-02-24T19:17:22.852 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.849+0000 7f2981f44640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:22.852 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.849+0000 7f2981f44640 1 -- 10.20.193.26:0/578121557 >> v1:10.20.193.26:6789/0 conn(0x7f297c0585e0 legacy=0x7f297c1fc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:22.852 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.849+0000 7f2981f44640 1 -- 10.20.193.26:0/578121557 shutdown_connections 2026-02-24T19:17:22.852 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.849+0000 7f2981f44640 1 -- 10.20.193.26:0/578121557 >> 10.20.193.26:0/578121557 conn(0x7f297c0b7990 msgr2=0x7f297c159aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:22.852 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.849+0000 7f2981f44640 1 -- 10.20.193.26:0/578121557 shutdown_connections 2026-02-24T19:17:22.852 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.849+0000 7f2981f44640 1 -- 10.20.193.26:0/578121557 wait complete. 2026-02-24T19:17:22.852 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:22.850+0000 7f2981f44640 1 librados: shutdown 2026-02-24T19:17:22.859 INFO:tasks.ceph:check_enable_crimson: False 2026-02-24T19:17:22.859 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-24T19:17:22.860 DEBUG:teuthology.orchestra.run.trial026:> set -ex 2026-02-24T19:17:22.860 DEBUG:teuthology.orchestra.run.trial026:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-24T19:17:22.884 DEBUG:teuthology.orchestra.run.trial026:> set -ex 2026-02-24T19:17:22.884 DEBUG:teuthology.orchestra.run.trial026:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-24T19:17:22.948 DEBUG:teuthology.orchestra.run.trial026:> set -ex 2026-02-24T19:17:22.948 DEBUG:teuthology.orchestra.run.trial026:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2026-02-24T19:17:23.012 DEBUG:teuthology.orchestra.run.trial026:> set -ex 2026-02-24T19:17:23.012 DEBUG:teuthology.orchestra.run.trial026:> sudo dd if=/var/lib/ceph/osd/ceph-12/fsid of=/dev/stdout 2026-02-24T19:17:23.076 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-24T19:17:23.076 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-24T19:17:23.103 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-24T19:17:23.103 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-24T19:17:23.168 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-24T19:17:23.168 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2026-02-24T19:17:23.232 DEBUG:teuthology.orchestra.run.trial070:> set -ex 2026-02-24T19:17:23.232 DEBUG:teuthology.orchestra.run.trial070:> sudo dd if=/var/lib/ceph/osd/ceph-13/fsid of=/dev/stdout 2026-02-24T19:17:23.233 INFO:tasks.ceph.mgr.x.trial162.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T19:17:23.233 INFO:tasks.ceph.mgr.x.trial162.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T19:17:23.233 INFO:tasks.ceph.mgr.x.trial162.stderr: from numpy import show_config as show_numpy_config 2026-02-24T19:17:23.271 INFO:tasks.ceph.mgr.y.trial026.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-24T19:17:23.272 INFO:tasks.ceph.mgr.y.trial026.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-24T19:17:23.272 INFO:tasks.ceph.mgr.y.trial026.stderr: from numpy import show_config as show_numpy_config 2026-02-24T19:17:23.296 DEBUG:teuthology.orchestra.run.trial103:> set -ex 2026-02-24T19:17:23.296 DEBUG:teuthology.orchestra.run.trial103:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-24T19:17:23.324 DEBUG:teuthology.orchestra.run.trial103:> set -ex 2026-02-24T19:17:23.324 DEBUG:teuthology.orchestra.run.trial103:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2026-02-24T19:17:23.388 DEBUG:teuthology.orchestra.run.trial103:> set -ex 2026-02-24T19:17:23.388 DEBUG:teuthology.orchestra.run.trial103:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2026-02-24T19:17:23.452 DEBUG:teuthology.orchestra.run.trial103:> set -ex 2026-02-24T19:17:23.452 DEBUG:teuthology.orchestra.run.trial103:> sudo dd if=/var/lib/ceph/osd/ceph-14/fsid of=/dev/stdout 2026-02-24T19:17:23.517 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-24T19:17:23.517 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-24T19:17:23.544 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-24T19:17:23.544 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2026-02-24T19:17:23.610 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-24T19:17:23.611 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2026-02-24T19:17:23.675 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-24T19:17:23.675 DEBUG:teuthology.orchestra.run.trial162:> sudo dd if=/var/lib/ceph/osd/ceph-15/fsid of=/dev/stdout 2026-02-24T19:17:23.739 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new e08ffdb8-0db6-4356-88b5-54397e40be58 0 2026-02-24T19:17:23.850 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.848+0000 7ff55df99640 10 monclient: get_monmap_and_config 2026-02-24T19:17:23.850 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.848+0000 7ff55df99640 10 monclient: build_initial_monmap 2026-02-24T19:17:23.850 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.848+0000 7ff55df99640 10 monclient: monmap: 2026-02-24T19:17:23.850 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:23.850 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:23.851 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:17:23.848624+0000 2026-02-24T19:17:23.851 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:17:23.848624+0000 2026-02-24T19:17:23.851 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:23.851 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:23.851 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:23.851 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:23.851 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:23.851 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:23.851 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.848+0000 7ff55df99640 1 Processor -- start 2026-02-24T19:17:23.851 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.848+0000 7ff55df99640 1 -- start start 2026-02-24T19:17:23.851 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.848+0000 7ff55df99640 10 monclient: init 2026-02-24T19:17:23.851 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.848+0000 7ff55df99640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:23.852 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.848+0000 7ff55df99640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:23.852 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.848+0000 7ff55df99640 10 monclient(hunting): picked mon.noname-c con 0x7ff55811fa30 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:23.852 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.848+0000 7ff55df99640 10 monclient(hunting): picked mon.noname-a con 0x7ff558142940 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:23.852 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.848+0000 7ff55df99640 10 monclient(hunting): picked mon.noname-b con 0x7ff5581644a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:23.852 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.848+0000 7ff55df99640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff558186250 con 0x7ff558142940 2026-02-24T19:17:23.852 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.848+0000 7ff55df99640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff558187450 con 0x7ff5581644a0 2026-02-24T19:17:23.852 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.848+0000 7ff55df99640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff558188650 con 0x7ff55811fa30 2026-02-24T19:17:23.852 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.848+0000 7ff55df99640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:23.852 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.848+0000 7ff55df99640 10 monclient(hunting): authenticate will time out at 3619.483893s 2026-02-24T19:17:23.852 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.849+0000 7ff557fff640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7ff5581644a0 0x7ff558184950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.162:45074/0 (socket says 10.20.193.162:45074) 2026-02-24T19:17:23.852 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.849+0000 7ff557fff640 1 -- 10.20.193.162:0/326471165 learned_addr learned my addr 10.20.193.162:0/326471165 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:23.857 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.850+0000 7ff5567fc640 1 -- 10.20.193.162:0/326471165 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2518352946 0 0) 0x7ff558187450 con 0x7ff5581644a0 2026-02-24T19:17:23.857 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.850+0000 7ff5567fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:23.857 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.850+0000 7ff5567fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:23.857 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.850+0000 7ff5567fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:23.857 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.850+0000 7ff5567fc640 10 monclient(hunting): my global_id is 4114 2026-02-24T19:17:23.857 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.850+0000 7ff5567fc640 1 -- 10.20.193.162:0/326471165 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff53c003610 con 0x7ff5581644a0 2026-02-24T19:17:23.857 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.850+0000 7ff5567fc640 1 -- 10.20.193.162:0/326471165 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 874103502 0 0) 0x7ff558188650 con 0x7ff55811fa30 2026-02-24T19:17:23.857 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.850+0000 7ff5567fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:23.858 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.850+0000 7ff5567fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:23.858 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.850+0000 7ff5567fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:23.858 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.850+0000 7ff5567fc640 10 monclient(hunting): my global_id is 4115 2026-02-24T19:17:23.858 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.850+0000 7ff5567fc640 1 -- 10.20.193.162:0/326471165 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff558187450 con 0x7ff55811fa30 2026-02-24T19:17:23.858 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.851+0000 7ff5567fc640 1 -- 10.20.193.162:0/326471165 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 396031307 0 0) 0x7ff558186250 con 0x7ff558142940 2026-02-24T19:17:23.858 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.851+0000 7ff5567fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:23.858 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.851+0000 7ff5567fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:23.858 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.851+0000 7ff5567fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:23.858 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.851+0000 7ff5567fc640 10 monclient(hunting): my global_id is 4122 2026-02-24T19:17:23.858 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.851+0000 7ff5567fc640 1 -- 10.20.193.162:0/326471165 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff558188650 con 0x7ff558142940 2026-02-24T19:17:23.858 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.853+0000 7ff5567fc640 1 -- 10.20.193.162:0/326471165 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 749434921 0 0) 0x7ff558188650 con 0x7ff558142940 2026-02-24T19:17:23.858 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.853+0000 7ff5567fc640 1 -- 10.20.193.162:0/326471165 >> v1:10.20.193.103:6789/0 conn(0x7ff55811fa30 legacy=0x7ff55811fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:23.858 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.853+0000 7ff5567fc640 1 -- 10.20.193.162:0/326471165 >> v1:10.20.193.70:6789/0 conn(0x7ff5581644a0 legacy=0x7ff558184950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:23.859 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.853+0000 7ff5567fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:23.859 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.853+0000 7ff5567fc640 1 monclient: found mon.noname-a 2026-02-24T19:17:23.859 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.853+0000 7ff5567fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:23.859 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.853+0000 7ff5567fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:17:23.859 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.853+0000 7ff5567fc640 1 -- 10.20.193.162:0/326471165 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5581898f0 con 0x7ff558142940 2026-02-24T19:17:23.859 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.853+0000 7ff5567fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:23.859 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.853+0000 7ff5567fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:23.859 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.853+0000 7ff5567fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:23.859 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.853+0000 7ff5567fc640 1 -- 10.20.193.162:0/326471165 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ff548002dd0 con 0x7ff558142940 2026-02-24T19:17:23.859 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.853+0000 7ff5567fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:23.859 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.853+0000 7ff5567fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:23.859 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.853+0000 7ff5567fc640 10 monclient: dump: 2026-02-24T19:17:23.860 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:23.860 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:23.860 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:23.860 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:23.860 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:23.860 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:23.860 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:23.860 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:23.860 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:23.860 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:23.860 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.853+0000 7ff55df99640 5 monclient: authenticate success, global_id 4122 2026-02-24T19:17:23.860 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.853+0000 7ff55df99640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:23.860 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.854+0000 7ff5567fc640 1 -- 10.20.193.162:0/326471165 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff548003010 con 0x7ff558142940 2026-02-24T19:17:23.861 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.854+0000 7ff5567fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:23.861 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.854+0000 7ff5567fc640 1 -- 10.20.193.162:0/326471165 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ff548003450 con 0x7ff558142940 2026-02-24T19:17:23.861 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.854+0000 7ff5567fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:23.861 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.854+0000 7ff5567fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:23.861 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.854+0000 7ff5567fc640 10 monclient: dump: 2026-02-24T19:17:23.861 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:23.861 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:23.861 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:23.861 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:23.861 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:23.861 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:23.861 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:23.862 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:23.862 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:23.862 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:23.862 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.854+0000 7ff55df99640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:23.862 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.854+0000 7ff55df99640 4 set_mon_vals no callback set 2026-02-24T19:17:23.862 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.854+0000 7ff55df99640 10 monclient: shutdown 2026-02-24T19:17:23.862 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.854+0000 7ff55df99640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:23.862 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.854+0000 7ff55df99640 1 -- 10.20.193.162:0/326471165 >> v1:10.20.193.26:6789/0 conn(0x7ff558142940 legacy=0x7ff558162d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:23.862 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.854+0000 7ff55df99640 1 -- 10.20.193.162:0/326471165 shutdown_connections 2026-02-24T19:17:23.862 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.854+0000 7ff55df99640 1 -- 10.20.193.162:0/326471165 >> 10.20.193.162:0/326471165 conn(0x7ff558058810 msgr2=0x7ff558058c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:23.862 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.854+0000 7ff55df99640 1 -- 10.20.193.162:0/326471165 shutdown_connections 2026-02-24T19:17:23.862 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.854+0000 7ff55df99640 1 -- 10.20.193.162:0/326471165 wait complete. 2026-02-24T19:17:23.863 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.854+0000 7ff55df99640 10 monclient: build_initial_monmap 2026-02-24T19:17:23.863 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.854+0000 7ff55df99640 10 monclient: monmap: 2026-02-24T19:17:23.863 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:23.863 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:23.863 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-24T19:17:23.863 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-24T19:17:23.863 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:23.863 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-24T19:17:23.863 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:23.863 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:23.863 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:23.863 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:23.863 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.854+0000 7ff55df99640 1 librados: starting msgr at 2026-02-24T19:17:23.864 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.854+0000 7ff55df99640 1 librados: starting objecter 2026-02-24T19:17:23.864 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.855+0000 7ff55df99640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:23.864 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.855+0000 7ff55df99640 1 Processor -- start 2026-02-24T19:17:23.864 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.855+0000 7ff55df99640 1 -- start start 2026-02-24T19:17:23.864 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.855+0000 7ff55df99640 1 librados: setting wanted keys 2026-02-24T19:17:23.864 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.855+0000 7ff55df99640 1 librados: calling monclient init 2026-02-24T19:17:23.864 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.855+0000 7ff55df99640 10 monclient: init 2026-02-24T19:17:23.864 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.855+0000 7ff55df99640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:23.864 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.855+0000 7ff55df99640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:23.864 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.855+0000 7ff55df99640 10 monclient(hunting): picked mon.noname-c con 0x7ff55811fa30 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:23.864 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.855+0000 7ff55df99640 10 monclient(hunting): picked mon.noname-b con 0x7ff558142940 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:23.864 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.855+0000 7ff55df99640 10 monclient(hunting): picked mon.noname-a con 0x7ff5581644a0 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:23.865 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.855+0000 7ff55df99640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff558127a60 con 0x7ff5581644a0 2026-02-24T19:17:23.865 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.855+0000 7ff55df99640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff55812f8b0 con 0x7ff558142940 2026-02-24T19:17:23.865 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.855+0000 7ff55df99640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff558130ab0 con 0x7ff55811fa30 2026-02-24T19:17:23.865 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.855+0000 7ff55df99640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:23.865 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.855+0000 7ff55df99640 10 monclient(hunting): authenticate will time out at 3619.490245s 2026-02-24T19:17:23.865 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.855+0000 7ff557fff640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7ff5581644a0 0x7ff558163d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.162:49674/0 (socket says 10.20.193.162:49674) 2026-02-24T19:17:23.865 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.855+0000 7ff557fff640 1 -- 10.20.193.162:0/2231635467 learned_addr learned my addr 10.20.193.162:0/2231635467 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:23.865 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.855+0000 7ff533fff640 10 client.?.objecter ms_handle_connect 0x7ff5581644a0 2026-02-24T19:17:23.865 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.856+0000 7ff533fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:23.868 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.857+0000 7ff533fff640 1 -- 10.20.193.162:0/2231635467 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 196516384 0 0) 0x7ff558127a60 con 0x7ff5581644a0 2026-02-24T19:17:23.868 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.857+0000 7ff533fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:23.868 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.857+0000 7ff533fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:23.868 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.857+0000 7ff533fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:23.868 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.857+0000 7ff533fff640 10 monclient(hunting): my global_id is 4125 2026-02-24T19:17:23.869 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.857+0000 7ff533fff640 1 -- 10.20.193.162:0/2231635467 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff528003610 con 0x7ff5581644a0 2026-02-24T19:17:23.869 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.859+0000 7ff533fff640 1 -- 10.20.193.162:0/2231635467 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2130373719 0 0) 0x7ff528003610 con 0x7ff5581644a0 2026-02-24T19:17:23.869 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.859+0000 7ff533fff640 1 -- 10.20.193.162:0/2231635467 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff558127a60 con 0x7ff5581644a0 2026-02-24T19:17:23.869 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.859+0000 7ff533fff640 1 -- 10.20.193.162:0/2231635467 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ff54c003430 con 0x7ff5581644a0 2026-02-24T19:17:23.869 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.859+0000 7ff533fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:23.869 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.859+0000 7ff533fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:23.869 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.859+0000 7ff533fff640 10 monclient(hunting): dump: 2026-02-24T19:17:23.869 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:23.869 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:23.869 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:23.869 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:23.869 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:23.870 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:23.870 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:23.870 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:23.870 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:23.870 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:23.870 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.859+0000 7ff533fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:23.870 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.861+0000 7ff533fff640 1 -- 10.20.193.162:0/2231635467 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3576010691 0 0) 0x7ff558127a60 con 0x7ff5581644a0 2026-02-24T19:17:23.870 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.861+0000 7ff533fff640 1 -- 10.20.193.162:0/2231635467 >> v1:10.20.193.103:6789/0 conn(0x7ff55811fa30 legacy=0x7ff558184950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:23.870 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.861+0000 7ff533fff640 1 -- 10.20.193.162:0/2231635467 >> v1:10.20.193.70:6789/0 conn(0x7ff558142940 legacy=0x7ff558127050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:23.870 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.861+0000 7ff533fff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:23.870 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.861+0000 7ff533fff640 1 monclient: found mon.a 2026-02-24T19:17:23.870 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.861+0000 7ff533fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:23.871 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.861+0000 7ff533fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:23.871 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.861+0000 7ff533fff640 1 -- 10.20.193.162:0/2231635467 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff558131d50 con 0x7ff5581644a0 2026-02-24T19:17:23.871 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.861+0000 7ff533fff640 10 monclient: _finish_auth 0 2026-02-24T19:17:23.871 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.861+0000 7ff533fff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:23.871 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.861+0000 7ff533fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:23.871 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.861+0000 7ff55df99640 5 monclient: authenticate success, global_id 4125 2026-02-24T19:17:23.871 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.861+0000 7ff55df99640 10 monclient: _renew_subs 2026-02-24T19:17:23.871 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.861+0000 7ff55df99640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:23.871 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.861+0000 7ff55df99640 1 -- 10.20.193.162:0/2231635467 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff558130ce0 con 0x7ff5581644a0 2026-02-24T19:17:23.871 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.861+0000 7ff55df99640 10 client.4125.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:23.871 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.861+0000 7ff55df99640 10 monclient: _renew_subs 2026-02-24T19:17:23.871 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.861+0000 7ff55df99640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:23.871 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.861+0000 7ff55df99640 1 -- 10.20.193.162:0/2231635467 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff5581312a0 con 0x7ff5581644a0 2026-02-24T19:17:23.872 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.861+0000 7ff55df99640 1 librados: init done 2026-02-24T19:17:23.872 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.861+0000 7ff55df99640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:23.872 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.861+0000 7ff55df99640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:23.872 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.861+0000 7ff55df99640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:23.872 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.861+0000 7ff55df99640 1 -- 10.20.193.162:0/2231635467 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff558188d20 con 0x7ff5581644a0 2026-02-24T19:17:23.872 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.863+0000 7ff533fff640 1 -- 10.20.193.162:0/2231635467 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff54c004c50 con 0x7ff5581644a0 2026-02-24T19:17:23.872 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.863+0000 7ff533fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:23.872 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.863+0000 7ff533fff640 1 -- 10.20.193.162:0/2231635467 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ff54c004fa0 con 0x7ff5581644a0 2026-02-24T19:17:23.872 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.863+0000 7ff533fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:23.872 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.863+0000 7ff533fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:23.872 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.863+0000 7ff533fff640 10 monclient: dump: 2026-02-24T19:17:23.872 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:23.872 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:23.873 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:23.873 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:23.873 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:23.873 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:23.873 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:23.873 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:23.873 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:23.873 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:23.873 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.863+0000 7ff555ffb640 4 set_mon_vals no callback set 2026-02-24T19:17:23.873 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.863+0000 7ff533fff640 1 -- 10.20.193.162:0/2231635467 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7ff54c005550 con 0x7ff5581644a0 2026-02-24T19:17:23.873 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.863+0000 7ff533fff640 1 -- 10.20.193.162:0/2231635467 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 720+0+0 (unknown 566961494 0 0) 0x7ff54c006ef0 con 0x7ff5581644a0 2026-02-24T19:17:23.873 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.863+0000 7ff533fff640 10 client.4125.objecter ms_dispatch2 0x7ff558000b90 osd_map(2..2 src has 1..2) 2026-02-24T19:17:23.873 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.863+0000 7ff533fff640 3 client.4125.objecter handle_osd_map got epochs [2,2] > 0 2026-02-24T19:17:23.874 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.863+0000 7ff533fff640 3 client.4125.objecter handle_osd_map decoding full epoch 2 2026-02-24T19:17:23.874 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.863+0000 7ff533fff640 20 client.4125.objecter dump_active .. 0 homeless 2026-02-24T19:17:23.894 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.893+0000 7ff533fff640 1 -- 10.20.193.162:0/2231635467 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7ff54c007360 con 0x7ff5581644a0 2026-02-24T19:17:23.894 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.893+0000 7ff533fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:23.894 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.893+0000 7ff533fff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:23.927 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.926+0000 7ff55df99640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "e08ffdb8-0db6-4356-88b5-54397e40be58", "id": 0}] 2026-02-24T19:17:23.927 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.926+0000 7ff55df99640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "e08ffdb8-0db6-4356-88b5-54397e40be58", "id": 0}] 2026-02-24T19:17:23.927 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.926+0000 7ff55df99640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:23.928 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.926+0000 7ff55df99640 1 -- 10.20.193.162:0/2231635467 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "osd new", "uuid": "e08ffdb8-0db6-4356-88b5-54397e40be58", "id": 0} v 0) -- 0x7ff558131590 con 0x7ff5581644a0 2026-02-24T19:17:23.983 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.982+0000 7ff533fff640 1 -- 10.20.193.162:0/2231635467 <== mon.0 v1:10.20.193.26:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e08ffdb8-0db6-4356-88b5-54397e40be58", "id": 0}]=0 v3) ==== 112+0+2 (unknown 259634875 0 732707515) 0x7ff54c007670 con 0x7ff5581644a0 2026-02-24T19:17:23.983 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.982+0000 7ff533fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "e08ffdb8-0db6-4356-88b5-54397e40be58", "id": 0}] 2026-02-24T19:17:23.983 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.982+0000 7ff533fff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:23.984 INFO:teuthology.orchestra.run.trial162.stdout:0 2026-02-24T19:17:23.985 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.983+0000 7ff55df99640 10 librados: watch_flush enter 2026-02-24T19:17:23.985 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.983+0000 7ff55df99640 10 librados: watch_flush exit 2026-02-24T19:17:23.985 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.983+0000 7ff55df99640 20 client.4125.objecter shutdown clearing up homeless session... 2026-02-24T19:17:23.985 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.983+0000 7ff55df99640 10 client.4125.objecter successfully canceled tick 2026-02-24T19:17:23.985 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.983+0000 7ff55df99640 10 monclient: shutdown 2026-02-24T19:17:23.985 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.983+0000 7ff55df99640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:23.985 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.983+0000 7ff55df99640 1 -- 10.20.193.162:0/2231635467 >> v1:10.20.193.26:6789/0 conn(0x7ff5581644a0 legacy=0x7ff558163d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:23.985 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.983+0000 7ff55df99640 1 -- 10.20.193.162:0/2231635467 shutdown_connections 2026-02-24T19:17:23.985 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.983+0000 7ff55df99640 1 -- 10.20.193.162:0/2231635467 >> 10.20.193.162:0/2231635467 conn(0x7ff558058810 msgr2=0x7ff5581861c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:23.985 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.983+0000 7ff55df99640 1 -- 10.20.193.162:0/2231635467 shutdown_connections 2026-02-24T19:17:23.986 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.983+0000 7ff55df99640 1 -- 10.20.193.162:0/2231635467 wait complete. 2026-02-24T19:17:23.986 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:23.983+0000 7ff55df99640 1 librados: shutdown 2026-02-24T19:17:23.993 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new 08b117f7-0152-42bb-8a51-220b41a964ee 1 2026-02-24T19:17:24.059 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.058+0000 7fae5f9e3640 10 monclient: get_monmap_and_config 2026-02-24T19:17:24.059 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.058+0000 7fae5f9e3640 10 monclient: build_initial_monmap 2026-02-24T19:17:24.059 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.058+0000 7fae5f9e3640 10 monclient: monmap: 2026-02-24T19:17:24.059 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:24.059 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:24.059 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:17:24.058609+0000 2026-02-24T19:17:24.059 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:17:24.058609+0000 2026-02-24T19:17:24.059 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:24.060 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:24.060 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:24.060 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:24.060 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:24.060 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:24.062 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.058+0000 7fae5f9e3640 1 Processor -- start 2026-02-24T19:17:24.062 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.058+0000 7fae5f9e3640 1 -- start start 2026-02-24T19:17:24.062 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.058+0000 7fae5f9e3640 10 monclient: init 2026-02-24T19:17:24.062 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.058+0000 7fae5f9e3640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:24.063 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.058+0000 7fae5f9e3640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:24.063 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.058+0000 7fae5f9e3640 10 monclient(hunting): picked mon.noname-b con 0x7fae58121d90 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:24.063 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.058+0000 7fae5f9e3640 10 monclient(hunting): picked mon.noname-a con 0x7fae58142a00 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:24.063 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.058+0000 7fae5f9e3640 10 monclient(hunting): picked mon.noname-c con 0x7fae58164710 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:24.063 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.058+0000 7fae5f9e3640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae581864c0 con 0x7fae58142a00 2026-02-24T19:17:24.063 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.058+0000 7fae5f9e3640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae581876c0 con 0x7fae58121d90 2026-02-24T19:17:24.063 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.058+0000 7fae5f9e3640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae581888c0 con 0x7fae58164710 2026-02-24T19:17:24.063 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.058+0000 7fae5f9e3640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:24.063 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.058+0000 7fae5f9e3640 10 monclient(hunting): authenticate will time out at 3619.693861s 2026-02-24T19:17:24.063 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.059+0000 7fae5df59640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fae58164710 0x7fae58184bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.162:37276/0 (socket says 10.20.193.162:37276) 2026-02-24T19:17:24.063 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.059+0000 7fae5df59640 1 -- 10.20.193.162:0/209860879 learned_addr learned my addr 10.20.193.162:0/209860879 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:24.063 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.060+0000 7fae47fff640 1 -- 10.20.193.162:0/209860879 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2841532568 0 0) 0x7fae581876c0 con 0x7fae58121d90 2026-02-24T19:17:24.064 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.060+0000 7fae47fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:24.064 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.060+0000 7fae47fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:24.064 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.060+0000 7fae47fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:24.064 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.060+0000 7fae47fff640 10 monclient(hunting): my global_id is 4117 2026-02-24T19:17:24.064 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.060+0000 7fae47fff640 1 -- 10.20.193.162:0/209860879 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae40003610 con 0x7fae58121d90 2026-02-24T19:17:24.064 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.060+0000 7fae47fff640 1 -- 10.20.193.162:0/209860879 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4155946801 0 0) 0x7fae581888c0 con 0x7fae58164710 2026-02-24T19:17:24.064 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.060+0000 7fae47fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:24.064 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.060+0000 7fae47fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:24.064 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.060+0000 7fae47fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:24.064 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.060+0000 7fae47fff640 10 monclient(hunting): my global_id is 4118 2026-02-24T19:17:24.064 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.060+0000 7fae47fff640 1 -- 10.20.193.162:0/209860879 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae581876c0 con 0x7fae58164710 2026-02-24T19:17:24.064 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.060+0000 7fae47fff640 1 -- 10.20.193.162:0/209860879 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2321622840 0 0) 0x7fae581864c0 con 0x7fae58142a00 2026-02-24T19:17:24.065 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.060+0000 7fae47fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:24.065 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.060+0000 7fae47fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:24.065 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.060+0000 7fae47fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:24.065 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.060+0000 7fae47fff640 10 monclient(hunting): my global_id is 4128 2026-02-24T19:17:24.065 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.060+0000 7fae47fff640 1 -- 10.20.193.162:0/209860879 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae581888c0 con 0x7fae58142a00 2026-02-24T19:17:24.069 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.062+0000 7fae47fff640 1 -- 10.20.193.162:0/209860879 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4095426343 0 0) 0x7fae581888c0 con 0x7fae58142a00 2026-02-24T19:17:24.069 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.062+0000 7fae47fff640 1 -- 10.20.193.162:0/209860879 >> v1:10.20.193.103:6789/0 conn(0x7fae58164710 legacy=0x7fae58184bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:24.069 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.062+0000 7fae47fff640 1 -- 10.20.193.162:0/209860879 >> v1:10.20.193.70:6789/0 conn(0x7fae58121d90 legacy=0x7fae58122160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:24.069 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.062+0000 7fae47fff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:24.069 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.062+0000 7fae47fff640 1 monclient: found mon.noname-a 2026-02-24T19:17:24.070 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.062+0000 7fae47fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:24.070 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.062+0000 7fae47fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:17:24.070 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.062+0000 7fae47fff640 1 -- 10.20.193.162:0/209860879 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae58189b60 con 0x7fae58142a00 2026-02-24T19:17:24.070 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.062+0000 7fae47fff640 10 monclient: _finish_auth 0 2026-02-24T19:17:24.070 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.062+0000 7fae47fff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:24.070 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.062+0000 7fae47fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:24.070 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.062+0000 7fae47fff640 1 -- 10.20.193.162:0/209860879 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fae4c002d50 con 0x7fae58142a00 2026-02-24T19:17:24.070 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.062+0000 7fae47fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:24.070 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.062+0000 7fae47fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:24.070 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.062+0000 7fae47fff640 10 monclient: dump: 2026-02-24T19:17:24.070 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:24.070 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:24.071 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.071 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.071 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:24.071 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:24.071 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:24.071 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:24.071 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:24.071 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:24.071 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.062+0000 7fae5f9e3640 5 monclient: authenticate success, global_id 4128 2026-02-24T19:17:24.071 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.062+0000 7fae5f9e3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:24.071 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.063+0000 7fae47fff640 1 -- 10.20.193.162:0/209860879 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fae4c002f90 con 0x7fae58142a00 2026-02-24T19:17:24.071 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.063+0000 7fae47fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:24.072 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.063+0000 7fae47fff640 1 -- 10.20.193.162:0/209860879 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fae4c0033d0 con 0x7fae58142a00 2026-02-24T19:17:24.072 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.063+0000 7fae47fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:24.072 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.063+0000 7fae47fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:24.072 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.063+0000 7fae47fff640 10 monclient: dump: 2026-02-24T19:17:24.072 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:24.072 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:24.072 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.072 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.072 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:24.072 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:24.072 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:24.072 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:24.073 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:24.073 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:24.073 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.063+0000 7fae5f9e3640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:24.073 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.063+0000 7fae5f9e3640 4 set_mon_vals no callback set 2026-02-24T19:17:24.073 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.063+0000 7fae5f9e3640 10 monclient: shutdown 2026-02-24T19:17:24.073 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.063+0000 7fae5f9e3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:24.073 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.063+0000 7fae5f9e3640 1 -- 10.20.193.162:0/209860879 >> v1:10.20.193.26:6789/0 conn(0x7fae58142a00 legacy=0x7fae58162e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:24.073 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.063+0000 7fae5f9e3640 1 -- 10.20.193.162:0/209860879 shutdown_connections 2026-02-24T19:17:24.073 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.063+0000 7fae5f9e3640 1 -- 10.20.193.162:0/209860879 >> 10.20.193.162:0/209860879 conn(0x7fae58057490 msgr2=0x7fae58057890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:24.073 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.063+0000 7fae5f9e3640 1 -- 10.20.193.162:0/209860879 shutdown_connections 2026-02-24T19:17:24.073 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.063+0000 7fae5f9e3640 1 -- 10.20.193.162:0/209860879 wait complete. 2026-02-24T19:17:24.073 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.064+0000 7fae5f9e3640 10 monclient: build_initial_monmap 2026-02-24T19:17:24.073 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.064+0000 7fae5f9e3640 10 monclient: monmap: 2026-02-24T19:17:24.074 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:24.074 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:24.074 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-24T19:17:24.074 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-24T19:17:24.074 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:24.074 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-24T19:17:24.074 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:24.074 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:24.074 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:24.074 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:24.074 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.064+0000 7fae5f9e3640 1 librados: starting msgr at 2026-02-24T19:17:24.074 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.064+0000 7fae5f9e3640 1 librados: starting objecter 2026-02-24T19:17:24.075 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.064+0000 7fae5f9e3640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:24.075 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.064+0000 7fae5f9e3640 1 Processor -- start 2026-02-24T19:17:24.075 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.064+0000 7fae5f9e3640 1 -- start start 2026-02-24T19:17:24.075 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.064+0000 7fae5f9e3640 1 librados: setting wanted keys 2026-02-24T19:17:24.075 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.064+0000 7fae5f9e3640 1 librados: calling monclient init 2026-02-24T19:17:24.075 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.064+0000 7fae5f9e3640 10 monclient: init 2026-02-24T19:17:24.075 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.064+0000 7fae5f9e3640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:24.075 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.064+0000 7fae5f9e3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:24.075 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.064+0000 7fae5f9e3640 10 monclient(hunting): picked mon.noname-a con 0x7fae58121d90 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:24.075 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.064+0000 7fae5f9e3640 10 monclient(hunting): picked mon.noname-c con 0x7fae58142a00 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:24.075 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.064+0000 7fae5f9e3640 10 monclient(hunting): picked mon.noname-b con 0x7fae58164710 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:24.075 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.064+0000 7fae5f9e3640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae5811c8e0 con 0x7fae58121d90 2026-02-24T19:17:24.076 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.064+0000 7fae5f9e3640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae5811cab0 con 0x7fae58164710 2026-02-24T19:17:24.076 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.064+0000 7fae5f9e3640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae5811cc80 con 0x7fae58142a00 2026-02-24T19:17:24.076 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.064+0000 7fae5f9e3640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:24.076 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.064+0000 7fae5f9e3640 10 monclient(hunting): authenticate will time out at 3619.699482s 2026-02-24T19:17:24.076 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.064+0000 7fae5df59640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7fae58164710 0x7fae5811c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.162:45082/0 (socket says 10.20.193.162:45082) 2026-02-24T19:17:24.076 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.064+0000 7fae5df59640 1 -- 10.20.193.162:0/2323326771 learned_addr learned my addr 10.20.193.162:0/2323326771 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:24.076 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.065+0000 7fae45ffb640 10 client.?.objecter ms_handle_connect 0x7fae58164710 2026-02-24T19:17:24.076 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.065+0000 7fae45ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:24.076 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.065+0000 7fae45ffb640 10 client.?.objecter ms_handle_connect 0x7fae58121d90 2026-02-24T19:17:24.076 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.065+0000 7fae45ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:24.076 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.066+0000 7fae45ffb640 10 client.?.objecter ms_handle_connect 0x7fae58142a00 2026-02-24T19:17:24.076 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.066+0000 7fae45ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:24.076 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.066+0000 7fae45ffb640 1 -- 10.20.193.162:0/2323326771 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3180296516 0 0) 0x7fae5811cab0 con 0x7fae58164710 2026-02-24T19:17:24.077 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.066+0000 7fae45ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:24.077 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.066+0000 7fae45ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:24.077 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.066+0000 7fae45ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:24.077 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.066+0000 7fae45ffb640 10 monclient(hunting): my global_id is 4120 2026-02-24T19:17:24.077 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.066+0000 7fae45ffb640 1 -- 10.20.193.162:0/2323326771 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae28003610 con 0x7fae58164710 2026-02-24T19:17:24.077 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.066+0000 7fae45ffb640 1 -- 10.20.193.162:0/2323326771 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1461752081 0 0) 0x7fae5811c8e0 con 0x7fae58121d90 2026-02-24T19:17:24.077 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.066+0000 7fae45ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:24.077 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.066+0000 7fae45ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:24.077 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.066+0000 7fae45ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:24.077 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.066+0000 7fae45ffb640 10 monclient(hunting): my global_id is 4131 2026-02-24T19:17:24.077 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.066+0000 7fae45ffb640 1 -- 10.20.193.162:0/2323326771 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae5811cab0 con 0x7fae58121d90 2026-02-24T19:17:24.077 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.067+0000 7fae45ffb640 1 -- 10.20.193.162:0/2323326771 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2857911669 0 0) 0x7fae5811cc80 con 0x7fae58142a00 2026-02-24T19:17:24.077 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.067+0000 7fae45ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:24.078 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.067+0000 7fae45ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:24.078 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.067+0000 7fae45ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:24.078 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.067+0000 7fae45ffb640 10 monclient(hunting): my global_id is 4121 2026-02-24T19:17:24.078 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.067+0000 7fae45ffb640 1 -- 10.20.193.162:0/2323326771 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae5811c8e0 con 0x7fae58142a00 2026-02-24T19:17:24.081 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.069+0000 7fae45ffb640 1 -- 10.20.193.162:0/2323326771 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3539152800 0 0) 0x7fae5811cab0 con 0x7fae58121d90 2026-02-24T19:17:24.081 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.069+0000 7fae45ffb640 1 -- 10.20.193.162:0/2323326771 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae5811cc80 con 0x7fae58121d90 2026-02-24T19:17:24.081 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.069+0000 7fae45ffb640 1 -- 10.20.193.162:0/2323326771 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fae48003070 con 0x7fae58121d90 2026-02-24T19:17:24.081 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.069+0000 7fae45ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:24.081 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.069+0000 7fae45ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:24.081 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.069+0000 7fae45ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:24.081 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:24.082 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:24.082 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.082 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.082 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:24.082 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:24.082 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:24.082 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:24.082 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:24.082 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:24.082 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.069+0000 7fae45ffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:24.082 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.071+0000 7fae45ffb640 1 -- 10.20.193.162:0/2323326771 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 245167879 0 0) 0x7fae5811cc80 con 0x7fae58121d90 2026-02-24T19:17:24.082 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.071+0000 7fae45ffb640 1 -- 10.20.193.162:0/2323326771 >> v1:10.20.193.103:6789/0 conn(0x7fae58142a00 legacy=0x7fae581485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:24.083 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.071+0000 7fae45ffb640 1 -- 10.20.193.162:0/2323326771 >> v1:10.20.193.70:6789/0 conn(0x7fae58164710 legacy=0x7fae5811c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:24.083 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.071+0000 7fae45ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:24.083 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.071+0000 7fae45ffb640 1 monclient: found mon.a 2026-02-24T19:17:24.083 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.071+0000 7fae45ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:24.083 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.071+0000 7fae45ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:24.083 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.071+0000 7fae45ffb640 1 -- 10.20.193.162:0/2323326771 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae5811ce50 con 0x7fae58121d90 2026-02-24T19:17:24.083 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.071+0000 7fae45ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:24.083 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.071+0000 7fae45ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:24.083 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.071+0000 7fae45ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:24.083 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.071+0000 7fae5f9e3640 5 monclient: authenticate success, global_id 4131 2026-02-24T19:17:24.083 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.071+0000 7fae5f9e3640 10 monclient: _renew_subs 2026-02-24T19:17:24.083 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.071+0000 7fae5f9e3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:24.083 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.071+0000 7fae5f9e3640 1 -- 10.20.193.162:0/2323326771 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fae5814fda0 con 0x7fae58121d90 2026-02-24T19:17:24.084 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.071+0000 7fae5f9e3640 10 client.4131.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:24.084 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.071+0000 7fae5f9e3640 10 monclient: _renew_subs 2026-02-24T19:17:24.084 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.071+0000 7fae5f9e3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:24.084 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.071+0000 7fae5f9e3640 1 -- 10.20.193.162:0/2323326771 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fae581503e0 con 0x7fae58121d90 2026-02-24T19:17:24.084 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.071+0000 7fae5f9e3640 1 librados: init done 2026-02-24T19:17:24.084 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.071+0000 7fae5f9e3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:24.084 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.071+0000 7fae5f9e3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:24.084 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.071+0000 7fae5f9e3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:24.084 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.071+0000 7fae5f9e3640 1 -- 10.20.193.162:0/2323326771 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae581869e0 con 0x7fae58121d90 2026-02-24T19:17:24.084 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.073+0000 7fae45ffb640 1 -- 10.20.193.162:0/2323326771 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fae48003700 con 0x7fae58121d90 2026-02-24T19:17:24.084 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.073+0000 7fae45ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:24.084 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.073+0000 7fae45ffb640 1 -- 10.20.193.162:0/2323326771 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fae48003a50 con 0x7fae58121d90 2026-02-24T19:17:24.085 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.073+0000 7fae45ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:24.085 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.073+0000 7fae45ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:24.085 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.073+0000 7fae45ffb640 10 monclient: dump: 2026-02-24T19:17:24.085 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:24.085 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:24.085 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.085 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.085 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:24.085 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:24.085 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:24.085 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:24.085 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:24.085 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:24.086 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.073+0000 7fae477fe640 4 set_mon_vals no callback set 2026-02-24T19:17:24.086 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.073+0000 7fae45ffb640 1 -- 10.20.193.162:0/2323326771 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fae48004000 con 0x7fae58121d90 2026-02-24T19:17:24.086 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.073+0000 7fae45ffb640 1 -- 10.20.193.162:0/2323326771 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 835+0+0 (unknown 2496107050 0 0) 0x7fae48005940 con 0x7fae58121d90 2026-02-24T19:17:24.086 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.073+0000 7fae45ffb640 10 client.4131.objecter ms_dispatch2 0x7fae58000b90 osd_map(3..3 src has 1..3) 2026-02-24T19:17:24.086 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.073+0000 7fae45ffb640 3 client.4131.objecter handle_osd_map got epochs [3,3] > 0 2026-02-24T19:17:24.086 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.073+0000 7fae45ffb640 3 client.4131.objecter handle_osd_map decoding full epoch 3 2026-02-24T19:17:24.086 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.073+0000 7fae45ffb640 20 client.4131.objecter dump_active .. 0 homeless 2026-02-24T19:17:24.103 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.102+0000 7fae45ffb640 1 -- 10.20.193.162:0/2323326771 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7fae48004320 con 0x7fae58121d90 2026-02-24T19:17:24.103 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.102+0000 7fae45ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:24.103 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.102+0000 7fae45ffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:24.136 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.135+0000 7fae5f9e3640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "08b117f7-0152-42bb-8a51-220b41a964ee", "id": 1}] 2026-02-24T19:17:24.136 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.135+0000 7fae5f9e3640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "08b117f7-0152-42bb-8a51-220b41a964ee", "id": 1}] 2026-02-24T19:17:24.136 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.135+0000 7fae5f9e3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:24.136 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.135+0000 7fae5f9e3640 1 -- 10.20.193.162:0/2323326771 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "osd new", "uuid": "08b117f7-0152-42bb-8a51-220b41a964ee", "id": 1} v 0) -- 0x7fae58186be0 con 0x7fae58121d90 2026-02-24T19:17:24.160 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.159+0000 7fae45ffb640 1 -- 10.20.193.162:0/2323326771 <== mon.0 v1:10.20.193.26:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "08b117f7-0152-42bb-8a51-220b41a964ee", "id": 1}]=0 v4) ==== 112+0+2 (unknown 1495436380 0 940483276) 0x7fae48004650 con 0x7fae58121d90 2026-02-24T19:17:24.160 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.159+0000 7fae45ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "08b117f7-0152-42bb-8a51-220b41a964ee", "id": 1}] 2026-02-24T19:17:24.160 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.159+0000 7fae45ffb640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:24.161 INFO:teuthology.orchestra.run.trial162.stdout:1 2026-02-24T19:17:24.162 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.160+0000 7fae5f9e3640 10 librados: watch_flush enter 2026-02-24T19:17:24.162 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.160+0000 7fae5f9e3640 10 librados: watch_flush exit 2026-02-24T19:17:24.162 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.160+0000 7fae5f9e3640 20 client.4131.objecter shutdown clearing up homeless session... 2026-02-24T19:17:24.162 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.160+0000 7fae5f9e3640 10 client.4131.objecter successfully canceled tick 2026-02-24T19:17:24.162 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.160+0000 7fae5f9e3640 10 monclient: shutdown 2026-02-24T19:17:24.162 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.160+0000 7fae5f9e3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:24.162 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.160+0000 7fae5f9e3640 1 -- 10.20.193.162:0/2323326771 >> v1:10.20.193.26:6789/0 conn(0x7fae58121d90 legacy=0x7fae58184bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:24.163 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.160+0000 7fae5f9e3640 1 -- 10.20.193.162:0/2323326771 shutdown_connections 2026-02-24T19:17:24.163 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.160+0000 7fae5f9e3640 1 -- 10.20.193.162:0/2323326771 >> 10.20.193.162:0/2323326771 conn(0x7fae58057490 msgr2=0x7fae581888c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:24.163 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.160+0000 7fae5f9e3640 1 -- 10.20.193.162:0/2323326771 shutdown_connections 2026-02-24T19:17:24.163 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.160+0000 7fae5f9e3640 1 -- 10.20.193.162:0/2323326771 wait complete. 2026-02-24T19:17:24.163 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.160+0000 7fae5f9e3640 1 librados: shutdown 2026-02-24T19:17:24.169 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new 3c37f6aa-25cb-43be-a75a-86a246086a85 2 2026-02-24T19:17:24.236 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.235+0000 7f3adac93640 10 monclient: get_monmap_and_config 2026-02-24T19:17:24.236 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.235+0000 7f3adac93640 10 monclient: build_initial_monmap 2026-02-24T19:17:24.236 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.235+0000 7f3adac93640 10 monclient: monmap: 2026-02-24T19:17:24.236 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:24.236 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:24.236 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:17:24.235565+0000 2026-02-24T19:17:24.236 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:17:24.235565+0000 2026-02-24T19:17:24.236 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:24.236 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:24.236 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:24.237 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:24.237 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:24.237 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:24.238 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.235+0000 7f3adac93640 1 Processor -- start 2026-02-24T19:17:24.239 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.235+0000 7f3adac93640 1 -- start start 2026-02-24T19:17:24.239 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.235+0000 7f3adac93640 10 monclient: init 2026-02-24T19:17:24.239 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.235+0000 7f3adac93640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:24.239 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.235+0000 7f3adac93640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:24.239 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.235+0000 7f3adac93640 10 monclient(hunting): picked mon.noname-a con 0x7f3ad411d7e0 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:24.239 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.235+0000 7f3adac93640 10 monclient(hunting): picked mon.noname-b con 0x7f3ad41406f0 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:24.239 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.235+0000 7f3adac93640 10 monclient(hunting): picked mon.noname-c con 0x7f3ad4162280 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:24.239 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.236+0000 7f3adac93640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ad4184030 con 0x7f3ad411d7e0 2026-02-24T19:17:24.239 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.236+0000 7f3adac93640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ad4185230 con 0x7f3ad41406f0 2026-02-24T19:17:24.239 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.236+0000 7f3adac93640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ad4186430 con 0x7f3ad4162280 2026-02-24T19:17:24.239 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.236+0000 7f3adac93640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:24.240 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.236+0000 7f3adac93640 10 monclient(hunting): authenticate will time out at 3619.871050s 2026-02-24T19:17:24.240 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.236+0000 7f3ad8a08640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f3ad411d7e0 0x7f3ad411dbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.162:49712/0 (socket says 10.20.193.162:49712) 2026-02-24T19:17:24.240 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.236+0000 7f3ad8a08640 1 -- 10.20.193.162:0/1550275633 learned_addr learned my addr 10.20.193.162:0/1550275633 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:24.240 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.238+0000 7f3acb7fe640 1 -- 10.20.193.162:0/1550275633 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2048957027 0 0) 0x7f3ad4184030 con 0x7f3ad411d7e0 2026-02-24T19:17:24.240 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.238+0000 7f3acb7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:24.240 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.238+0000 7f3acb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:24.240 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.238+0000 7f3acb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:24.240 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.238+0000 7f3acb7fe640 10 monclient(hunting): my global_id is 4134 2026-02-24T19:17:24.240 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.238+0000 7f3acb7fe640 1 -- 10.20.193.162:0/1550275633 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ac0003610 con 0x7f3ad411d7e0 2026-02-24T19:17:24.241 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.240+0000 7f3acb7fe640 1 -- 10.20.193.162:0/1550275633 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1136518390 0 0) 0x7f3ac0003610 con 0x7f3ad411d7e0 2026-02-24T19:17:24.241 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.240+0000 7f3acb7fe640 1 -- 10.20.193.162:0/1550275633 >> v1:10.20.193.103:6789/0 conn(0x7f3ad4162280 legacy=0x7f3ad4182730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:24.241 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.240+0000 7f3acb7fe640 1 -- 10.20.193.162:0/1550275633 >> v1:10.20.193.70:6789/0 conn(0x7f3ad41406f0 legacy=0x7f3ad4160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:24.242 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.240+0000 7f3acb7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:24.242 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.240+0000 7f3acb7fe640 1 monclient: found mon.noname-a 2026-02-24T19:17:24.242 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.240+0000 7f3acb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:24.242 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.240+0000 7f3acb7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:17:24.242 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.240+0000 7f3acb7fe640 1 -- 10.20.193.162:0/1550275633 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad41876d0 con 0x7f3ad411d7e0 2026-02-24T19:17:24.242 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.240+0000 7f3acb7fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:24.242 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.240+0000 7f3acb7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:24.242 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.240+0000 7f3acb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:24.242 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.240+0000 7f3acb7fe640 1 -- 10.20.193.162:0/1550275633 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f3ac4002df0 con 0x7f3ad411d7e0 2026-02-24T19:17:24.242 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.240+0000 7f3acb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:24.242 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.240+0000 7f3acb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:24.242 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.240+0000 7f3acb7fe640 10 monclient: dump: 2026-02-24T19:17:24.242 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:24.243 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:24.243 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.243 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.243 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:24.243 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:24.243 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:24.243 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:24.243 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:24.243 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:24.243 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.240+0000 7f3adac93640 5 monclient: authenticate success, global_id 4134 2026-02-24T19:17:24.243 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.240+0000 7f3adac93640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:24.245 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.244+0000 7f3acb7fe640 1 -- 10.20.193.162:0/1550275633 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3ac4003070 con 0x7f3ad411d7e0 2026-02-24T19:17:24.245 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.244+0000 7f3acb7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:24.246 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.244+0000 7f3acb7fe640 1 -- 10.20.193.162:0/1550275633 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f3ac40034b0 con 0x7f3ad411d7e0 2026-02-24T19:17:24.246 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.244+0000 7f3acb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:24.246 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.244+0000 7f3acb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:24.246 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.244+0000 7f3acb7fe640 10 monclient: dump: 2026-02-24T19:17:24.246 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:24.246 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:24.246 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.246 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.246 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:24.246 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:24.246 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:24.246 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:24.246 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:24.247 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:24.247 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.244+0000 7f3adac93640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:24.247 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.244+0000 7f3adac93640 4 set_mon_vals no callback set 2026-02-24T19:17:24.247 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.244+0000 7f3adac93640 10 monclient: shutdown 2026-02-24T19:17:24.247 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.244+0000 7f3adac93640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:24.247 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.244+0000 7f3adac93640 1 -- 10.20.193.162:0/1550275633 >> v1:10.20.193.26:6789/0 conn(0x7f3ad411d7e0 legacy=0x7f3ad411dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:24.247 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.244+0000 7f3adac93640 1 -- 10.20.193.162:0/1550275633 shutdown_connections 2026-02-24T19:17:24.247 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.244+0000 7f3adac93640 1 -- 10.20.193.162:0/1550275633 >> 10.20.193.162:0/1550275633 conn(0x7f3ad4059960 msgr2=0x7f3ad4059d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:24.247 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.244+0000 7f3adac93640 1 -- 10.20.193.162:0/1550275633 shutdown_connections 2026-02-24T19:17:24.247 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.244+0000 7f3adac93640 1 -- 10.20.193.162:0/1550275633 wait complete. 2026-02-24T19:17:24.249 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.245+0000 7f3adac93640 10 monclient: build_initial_monmap 2026-02-24T19:17:24.250 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.245+0000 7f3adac93640 10 monclient: monmap: 2026-02-24T19:17:24.250 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:24.250 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:24.250 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-24T19:17:24.250 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-24T19:17:24.250 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:24.250 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-24T19:17:24.250 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:24.250 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:24.250 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:24.250 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:24.251 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.245+0000 7f3adac93640 1 librados: starting msgr at 2026-02-24T19:17:24.251 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.245+0000 7f3adac93640 1 librados: starting objecter 2026-02-24T19:17:24.251 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.245+0000 7f3adac93640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:24.251 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.245+0000 7f3adac93640 1 Processor -- start 2026-02-24T19:17:24.251 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.245+0000 7f3adac93640 1 -- start start 2026-02-24T19:17:24.251 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.245+0000 7f3adac93640 1 librados: setting wanted keys 2026-02-24T19:17:24.251 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.245+0000 7f3adac93640 1 librados: calling monclient init 2026-02-24T19:17:24.251 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.245+0000 7f3adac93640 10 monclient: init 2026-02-24T19:17:24.251 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.245+0000 7f3adac93640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:24.251 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.245+0000 7f3adac93640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:24.251 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.245+0000 7f3adac93640 10 monclient(hunting): picked mon.noname-a con 0x7f3ad411d7e0 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:24.251 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.245+0000 7f3adac93640 10 monclient(hunting): picked mon.noname-c con 0x7f3ad41406f0 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:24.252 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.245+0000 7f3adac93640 10 monclient(hunting): picked mon.noname-b con 0x7f3ad4162280 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:24.252 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.245+0000 7f3adac93640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ad412e6e0 con 0x7f3ad411d7e0 2026-02-24T19:17:24.252 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.245+0000 7f3adac93640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ad412f8e0 con 0x7f3ad4162280 2026-02-24T19:17:24.252 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.245+0000 7f3adac93640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ad4130ae0 con 0x7f3ad41406f0 2026-02-24T19:17:24.252 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.245+0000 7f3adac93640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:24.252 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.245+0000 7f3adac93640 10 monclient(hunting): authenticate will time out at 3619.880686s 2026-02-24T19:17:24.252 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.246+0000 7f3acbfff640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f3ad41406f0 0x7f3ad4160ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.162:37306/0 (socket says 10.20.193.162:37306) 2026-02-24T19:17:24.252 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.246+0000 7f3acbfff640 1 -- 10.20.193.162:0/1257565522 learned_addr learned my addr 10.20.193.162:0/1257565522 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:24.252 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.246+0000 7f3ac97fa640 10 client.?.objecter ms_handle_connect 0x7f3ad41406f0 2026-02-24T19:17:24.252 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.246+0000 7f3ac97fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:24.252 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.248+0000 7f3ac97fa640 10 client.?.objecter ms_handle_connect 0x7f3ad411d7e0 2026-02-24T19:17:24.252 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.248+0000 7f3ac97fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:24.253 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.249+0000 7f3ac97fa640 10 client.?.objecter ms_handle_connect 0x7f3ad4162280 2026-02-24T19:17:24.253 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.249+0000 7f3ac97fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:24.261 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.260+0000 7f3ac97fa640 1 -- 10.20.193.162:0/1257565522 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2163519889 0 0) 0x7f3ad412f8e0 con 0x7f3ad4162280 2026-02-24T19:17:24.261 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.260+0000 7f3ac97fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:24.261 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.260+0000 7f3ac97fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:24.261 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.260+0000 7f3ac97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:24.262 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.260+0000 7f3ac97fa640 10 monclient(hunting): my global_id is 4123 2026-02-24T19:17:24.262 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.260+0000 7f3ac97fa640 1 -- 10.20.193.162:0/1257565522 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3aa4003610 con 0x7f3ad4162280 2026-02-24T19:17:24.262 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.262+0000 7f3ac97fa640 1 -- 10.20.193.162:0/1257565522 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3220143209 0 0) 0x7f3ad412e6e0 con 0x7f3ad411d7e0 2026-02-24T19:17:24.263 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.262+0000 7f3ac97fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:24.263 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.262+0000 7f3ac97fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:24.263 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.262+0000 7f3ac97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:24.263 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.262+0000 7f3ac97fa640 10 monclient(hunting): my global_id is 4137 2026-02-24T19:17:24.263 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.262+0000 7f3ac97fa640 1 -- 10.20.193.162:0/1257565522 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ad412f8e0 con 0x7f3ad411d7e0 2026-02-24T19:17:24.264 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.262+0000 7f3ac97fa640 1 -- 10.20.193.162:0/1257565522 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2994142210 0 0) 0x7f3ad4130ae0 con 0x7f3ad41406f0 2026-02-24T19:17:24.264 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.262+0000 7f3ac97fa640 10 monclient(hunting): _negotiate 2026-02-24T19:17:24.264 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.262+0000 7f3ac97fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:24.264 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.262+0000 7f3ac97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:24.265 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.262+0000 7f3ac97fa640 10 monclient(hunting): my global_id is 4124 2026-02-24T19:17:24.265 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.262+0000 7f3ac97fa640 1 -- 10.20.193.162:0/1257565522 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ad412e6e0 con 0x7f3ad41406f0 2026-02-24T19:17:24.265 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.263+0000 7f3ac97fa640 1 -- 10.20.193.162:0/1257565522 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1458575751 0 0) 0x7f3aa4003610 con 0x7f3ad4162280 2026-02-24T19:17:24.265 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.263+0000 7f3ac97fa640 1 -- 10.20.193.162:0/1257565522 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3ad4130ae0 con 0x7f3ad4162280 2026-02-24T19:17:24.265 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.263+0000 7f3ac97fa640 1 -- 10.20.193.162:0/1257565522 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f3ad0003040 con 0x7f3ad4162280 2026-02-24T19:17:24.265 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.263+0000 7f3ac97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:24.265 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.263+0000 7f3ac97fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:24.265 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.263+0000 7f3ac97fa640 10 monclient(hunting): dump: 2026-02-24T19:17:24.265 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:24.265 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:24.265 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.265 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.266 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:24.266 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:24.266 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:24.266 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:24.266 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:24.266 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:24.266 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.263+0000 7f3ac97fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:24.267 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.265+0000 7f3ac97fa640 1 -- 10.20.193.162:0/1257565522 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1177200380 0 0) 0x7f3ad412e6e0 con 0x7f3ad41406f0 2026-02-24T19:17:24.267 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.265+0000 7f3ac97fa640 1 -- 10.20.193.162:0/1257565522 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3aa4003610 con 0x7f3ad41406f0 2026-02-24T19:17:24.267 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.265+0000 7f3ac97fa640 1 -- 10.20.193.162:0/1257565522 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f3abc003190 con 0x7f3ad41406f0 2026-02-24T19:17:24.267 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.265+0000 7f3ac97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:24.267 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.265+0000 7f3ac97fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:24.267 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.265+0000 7f3ac97fa640 10 monclient(hunting): dump: 2026-02-24T19:17:24.268 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:24.268 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:24.268 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.268 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.268 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:24.268 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:24.268 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:24.268 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:24.268 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:24.268 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:24.268 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.265+0000 7f3ac97fa640 1 -- 10.20.193.162:0/1257565522 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3967800297 0 0) 0x7f3ad412f8e0 con 0x7f3ad411d7e0 2026-02-24T19:17:24.268 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.265+0000 7f3ac97fa640 1 -- 10.20.193.162:0/1257565522 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3ad412e6e0 con 0x7f3ad411d7e0 2026-02-24T19:17:24.269 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.265+0000 7f3ac97fa640 1 -- 10.20.193.162:0/1257565522 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f3ac4002d00 con 0x7f3ad411d7e0 2026-02-24T19:17:24.269 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.265+0000 7f3ac97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:24.269 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.265+0000 7f3ac97fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:24.269 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.265+0000 7f3ac97fa640 10 monclient(hunting): dump: 2026-02-24T19:17:24.269 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:24.269 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:24.269 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.269 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.269 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:24.269 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:24.269 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:24.269 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:24.270 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:24.270 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:24.272 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.268+0000 7f3ac97fa640 1 -- 10.20.193.162:0/1257565522 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 294515802 0 0) 0x7f3ad412e6e0 con 0x7f3ad411d7e0 2026-02-24T19:17:24.272 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.268+0000 7f3ac97fa640 1 -- 10.20.193.162:0/1257565522 >> v1:10.20.193.103:6789/0 conn(0x7f3ad41406f0 legacy=0x7f3ad4160ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:24.272 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.268+0000 7f3ac97fa640 1 -- 10.20.193.162:0/1257565522 >> v1:10.20.193.70:6789/0 conn(0x7f3ad4162280 legacy=0x7f3ad412ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:24.272 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.268+0000 7f3ac97fa640 10 monclient: _finish_hunting 0 2026-02-24T19:17:24.272 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.268+0000 7f3ac97fa640 1 monclient: found mon.a 2026-02-24T19:17:24.272 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.268+0000 7f3ac97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:24.273 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.268+0000 7f3ac97fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:24.273 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.268+0000 7f3ac97fa640 1 -- 10.20.193.162:0/1257565522 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad4131d80 con 0x7f3ad411d7e0 2026-02-24T19:17:24.273 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.268+0000 7f3ac97fa640 10 monclient: _finish_auth 0 2026-02-24T19:17:24.273 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.268+0000 7f3ac97fa640 10 monclient: _check_auth_tickets 2026-02-24T19:17:24.273 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.268+0000 7f3ac97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:24.273 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.268+0000 7f3adac93640 5 monclient: authenticate success, global_id 4137 2026-02-24T19:17:24.273 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.268+0000 7f3adac93640 10 monclient: _renew_subs 2026-02-24T19:17:24.273 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.268+0000 7f3adac93640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:24.273 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.268+0000 7f3adac93640 1 -- 10.20.193.162:0/1257565522 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3ad412e910 con 0x7f3ad411d7e0 2026-02-24T19:17:24.273 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.268+0000 7f3adac93640 10 client.4137.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:24.273 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.268+0000 7f3adac93640 10 monclient: _renew_subs 2026-02-24T19:17:24.273 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.268+0000 7f3adac93640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:24.274 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.268+0000 7f3adac93640 1 -- 10.20.193.162:0/1257565522 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3ad412ee80 con 0x7f3ad411d7e0 2026-02-24T19:17:24.274 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.268+0000 7f3adac93640 1 librados: init done 2026-02-24T19:17:24.274 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.268+0000 7f3adac93640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:24.274 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.268+0000 7f3adac93640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:24.274 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.268+0000 7f3adac93640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:24.274 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.268+0000 7f3adac93640 1 -- 10.20.193.162:0/1257565522 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ad4185780 con 0x7f3ad411d7e0 2026-02-24T19:17:24.274 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.269+0000 7f3ac97fa640 1 -- 10.20.193.162:0/1257565522 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3ac4002ea0 con 0x7f3ad411d7e0 2026-02-24T19:17:24.274 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.269+0000 7f3ac97fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:24.274 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.269+0000 7f3ac97fa640 1 -- 10.20.193.162:0/1257565522 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f3ac4004e80 con 0x7f3ad411d7e0 2026-02-24T19:17:24.274 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.269+0000 7f3ac97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:24.274 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.269+0000 7f3ac97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:24.274 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.269+0000 7f3acaffd640 4 set_mon_vals no callback set 2026-02-24T19:17:24.274 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.269+0000 7f3ac97fa640 10 monclient: dump: 2026-02-24T19:17:24.275 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:24.275 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:24.275 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.275 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.275 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:24.275 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:24.275 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:24.275 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:24.275 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:24.275 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:24.275 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.269+0000 7f3ac97fa640 1 -- 10.20.193.162:0/1257565522 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f3ac4005430 con 0x7f3ad411d7e0 2026-02-24T19:17:24.275 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.269+0000 7f3ac97fa640 1 -- 10.20.193.162:0/1257565522 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(4..4 src has 1..4) ==== 950+0+0 (unknown 1794401184 0 0) 0x7f3ac4006870 con 0x7f3ad411d7e0 2026-02-24T19:17:24.276 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.269+0000 7f3ac97fa640 10 client.4137.objecter ms_dispatch2 0x7f3ad4000b90 osd_map(4..4 src has 1..4) 2026-02-24T19:17:24.276 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.269+0000 7f3ac97fa640 3 client.4137.objecter handle_osd_map got epochs [4,4] > 0 2026-02-24T19:17:24.276 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.269+0000 7f3ac97fa640 3 client.4137.objecter handle_osd_map decoding full epoch 4 2026-02-24T19:17:24.276 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.270+0000 7f3ac97fa640 20 client.4137.objecter dump_active .. 0 homeless 2026-02-24T19:17:24.298 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.298+0000 7f3ac97fa640 1 -- 10.20.193.162:0/1257565522 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f3ac4006520 con 0x7f3ad411d7e0 2026-02-24T19:17:24.299 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.298+0000 7f3ac97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:24.299 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.298+0000 7f3ac97fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:24.332 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.331+0000 7f3adac93640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "3c37f6aa-25cb-43be-a75a-86a246086a85", "id": 2}] 2026-02-24T19:17:24.332 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.331+0000 7f3adac93640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "3c37f6aa-25cb-43be-a75a-86a246086a85", "id": 2}] 2026-02-24T19:17:24.332 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.331+0000 7f3adac93640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:24.332 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.331+0000 7f3adac93640 1 -- 10.20.193.162:0/1257565522 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "osd new", "uuid": "3c37f6aa-25cb-43be-a75a-86a246086a85", "id": 2} v 0) -- 0x7f3ad412f1c0 con 0x7f3ad411d7e0 2026-02-24T19:17:24.348 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.347+0000 7f3ac97fa640 1 -- 10.20.193.162:0/1257565522 <== mon.0 v1:10.20.193.26:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3c37f6aa-25cb-43be-a75a-86a246086a85", "id": 2}]=0 v5) ==== 112+0+2 (unknown 1799182302 0 216599125) 0x7f3ac4006a70 con 0x7f3ad411d7e0 2026-02-24T19:17:24.348 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.347+0000 7f3ac97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "3c37f6aa-25cb-43be-a75a-86a246086a85", "id": 2}] 2026-02-24T19:17:24.348 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.347+0000 7f3ac97fa640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:24.349 INFO:teuthology.orchestra.run.trial162.stdout:2 2026-02-24T19:17:24.350 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.348+0000 7f3adac93640 10 librados: watch_flush enter 2026-02-24T19:17:24.350 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.348+0000 7f3adac93640 10 librados: watch_flush exit 2026-02-24T19:17:24.350 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.348+0000 7f3adac93640 20 client.4137.objecter shutdown clearing up homeless session... 2026-02-24T19:17:24.350 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.348+0000 7f3adac93640 10 client.4137.objecter successfully canceled tick 2026-02-24T19:17:24.350 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.348+0000 7f3adac93640 10 monclient: shutdown 2026-02-24T19:17:24.351 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.348+0000 7f3adac93640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:24.351 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.348+0000 7f3adac93640 1 -- 10.20.193.162:0/1257565522 >> v1:10.20.193.26:6789/0 conn(0x7f3ad411d7e0 legacy=0x7f3ad41826f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:24.351 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.348+0000 7f3adac93640 1 -- 10.20.193.162:0/1257565522 shutdown_connections 2026-02-24T19:17:24.351 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.348+0000 7f3adac93640 1 -- 10.20.193.162:0/1257565522 >> 10.20.193.162:0/1257565522 conn(0x7f3ad4059960 msgr2=0x7f3ad4183fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:24.351 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.348+0000 7f3adac93640 1 -- 10.20.193.162:0/1257565522 shutdown_connections 2026-02-24T19:17:24.351 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.348+0000 7f3adac93640 1 -- 10.20.193.162:0/1257565522 wait complete. 2026-02-24T19:17:24.351 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.348+0000 7f3adac93640 1 librados: shutdown 2026-02-24T19:17:24.357 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new a7e3939e-f8f5-4216-9700-27e229d1c4d9 3 2026-02-24T19:17:24.422 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.421+0000 7f5e69c4d640 10 monclient: get_monmap_and_config 2026-02-24T19:17:24.422 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.421+0000 7f5e69c4d640 10 monclient: build_initial_monmap 2026-02-24T19:17:24.422 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.421+0000 7f5e69c4d640 10 monclient: monmap: 2026-02-24T19:17:24.422 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:24.423 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:24.423 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:17:24.422013+0000 2026-02-24T19:17:24.423 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:17:24.422013+0000 2026-02-24T19:17:24.423 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:24.423 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:24.423 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:24.423 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:24.423 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:24.423 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:24.425 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.422+0000 7f5e69c4d640 1 Processor -- start 2026-02-24T19:17:24.426 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.422+0000 7f5e69c4d640 1 -- start start 2026-02-24T19:17:24.426 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.422+0000 7f5e69c4d640 10 monclient: init 2026-02-24T19:17:24.426 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.422+0000 7f5e69c4d640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:24.426 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.422+0000 7f5e69c4d640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:24.426 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.422+0000 7f5e69c4d640 10 monclient(hunting): picked mon.noname-b con 0x7f5e64121d90 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:24.426 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.422+0000 7f5e69c4d640 10 monclient(hunting): picked mon.noname-c con 0x7f5e64142a00 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:24.426 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.422+0000 7f5e69c4d640 10 monclient(hunting): picked mon.noname-a con 0x7f5e64164710 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:24.426 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.422+0000 7f5e69c4d640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e641864c0 con 0x7f5e64164710 2026-02-24T19:17:24.426 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.422+0000 7f5e69c4d640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e641876c0 con 0x7f5e64121d90 2026-02-24T19:17:24.426 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.422+0000 7f5e69c4d640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e641888c0 con 0x7f5e64142a00 2026-02-24T19:17:24.427 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.422+0000 7f5e69c4d640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:24.427 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.422+0000 7f5e69c4d640 10 monclient(hunting): authenticate will time out at 3620.057434s 2026-02-24T19:17:24.427 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.422+0000 7f5e637fe640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f5e64121d90 0x7f5e64122160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.162:45092/0 (socket says 10.20.193.162:45092) 2026-02-24T19:17:24.427 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.422+0000 7f5e637fe640 1 -- 10.20.193.162:0/1779549572 learned_addr learned my addr 10.20.193.162:0/1779549572 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:24.427 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.424+0000 7f5e627fc640 1 -- 10.20.193.162:0/1779549572 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2223807640 0 0) 0x7f5e641876c0 con 0x7f5e64121d90 2026-02-24T19:17:24.427 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.424+0000 7f5e627fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:24.427 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.424+0000 7f5e627fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:24.427 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.424+0000 7f5e627fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:24.427 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.424+0000 7f5e627fc640 10 monclient(hunting): my global_id is 4126 2026-02-24T19:17:24.427 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.424+0000 7f5e627fc640 1 -- 10.20.193.162:0/1779549572 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e48003610 con 0x7f5e64121d90 2026-02-24T19:17:24.427 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.424+0000 7f5e627fc640 1 -- 10.20.193.162:0/1779549572 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1006796449 0 0) 0x7f5e641888c0 con 0x7f5e64142a00 2026-02-24T19:17:24.428 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.424+0000 7f5e627fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:24.428 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.424+0000 7f5e627fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:24.428 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.424+0000 7f5e627fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:24.428 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.424+0000 7f5e627fc640 10 monclient(hunting): my global_id is 4127 2026-02-24T19:17:24.428 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.424+0000 7f5e627fc640 1 -- 10.20.193.162:0/1779549572 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e641876c0 con 0x7f5e64142a00 2026-02-24T19:17:24.429 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.425+0000 7f5e627fc640 1 -- 10.20.193.162:0/1779549572 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1355225760 0 0) 0x7f5e48003610 con 0x7f5e64121d90 2026-02-24T19:17:24.429 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.425+0000 7f5e627fc640 1 -- 10.20.193.162:0/1779549572 >> v1:10.20.193.103:6789/0 conn(0x7f5e64142a00 legacy=0x7f5e64162e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:24.430 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.425+0000 7f5e627fc640 1 -- 10.20.193.162:0/1779549572 >> v1:10.20.193.26:6789/0 conn(0x7f5e64164710 legacy=0x7f5e64184bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:24.430 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.425+0000 7f5e627fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:24.430 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.425+0000 7f5e627fc640 1 monclient: found mon.noname-b 2026-02-24T19:17:24.430 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.425+0000 7f5e627fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:24.430 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.425+0000 7f5e627fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:17:24.430 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.425+0000 7f5e627fc640 1 -- 10.20.193.162:0/1779549572 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e64189b60 con 0x7f5e64121d90 2026-02-24T19:17:24.430 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.425+0000 7f5e627fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:24.430 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.425+0000 7f5e627fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:24.430 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.425+0000 7f5e627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:24.430 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.425+0000 7f5e627fc640 1 -- 10.20.193.162:0/1779549572 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f5e50002df0 con 0x7f5e64121d90 2026-02-24T19:17:24.430 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.425+0000 7f5e627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:24.430 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.425+0000 7f5e627fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:24.430 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.425+0000 7f5e627fc640 10 monclient: dump: 2026-02-24T19:17:24.431 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:24.431 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:24.431 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.431 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.431 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:24.431 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:24.431 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:24.431 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:24.431 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:24.431 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:24.431 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.425+0000 7f5e69c4d640 5 monclient: authenticate success, global_id 4126 2026-02-24T19:17:24.431 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.425+0000 7f5e69c4d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:24.442 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.439+0000 7f5e627fc640 1 -- 10.20.193.162:0/1779549572 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5e50003070 con 0x7f5e64121d90 2026-02-24T19:17:24.442 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.439+0000 7f5e627fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:24.442 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.439+0000 7f5e627fc640 1 -- 10.20.193.162:0/1779549572 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f5e500034b0 con 0x7f5e64121d90 2026-02-24T19:17:24.442 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.439+0000 7f5e627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:24.442 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.439+0000 7f5e627fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:24.443 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.439+0000 7f5e627fc640 10 monclient: dump: 2026-02-24T19:17:24.443 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:24.443 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:24.443 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.443 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.443 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:24.443 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:24.443 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:24.443 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:24.443 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:24.443 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:24.443 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.439+0000 7f5e69c4d640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:24.444 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.439+0000 7f5e69c4d640 4 set_mon_vals no callback set 2026-02-24T19:17:24.444 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.439+0000 7f5e69c4d640 10 monclient: shutdown 2026-02-24T19:17:24.444 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.439+0000 7f5e69c4d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:24.444 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.439+0000 7f5e69c4d640 1 -- 10.20.193.162:0/1779549572 >> v1:10.20.193.70:6789/0 conn(0x7f5e64121d90 legacy=0x7f5e64122160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:24.444 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.439+0000 7f5e69c4d640 1 -- 10.20.193.162:0/1779549572 shutdown_connections 2026-02-24T19:17:24.444 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.439+0000 7f5e69c4d640 1 -- 10.20.193.162:0/1779549572 >> 10.20.193.162:0/1779549572 conn(0x7f5e64057490 msgr2=0x7f5e64057890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:24.444 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.439+0000 7f5e69c4d640 1 -- 10.20.193.162:0/1779549572 shutdown_connections 2026-02-24T19:17:24.444 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.439+0000 7f5e69c4d640 1 -- 10.20.193.162:0/1779549572 wait complete. 2026-02-24T19:17:24.444 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.439+0000 7f5e69c4d640 10 monclient: build_initial_monmap 2026-02-24T19:17:24.444 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.439+0000 7f5e69c4d640 10 monclient: monmap: 2026-02-24T19:17:24.444 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:24.444 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:24.445 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-24T19:17:24.445 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-24T19:17:24.445 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:24.445 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-24T19:17:24.445 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:24.445 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:24.445 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:24.445 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:24.445 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.439+0000 7f5e69c4d640 1 librados: starting msgr at 2026-02-24T19:17:24.445 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.439+0000 7f5e69c4d640 1 librados: starting objecter 2026-02-24T19:17:24.445 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.439+0000 7f5e69c4d640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:24.445 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.439+0000 7f5e69c4d640 1 Processor -- start 2026-02-24T19:17:24.445 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.439+0000 7f5e69c4d640 1 -- start start 2026-02-24T19:17:24.446 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.439+0000 7f5e69c4d640 1 librados: setting wanted keys 2026-02-24T19:17:24.446 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.439+0000 7f5e69c4d640 1 librados: calling monclient init 2026-02-24T19:17:24.446 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.439+0000 7f5e69c4d640 10 monclient: init 2026-02-24T19:17:24.446 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.440+0000 7f5e69c4d640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:24.446 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.440+0000 7f5e69c4d640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:24.446 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.440+0000 7f5e69c4d640 10 monclient(hunting): picked mon.noname-a con 0x7f5e64121d90 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:24.446 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.440+0000 7f5e69c4d640 10 monclient(hunting): picked mon.noname-b con 0x7f5e64142a00 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:24.446 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.440+0000 7f5e69c4d640 10 monclient(hunting): picked mon.noname-c con 0x7f5e64164710 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:24.446 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.440+0000 7f5e69c4d640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e6411c8e0 con 0x7f5e64121d90 2026-02-24T19:17:24.446 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.440+0000 7f5e69c4d640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e6411cab0 con 0x7f5e64142a00 2026-02-24T19:17:24.446 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.440+0000 7f5e69c4d640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e6411cc80 con 0x7f5e64164710 2026-02-24T19:17:24.446 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.440+0000 7f5e69c4d640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:24.446 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.440+0000 7f5e69c4d640 10 monclient(hunting): authenticate will time out at 3620.075118s 2026-02-24T19:17:24.447 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.440+0000 7f5e62ffd640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f5e64142a00 0x7f5e641485a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.162:45100/0 (socket says 10.20.193.162:45100) 2026-02-24T19:17:24.447 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.440+0000 7f5e62ffd640 1 -- 10.20.193.162:0/3009558615 learned_addr learned my addr 10.20.193.162:0/3009558615 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:24.447 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.440+0000 7f5e3ffff640 10 client.?.objecter ms_handle_connect 0x7f5e64142a00 2026-02-24T19:17:24.447 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.440+0000 7f5e3ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:24.447 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.441+0000 7f5e3ffff640 10 client.?.objecter ms_handle_connect 0x7f5e64164710 2026-02-24T19:17:24.447 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.441+0000 7f5e3ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:24.447 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.441+0000 7f5e3ffff640 1 -- 10.20.193.162:0/3009558615 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3636787886 0 0) 0x7f5e6411cab0 con 0x7f5e64142a00 2026-02-24T19:17:24.447 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.441+0000 7f5e3ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:24.447 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.441+0000 7f5e3ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:24.447 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.441+0000 7f5e3ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:24.447 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.441+0000 7f5e3ffff640 10 monclient(hunting): my global_id is 4129 2026-02-24T19:17:24.447 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.441+0000 7f5e3ffff640 1 -- 10.20.193.162:0/3009558615 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e34003610 con 0x7f5e64142a00 2026-02-24T19:17:24.450 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.442+0000 7f5e3ffff640 1 -- 10.20.193.162:0/3009558615 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 707467723 0 0) 0x7f5e6411cc80 con 0x7f5e64164710 2026-02-24T19:17:24.450 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.442+0000 7f5e3ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:24.450 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.442+0000 7f5e3ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:24.451 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.442+0000 7f5e3ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:24.451 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.442+0000 7f5e3ffff640 10 monclient(hunting): my global_id is 4130 2026-02-24T19:17:24.451 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.442+0000 7f5e3ffff640 1 -- 10.20.193.162:0/3009558615 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e6411cab0 con 0x7f5e64164710 2026-02-24T19:17:24.451 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.443+0000 7f5e3ffff640 1 -- 10.20.193.162:0/3009558615 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2179686076 0 0) 0x7f5e34003610 con 0x7f5e64142a00 2026-02-24T19:17:24.451 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.443+0000 7f5e3ffff640 1 -- 10.20.193.162:0/3009558615 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5e6411cc80 con 0x7f5e64142a00 2026-02-24T19:17:24.451 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.443+0000 7f5e3ffff640 1 -- 10.20.193.162:0/3009558615 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f5e54003150 con 0x7f5e64142a00 2026-02-24T19:17:24.451 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.443+0000 7f5e3ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:24.451 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.443+0000 7f5e3ffff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:24.451 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.443+0000 7f5e3ffff640 10 monclient(hunting): dump: 2026-02-24T19:17:24.451 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:24.451 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:24.451 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.451 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.452 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:24.452 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:24.452 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:24.452 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:24.452 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:24.452 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:24.452 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.443+0000 7f5e3ffff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:24.452 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.444+0000 7f5e3ffff640 1 -- 10.20.193.162:0/3009558615 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2525503726 0 0) 0x7f5e6411cab0 con 0x7f5e64164710 2026-02-24T19:17:24.452 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.444+0000 7f5e3ffff640 1 -- 10.20.193.162:0/3009558615 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5e34003610 con 0x7f5e64164710 2026-02-24T19:17:24.452 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.444+0000 7f5e3ffff640 1 -- 10.20.193.162:0/3009558615 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f5e58003270 con 0x7f5e64164710 2026-02-24T19:17:24.452 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.444+0000 7f5e3ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:24.452 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.444+0000 7f5e3ffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:24.453 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.444+0000 7f5e3ffff640 10 monclient(hunting): dump: 2026-02-24T19:17:24.453 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:24.453 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:24.453 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.453 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.453 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:24.453 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:24.453 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:24.453 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:24.453 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:24.453 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:24.453 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.445+0000 7f5e3ffff640 1 -- 10.20.193.162:0/3009558615 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2130504418 0 0) 0x7f5e6411cc80 con 0x7f5e64142a00 2026-02-24T19:17:24.454 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.445+0000 7f5e3ffff640 1 -- 10.20.193.162:0/3009558615 >> v1:10.20.193.103:6789/0 conn(0x7f5e64164710 legacy=0x7f5e6411c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:24.454 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.445+0000 7f5e3ffff640 1 -- 10.20.193.162:0/3009558615 >> v1:10.20.193.26:6789/0 conn(0x7f5e64121d90 legacy=0x7f5e64184ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:24.454 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.445+0000 7f5e3ffff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:24.454 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.445+0000 7f5e3ffff640 1 monclient: found mon.b 2026-02-24T19:17:24.454 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.445+0000 7f5e3ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:24.454 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.445+0000 7f5e3ffff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:24.454 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.445+0000 7f5e3ffff640 1 -- 10.20.193.162:0/3009558615 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e6411ce50 con 0x7f5e64142a00 2026-02-24T19:17:24.454 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.445+0000 7f5e3ffff640 10 monclient: _finish_auth 0 2026-02-24T19:17:24.454 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.445+0000 7f5e3ffff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:24.454 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.445+0000 7f5e3ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:24.454 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.445+0000 7f5e69c4d640 5 monclient: authenticate success, global_id 4129 2026-02-24T19:17:24.454 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.445+0000 7f5e69c4d640 10 monclient: _renew_subs 2026-02-24T19:17:24.454 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.445+0000 7f5e69c4d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:24.454 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.445+0000 7f5e69c4d640 1 -- 10.20.193.162:0/3009558615 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5e6414fdd0 con 0x7f5e64142a00 2026-02-24T19:17:24.455 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.445+0000 7f5e69c4d640 10 client.4129.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:24.455 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.445+0000 7f5e69c4d640 10 monclient: _renew_subs 2026-02-24T19:17:24.455 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.445+0000 7f5e69c4d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:24.455 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.445+0000 7f5e69c4d640 1 -- 10.20.193.162:0/3009558615 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5e64150410 con 0x7f5e64142a00 2026-02-24T19:17:24.455 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.445+0000 7f5e69c4d640 1 librados: init done 2026-02-24T19:17:24.455 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.445+0000 7f5e69c4d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:24.455 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.445+0000 7f5e69c4d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:24.455 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.445+0000 7f5e69c4d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:24.455 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.445+0000 7f5e69c4d640 1 -- 10.20.193.162:0/3009558615 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e24005180 con 0x7f5e64142a00 2026-02-24T19:17:24.530 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.529+0000 7f5e3ffff640 1 -- 10.20.193.162:0/3009558615 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5e54003500 con 0x7f5e64142a00 2026-02-24T19:17:24.530 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.529+0000 7f5e3ffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:24.530 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.529+0000 7f5e3ffff640 1 -- 10.20.193.162:0/3009558615 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f5e54003b50 con 0x7f5e64142a00 2026-02-24T19:17:24.530 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.529+0000 7f5e3ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:24.530 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.529+0000 7f5e3ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:24.530 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.529+0000 7f5e3ffff640 10 monclient: dump: 2026-02-24T19:17:24.530 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:24.531 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:24.531 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.531 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.531 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:24.531 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:24.531 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:24.531 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:24.531 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:24.531 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:24.531 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.529+0000 7f5e61ffb640 4 set_mon_vals no callback set 2026-02-24T19:17:24.534 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.532+0000 7f5e3ffff640 1 -- 10.20.193.162:0/3009558615 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f5e54004140 con 0x7f5e64142a00 2026-02-24T19:17:24.534 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.532+0000 7f5e3ffff640 1 -- 10.20.193.162:0/3009558615 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(5..5 src has 1..5) ==== 1065+0+0 (unknown 1104468452 0 0) 0x7f5e54006ce0 con 0x7f5e64142a00 2026-02-24T19:17:24.534 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.532+0000 7f5e3ffff640 10 client.4129.objecter ms_dispatch2 0x7f5e64000b90 osd_map(5..5 src has 1..5) 2026-02-24T19:17:24.534 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.532+0000 7f5e3ffff640 3 client.4129.objecter handle_osd_map got epochs [5,5] > 0 2026-02-24T19:17:24.534 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.532+0000 7f5e3ffff640 3 client.4129.objecter handle_osd_map decoding full epoch 5 2026-02-24T19:17:24.534 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.532+0000 7f5e3ffff640 20 client.4129.objecter dump_active .. 0 homeless 2026-02-24T19:17:24.534 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.533+0000 7f5e3ffff640 1 -- 10.20.193.162:0/3009558615 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f5e54006850 con 0x7f5e64142a00 2026-02-24T19:17:24.534 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.533+0000 7f5e3ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:24.534 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.533+0000 7f5e3ffff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:24.567 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.566+0000 7f5e69c4d640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "a7e3939e-f8f5-4216-9700-27e229d1c4d9", "id": 3}] 2026-02-24T19:17:24.567 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.566+0000 7f5e69c4d640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "a7e3939e-f8f5-4216-9700-27e229d1c4d9", "id": 3}] 2026-02-24T19:17:24.567 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.566+0000 7f5e69c4d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:24.567 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.566+0000 7f5e69c4d640 1 -- 10.20.193.162:0/3009558615 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "osd new", "uuid": "a7e3939e-f8f5-4216-9700-27e229d1c4d9", "id": 3} v 0) -- 0x7f5e24005470 con 0x7f5e64142a00 2026-02-24T19:17:24.607 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.606+0000 7f5e3ffff640 1 -- 10.20.193.162:0/3009558615 <== mon.1 v1:10.20.193.70:6789/0 10 ==== mgrmap(e 2) ==== 50897+0+0 (unknown 4005228020 0 0) 0x7f5e540058b0 con 0x7f5e64142a00 2026-02-24T19:17:24.786 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.785+0000 7f5e3ffff640 1 -- 10.20.193.162:0/3009558615 <== mon.1 v1:10.20.193.70:6789/0 11 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a7e3939e-f8f5-4216-9700-27e229d1c4d9", "id": 3}]=0 v6) ==== 112+0+2 (unknown 3828243905 0 525046306) 0x7f5e54018da0 con 0x7f5e64142a00 2026-02-24T19:17:24.786 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.785+0000 7f5e3ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "a7e3939e-f8f5-4216-9700-27e229d1c4d9", "id": 3}] 2026-02-24T19:17:24.786 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.785+0000 7f5e3ffff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:24.787 INFO:teuthology.orchestra.run.trial162.stdout:3 2026-02-24T19:17:24.788 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.785+0000 7f5e69c4d640 10 librados: watch_flush enter 2026-02-24T19:17:24.788 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.785+0000 7f5e69c4d640 10 librados: watch_flush exit 2026-02-24T19:17:24.788 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.785+0000 7f5e69c4d640 20 client.4129.objecter shutdown clearing up homeless session... 2026-02-24T19:17:24.788 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.785+0000 7f5e69c4d640 10 client.4129.objecter successfully canceled tick 2026-02-24T19:17:24.788 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.785+0000 7f5e69c4d640 10 monclient: shutdown 2026-02-24T19:17:24.788 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.785+0000 7f5e69c4d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:24.788 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.785+0000 7f5e69c4d640 1 -- 10.20.193.162:0/3009558615 >> v1:10.20.193.70:6789/0 conn(0x7f5e64142a00 legacy=0x7f5e641485a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:24.789 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.785+0000 7f5e69c4d640 1 -- 10.20.193.162:0/3009558615 shutdown_connections 2026-02-24T19:17:24.789 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.785+0000 7f5e69c4d640 1 -- 10.20.193.162:0/3009558615 >> 10.20.193.162:0/3009558615 conn(0x7f5e64057490 msgr2=0x7f5e64186430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:24.789 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.785+0000 7f5e69c4d640 1 -- 10.20.193.162:0/3009558615 shutdown_connections 2026-02-24T19:17:24.789 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.785+0000 7f5e69c4d640 1 -- 10.20.193.162:0/3009558615 wait complete. 2026-02-24T19:17:24.789 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.785+0000 7f5e69c4d640 1 librados: shutdown 2026-02-24T19:17:24.794 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new 445d43ab-a28c-4afa-90ff-e451602e494f 4 2026-02-24T19:17:24.859 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.858+0000 7f6ecc94c640 10 monclient: get_monmap_and_config 2026-02-24T19:17:24.859 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.858+0000 7f6ecc94c640 10 monclient: build_initial_monmap 2026-02-24T19:17:24.860 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.858+0000 7f6ecc94c640 10 monclient: monmap: 2026-02-24T19:17:24.860 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:24.860 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:24.860 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:17:24.859257+0000 2026-02-24T19:17:24.860 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:17:24.859257+0000 2026-02-24T19:17:24.860 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:24.860 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:24.860 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:24.860 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:24.860 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:24.861 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:24.863 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.859+0000 7f6ecc94c640 1 Processor -- start 2026-02-24T19:17:24.863 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.859+0000 7f6ecc94c640 1 -- start start 2026-02-24T19:17:24.863 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.859+0000 7f6ecc94c640 10 monclient: init 2026-02-24T19:17:24.863 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.859+0000 7f6ecc94c640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:24.863 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.859+0000 7f6ecc94c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:24.863 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.859+0000 7f6ecc94c640 10 monclient(hunting): picked mon.noname-c con 0x7f6ec405d9b0 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:24.863 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.859+0000 7f6ecc94c640 10 monclient(hunting): picked mon.noname-b con 0x7f6ec405dd80 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:24.863 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.859+0000 7f6ecc94c640 10 monclient(hunting): picked mon.noname-a con 0x7f6ec41649b0 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:24.863 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.859+0000 7f6ecc94c640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ec405e200 con 0x7f6ec41649b0 2026-02-24T19:17:24.863 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.859+0000 7f6ecc94c640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ec41874c0 con 0x7f6ec405dd80 2026-02-24T19:17:24.864 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.859+0000 7f6ecc94c640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ec41886a0 con 0x7f6ec405d9b0 2026-02-24T19:17:24.864 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.859+0000 7f6ecc94c640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:24.864 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.859+0000 7f6ecc94c640 10 monclient(hunting): authenticate will time out at 3620.494492s 2026-02-24T19:17:24.864 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.859+0000 7f6eca6c1640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f6ec405d9b0 0x7f6ec411b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.162:37398/0 (socket says 10.20.193.162:37398) 2026-02-24T19:17:24.864 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.859+0000 7f6eca6c1640 1 -- 10.20.193.162:0/791216676 learned_addr learned my addr 10.20.193.162:0/791216676 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:24.864 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.861+0000 7f6ec96bf640 1 -- 10.20.193.162:0/791216676 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2019970373 0 0) 0x7f6ec41874c0 con 0x7f6ec405dd80 2026-02-24T19:17:24.864 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.861+0000 7f6ec96bf640 10 monclient(hunting): _negotiate 2026-02-24T19:17:24.864 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.861+0000 7f6ec96bf640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:24.864 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.861+0000 7f6ec96bf640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:24.864 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.861+0000 7f6ec96bf640 10 monclient(hunting): my global_id is 4132 2026-02-24T19:17:24.864 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.861+0000 7f6ec96bf640 1 -- 10.20.193.162:0/791216676 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6eb4003610 con 0x7f6ec405dd80 2026-02-24T19:17:24.864 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.861+0000 7f6ec96bf640 1 -- 10.20.193.162:0/791216676 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1380129110 0 0) 0x7f6ec41886a0 con 0x7f6ec405d9b0 2026-02-24T19:17:24.865 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.861+0000 7f6ec96bf640 10 monclient(hunting): _negotiate 2026-02-24T19:17:24.865 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.861+0000 7f6ec96bf640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:24.865 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.861+0000 7f6ec96bf640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:24.865 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.861+0000 7f6ec96bf640 10 monclient(hunting): my global_id is 4148 2026-02-24T19:17:24.865 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.861+0000 7f6ec96bf640 1 -- 10.20.193.162:0/791216676 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ec41874c0 con 0x7f6ec405d9b0 2026-02-24T19:17:24.869 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.862+0000 7f6ec96bf640 1 -- 10.20.193.162:0/791216676 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2649994157 0 0) 0x7f6ec41874c0 con 0x7f6ec405d9b0 2026-02-24T19:17:24.870 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.862+0000 7f6ec96bf640 1 -- 10.20.193.162:0/791216676 >> v1:10.20.193.70:6789/0 conn(0x7f6ec405dd80 legacy=0x7f6ec411b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:24.870 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.862+0000 7f6ec96bf640 1 -- 10.20.193.162:0/791216676 >> v1:10.20.193.26:6789/0 conn(0x7f6ec41649b0 legacy=0x7f6ec4184d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:24.870 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.862+0000 7f6ec96bf640 10 monclient: _finish_hunting 0 2026-02-24T19:17:24.870 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.862+0000 7f6ec96bf640 1 monclient: found mon.noname-c 2026-02-24T19:17:24.870 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.862+0000 7f6ec96bf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:24.870 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.862+0000 7f6ec96bf640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:17:24.870 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.862+0000 7f6ec96bf640 1 -- 10.20.193.162:0/791216676 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec4189920 con 0x7f6ec405d9b0 2026-02-24T19:17:24.870 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.862+0000 7f6ec96bf640 10 monclient: _finish_auth 0 2026-02-24T19:17:24.870 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.862+0000 7f6ec96bf640 10 monclient: _check_auth_tickets 2026-02-24T19:17:24.870 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.862+0000 7f6ec96bf640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:24.870 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.862+0000 7f6ec96bf640 1 -- 10.20.193.162:0/791216676 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6ebc002df0 con 0x7f6ec405d9b0 2026-02-24T19:17:24.871 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.862+0000 7f6ec96bf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:24.871 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.862+0000 7f6ec96bf640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:24.871 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.862+0000 7f6ec96bf640 10 monclient: dump: 2026-02-24T19:17:24.871 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:24.871 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:24.871 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.871 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.871 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:24.871 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:24.871 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:24.871 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:24.871 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:24.871 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:24.872 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.862+0000 7f6ecc94c640 5 monclient: authenticate success, global_id 4148 2026-02-24T19:17:24.872 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.862+0000 7f6ecc94c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:24.872 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.863+0000 7f6ec96bf640 1 -- 10.20.193.162:0/791216676 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6ebc003070 con 0x7f6ec405d9b0 2026-02-24T19:17:24.872 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.863+0000 7f6ec96bf640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:24.872 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.863+0000 7f6ec96bf640 1 -- 10.20.193.162:0/791216676 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6ebc0034b0 con 0x7f6ec405d9b0 2026-02-24T19:17:24.872 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.863+0000 7f6ec96bf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:24.872 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.863+0000 7f6ec96bf640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:24.872 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.863+0000 7f6ec96bf640 10 monclient: dump: 2026-02-24T19:17:24.872 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:24.872 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:24.872 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.872 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.873 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:24.873 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:24.873 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:24.873 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:24.873 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:24.873 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:24.873 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.863+0000 7f6ecc94c640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:24.873 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.863+0000 7f6ecc94c640 4 set_mon_vals no callback set 2026-02-24T19:17:24.873 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.864+0000 7f6ecc94c640 10 monclient: shutdown 2026-02-24T19:17:24.873 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.864+0000 7f6ecc94c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:24.873 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.864+0000 7f6ecc94c640 1 -- 10.20.193.162:0/791216676 >> v1:10.20.193.103:6789/0 conn(0x7f6ec405d9b0 legacy=0x7f6ec411b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:24.873 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.864+0000 7f6ecc94c640 1 -- 10.20.193.162:0/791216676 shutdown_connections 2026-02-24T19:17:24.874 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.864+0000 7f6ecc94c640 1 -- 10.20.193.162:0/791216676 >> 10.20.193.162:0/791216676 conn(0x7f6ec40588d0 msgr2=0x7f6ec4058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:24.874 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.864+0000 7f6ecc94c640 1 -- 10.20.193.162:0/791216676 shutdown_connections 2026-02-24T19:17:24.874 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.864+0000 7f6ecc94c640 1 -- 10.20.193.162:0/791216676 wait complete. 2026-02-24T19:17:24.874 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.864+0000 7f6ecc94c640 10 monclient: build_initial_monmap 2026-02-24T19:17:24.874 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.864+0000 7f6ecc94c640 10 monclient: monmap: 2026-02-24T19:17:24.874 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:24.874 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:24.874 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-24T19:17:24.874 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-24T19:17:24.874 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:24.874 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-24T19:17:24.874 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:24.874 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:24.875 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:24.875 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:24.875 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.864+0000 7f6ecc94c640 1 librados: starting msgr at 2026-02-24T19:17:24.875 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.864+0000 7f6ecc94c640 1 librados: starting objecter 2026-02-24T19:17:24.875 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.864+0000 7f6ecc94c640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:24.875 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.864+0000 7f6ecc94c640 1 Processor -- start 2026-02-24T19:17:24.875 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.864+0000 7f6ecc94c640 1 -- start start 2026-02-24T19:17:24.875 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.864+0000 7f6ecc94c640 1 librados: setting wanted keys 2026-02-24T19:17:24.875 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.864+0000 7f6ecc94c640 1 librados: calling monclient init 2026-02-24T19:17:24.875 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.864+0000 7f6ecc94c640 10 monclient: init 2026-02-24T19:17:24.875 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.864+0000 7f6ecc94c640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:24.876 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.864+0000 7f6ecc94c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:24.876 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.864+0000 7f6ecc94c640 10 monclient(hunting): picked mon.noname-c con 0x7f6ec405d9b0 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:24.876 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.864+0000 7f6ecc94c640 10 monclient(hunting): picked mon.noname-a con 0x7f6ec405dd80 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:24.876 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.864+0000 7f6ecc94c640 10 monclient(hunting): picked mon.noname-b con 0x7f6ec41649b0 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:24.876 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.864+0000 7f6ecc94c640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ec416d740 con 0x7f6ec405dd80 2026-02-24T19:17:24.876 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.864+0000 7f6ecc94c640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ec41745d0 con 0x7f6ec41649b0 2026-02-24T19:17:24.876 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.864+0000 7f6ecc94c640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ec41757b0 con 0x7f6ec405d9b0 2026-02-24T19:17:24.876 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.864+0000 7f6ecc94c640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:24.876 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.864+0000 7f6ecc94c640 10 monclient(hunting): authenticate will time out at 3620.499741s 2026-02-24T19:17:24.876 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.865+0000 7f6ecaec2640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f6ec41649b0 0x7f6ec41630a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.162:45166/0 (socket says 10.20.193.162:45166) 2026-02-24T19:17:24.876 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.865+0000 7f6ecaec2640 1 -- 10.20.193.162:0/3901094549 learned_addr learned my addr 10.20.193.162:0/3901094549 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:24.876 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.865+0000 7f6eaeffd640 10 client.?.objecter ms_handle_connect 0x7f6ec405d9b0 2026-02-24T19:17:24.876 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.865+0000 7f6eaeffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:24.877 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.865+0000 7f6eaeffd640 10 client.?.objecter ms_handle_connect 0x7f6ec41649b0 2026-02-24T19:17:24.877 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.865+0000 7f6eaeffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:24.877 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.866+0000 7f6eaeffd640 1 -- 10.20.193.162:0/3901094549 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3004412070 0 0) 0x7f6ec41757b0 con 0x7f6ec405d9b0 2026-02-24T19:17:24.877 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.866+0000 7f6eaeffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:24.877 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.866+0000 7f6eaeffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:24.877 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.866+0000 7f6eaeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:24.877 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.866+0000 7f6eaeffd640 10 monclient(hunting): my global_id is 4151 2026-02-24T19:17:24.877 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.866+0000 7f6eaeffd640 1 -- 10.20.193.162:0/3901094549 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e94003610 con 0x7f6ec405d9b0 2026-02-24T19:17:24.877 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.868+0000 7f6eaeffd640 1 -- 10.20.193.162:0/3901094549 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3269704362 0 0) 0x7f6e94003610 con 0x7f6ec405d9b0 2026-02-24T19:17:24.877 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.868+0000 7f6eaeffd640 1 -- 10.20.193.162:0/3901094549 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6ec41757b0 con 0x7f6ec405d9b0 2026-02-24T19:17:24.877 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.868+0000 7f6eaeffd640 1 -- 10.20.193.162:0/3901094549 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6ebc002d00 con 0x7f6ec405d9b0 2026-02-24T19:17:24.877 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.868+0000 7f6eaeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:24.878 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.868+0000 7f6eaeffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:24.878 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.868+0000 7f6eaeffd640 10 monclient(hunting): dump: 2026-02-24T19:17:24.878 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:24.878 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:24.878 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.878 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.878 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:24.878 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:24.878 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:24.878 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:24.878 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:24.878 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:24.879 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.868+0000 7f6eaeffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:24.881 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.870+0000 7f6eaeffd640 1 -- 10.20.193.162:0/3901094549 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2735103013 0 0) 0x7f6ec41757b0 con 0x7f6ec405d9b0 2026-02-24T19:17:24.881 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.870+0000 7f6eaeffd640 1 -- 10.20.193.162:0/3901094549 >> v1:10.20.193.70:6789/0 conn(0x7f6ec41649b0 legacy=0x7f6ec41630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:24.881 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.870+0000 7f6eaeffd640 1 -- 10.20.193.162:0/3901094549 >> v1:10.20.193.26:6789/0 conn(0x7f6ec405dd80 legacy=0x7f6ec4161980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:24.881 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.870+0000 7f6eaeffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:24.881 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.870+0000 7f6eaeffd640 1 monclient: found mon.c 2026-02-24T19:17:24.881 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.870+0000 7f6eaeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:24.881 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.870+0000 7f6eaeffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:24.881 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.870+0000 7f6eaeffd640 1 -- 10.20.193.162:0/3901094549 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec4176990 con 0x7f6ec405d9b0 2026-02-24T19:17:24.882 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.870+0000 7f6eaeffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:24.882 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.870+0000 7f6eaeffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:24.882 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.870+0000 7f6eaeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:24.882 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.870+0000 7f6ecc94c640 5 monclient: authenticate success, global_id 4151 2026-02-24T19:17:24.882 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.870+0000 7f6ecc94c640 10 monclient: _renew_subs 2026-02-24T19:17:24.882 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.870+0000 7f6ecc94c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:24.882 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.870+0000 7f6ecc94c640 1 -- 10.20.193.162:0/3901094549 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6ec41747a0 con 0x7f6ec405d9b0 2026-02-24T19:17:24.882 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.870+0000 7f6ecc94c640 10 client.4151.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:24.882 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.870+0000 7f6ecc94c640 10 monclient: _renew_subs 2026-02-24T19:17:24.882 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.870+0000 7f6ecc94c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:24.882 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.870+0000 7f6ecc94c640 1 -- 10.20.193.162:0/3901094549 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6ec4174d60 con 0x7f6ec405d9b0 2026-02-24T19:17:24.882 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.870+0000 7f6ecc94c640 1 librados: init done 2026-02-24T19:17:24.883 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.870+0000 7f6ecc94c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:24.883 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.870+0000 7f6ecc94c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:24.883 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.870+0000 7f6ecc94c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:24.883 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.870+0000 7f6ecc94c640 1 -- 10.20.193.162:0/3901094549 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ec4187bc0 con 0x7f6ec405d9b0 2026-02-24T19:17:24.883 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.874+0000 7f6eaeffd640 1 -- 10.20.193.162:0/3901094549 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6ebc002f10 con 0x7f6ec405d9b0 2026-02-24T19:17:24.883 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.874+0000 7f6eaeffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:24.883 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.874+0000 7f6eaeffd640 1 -- 10.20.193.162:0/3901094549 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6ebc004e80 con 0x7f6ec405d9b0 2026-02-24T19:17:24.883 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.874+0000 7f6eaeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:24.883 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.874+0000 7f6eaeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:24.883 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.874+0000 7f6eaeffd640 10 monclient: dump: 2026-02-24T19:17:24.883 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:24.883 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:24.883 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.884 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:24.884 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:24.884 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:24.884 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:24.884 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:24.884 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:24.884 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:24.884 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.874+0000 7f6ec8ebe640 4 set_mon_vals no callback set 2026-02-24T19:17:24.884 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.875+0000 7f6eaeffd640 1 -- 10.20.193.162:0/3901094549 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 2) ==== 50897+0+0 (unknown 4005228020 0 0) 0x7f6ebc011700 con 0x7f6ec405d9b0 2026-02-24T19:17:24.884 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.875+0000 7f6eaeffd640 1 -- 10.20.193.162:0/3901094549 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(6..6 src has 1..6) ==== 1180+0+0 (unknown 2303393322 0 0) 0x7f6ebc04cee0 con 0x7f6ec405d9b0 2026-02-24T19:17:24.884 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.875+0000 7f6eaeffd640 10 client.4151.objecter ms_dispatch2 0x7f6ec4000b90 osd_map(6..6 src has 1..6) 2026-02-24T19:17:24.884 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.875+0000 7f6eaeffd640 3 client.4151.objecter handle_osd_map got epochs [6,6] > 0 2026-02-24T19:17:24.885 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.875+0000 7f6eaeffd640 3 client.4151.objecter handle_osd_map decoding full epoch 6 2026-02-24T19:17:24.885 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.875+0000 7f6eaeffd640 20 client.4151.objecter dump_active .. 0 homeless 2026-02-24T19:17:24.944 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.943+0000 7f6eaeffd640 1 -- 10.20.193.162:0/3901094549 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f6ebc0176d0 con 0x7f6ec405d9b0 2026-02-24T19:17:24.944 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.943+0000 7f6eaeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:24.945 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.943+0000 7f6eaeffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:24.978 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.977+0000 7f6ecc94c640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "445d43ab-a28c-4afa-90ff-e451602e494f", "id": 4}] 2026-02-24T19:17:24.978 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.977+0000 7f6ecc94c640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "445d43ab-a28c-4afa-90ff-e451602e494f", "id": 4}] 2026-02-24T19:17:24.978 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.977+0000 7f6ecc94c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:24.978 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:24.977+0000 7f6ecc94c640 1 -- 10.20.193.162:0/3901094549 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "osd new", "uuid": "445d43ab-a28c-4afa-90ff-e451602e494f", "id": 4} v 0) -- 0x7f6ec41754c0 con 0x7f6ec405d9b0 2026-02-24T19:17:25.081 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.081+0000 7f6eaeffd640 1 -- 10.20.193.162:0/3901094549 <== mon.2 v1:10.20.193.103:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "445d43ab-a28c-4afa-90ff-e451602e494f", "id": 4}]=0 v7) ==== 112+0+2 (unknown 2227487496 0 1697012583) 0x7f6ebc016fd0 con 0x7f6ec405d9b0 2026-02-24T19:17:25.081 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.081+0000 7f6eaeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "445d43ab-a28c-4afa-90ff-e451602e494f", "id": 4}] 2026-02-24T19:17:25.082 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.081+0000 7f6eaeffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:25.082 INFO:teuthology.orchestra.run.trial162.stdout:4 2026-02-24T19:17:25.083 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.081+0000 7f6ecc94c640 10 librados: watch_flush enter 2026-02-24T19:17:25.083 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.081+0000 7f6ecc94c640 10 librados: watch_flush exit 2026-02-24T19:17:25.083 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.081+0000 7f6ecc94c640 20 client.4151.objecter shutdown clearing up homeless session... 2026-02-24T19:17:25.083 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.081+0000 7f6ecc94c640 10 client.4151.objecter successfully canceled tick 2026-02-24T19:17:25.083 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.081+0000 7f6ecc94c640 10 monclient: shutdown 2026-02-24T19:17:25.084 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.081+0000 7f6ecc94c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:25.084 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.081+0000 7f6ecc94c640 1 -- 10.20.193.162:0/3901094549 >> v1:10.20.193.103:6789/0 conn(0x7f6ec405d9b0 legacy=0x7f6ec416cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:25.084 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.081+0000 7f6ecc94c640 1 -- 10.20.193.162:0/3901094549 shutdown_connections 2026-02-24T19:17:25.084 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.081+0000 7f6ecc94c640 1 -- 10.20.193.162:0/3901094549 >> 10.20.193.162:0/3901094549 conn(0x7f6ec40588d0 msgr2=0x7f6ec405b500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:25.084 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.081+0000 7f6ecc94c640 1 -- 10.20.193.162:0/3901094549 shutdown_connections 2026-02-24T19:17:25.084 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.081+0000 7f6ecc94c640 1 -- 10.20.193.162:0/3901094549 wait complete. 2026-02-24T19:17:25.084 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.081+0000 7f6ecc94c640 1 librados: shutdown 2026-02-24T19:17:25.091 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new 37303b3f-6b88-4c73-aaff-10055ec5cc85 5 2026-02-24T19:17:25.158 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.157+0000 7f1723c24640 10 monclient: get_monmap_and_config 2026-02-24T19:17:25.158 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.157+0000 7f1723c24640 10 monclient: build_initial_monmap 2026-02-24T19:17:25.158 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.157+0000 7f1723c24640 10 monclient: monmap: 2026-02-24T19:17:25.158 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:25.158 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:25.158 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:17:25.157568+0000 2026-02-24T19:17:25.158 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:17:25.157568+0000 2026-02-24T19:17:25.158 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:25.158 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:25.159 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:25.159 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:25.159 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:25.159 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.164 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.157+0000 7f1723c24640 1 Processor -- start 2026-02-24T19:17:25.164 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.157+0000 7f1723c24640 1 -- start start 2026-02-24T19:17:25.165 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.157+0000 7f1723c24640 10 monclient: init 2026-02-24T19:17:25.165 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.157+0000 7f1723c24640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:25.165 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.157+0000 7f1723c24640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:25.165 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.157+0000 7f1723c24640 10 monclient(hunting): picked mon.noname-c con 0x7f171c121d90 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:25.165 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.157+0000 7f1723c24640 10 monclient(hunting): picked mon.noname-a con 0x7f171c142a00 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:25.165 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.157+0000 7f1723c24640 10 monclient(hunting): picked mon.noname-b con 0x7f171c164710 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:25.165 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.157+0000 7f1723c24640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f171c1864c0 con 0x7f171c142a00 2026-02-24T19:17:25.165 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.157+0000 7f1723c24640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f171c1876c0 con 0x7f171c164710 2026-02-24T19:17:25.165 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.157+0000 7f1723c24640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f171c1888c0 con 0x7f171c121d90 2026-02-24T19:17:25.165 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.157+0000 7f1723c24640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:25.165 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.157+0000 7f1723c24640 10 monclient(hunting): authenticate will time out at 3620.792841s 2026-02-24T19:17:25.165 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.158+0000 7f1721999640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f171c121d90 0x7f171c122160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.162:37418/0 (socket says 10.20.193.162:37418) 2026-02-24T19:17:25.166 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.158+0000 7f1721999640 1 -- 10.20.193.162:0/3412574353 learned_addr learned my addr 10.20.193.162:0/3412574353 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:25.166 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.159+0000 7f1720997640 1 -- 10.20.193.162:0/3412574353 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 807434215 0 0) 0x7f171c1864c0 con 0x7f171c142a00 2026-02-24T19:17:25.166 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.159+0000 7f1720997640 10 monclient(hunting): _negotiate 2026-02-24T19:17:25.166 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.159+0000 7f1720997640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:25.166 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.159+0000 7f1720997640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:25.166 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.159+0000 7f1720997640 10 monclient(hunting): my global_id is 4155 2026-02-24T19:17:25.166 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.159+0000 7f1720997640 1 -- 10.20.193.162:0/3412574353 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1704003610 con 0x7f171c142a00 2026-02-24T19:17:25.166 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.159+0000 7f1720997640 1 -- 10.20.193.162:0/3412574353 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3855482849 0 0) 0x7f171c1888c0 con 0x7f171c121d90 2026-02-24T19:17:25.166 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.159+0000 7f1720997640 10 monclient(hunting): _negotiate 2026-02-24T19:17:25.166 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.159+0000 7f1720997640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:25.166 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.159+0000 7f1720997640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:25.166 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.159+0000 7f1720997640 10 monclient(hunting): my global_id is 4154 2026-02-24T19:17:25.167 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.159+0000 7f1720997640 1 -- 10.20.193.162:0/3412574353 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f171c1864c0 con 0x7f171c121d90 2026-02-24T19:17:25.167 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.159+0000 7f1720997640 1 -- 10.20.193.162:0/3412574353 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3804070178 0 0) 0x7f171c1876c0 con 0x7f171c164710 2026-02-24T19:17:25.167 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.159+0000 7f1720997640 10 monclient(hunting): _negotiate 2026-02-24T19:17:25.167 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.159+0000 7f1720997640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:25.167 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.159+0000 7f1720997640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:25.167 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.159+0000 7f1720997640 10 monclient(hunting): my global_id is 4135 2026-02-24T19:17:25.167 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.159+0000 7f1720997640 1 -- 10.20.193.162:0/3412574353 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f171c1888c0 con 0x7f171c164710 2026-02-24T19:17:25.167 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.161+0000 7f1720997640 1 -- 10.20.193.162:0/3412574353 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 734439264 0 0) 0x7f171c1864c0 con 0x7f171c121d90 2026-02-24T19:17:25.167 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.161+0000 7f1720997640 1 -- 10.20.193.162:0/3412574353 >> v1:10.20.193.70:6789/0 conn(0x7f171c164710 legacy=0x7f171c184bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:25.167 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.161+0000 7f1720997640 1 -- 10.20.193.162:0/3412574353 >> v1:10.20.193.26:6789/0 conn(0x7f171c142a00 legacy=0x7f171c162e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:25.167 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.161+0000 7f1720997640 10 monclient: _finish_hunting 0 2026-02-24T19:17:25.167 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.161+0000 7f1720997640 1 monclient: found mon.noname-c 2026-02-24T19:17:25.168 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.161+0000 7f1720997640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:25.168 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.161+0000 7f1720997640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:17:25.168 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.161+0000 7f1720997640 1 -- 10.20.193.162:0/3412574353 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f171c189b60 con 0x7f171c121d90 2026-02-24T19:17:25.168 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.161+0000 7f1720997640 10 monclient: _finish_auth 0 2026-02-24T19:17:25.168 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.161+0000 7f1720997640 10 monclient: _check_auth_tickets 2026-02-24T19:17:25.168 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.161+0000 7f1720997640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:25.168 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.161+0000 7f1720997640 1 -- 10.20.193.162:0/3412574353 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f170c002df0 con 0x7f171c121d90 2026-02-24T19:17:25.168 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.161+0000 7f1720997640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:25.168 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.161+0000 7f1720997640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:25.168 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.161+0000 7f1720997640 10 monclient: dump: 2026-02-24T19:17:25.168 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:25.168 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:25.168 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.169 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.169 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:25.169 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:25.169 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:25.169 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:25.169 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:25.169 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.169 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.161+0000 7f1723c24640 5 monclient: authenticate success, global_id 4154 2026-02-24T19:17:25.169 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.161+0000 7f1723c24640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:25.169 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.161+0000 7f1720997640 1 -- 10.20.193.162:0/3412574353 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f170c0030b0 con 0x7f171c121d90 2026-02-24T19:17:25.169 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.161+0000 7f1720997640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:25.169 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.161+0000 7f1720997640 1 -- 10.20.193.162:0/3412574353 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f170c0034c0 con 0x7f171c121d90 2026-02-24T19:17:25.169 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.161+0000 7f1720997640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:25.170 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.161+0000 7f1720997640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:25.170 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.161+0000 7f1720997640 10 monclient: dump: 2026-02-24T19:17:25.170 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:25.170 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:25.170 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.170 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.170 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:25.170 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:25.170 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:25.170 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:25.170 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:25.170 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.170 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.161+0000 7f1723c24640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:25.171 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.161+0000 7f1723c24640 4 set_mon_vals no callback set 2026-02-24T19:17:25.171 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.162+0000 7f1723c24640 10 monclient: shutdown 2026-02-24T19:17:25.171 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.162+0000 7f1723c24640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:25.171 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.162+0000 7f1723c24640 1 -- 10.20.193.162:0/3412574353 >> v1:10.20.193.103:6789/0 conn(0x7f171c121d90 legacy=0x7f171c122160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:25.171 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.162+0000 7f1723c24640 1 -- 10.20.193.162:0/3412574353 shutdown_connections 2026-02-24T19:17:25.171 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.162+0000 7f1723c24640 1 -- 10.20.193.162:0/3412574353 >> 10.20.193.162:0/3412574353 conn(0x7f171c057490 msgr2=0x7f171c057890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:25.171 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.162+0000 7f1723c24640 1 -- 10.20.193.162:0/3412574353 shutdown_connections 2026-02-24T19:17:25.171 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.162+0000 7f1723c24640 1 -- 10.20.193.162:0/3412574353 wait complete. 2026-02-24T19:17:25.171 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.162+0000 7f1723c24640 10 monclient: build_initial_monmap 2026-02-24T19:17:25.171 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.162+0000 7f1723c24640 10 monclient: monmap: 2026-02-24T19:17:25.171 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:25.172 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:25.172 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-24T19:17:25.172 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-24T19:17:25.172 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:25.172 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-24T19:17:25.172 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:25.172 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:25.172 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:25.172 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.172 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.162+0000 7f1723c24640 1 librados: starting msgr at 2026-02-24T19:17:25.172 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.162+0000 7f1723c24640 1 librados: starting objecter 2026-02-24T19:17:25.172 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.162+0000 7f1723c24640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:25.173 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.162+0000 7f1723c24640 1 Processor -- start 2026-02-24T19:17:25.173 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.162+0000 7f1723c24640 1 -- start start 2026-02-24T19:17:25.173 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.162+0000 7f1723c24640 1 librados: setting wanted keys 2026-02-24T19:17:25.173 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.162+0000 7f1723c24640 1 librados: calling monclient init 2026-02-24T19:17:25.173 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.162+0000 7f1723c24640 10 monclient: init 2026-02-24T19:17:25.173 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.162+0000 7f1723c24640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:25.173 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.162+0000 7f1723c24640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:25.173 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.162+0000 7f1723c24640 10 monclient(hunting): picked mon.noname-b con 0x7f171c121d90 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:25.173 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.162+0000 7f1723c24640 10 monclient(hunting): picked mon.noname-c con 0x7f171c142a00 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:25.173 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.162+0000 7f1723c24640 10 monclient(hunting): picked mon.noname-a con 0x7f171c164710 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:25.173 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.162+0000 7f1723c24640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f171c11c8e0 con 0x7f171c164710 2026-02-24T19:17:25.173 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.162+0000 7f1723c24640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f171c11cab0 con 0x7f171c121d90 2026-02-24T19:17:25.173 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.162+0000 7f1723c24640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f171c11cc80 con 0x7f171c142a00 2026-02-24T19:17:25.174 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.162+0000 7f1723c24640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:25.174 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.162+0000 7f1723c24640 10 monclient(hunting): authenticate will time out at 3620.797911s 2026-02-24T19:17:25.174 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.163+0000 7f1721999640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f171c121d90 0x7f171c184b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.162:45178/0 (socket says 10.20.193.162:45178) 2026-02-24T19:17:25.174 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.163+0000 7f1721999640 1 -- 10.20.193.162:0/480681586 learned_addr learned my addr 10.20.193.162:0/480681586 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:25.174 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.163+0000 7f170a7fc640 10 client.?.objecter ms_handle_connect 0x7f171c164710 2026-02-24T19:17:25.174 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.163+0000 7f170a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:25.174 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.163+0000 7f170a7fc640 10 client.?.objecter ms_handle_connect 0x7f171c142a00 2026-02-24T19:17:25.174 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.163+0000 7f170a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:25.174 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.163+0000 7f170a7fc640 10 client.?.objecter ms_handle_connect 0x7f171c121d90 2026-02-24T19:17:25.174 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.163+0000 7f170a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:25.178 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.164+0000 7f170a7fc640 1 -- 10.20.193.162:0/480681586 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2003418546 0 0) 0x7f171c11cab0 con 0x7f171c121d90 2026-02-24T19:17:25.178 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.164+0000 7f170a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:25.179 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.164+0000 7f170a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:25.179 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.164+0000 7f170a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:25.179 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.164+0000 7f170a7fc640 10 monclient(hunting): my global_id is 4138 2026-02-24T19:17:25.179 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.164+0000 7f170a7fc640 1 -- 10.20.193.162:0/480681586 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f16ec003610 con 0x7f171c121d90 2026-02-24T19:17:25.179 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.164+0000 7f170a7fc640 1 -- 10.20.193.162:0/480681586 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1748276052 0 0) 0x7f171c11c8e0 con 0x7f171c164710 2026-02-24T19:17:25.179 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.164+0000 7f170a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:25.179 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.164+0000 7f170a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:25.179 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.164+0000 7f170a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:25.179 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.164+0000 7f170a7fc640 10 monclient(hunting): my global_id is 4158 2026-02-24T19:17:25.179 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.164+0000 7f170a7fc640 1 -- 10.20.193.162:0/480681586 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f171c11cab0 con 0x7f171c164710 2026-02-24T19:17:25.179 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.164+0000 7f170a7fc640 1 -- 10.20.193.162:0/480681586 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1201111585 0 0) 0x7f171c11cc80 con 0x7f171c142a00 2026-02-24T19:17:25.179 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.164+0000 7f170a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:25.180 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.164+0000 7f170a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:25.180 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.164+0000 7f170a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:25.180 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.164+0000 7f170a7fc640 10 monclient(hunting): my global_id is 4157 2026-02-24T19:17:25.180 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.164+0000 7f170a7fc640 1 -- 10.20.193.162:0/480681586 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f171c11c8e0 con 0x7f171c142a00 2026-02-24T19:17:25.180 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.166+0000 7f170a7fc640 1 -- 10.20.193.162:0/480681586 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 211136281 0 0) 0x7f16ec003610 con 0x7f171c121d90 2026-02-24T19:17:25.180 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.166+0000 7f170a7fc640 1 -- 10.20.193.162:0/480681586 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f171c11cc80 con 0x7f171c121d90 2026-02-24T19:17:25.180 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.166+0000 7f170a7fc640 1 -- 10.20.193.162:0/480681586 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f170c002db0 con 0x7f171c121d90 2026-02-24T19:17:25.180 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.166+0000 7f170a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:25.180 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.166+0000 7f170a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:25.180 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.166+0000 7f170a7fc640 10 monclient(hunting): dump: 2026-02-24T19:17:25.180 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:25.180 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:25.181 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.181 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.181 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:25.181 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:25.181 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:25.181 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:25.181 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:25.181 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.181 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.166+0000 7f170a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:25.181 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.166+0000 7f170a7fc640 1 -- 10.20.193.162:0/480681586 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3712538091 0 0) 0x7f171c11c8e0 con 0x7f171c142a00 2026-02-24T19:17:25.181 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.166+0000 7f170a7fc640 1 -- 10.20.193.162:0/480681586 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f16ec003610 con 0x7f171c142a00 2026-02-24T19:17:25.181 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.166+0000 7f170a7fc640 1 -- 10.20.193.162:0/480681586 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f1710003030 con 0x7f171c142a00 2026-02-24T19:17:25.181 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.166+0000 7f170a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:25.182 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.166+0000 7f170a7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:25.182 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.166+0000 7f170a7fc640 10 monclient(hunting): dump: 2026-02-24T19:17:25.182 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:25.182 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:25.182 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.182 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.182 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:25.182 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:25.182 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:25.182 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:25.182 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:25.182 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.183 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.166+0000 7f170a7fc640 1 -- 10.20.193.162:0/480681586 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2947758025 0 0) 0x7f171c11cab0 con 0x7f171c164710 2026-02-24T19:17:25.183 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.166+0000 7f170a7fc640 1 -- 10.20.193.162:0/480681586 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f171c11c8e0 con 0x7f171c164710 2026-02-24T19:17:25.183 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.166+0000 7f170a7fc640 1 -- 10.20.193.162:0/480681586 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f1718003520 con 0x7f171c164710 2026-02-24T19:17:25.183 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.166+0000 7f170a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:25.183 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.166+0000 7f170a7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:25.183 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.166+0000 7f170a7fc640 10 monclient(hunting): dump: 2026-02-24T19:17:25.183 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:25.183 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:25.183 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.183 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.183 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:25.183 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:25.183 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:25.184 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:25.184 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:25.184 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.184 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.168+0000 7f170a7fc640 1 -- 10.20.193.162:0/480681586 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4112177818 0 0) 0x7f171c11cc80 con 0x7f171c121d90 2026-02-24T19:17:25.184 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.168+0000 7f170a7fc640 1 -- 10.20.193.162:0/480681586 >> v1:10.20.193.103:6789/0 conn(0x7f171c142a00 legacy=0x7f171c148450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:25.184 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.168+0000 7f170a7fc640 1 -- 10.20.193.162:0/480681586 >> v1:10.20.193.26:6789/0 conn(0x7f171c164710 legacy=0x7f171c11c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:25.184 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.168+0000 7f170a7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:25.184 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.168+0000 7f170a7fc640 1 monclient: found mon.b 2026-02-24T19:17:25.184 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.168+0000 7f170a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:25.184 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.168+0000 7f170a7fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:25.184 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.168+0000 7f170a7fc640 1 -- 10.20.193.162:0/480681586 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f171c11ce50 con 0x7f171c121d90 2026-02-24T19:17:25.184 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.168+0000 7f170a7fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:25.185 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.168+0000 7f170a7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:25.185 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.168+0000 7f170a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:25.185 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.168+0000 7f1723c24640 5 monclient: authenticate success, global_id 4138 2026-02-24T19:17:25.185 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.168+0000 7f1723c24640 10 monclient: _renew_subs 2026-02-24T19:17:25.185 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.168+0000 7f1723c24640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:25.185 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.168+0000 7f1723c24640 1 -- 10.20.193.162:0/480681586 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f171c14fc50 con 0x7f171c121d90 2026-02-24T19:17:25.185 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.168+0000 7f1723c24640 10 client.4138.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:25.185 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.168+0000 7f1723c24640 10 monclient: _renew_subs 2026-02-24T19:17:25.185 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.168+0000 7f1723c24640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:25.185 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.168+0000 7f1723c24640 1 -- 10.20.193.162:0/480681586 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f171c150290 con 0x7f171c121d90 2026-02-24T19:17:25.185 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.168+0000 7f1723c24640 1 librados: init done 2026-02-24T19:17:25.185 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.168+0000 7f1723c24640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:25.186 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.168+0000 7f1723c24640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:25.186 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.168+0000 7f1723c24640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:25.186 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.168+0000 7f1723c24640 1 -- 10.20.193.162:0/480681586 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f171c187be0 con 0x7f171c121d90 2026-02-24T19:17:25.186 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.172+0000 7f170a7fc640 1 -- 10.20.193.162:0/480681586 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f170c0028c0 con 0x7f171c121d90 2026-02-24T19:17:25.186 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.172+0000 7f170a7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:25.186 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.172+0000 7f170a7fc640 1 -- 10.20.193.162:0/480681586 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f170c004ce0 con 0x7f171c121d90 2026-02-24T19:17:25.186 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.172+0000 7f170a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:25.186 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.172+0000 7f170a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:25.186 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.172+0000 7f170a7fc640 10 monclient: dump: 2026-02-24T19:17:25.186 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:25.186 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:25.186 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.186 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.187 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:25.187 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:25.187 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:25.187 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:25.187 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:25.187 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.187 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.172+0000 7f170bfff640 4 set_mon_vals no callback set 2026-02-24T19:17:25.187 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.172+0000 7f170a7fc640 1 -- 10.20.193.162:0/480681586 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 2) ==== 50897+0+0 (unknown 4005228020 0 0) 0x7f170c011560 con 0x7f171c121d90 2026-02-24T19:17:25.187 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.173+0000 7f170a7fc640 1 -- 10.20.193.162:0/480681586 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(7..7 src has 1..7) ==== 1295+0+0 (unknown 2076089814 0 0) 0x7f170c014d60 con 0x7f171c121d90 2026-02-24T19:17:25.187 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.173+0000 7f170a7fc640 10 client.4138.objecter ms_dispatch2 0x7f171c000b90 osd_map(7..7 src has 1..7) 2026-02-24T19:17:25.187 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.173+0000 7f170a7fc640 3 client.4138.objecter handle_osd_map got epochs [7,7] > 0 2026-02-24T19:17:25.187 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.173+0000 7f170a7fc640 3 client.4138.objecter handle_osd_map decoding full epoch 7 2026-02-24T19:17:25.187 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.173+0000 7f170a7fc640 20 client.4138.objecter dump_active .. 0 homeless 2026-02-24T19:17:25.204 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.203+0000 7f170a7fc640 1 -- 10.20.193.162:0/480681586 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f170c017540 con 0x7f171c121d90 2026-02-24T19:17:25.204 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.203+0000 7f170a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:25.204 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.203+0000 7f170a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:25.237 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.236+0000 7f1723c24640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "37303b3f-6b88-4c73-aaff-10055ec5cc85", "id": 5}] 2026-02-24T19:17:25.237 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.236+0000 7f1723c24640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "37303b3f-6b88-4c73-aaff-10055ec5cc85", "id": 5}] 2026-02-24T19:17:25.237 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.236+0000 7f1723c24640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:25.237 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.236+0000 7f1723c24640 1 -- 10.20.193.162:0/480681586 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "osd new", "uuid": "37303b3f-6b88-4c73-aaff-10055ec5cc85", "id": 5} v 0) -- 0x7f171c187e00 con 0x7f171c121d90 2026-02-24T19:17:25.273 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.272+0000 7f170a7fc640 1 -- 10.20.193.162:0/480681586 <== mon.1 v1:10.20.193.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "37303b3f-6b88-4c73-aaff-10055ec5cc85", "id": 5}]=0 v8) ==== 112+0+2 (unknown 3856099731 0 1988412176) 0x7f170c016e40 con 0x7f171c121d90 2026-02-24T19:17:25.273 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.272+0000 7f170a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "37303b3f-6b88-4c73-aaff-10055ec5cc85", "id": 5}] 2026-02-24T19:17:25.273 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.272+0000 7f170a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:25.273 INFO:teuthology.orchestra.run.trial162.stdout:5 2026-02-24T19:17:25.274 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.272+0000 7f1723c24640 10 librados: watch_flush enter 2026-02-24T19:17:25.274 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.272+0000 7f1723c24640 10 librados: watch_flush exit 2026-02-24T19:17:25.275 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.272+0000 7f1723c24640 20 client.4138.objecter shutdown clearing up homeless session... 2026-02-24T19:17:25.275 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.272+0000 7f1723c24640 10 client.4138.objecter successfully canceled tick 2026-02-24T19:17:25.275 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.272+0000 7f1723c24640 10 monclient: shutdown 2026-02-24T19:17:25.275 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.272+0000 7f1723c24640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:25.275 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.272+0000 7f1723c24640 1 -- 10.20.193.162:0/480681586 >> v1:10.20.193.70:6789/0 conn(0x7f171c121d90 legacy=0x7f171c184b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:25.275 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.272+0000 7f1723c24640 1 -- 10.20.193.162:0/480681586 shutdown_connections 2026-02-24T19:17:25.275 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.272+0000 7f1723c24640 1 -- 10.20.193.162:0/480681586 >> 10.20.193.162:0/480681586 conn(0x7f171c057490 msgr2=0x7f171c188310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:25.275 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.272+0000 7f1723c24640 1 -- 10.20.193.162:0/480681586 shutdown_connections 2026-02-24T19:17:25.275 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.272+0000 7f1723c24640 1 -- 10.20.193.162:0/480681586 wait complete. 2026-02-24T19:17:25.275 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.273+0000 7f1723c24640 1 librados: shutdown 2026-02-24T19:17:25.283 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new ef2c9883-f17f-41ec-96b7-dbbe936b77d3 6 2026-02-24T19:17:25.350 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.349+0000 7f31639fa640 10 monclient: get_monmap_and_config 2026-02-24T19:17:25.350 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.349+0000 7f31639fa640 10 monclient: build_initial_monmap 2026-02-24T19:17:25.350 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.349+0000 7f31639fa640 10 monclient: monmap: 2026-02-24T19:17:25.350 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:25.350 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:25.350 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:17:25.349726+0000 2026-02-24T19:17:25.350 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:17:25.349726+0000 2026-02-24T19:17:25.351 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:25.351 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:25.351 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:25.351 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:25.351 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:25.351 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.353 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.349+0000 7f31639fa640 1 Processor -- start 2026-02-24T19:17:25.353 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.349+0000 7f31639fa640 1 -- start start 2026-02-24T19:17:25.353 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.349+0000 7f31639fa640 10 monclient: init 2026-02-24T19:17:25.354 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.349+0000 7f31639fa640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:25.354 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.349+0000 7f31639fa640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:25.354 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.349+0000 7f31639fa640 10 monclient(hunting): picked mon.noname-a con 0x7f315c11c500 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:25.354 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.349+0000 7f31639fa640 10 monclient(hunting): picked mon.noname-c con 0x7f315c11e420 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:25.354 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.349+0000 7f31639fa640 10 monclient(hunting): picked mon.noname-b con 0x7f315c11ffc0 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:25.354 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.349+0000 7f31639fa640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f315c120d10 con 0x7f315c11c500 2026-02-24T19:17:25.354 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.349+0000 7f31639fa640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f315c120f00 con 0x7f315c11ffc0 2026-02-24T19:17:25.354 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.349+0000 7f31639fa640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f315c1210f0 con 0x7f315c11e420 2026-02-24T19:17:25.354 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.349+0000 7f31639fa640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:25.354 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.349+0000 7f31639fa640 10 monclient(hunting): authenticate will time out at 3620.984994s 2026-02-24T19:17:25.354 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.350+0000 7f3161f70640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f315c11ffc0 0x7f315c120420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.162:45194/0 (socket says 10.20.193.162:45194) 2026-02-24T19:17:25.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.350+0000 7f3161f70640 1 -- 10.20.193.162:0/4276290355 learned_addr learned my addr 10.20.193.162:0/4276290355 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:25.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.351+0000 7f314bfff640 1 -- 10.20.193.162:0/4276290355 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4100563168 0 0) 0x7f315c120f00 con 0x7f315c11ffc0 2026-02-24T19:17:25.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.351+0000 7f314bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:25.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.351+0000 7f314bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:25.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.351+0000 7f314bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:25.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.351+0000 7f314bfff640 10 monclient(hunting): my global_id is 4141 2026-02-24T19:17:25.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.351+0000 7f314bfff640 1 -- 10.20.193.162:0/4276290355 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3144003610 con 0x7f315c11ffc0 2026-02-24T19:17:25.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.351+0000 7f314bfff640 1 -- 10.20.193.162:0/4276290355 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1168431711 0 0) 0x7f315c120d10 con 0x7f315c11c500 2026-02-24T19:17:25.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.351+0000 7f314bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:25.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.351+0000 7f314bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:25.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.351+0000 7f314bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:25.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.351+0000 7f314bfff640 10 monclient(hunting): my global_id is 4161 2026-02-24T19:17:25.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.351+0000 7f314bfff640 1 -- 10.20.193.162:0/4276290355 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f315c120f00 con 0x7f315c11c500 2026-02-24T19:17:25.356 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.351+0000 7f314bfff640 1 -- 10.20.193.162:0/4276290355 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 932898241 0 0) 0x7f315c1210f0 con 0x7f315c11e420 2026-02-24T19:17:25.356 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.351+0000 7f314bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:25.356 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.351+0000 7f314bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:25.356 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.351+0000 7f314bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:25.356 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.351+0000 7f314bfff640 10 monclient(hunting): my global_id is 4160 2026-02-24T19:17:25.356 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.351+0000 7f314bfff640 1 -- 10.20.193.162:0/4276290355 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f315c120d10 con 0x7f315c11e420 2026-02-24T19:17:25.363 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.353+0000 7f314bfff640 1 -- 10.20.193.162:0/4276290355 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2052888369 0 0) 0x7f3144003610 con 0x7f315c11ffc0 2026-02-24T19:17:25.363 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.353+0000 7f314bfff640 1 -- 10.20.193.162:0/4276290355 >> v1:10.20.193.103:6789/0 conn(0x7f315c11e420 legacy=0x7f315c11e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:25.363 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.353+0000 7f314bfff640 1 -- 10.20.193.162:0/4276290355 >> v1:10.20.193.26:6789/0 conn(0x7f315c11c500 legacy=0x7f315c11c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:25.363 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.353+0000 7f314bfff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:25.363 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.353+0000 7f314bfff640 1 monclient: found mon.noname-b 2026-02-24T19:17:25.363 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.353+0000 7f314bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:25.363 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.353+0000 7f314bfff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:17:25.363 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.353+0000 7f314bfff640 1 -- 10.20.193.162:0/4276290355 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c121380 con 0x7f315c11ffc0 2026-02-24T19:17:25.364 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.353+0000 7f314bfff640 10 monclient: _finish_auth 0 2026-02-24T19:17:25.364 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.353+0000 7f314bfff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:25.364 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.353+0000 7f314bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:25.364 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.353+0000 7f314bfff640 1 -- 10.20.193.162:0/4276290355 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f3158003170 con 0x7f315c11ffc0 2026-02-24T19:17:25.364 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.353+0000 7f314bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:25.364 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.353+0000 7f314bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:25.364 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.353+0000 7f314bfff640 10 monclient: dump: 2026-02-24T19:17:25.364 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:25.364 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:25.364 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.364 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.364 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:25.364 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:25.365 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:25.365 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:25.365 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:25.365 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.365 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.353+0000 7f31639fa640 5 monclient: authenticate success, global_id 4141 2026-02-24T19:17:25.365 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.353+0000 7f31639fa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:25.365 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.354+0000 7f314bfff640 1 -- 10.20.193.162:0/4276290355 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f31580033b0 con 0x7f315c11ffc0 2026-02-24T19:17:25.365 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.354+0000 7f314bfff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:25.365 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.354+0000 7f314bfff640 1 -- 10.20.193.162:0/4276290355 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f31580037f0 con 0x7f315c11ffc0 2026-02-24T19:17:25.365 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.354+0000 7f314bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:25.365 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.354+0000 7f314bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:25.365 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.354+0000 7f314bfff640 10 monclient: dump: 2026-02-24T19:17:25.366 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:25.366 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:25.366 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.366 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.366 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:25.366 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:25.366 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:25.366 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:25.366 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:25.366 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.366 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.354+0000 7f31639fa640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:25.366 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.354+0000 7f31639fa640 4 set_mon_vals no callback set 2026-02-24T19:17:25.367 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.354+0000 7f31639fa640 10 monclient: shutdown 2026-02-24T19:17:25.367 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.354+0000 7f31639fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:25.367 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.354+0000 7f31639fa640 1 -- 10.20.193.162:0/4276290355 >> v1:10.20.193.70:6789/0 conn(0x7f315c11ffc0 legacy=0x7f315c120420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:25.367 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.354+0000 7f31639fa640 1 -- 10.20.193.162:0/4276290355 shutdown_connections 2026-02-24T19:17:25.367 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.354+0000 7f31639fa640 1 -- 10.20.193.162:0/4276290355 >> 10.20.193.162:0/4276290355 conn(0x7f315c0588d0 msgr2=0x7f315c058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:25.367 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.354+0000 7f31639fa640 1 -- 10.20.193.162:0/4276290355 shutdown_connections 2026-02-24T19:17:25.367 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.354+0000 7f31639fa640 1 -- 10.20.193.162:0/4276290355 wait complete. 2026-02-24T19:17:25.367 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.354+0000 7f31639fa640 10 monclient: build_initial_monmap 2026-02-24T19:17:25.367 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.354+0000 7f31639fa640 10 monclient: monmap: 2026-02-24T19:17:25.367 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:25.367 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:25.367 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-24T19:17:25.367 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-24T19:17:25.368 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:25.368 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-24T19:17:25.368 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:25.368 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:25.368 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:25.368 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.368 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.354+0000 7f31639fa640 1 librados: starting msgr at 2026-02-24T19:17:25.368 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.354+0000 7f31639fa640 1 librados: starting objecter 2026-02-24T19:17:25.368 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.354+0000 7f31639fa640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:25.368 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.354+0000 7f31639fa640 1 Processor -- start 2026-02-24T19:17:25.368 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.354+0000 7f31639fa640 1 -- start start 2026-02-24T19:17:25.368 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.354+0000 7f31639fa640 1 librados: setting wanted keys 2026-02-24T19:17:25.369 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.354+0000 7f31639fa640 1 librados: calling monclient init 2026-02-24T19:17:25.369 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.354+0000 7f31639fa640 10 monclient: init 2026-02-24T19:17:25.369 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.355+0000 7f31639fa640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:25.369 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.355+0000 7f31639fa640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:25.369 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.355+0000 7f31639fa640 10 monclient(hunting): picked mon.noname-b con 0x7f315c11c500 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:25.369 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.355+0000 7f31639fa640 10 monclient(hunting): picked mon.noname-a con 0x7f315c11e420 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:25.369 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.355+0000 7f31639fa640 10 monclient(hunting): picked mon.noname-c con 0x7f315c11ffc0 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:25.369 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.355+0000 7f31639fa640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f315c179890 con 0x7f315c11e420 2026-02-24T19:17:25.369 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.355+0000 7f31639fa640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f315c17aa70 con 0x7f315c11c500 2026-02-24T19:17:25.369 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.355+0000 7f31639fa640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f315c17bc50 con 0x7f315c11ffc0 2026-02-24T19:17:25.369 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.355+0000 7f31639fa640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:25.369 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.355+0000 7f31639fa640 10 monclient(hunting): authenticate will time out at 3620.990076s 2026-02-24T19:17:25.369 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.355+0000 7f3161f70640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f315c11ffc0 0x7f315c178170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.162:37446/0 (socket says 10.20.193.162:37446) 2026-02-24T19:17:25.370 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.355+0000 7f3161f70640 1 -- 10.20.193.162:0/381456401 learned_addr learned my addr 10.20.193.162:0/381456401 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:25.370 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.355+0000 7f3149ffb640 10 client.?.objecter ms_handle_connect 0x7f315c11ffc0 2026-02-24T19:17:25.370 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.355+0000 7f3149ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:25.370 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.355+0000 7f3149ffb640 10 client.?.objecter ms_handle_connect 0x7f315c11e420 2026-02-24T19:17:25.370 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.355+0000 7f3149ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:25.370 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.355+0000 7f3149ffb640 10 client.?.objecter ms_handle_connect 0x7f315c11c500 2026-02-24T19:17:25.370 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.355+0000 7f3149ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:25.370 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.356+0000 7f3149ffb640 1 -- 10.20.193.162:0/381456401 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3509668106 0 0) 0x7f315c17bc50 con 0x7f315c11ffc0 2026-02-24T19:17:25.370 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.356+0000 7f3149ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:25.370 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.356+0000 7f3149ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:25.370 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.356+0000 7f3149ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:25.370 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.356+0000 7f3149ffb640 10 monclient(hunting): my global_id is 4163 2026-02-24T19:17:25.371 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.356+0000 7f3149ffb640 1 -- 10.20.193.162:0/381456401 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f312c003610 con 0x7f315c11ffc0 2026-02-24T19:17:25.371 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.356+0000 7f3149ffb640 1 -- 10.20.193.162:0/381456401 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1212319844 0 0) 0x7f315c179890 con 0x7f315c11e420 2026-02-24T19:17:25.371 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.356+0000 7f3149ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:25.371 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.356+0000 7f3149ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:25.371 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.356+0000 7f3149ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:25.371 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.356+0000 7f3149ffb640 10 monclient(hunting): my global_id is 4164 2026-02-24T19:17:25.371 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.356+0000 7f3149ffb640 1 -- 10.20.193.162:0/381456401 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f315c17bc50 con 0x7f315c11e420 2026-02-24T19:17:25.371 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.356+0000 7f3149ffb640 1 -- 10.20.193.162:0/381456401 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3463361302 0 0) 0x7f315c17aa70 con 0x7f315c11c500 2026-02-24T19:17:25.371 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.356+0000 7f3149ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:25.371 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.356+0000 7f3149ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:25.371 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.356+0000 7f3149ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:25.371 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.356+0000 7f3149ffb640 10 monclient(hunting): my global_id is 4144 2026-02-24T19:17:25.371 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.356+0000 7f3149ffb640 1 -- 10.20.193.162:0/381456401 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f315c179890 con 0x7f315c11c500 2026-02-24T19:17:25.372 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.358+0000 7f3149ffb640 1 -- 10.20.193.162:0/381456401 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2797511171 0 0) 0x7f315c17bc50 con 0x7f315c11e420 2026-02-24T19:17:25.372 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.358+0000 7f3149ffb640 1 -- 10.20.193.162:0/381456401 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f315c17aa70 con 0x7f315c11e420 2026-02-24T19:17:25.372 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.358+0000 7f3149ffb640 1 -- 10.20.193.162:0/381456401 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f3150002fd0 con 0x7f315c11e420 2026-02-24T19:17:25.372 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.358+0000 7f3149ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:25.372 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.358+0000 7f3149ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:25.372 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.358+0000 7f3149ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:25.372 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:25.372 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:25.372 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.372 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.372 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:25.372 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:25.372 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:25.373 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:25.373 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:25.373 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.373 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.358+0000 7f3149ffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:25.373 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.358+0000 7f3149ffb640 1 -- 10.20.193.162:0/381456401 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1329635559 0 0) 0x7f312c003610 con 0x7f315c11ffc0 2026-02-24T19:17:25.373 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.358+0000 7f3149ffb640 1 -- 10.20.193.162:0/381456401 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f315c17bc50 con 0x7f315c11ffc0 2026-02-24T19:17:25.373 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.358+0000 7f3149ffb640 1 -- 10.20.193.162:0/381456401 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f3158003700 con 0x7f315c11ffc0 2026-02-24T19:17:25.373 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.358+0000 7f3149ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:25.373 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.358+0000 7f3149ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:25.373 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.358+0000 7f3149ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:25.373 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:25.374 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:25.374 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.374 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.374 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:25.374 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:25.374 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:25.374 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:25.374 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:25.374 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.374 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.358+0000 7f3149ffb640 1 -- 10.20.193.162:0/381456401 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3863485157 0 0) 0x7f315c179890 con 0x7f315c11c500 2026-02-24T19:17:25.374 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.358+0000 7f3149ffb640 1 -- 10.20.193.162:0/381456401 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f312c003610 con 0x7f315c11c500 2026-02-24T19:17:25.374 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.358+0000 7f3149ffb640 1 -- 10.20.193.162:0/381456401 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f314c003070 con 0x7f315c11c500 2026-02-24T19:17:25.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.358+0000 7f3149ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:25.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.358+0000 7f3149ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:25.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.358+0000 7f3149ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:25.375 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:25.375 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:25.375 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.375 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.375 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:25.375 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:25.375 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:25.375 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:25.375 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:25.376 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.360+0000 7f3149ffb640 1 -- 10.20.193.162:0/381456401 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 226140798 0 0) 0x7f315c17aa70 con 0x7f315c11e420 2026-02-24T19:17:25.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.360+0000 7f3149ffb640 1 -- 10.20.193.162:0/381456401 >> v1:10.20.193.103:6789/0 conn(0x7f315c11ffc0 legacy=0x7f315c178170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:25.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.360+0000 7f3149ffb640 1 -- 10.20.193.162:0/381456401 >> v1:10.20.193.70:6789/0 conn(0x7f315c11c500 legacy=0x7f315c1300f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:25.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.360+0000 7f3149ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:25.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.360+0000 7f3149ffb640 1 monclient: found mon.a 2026-02-24T19:17:25.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.360+0000 7f3149ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:25.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.360+0000 7f3149ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:25.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.360+0000 7f3149ffb640 1 -- 10.20.193.162:0/381456401 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c17ce30 con 0x7f315c11e420 2026-02-24T19:17:25.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.360+0000 7f3149ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:25.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.360+0000 7f3149ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:25.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.360+0000 7f3149ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:25.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.360+0000 7f31639fa640 5 monclient: authenticate success, global_id 4164 2026-02-24T19:17:25.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.360+0000 7f31639fa640 10 monclient: _renew_subs 2026-02-24T19:17:25.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.360+0000 7f31639fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:25.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.360+0000 7f31639fa640 1 -- 10.20.193.162:0/381456401 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f315c179a60 con 0x7f315c11e420 2026-02-24T19:17:25.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.360+0000 7f31639fa640 10 client.4164.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:25.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.360+0000 7f31639fa640 10 monclient: _renew_subs 2026-02-24T19:17:25.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.360+0000 7f31639fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:25.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.360+0000 7f31639fa640 1 -- 10.20.193.162:0/381456401 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f315c17a050 con 0x7f315c11e420 2026-02-24T19:17:25.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.360+0000 7f31639fa640 1 librados: init done 2026-02-24T19:17:25.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.360+0000 7f31639fa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:25.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.360+0000 7f31639fa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:25.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.360+0000 7f31639fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:25.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.360+0000 7f31639fa640 1 -- 10.20.193.162:0/381456401 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f315c18b560 con 0x7f315c11e420 2026-02-24T19:17:25.392 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.392+0000 7f3149ffb640 1 -- 10.20.193.162:0/381456401 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3150003170 con 0x7f315c11e420 2026-02-24T19:17:25.392 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.392+0000 7f3149ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:25.392 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.392+0000 7f3149ffb640 1 -- 10.20.193.162:0/381456401 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f31500038a0 con 0x7f315c11e420 2026-02-24T19:17:25.393 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.392+0000 7f3149ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:25.393 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.392+0000 7f3149ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:25.393 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.392+0000 7f3149ffb640 10 monclient: dump: 2026-02-24T19:17:25.393 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:25.393 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:25.393 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.393 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.393 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:25.393 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:25.393 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:25.393 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:25.393 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:25.394 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.394 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.392+0000 7f314b7fe640 4 set_mon_vals no callback set 2026-02-24T19:17:25.395 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.392+0000 7f3149ffb640 1 -- 10.20.193.162:0/381456401 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 2) ==== 50897+0+0 (unknown 4005228020 0 0) 0x7f3150010160 con 0x7f315c11e420 2026-02-24T19:17:25.395 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.393+0000 7f3149ffb640 1 -- 10.20.193.162:0/381456401 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(8..8 src has 1..8) ==== 1410+0+0 (unknown 3301978266 0 0) 0x7f3150015420 con 0x7f315c11e420 2026-02-24T19:17:25.395 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.393+0000 7f3149ffb640 10 client.4164.objecter ms_dispatch2 0x7f315c000b90 osd_map(8..8 src has 1..8) 2026-02-24T19:17:25.395 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.393+0000 7f3149ffb640 3 client.4164.objecter handle_osd_map got epochs [8,8] > 0 2026-02-24T19:17:25.395 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.393+0000 7f3149ffb640 3 client.4164.objecter handle_osd_map decoding full epoch 8 2026-02-24T19:17:25.395 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.393+0000 7f3149ffb640 20 client.4164.objecter dump_active .. 0 homeless 2026-02-24T19:17:25.395 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.394+0000 7f3149ffb640 1 -- 10.20.193.162:0/381456401 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f3150016200 con 0x7f315c11e420 2026-02-24T19:17:25.395 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.394+0000 7f3149ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:25.395 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.394+0000 7f3149ffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:25.427 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.426+0000 7f31639fa640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "ef2c9883-f17f-41ec-96b7-dbbe936b77d3", "id": 6}] 2026-02-24T19:17:25.427 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.426+0000 7f31639fa640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "ef2c9883-f17f-41ec-96b7-dbbe936b77d3", "id": 6}] 2026-02-24T19:17:25.427 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.426+0000 7f31639fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:25.428 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.426+0000 7f31639fa640 1 -- 10.20.193.162:0/381456401 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "osd new", "uuid": "ef2c9883-f17f-41ec-96b7-dbbe936b77d3", "id": 6} v 0) -- 0x7f315c17a390 con 0x7f315c11e420 2026-02-24T19:17:25.456 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.456+0000 7f3149ffb640 1 -- 10.20.193.162:0/381456401 <== mon.0 v1:10.20.193.26:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ef2c9883-f17f-41ec-96b7-dbbe936b77d3", "id": 6}]=0 v9) ==== 112+0+2 (unknown 864346048 0 1113811849) 0x7f3150015b00 con 0x7f315c11e420 2026-02-24T19:17:25.456 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.456+0000 7f3149ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "ef2c9883-f17f-41ec-96b7-dbbe936b77d3", "id": 6}] 2026-02-24T19:17:25.457 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.456+0000 7f3149ffb640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:25.457 INFO:teuthology.orchestra.run.trial162.stdout:6 2026-02-24T19:17:25.458 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.456+0000 7f31639fa640 10 librados: watch_flush enter 2026-02-24T19:17:25.458 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.456+0000 7f31639fa640 10 librados: watch_flush exit 2026-02-24T19:17:25.458 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.456+0000 7f31639fa640 20 client.4164.objecter shutdown clearing up homeless session... 2026-02-24T19:17:25.458 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.456+0000 7f31639fa640 10 client.4164.objecter successfully canceled tick 2026-02-24T19:17:25.458 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.456+0000 7f31639fa640 10 monclient: shutdown 2026-02-24T19:17:25.459 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.456+0000 7f31639fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:25.459 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.456+0000 7f31639fa640 1 -- 10.20.193.162:0/381456401 >> v1:10.20.193.26:6789/0 conn(0x7f315c11e420 legacy=0x7f315c176a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:25.459 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.456+0000 7f31639fa640 1 -- 10.20.193.162:0/381456401 shutdown_connections 2026-02-24T19:17:25.459 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.456+0000 7f31639fa640 1 -- 10.20.193.162:0/381456401 >> 10.20.193.162:0/381456401 conn(0x7f315c0588d0 msgr2=0x7f315c059490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:25.459 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.456+0000 7f31639fa640 1 -- 10.20.193.162:0/381456401 shutdown_connections 2026-02-24T19:17:25.459 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.456+0000 7f31639fa640 1 -- 10.20.193.162:0/381456401 wait complete. 2026-02-24T19:17:25.459 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.456+0000 7f31639fa640 1 librados: shutdown 2026-02-24T19:17:25.464 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new 3e4a495e-c742-43fc-991a-371a47ff87bf 7 2026-02-24T19:17:25.532 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.530+0000 7f4e69778640 10 monclient: get_monmap_and_config 2026-02-24T19:17:25.532 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.530+0000 7f4e69778640 10 monclient: build_initial_monmap 2026-02-24T19:17:25.532 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.530+0000 7f4e69778640 10 monclient: monmap: 2026-02-24T19:17:25.533 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:25.533 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:25.533 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:17:25.530898+0000 2026-02-24T19:17:25.533 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:17:25.530898+0000 2026-02-24T19:17:25.533 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:25.533 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:25.533 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:25.533 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:25.533 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:25.533 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.533 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.530+0000 7f4e69778640 1 Processor -- start 2026-02-24T19:17:25.534 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.530+0000 7f4e69778640 1 -- start start 2026-02-24T19:17:25.534 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.530+0000 7f4e69778640 10 monclient: init 2026-02-24T19:17:25.534 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.531+0000 7f4e69778640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:25.534 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.531+0000 7f4e69778640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:25.534 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.531+0000 7f4e69778640 10 monclient(hunting): picked mon.noname-b con 0x7f4e6411e810 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:25.534 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.531+0000 7f4e69778640 10 monclient(hunting): picked mon.noname-a con 0x7f4e64140740 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:25.534 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.531+0000 7f4e69778640 10 monclient(hunting): picked mon.noname-c con 0x7f4e641622d0 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:25.534 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.531+0000 7f4e69778640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e64184060 con 0x7f4e64140740 2026-02-24T19:17:25.534 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.531+0000 7f4e69778640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e64185260 con 0x7f4e6411e810 2026-02-24T19:17:25.534 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.531+0000 7f4e69778640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e64186460 con 0x7f4e641622d0 2026-02-24T19:17:25.534 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.531+0000 7f4e69778640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:25.534 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.531+0000 7f4e69778640 10 monclient(hunting): authenticate will time out at 3621.166182s 2026-02-24T19:17:25.534 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.531+0000 7f4e637fe640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f4e641622d0 0x7f4e64182760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.162:37460/0 (socket says 10.20.193.162:37460) 2026-02-24T19:17:25.535 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.531+0000 7f4e637fe640 1 -- 10.20.193.162:0/2998466224 learned_addr learned my addr 10.20.193.162:0/2998466224 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:25.540 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.532+0000 7f4e61ffb640 1 -- 10.20.193.162:0/2998466224 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 590691288 0 0) 0x7f4e64184060 con 0x7f4e64140740 2026-02-24T19:17:25.540 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.532+0000 7f4e61ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:25.540 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.532+0000 7f4e61ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:25.540 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.532+0000 7f4e61ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:25.540 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.532+0000 7f4e61ffb640 10 monclient(hunting): my global_id is 4167 2026-02-24T19:17:25.540 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.533+0000 7f4e61ffb640 1 -- 10.20.193.162:0/2998466224 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e50003610 con 0x7f4e64140740 2026-02-24T19:17:25.540 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.533+0000 7f4e61ffb640 1 -- 10.20.193.162:0/2998466224 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 697228382 0 0) 0x7f4e64186460 con 0x7f4e641622d0 2026-02-24T19:17:25.540 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.533+0000 7f4e61ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:25.540 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.533+0000 7f4e61ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:25.541 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.533+0000 7f4e61ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:25.541 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.533+0000 7f4e61ffb640 10 monclient(hunting): my global_id is 4166 2026-02-24T19:17:25.541 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.533+0000 7f4e61ffb640 1 -- 10.20.193.162:0/2998466224 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e64184060 con 0x7f4e641622d0 2026-02-24T19:17:25.541 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.533+0000 7f4e61ffb640 1 -- 10.20.193.162:0/2998466224 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 752123154 0 0) 0x7f4e64185260 con 0x7f4e6411e810 2026-02-24T19:17:25.541 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.533+0000 7f4e61ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:25.541 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.533+0000 7f4e61ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:25.541 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.533+0000 7f4e61ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:25.541 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.533+0000 7f4e61ffb640 10 monclient(hunting): my global_id is 4147 2026-02-24T19:17:25.541 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.533+0000 7f4e61ffb640 1 -- 10.20.193.162:0/2998466224 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e64186460 con 0x7f4e6411e810 2026-02-24T19:17:25.541 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.534+0000 7f4e61ffb640 1 -- 10.20.193.162:0/2998466224 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4286625967 0 0) 0x7f4e50003610 con 0x7f4e64140740 2026-02-24T19:17:25.541 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.534+0000 7f4e61ffb640 1 -- 10.20.193.162:0/2998466224 >> v1:10.20.193.103:6789/0 conn(0x7f4e641622d0 legacy=0x7f4e64182760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:25.541 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.534+0000 7f4e61ffb640 1 -- 10.20.193.162:0/2998466224 >> v1:10.20.193.70:6789/0 conn(0x7f4e6411e810 legacy=0x7f4e6411ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:25.541 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.534+0000 7f4e61ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:25.542 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.534+0000 7f4e61ffb640 1 monclient: found mon.noname-a 2026-02-24T19:17:25.542 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.534+0000 7f4e61ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:25.542 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.534+0000 7f4e61ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:17:25.542 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.534+0000 7f4e61ffb640 1 -- 10.20.193.162:0/2998466224 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e64187700 con 0x7f4e64140740 2026-02-24T19:17:25.542 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.534+0000 7f4e61ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:25.542 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.534+0000 7f4e61ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:25.542 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.534+0000 7f4e61ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:25.542 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.534+0000 7f4e69778640 5 monclient: authenticate success, global_id 4167 2026-02-24T19:17:25.542 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.534+0000 7f4e69778640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:25.542 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.534+0000 7f4e61ffb640 1 -- 10.20.193.162:0/2998466224 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f4e4c002df0 con 0x7f4e64140740 2026-02-24T19:17:25.542 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.534+0000 7f4e61ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:25.542 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.534+0000 7f4e61ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:25.543 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.534+0000 7f4e61ffb640 10 monclient: dump: 2026-02-24T19:17:25.543 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:25.543 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:25.543 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.543 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.543 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:25.543 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:25.543 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:25.543 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:25.543 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:25.543 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.543 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.534+0000 7f4e69778640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:25.543 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.535+0000 7f4e61ffb640 1 -- 10.20.193.162:0/2998466224 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4e4c0030b0 con 0x7f4e64140740 2026-02-24T19:17:25.544 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.535+0000 7f4e61ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:25.544 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.535+0000 7f4e61ffb640 1 -- 10.20.193.162:0/2998466224 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f4e4c0034b0 con 0x7f4e64140740 2026-02-24T19:17:25.544 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.535+0000 7f4e61ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:25.544 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.535+0000 7f4e61ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:25.544 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.535+0000 7f4e61ffb640 10 monclient: dump: 2026-02-24T19:17:25.544 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:25.544 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:25.544 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.544 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.544 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:25.544 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:25.544 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:25.545 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:25.545 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:25.545 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.545 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.535+0000 7f4e69778640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:25.545 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.535+0000 7f4e69778640 4 set_mon_vals no callback set 2026-02-24T19:17:25.545 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.535+0000 7f4e69778640 10 monclient: shutdown 2026-02-24T19:17:25.545 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.535+0000 7f4e69778640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:25.545 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.535+0000 7f4e69778640 1 -- 10.20.193.162:0/2998466224 >> v1:10.20.193.26:6789/0 conn(0x7f4e64140740 legacy=0x7f4e64160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:25.545 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.535+0000 7f4e69778640 1 -- 10.20.193.162:0/2998466224 shutdown_connections 2026-02-24T19:17:25.545 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.535+0000 7f4e69778640 1 -- 10.20.193.162:0/2998466224 >> 10.20.193.162:0/2998466224 conn(0x7f4e64055dc0 msgr2=0x7f4e640561c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:25.545 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.535+0000 7f4e69778640 1 -- 10.20.193.162:0/2998466224 shutdown_connections 2026-02-24T19:17:25.545 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.535+0000 7f4e69778640 1 -- 10.20.193.162:0/2998466224 wait complete. 2026-02-24T19:17:25.545 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.536+0000 7f4e69778640 10 monclient: build_initial_monmap 2026-02-24T19:17:25.546 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.536+0000 7f4e69778640 10 monclient: monmap: 2026-02-24T19:17:25.546 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:25.546 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:25.546 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-24T19:17:25.546 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-24T19:17:25.546 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:25.546 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-24T19:17:25.546 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:25.546 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:25.546 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:25.546 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.546 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.536+0000 7f4e69778640 1 librados: starting msgr at 2026-02-24T19:17:25.546 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.536+0000 7f4e69778640 1 librados: starting objecter 2026-02-24T19:17:25.547 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.536+0000 7f4e69778640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:25.547 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.536+0000 7f4e69778640 1 Processor -- start 2026-02-24T19:17:25.547 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.536+0000 7f4e69778640 1 -- start start 2026-02-24T19:17:25.547 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.536+0000 7f4e69778640 1 librados: setting wanted keys 2026-02-24T19:17:25.547 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.536+0000 7f4e69778640 1 librados: calling monclient init 2026-02-24T19:17:25.547 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.536+0000 7f4e69778640 10 monclient: init 2026-02-24T19:17:25.547 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.536+0000 7f4e69778640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:25.547 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.536+0000 7f4e69778640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:25.547 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.536+0000 7f4e69778640 10 monclient(hunting): picked mon.noname-c con 0x7f4e6411e810 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:25.547 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.536+0000 7f4e69778640 10 monclient(hunting): picked mon.noname-a con 0x7f4e64140740 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:25.547 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.536+0000 7f4e69778640 10 monclient(hunting): picked mon.noname-b con 0x7f4e641622d0 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:25.547 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.536+0000 7f4e69778640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e6412e7a0 con 0x7f4e64140740 2026-02-24T19:17:25.548 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.536+0000 7f4e69778640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e6412f980 con 0x7f4e641622d0 2026-02-24T19:17:25.548 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.536+0000 7f4e69778640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e64130b80 con 0x7f4e6411e810 2026-02-24T19:17:25.548 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.536+0000 7f4e69778640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:25.548 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.536+0000 7f4e69778640 10 monclient(hunting): authenticate will time out at 3621.171454s 2026-02-24T19:17:25.548 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.536+0000 7f4e637fe640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f4e641622d0 0x7f4e6412ced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.162:45216/0 (socket says 10.20.193.162:45216) 2026-02-24T19:17:25.548 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.536+0000 7f4e637fe640 1 -- 10.20.193.162:0/1643327576 learned_addr learned my addr 10.20.193.162:0/1643327576 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:25.548 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.537+0000 7f4e437fe640 10 client.?.objecter ms_handle_connect 0x7f4e641622d0 2026-02-24T19:17:25.548 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.537+0000 7f4e437fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:25.548 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.537+0000 7f4e437fe640 10 client.?.objecter ms_handle_connect 0x7f4e6411e810 2026-02-24T19:17:25.548 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.537+0000 7f4e437fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:25.548 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.537+0000 7f4e437fe640 10 client.?.objecter ms_handle_connect 0x7f4e64140740 2026-02-24T19:17:25.548 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.537+0000 7f4e437fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:25.549 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.538+0000 7f4e437fe640 1 -- 10.20.193.162:0/1643327576 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 68586073 0 0) 0x7f4e64130b80 con 0x7f4e6411e810 2026-02-24T19:17:25.549 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.538+0000 7f4e437fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:25.549 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.538+0000 7f4e437fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:25.549 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.538+0000 7f4e437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:25.549 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.538+0000 7f4e437fe640 10 monclient(hunting): my global_id is 4169 2026-02-24T19:17:25.549 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.538+0000 7f4e437fe640 1 -- 10.20.193.162:0/1643327576 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e30003610 con 0x7f4e6411e810 2026-02-24T19:17:25.549 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.538+0000 7f4e437fe640 1 -- 10.20.193.162:0/1643327576 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2572695522 0 0) 0x7f4e6412f980 con 0x7f4e641622d0 2026-02-24T19:17:25.549 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.538+0000 7f4e437fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:25.549 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.538+0000 7f4e437fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:25.549 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.538+0000 7f4e437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:25.549 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.538+0000 7f4e437fe640 10 monclient(hunting): my global_id is 4150 2026-02-24T19:17:25.549 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.538+0000 7f4e437fe640 1 -- 10.20.193.162:0/1643327576 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e64130b80 con 0x7f4e641622d0 2026-02-24T19:17:25.549 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.538+0000 7f4e437fe640 1 -- 10.20.193.162:0/1643327576 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3404019844 0 0) 0x7f4e6412e7a0 con 0x7f4e64140740 2026-02-24T19:17:25.550 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.538+0000 7f4e437fe640 10 monclient(hunting): _negotiate 2026-02-24T19:17:25.550 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.538+0000 7f4e437fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:25.550 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.538+0000 7f4e437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:25.550 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.538+0000 7f4e437fe640 10 monclient(hunting): my global_id is 4170 2026-02-24T19:17:25.550 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.538+0000 7f4e437fe640 1 -- 10.20.193.162:0/1643327576 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e6412f980 con 0x7f4e64140740 2026-02-24T19:17:25.553 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.540+0000 7f4e437fe640 1 -- 10.20.193.162:0/1643327576 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3693377257 0 0) 0x7f4e64130b80 con 0x7f4e641622d0 2026-02-24T19:17:25.553 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.540+0000 7f4e437fe640 1 -- 10.20.193.162:0/1643327576 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4e6412e7a0 con 0x7f4e641622d0 2026-02-24T19:17:25.553 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.540+0000 7f4e437fe640 1 -- 10.20.193.162:0/1643327576 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f4e540033b0 con 0x7f4e641622d0 2026-02-24T19:17:25.553 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.540+0000 7f4e437fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:25.553 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.540+0000 7f4e437fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:25.554 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.540+0000 7f4e437fe640 10 monclient(hunting): dump: 2026-02-24T19:17:25.554 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:25.554 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:25.554 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.554 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.554 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:25.554 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:25.554 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:25.554 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:25.554 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:25.554 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.554 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.540+0000 7f4e437fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:25.555 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.540+0000 7f4e437fe640 1 -- 10.20.193.162:0/1643327576 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 779294463 0 0) 0x7f4e30003610 con 0x7f4e6411e810 2026-02-24T19:17:25.555 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.540+0000 7f4e437fe640 1 -- 10.20.193.162:0/1643327576 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4e64130b80 con 0x7f4e6411e810 2026-02-24T19:17:25.555 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.540+0000 7f4e437fe640 1 -- 10.20.193.162:0/1643327576 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f4e58003060 con 0x7f4e6411e810 2026-02-24T19:17:25.555 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.540+0000 7f4e437fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:25.555 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.540+0000 7f4e437fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:25.555 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.540+0000 7f4e437fe640 10 monclient(hunting): dump: 2026-02-24T19:17:25.555 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:25.555 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:25.555 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.555 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.555 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:25.555 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:25.556 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:25.556 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:25.556 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:25.556 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.556 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.542+0000 7f4e437fe640 1 -- 10.20.193.162:0/1643327576 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 475812755 0 0) 0x7f4e6412e7a0 con 0x7f4e641622d0 2026-02-24T19:17:25.556 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.542+0000 7f4e437fe640 1 -- 10.20.193.162:0/1643327576 >> v1:10.20.193.103:6789/0 conn(0x7f4e6411e810 legacy=0x7f4e64182760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:25.556 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.542+0000 7f4e437fe640 1 -- 10.20.193.162:0/1643327576 >> v1:10.20.193.26:6789/0 conn(0x7f4e64140740 legacy=0x7f4e64160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:25.556 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.542+0000 7f4e437fe640 10 monclient: _finish_hunting 0 2026-02-24T19:17:25.556 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.542+0000 7f4e437fe640 1 monclient: found mon.b 2026-02-24T19:17:25.556 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.542+0000 7f4e437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:25.556 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.542+0000 7f4e437fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:25.556 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.542+0000 7f4e437fe640 1 -- 10.20.193.162:0/1643327576 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e64131e20 con 0x7f4e641622d0 2026-02-24T19:17:25.557 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.542+0000 7f4e437fe640 10 monclient: _finish_auth 0 2026-02-24T19:17:25.557 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.542+0000 7f4e437fe640 10 monclient: _check_auth_tickets 2026-02-24T19:17:25.557 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.542+0000 7f4e437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:25.557 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.542+0000 7f4e69778640 5 monclient: authenticate success, global_id 4150 2026-02-24T19:17:25.557 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.542+0000 7f4e69778640 10 monclient: _renew_subs 2026-02-24T19:17:25.557 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.542+0000 7f4e69778640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:25.557 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.542+0000 7f4e69778640 1 -- 10.20.193.162:0/1643327576 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4e64130db0 con 0x7f4e641622d0 2026-02-24T19:17:25.557 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.542+0000 7f4e69778640 10 client.4150.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:25.557 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.542+0000 7f4e69778640 10 monclient: _renew_subs 2026-02-24T19:17:25.557 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.542+0000 7f4e69778640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:25.557 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.542+0000 7f4e69778640 1 -- 10.20.193.162:0/1643327576 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4e64131320 con 0x7f4e641622d0 2026-02-24T19:17:25.557 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.542+0000 7f4e69778640 1 librados: init done 2026-02-24T19:17:25.557 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.542+0000 7f4e69778640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:25.558 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.542+0000 7f4e69778640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:25.558 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.542+0000 7f4e69778640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:25.558 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.542+0000 7f4e69778640 1 -- 10.20.193.162:0/1643327576 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e641869c0 con 0x7f4e641622d0 2026-02-24T19:17:25.558 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.546+0000 7f4e437fe640 1 -- 10.20.193.162:0/1643327576 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4e54003550 con 0x7f4e641622d0 2026-02-24T19:17:25.558 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.546+0000 7f4e437fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:25.558 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.546+0000 7f4e437fe640 1 -- 10.20.193.162:0/1643327576 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f4e54004e70 con 0x7f4e641622d0 2026-02-24T19:17:25.558 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.546+0000 7f4e437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:25.558 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.546+0000 7f4e437fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:25.558 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.546+0000 7f4e437fe640 10 monclient: dump: 2026-02-24T19:17:25.558 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:25.558 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:25.558 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.559 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.559 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:25.559 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:25.559 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:25.559 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:25.559 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:25.559 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.559 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.546+0000 7f4e617fa640 4 set_mon_vals no callback set 2026-02-24T19:17:25.559 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.547+0000 7f4e437fe640 1 -- 10.20.193.162:0/1643327576 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 2) ==== 50897+0+0 (unknown 4005228020 0 0) 0x7f4e540116f0 con 0x7f4e641622d0 2026-02-24T19:17:25.559 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.548+0000 7f4e437fe640 1 -- 10.20.193.162:0/1643327576 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(9..9 src has 1..9) ==== 1525+0+0 (unknown 2565159470 0 0) 0x7f4e54013230 con 0x7f4e641622d0 2026-02-24T19:17:25.559 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.548+0000 7f4e437fe640 10 client.4150.objecter ms_dispatch2 0x7f4e64000b90 osd_map(9..9 src has 1..9) 2026-02-24T19:17:25.559 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.548+0000 7f4e437fe640 3 client.4150.objecter handle_osd_map got epochs [9,9] > 0 2026-02-24T19:17:25.560 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.548+0000 7f4e437fe640 3 client.4150.objecter handle_osd_map decoding full epoch 9 2026-02-24T19:17:25.560 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.548+0000 7f4e437fe640 20 client.4150.objecter dump_active .. 0 homeless 2026-02-24T19:17:25.578 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.577+0000 7f4e437fe640 1 -- 10.20.193.162:0/1643327576 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f4e54017900 con 0x7f4e641622d0 2026-02-24T19:17:25.578 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.577+0000 7f4e437fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:25.578 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.577+0000 7f4e437fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:25.611 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.610+0000 7f4e69778640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "3e4a495e-c742-43fc-991a-371a47ff87bf", "id": 7}] 2026-02-24T19:17:25.612 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.610+0000 7f4e69778640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "3e4a495e-c742-43fc-991a-371a47ff87bf", "id": 7}] 2026-02-24T19:17:25.612 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.610+0000 7f4e69778640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:25.612 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.610+0000 7f4e69778640 1 -- 10.20.193.162:0/1643327576 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "osd new", "uuid": "3e4a495e-c742-43fc-991a-371a47ff87bf", "id": 7} v 0) -- 0x7f4e64131660 con 0x7f4e641622d0 2026-02-24T19:17:25.803 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-24T19:17:25.801+0000 7fbb46c67640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-24T19:17:25.812 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.810+0000 7f4e437fe640 1 -- 10.20.193.162:0/1643327576 <== mon.1 v1:10.20.193.70:6789/0 10 ==== mgrmap(e 3) ==== 101401+0+0 (unknown 3979941933 0 0) 0x7f4e54016b20 con 0x7f4e641622d0 2026-02-24T19:17:25.813 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.811+0000 7f4e62ffd640 10 monclient: get_auth_request con 0x7f4e30077f00 auth_method 0 2026-02-24T19:17:25.813 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.811+0000 7f4e437fe640 10 client.4150.objecter ms_handle_connect 0x7f4e30077f00 2026-02-24T19:17:25.866 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-24T19:17:25.864+0000 7fbb46c67640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-24T19:17:25.868 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.866+0000 7f4e437fe640 1 -- 10.20.193.162:0/1643327576 <== mon.1 v1:10.20.193.70:6789/0 11 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3e4a495e-c742-43fc-991a-371a47ff87bf", "id": 7}]=0 v10) ==== 112+0+2 (unknown 2450083989 0 1371665406) 0x7f4e54017b90 con 0x7f4e641622d0 2026-02-24T19:17:25.868 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.866+0000 7f4e437fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "3e4a495e-c742-43fc-991a-371a47ff87bf", "id": 7}] 2026-02-24T19:17:25.868 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.866+0000 7f4e437fe640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:25.869 INFO:teuthology.orchestra.run.trial162.stdout:7 2026-02-24T19:17:25.870 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.867+0000 7f4e69778640 10 librados: watch_flush enter 2026-02-24T19:17:25.870 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.867+0000 7f4e69778640 10 librados: watch_flush exit 2026-02-24T19:17:25.870 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.867+0000 7f4e69778640 20 client.4150.objecter shutdown clearing up homeless session... 2026-02-24T19:17:25.870 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.867+0000 7f4e69778640 10 client.4150.objecter successfully canceled tick 2026-02-24T19:17:25.871 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.867+0000 7f4e69778640 1 -- 10.20.193.162:0/1643327576 >> v1:10.20.193.162:6800/3889602630 conn(0x7f4e30077f00 legacy=0x7f4e300982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:25.871 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.867+0000 7f4e69778640 10 monclient: shutdown 2026-02-24T19:17:25.871 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.867+0000 7f4e69778640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:25.871 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.867+0000 7f4e69778640 1 -- 10.20.193.162:0/1643327576 >> v1:10.20.193.70:6789/0 conn(0x7f4e641622d0 legacy=0x7f4e6412ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:25.871 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.867+0000 7f4e69778640 1 -- 10.20.193.162:0/1643327576 shutdown_connections 2026-02-24T19:17:25.871 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.867+0000 7f4e69778640 1 -- 10.20.193.162:0/1643327576 >> 10.20.193.162:0/1643327576 conn(0x7f4e64055dc0 msgr2=0x7f4e64182f10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:25.871 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.867+0000 7f4e69778640 1 -- 10.20.193.162:0/1643327576 shutdown_connections 2026-02-24T19:17:25.871 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.867+0000 7f4e69778640 1 -- 10.20.193.162:0/1643327576 wait complete. 2026-02-24T19:17:25.871 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.867+0000 7f4e69778640 1 librados: shutdown 2026-02-24T19:17:25.879 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new fb377a45-1ce5-4e07-92cd-7f546cfad57f 8 2026-02-24T19:17:25.943 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.941+0000 7f93675c0640 10 monclient: get_monmap_and_config 2026-02-24T19:17:25.943 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.941+0000 7f93675c0640 10 monclient: build_initial_monmap 2026-02-24T19:17:25.943 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.941+0000 7f93675c0640 10 monclient: monmap: 2026-02-24T19:17:25.944 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:25.944 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:25.944 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:17:25.943054+0000 2026-02-24T19:17:25.944 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:17:25.943054+0000 2026-02-24T19:17:25.944 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:25.944 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:25.944 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:25.944 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:25.944 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:25.944 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.947 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.942+0000 7f93675c0640 1 Processor -- start 2026-02-24T19:17:25.947 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.942+0000 7f93675c0640 1 -- start start 2026-02-24T19:17:25.947 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.942+0000 7f93675c0640 10 monclient: init 2026-02-24T19:17:25.947 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.942+0000 7f93675c0640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:25.947 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.942+0000 7f93675c0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:25.947 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.942+0000 7f93675c0640 10 monclient(hunting): picked mon.noname-a con 0x7f9360121d90 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:25.948 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.942+0000 7f93675c0640 10 monclient(hunting): picked mon.noname-c con 0x7f9360142a00 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:25.948 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.942+0000 7f93675c0640 10 monclient(hunting): picked mon.noname-b con 0x7f9360164710 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:25.948 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.942+0000 7f93675c0640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93601864c0 con 0x7f9360121d90 2026-02-24T19:17:25.948 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.942+0000 7f93675c0640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93601876c0 con 0x7f9360164710 2026-02-24T19:17:25.948 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.942+0000 7f93675c0640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93601888c0 con 0x7f9360142a00 2026-02-24T19:17:25.948 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.942+0000 7f93675c0640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:25.948 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.942+0000 7f93675c0640 10 monclient(hunting): authenticate will time out at 3621.578442s 2026-02-24T19:17:25.948 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.942+0000 7f9365b36640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f9360164710 0x7f9360184bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.162:45228/0 (socket says 10.20.193.162:45228) 2026-02-24T19:17:25.948 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.942+0000 7f9365b36640 1 -- 10.20.193.162:0/3539278392 learned_addr learned my addr 10.20.193.162:0/3539278392 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:25.948 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.942+0000 7f9364b34640 1 --1- 10.20.193.162:0/3539278392 >> v1:10.20.193.103:6789/0 conn(0x7f9360142a00 0x7f9360162e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.162:37474/0 (socket says 10.20.193.162:37474) 2026-02-24T19:17:25.948 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.944+0000 7f934ffff640 1 -- 10.20.193.162:0/3539278392 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3005645156 0 0) 0x7f93601876c0 con 0x7f9360164710 2026-02-24T19:17:25.948 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.944+0000 7f934ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:25.949 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.944+0000 7f934ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:25.949 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.944+0000 7f934ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:25.949 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.944+0000 7f934ffff640 10 monclient(hunting): my global_id is 4153 2026-02-24T19:17:25.949 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.944+0000 7f934ffff640 1 -- 10.20.193.162:0/3539278392 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9348003610 con 0x7f9360164710 2026-02-24T19:17:25.949 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.944+0000 7f934ffff640 1 -- 10.20.193.162:0/3539278392 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 868874310 0 0) 0x7f93601864c0 con 0x7f9360121d90 2026-02-24T19:17:25.949 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.944+0000 7f934ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:25.949 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.944+0000 7f934ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:25.949 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.944+0000 7f934ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:25.949 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.944+0000 7f934ffff640 10 monclient(hunting): my global_id is 4173 2026-02-24T19:17:25.949 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.944+0000 7f934ffff640 1 -- 10.20.193.162:0/3539278392 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93601876c0 con 0x7f9360121d90 2026-02-24T19:17:25.949 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.944+0000 7f934ffff640 1 -- 10.20.193.162:0/3539278392 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4081483642 0 0) 0x7f93601888c0 con 0x7f9360142a00 2026-02-24T19:17:25.950 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.944+0000 7f934ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:25.950 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.944+0000 7f934ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:25.950 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.944+0000 7f934ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:25.950 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.944+0000 7f934ffff640 10 monclient(hunting): my global_id is 4172 2026-02-24T19:17:25.950 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.944+0000 7f934ffff640 1 -- 10.20.193.162:0/3539278392 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93601864c0 con 0x7f9360142a00 2026-02-24T19:17:25.957 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.946+0000 7f934ffff640 1 -- 10.20.193.162:0/3539278392 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2496409170 0 0) 0x7f93601876c0 con 0x7f9360121d90 2026-02-24T19:17:25.957 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.946+0000 7f934ffff640 1 -- 10.20.193.162:0/3539278392 >> v1:10.20.193.103:6789/0 conn(0x7f9360142a00 legacy=0x7f9360162e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:25.958 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.946+0000 7f934ffff640 1 -- 10.20.193.162:0/3539278392 >> v1:10.20.193.70:6789/0 conn(0x7f9360164710 legacy=0x7f9360184bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:25.958 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.946+0000 7f934ffff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:25.958 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.946+0000 7f934ffff640 1 monclient: found mon.noname-a 2026-02-24T19:17:25.958 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.946+0000 7f934ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:25.958 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.946+0000 7f934ffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:17:25.958 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.946+0000 7f934ffff640 1 -- 10.20.193.162:0/3539278392 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9360189b60 con 0x7f9360121d90 2026-02-24T19:17:25.958 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.946+0000 7f934ffff640 10 monclient: _finish_auth 0 2026-02-24T19:17:25.958 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.946+0000 7f934ffff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:25.958 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.946+0000 7f934ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:25.958 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.946+0000 7f934ffff640 1 -- 10.20.193.162:0/3539278392 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9350002df0 con 0x7f9360121d90 2026-02-24T19:17:25.958 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.946+0000 7f934ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:25.959 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.946+0000 7f934ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:25.959 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.946+0000 7f934ffff640 10 monclient: dump: 2026-02-24T19:17:25.959 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:25.959 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:25.959 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.959 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.959 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:25.959 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:25.959 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:25.959 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:25.959 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:25.959 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.960 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.946+0000 7f93675c0640 5 monclient: authenticate success, global_id 4173 2026-02-24T19:17:25.960 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.946+0000 7f93675c0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:25.960 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.946+0000 7f934ffff640 1 -- 10.20.193.162:0/3539278392 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9350003030 con 0x7f9360121d90 2026-02-24T19:17:25.960 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.946+0000 7f934ffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:25.960 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.946+0000 7f934ffff640 1 -- 10.20.193.162:0/3539278392 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9350003470 con 0x7f9360121d90 2026-02-24T19:17:25.960 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.946+0000 7f93675c0640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:25.960 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.946+0000 7f934ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:25.960 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.946+0000 7f93675c0640 4 set_mon_vals no callback set 2026-02-24T19:17:25.960 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.946+0000 7f934ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:25.960 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.946+0000 7f934ffff640 10 monclient: dump: 2026-02-24T19:17:25.960 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:25.960 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:25.960 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.961 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.961 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:25.961 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:25.961 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:25.961 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:25.961 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:25.961 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.961 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.947+0000 7f93675c0640 10 monclient: shutdown 2026-02-24T19:17:25.961 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.947+0000 7f93675c0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:25.961 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.947+0000 7f93675c0640 1 -- 10.20.193.162:0/3539278392 >> v1:10.20.193.26:6789/0 conn(0x7f9360121d90 legacy=0x7f9360122160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:25.961 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.947+0000 7f93675c0640 1 -- 10.20.193.162:0/3539278392 shutdown_connections 2026-02-24T19:17:25.961 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.947+0000 7f93675c0640 1 -- 10.20.193.162:0/3539278392 >> 10.20.193.162:0/3539278392 conn(0x7f9360057490 msgr2=0x7f9360057890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:25.962 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.947+0000 7f93675c0640 1 -- 10.20.193.162:0/3539278392 shutdown_connections 2026-02-24T19:17:25.962 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.947+0000 7f93675c0640 1 -- 10.20.193.162:0/3539278392 wait complete. 2026-02-24T19:17:25.962 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.947+0000 7f93675c0640 10 monclient: build_initial_monmap 2026-02-24T19:17:25.962 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.947+0000 7f93675c0640 10 monclient: monmap: 2026-02-24T19:17:25.962 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:25.962 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:25.962 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-24T19:17:25.962 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-24T19:17:25.962 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:25.962 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-24T19:17:25.962 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:25.962 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:25.962 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:25.963 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.963 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.947+0000 7f93675c0640 1 librados: starting msgr at 2026-02-24T19:17:25.963 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.947+0000 7f93675c0640 1 librados: starting objecter 2026-02-24T19:17:25.963 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.947+0000 7f93675c0640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:25.963 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.947+0000 7f93675c0640 1 Processor -- start 2026-02-24T19:17:25.963 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.947+0000 7f93675c0640 1 -- start start 2026-02-24T19:17:25.963 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.947+0000 7f93675c0640 1 librados: setting wanted keys 2026-02-24T19:17:25.963 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.947+0000 7f93675c0640 1 librados: calling monclient init 2026-02-24T19:17:25.963 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.947+0000 7f93675c0640 10 monclient: init 2026-02-24T19:17:25.963 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.947+0000 7f93675c0640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:25.963 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.947+0000 7f93675c0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:25.963 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.947+0000 7f93675c0640 10 monclient(hunting): picked mon.noname-a con 0x7f9360121d90 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:25.963 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.947+0000 7f93675c0640 10 monclient(hunting): picked mon.noname-c con 0x7f9360142a00 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:25.964 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.947+0000 7f93675c0640 10 monclient(hunting): picked mon.noname-b con 0x7f9360164710 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:25.964 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.947+0000 7f93675c0640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f936011c8e0 con 0x7f9360121d90 2026-02-24T19:17:25.964 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.947+0000 7f93675c0640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f936011cab0 con 0x7f9360164710 2026-02-24T19:17:25.964 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.947+0000 7f93675c0640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f936011cc80 con 0x7f9360142a00 2026-02-24T19:17:25.964 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.947+0000 7f93675c0640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:25.964 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.947+0000 7f93675c0640 10 monclient(hunting): authenticate will time out at 3621.583886s 2026-02-24T19:17:25.964 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.948+0000 7f9365335640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f9360121d90 0x7f9360184bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.162:49878/0 (socket says 10.20.193.162:49878) 2026-02-24T19:17:25.964 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.948+0000 7f9365335640 1 -- 10.20.193.162:0/1748371072 learned_addr learned my addr 10.20.193.162:0/1748371072 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:25.964 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.948+0000 7f934dffb640 10 client.?.objecter ms_handle_connect 0x7f9360121d90 2026-02-24T19:17:25.964 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.948+0000 7f934dffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:25.964 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.948+0000 7f934dffb640 10 client.?.objecter ms_handle_connect 0x7f9360142a00 2026-02-24T19:17:25.964 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.948+0000 7f934dffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:25.965 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.948+0000 7f934dffb640 10 client.?.objecter ms_handle_connect 0x7f9360164710 2026-02-24T19:17:25.965 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.948+0000 7f934dffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:25.965 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.949+0000 7f934dffb640 1 -- 10.20.193.162:0/1748371072 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2644938514 0 0) 0x7f936011c8e0 con 0x7f9360121d90 2026-02-24T19:17:25.965 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.949+0000 7f934dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:25.965 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.949+0000 7f934dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:25.965 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.949+0000 7f934dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:25.965 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.949+0000 7f934dffb640 10 monclient(hunting): my global_id is 4176 2026-02-24T19:17:25.965 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.949+0000 7f934dffb640 1 -- 10.20.193.162:0/1748371072 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9330003610 con 0x7f9360121d90 2026-02-24T19:17:25.965 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.949+0000 7f934dffb640 1 -- 10.20.193.162:0/1748371072 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1402671392 0 0) 0x7f936011cc80 con 0x7f9360142a00 2026-02-24T19:17:25.965 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.949+0000 7f934dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:25.965 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.949+0000 7f934dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:25.965 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.949+0000 7f934dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:25.965 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.949+0000 7f934dffb640 10 monclient(hunting): my global_id is 4175 2026-02-24T19:17:25.966 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.949+0000 7f934dffb640 1 -- 10.20.193.162:0/1748371072 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f936011c8e0 con 0x7f9360142a00 2026-02-24T19:17:25.966 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.949+0000 7f934dffb640 1 -- 10.20.193.162:0/1748371072 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1996098963 0 0) 0x7f936011cab0 con 0x7f9360164710 2026-02-24T19:17:25.966 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.949+0000 7f934dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:25.966 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.949+0000 7f934dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:25.966 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.949+0000 7f934dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:25.966 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.949+0000 7f934dffb640 10 monclient(hunting): my global_id is 4156 2026-02-24T19:17:25.966 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.949+0000 7f934dffb640 1 -- 10.20.193.162:0/1748371072 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f936011cc80 con 0x7f9360164710 2026-02-24T19:17:25.966 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.951+0000 7f934dffb640 1 -- 10.20.193.162:0/1748371072 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2888135658 0 0) 0x7f9330003610 con 0x7f9360121d90 2026-02-24T19:17:25.966 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.951+0000 7f934dffb640 1 -- 10.20.193.162:0/1748371072 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f936011cab0 con 0x7f9360121d90 2026-02-24T19:17:25.966 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.951+0000 7f934dffb640 1 -- 10.20.193.162:0/1748371072 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9350003380 con 0x7f9360121d90 2026-02-24T19:17:25.966 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.951+0000 7f934dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:25.966 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.951+0000 7f934dffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:25.966 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.951+0000 7f934dffb640 10 monclient(hunting): dump: 2026-02-24T19:17:25.967 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:25.967 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:25.967 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.967 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.967 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:25.967 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:25.967 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:25.967 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:25.967 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:25.967 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.967 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.951+0000 7f934dffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:25.967 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.951+0000 7f934dffb640 1 -- 10.20.193.162:0/1748371072 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 313793669 0 0) 0x7f936011cc80 con 0x7f9360164710 2026-02-24T19:17:25.968 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.951+0000 7f934dffb640 1 -- 10.20.193.162:0/1748371072 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9330003610 con 0x7f9360164710 2026-02-24T19:17:25.968 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.951+0000 7f934dffb640 1 -- 10.20.193.162:0/1748371072 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f935c0033b0 con 0x7f9360164710 2026-02-24T19:17:25.968 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.951+0000 7f934dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:25.968 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.951+0000 7f934dffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:25.968 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.951+0000 7f934dffb640 10 monclient(hunting): dump: 2026-02-24T19:17:25.968 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:25.968 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:25.968 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.968 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.968 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:25.968 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:25.968 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:25.968 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:25.969 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:25.969 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.969 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.951+0000 7f934dffb640 1 -- 10.20.193.162:0/1748371072 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 307372471 0 0) 0x7f936011c8e0 con 0x7f9360142a00 2026-02-24T19:17:25.969 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.951+0000 7f934dffb640 1 -- 10.20.193.162:0/1748371072 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f936011cc80 con 0x7f9360142a00 2026-02-24T19:17:25.969 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.951+0000 7f934dffb640 1 -- 10.20.193.162:0/1748371072 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9354003090 con 0x7f9360142a00 2026-02-24T19:17:25.969 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.951+0000 7f934dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:25.969 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.951+0000 7f934dffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:25.969 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.951+0000 7f934dffb640 10 monclient(hunting): dump: 2026-02-24T19:17:25.969 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:25.969 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:25.969 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.969 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.969 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:25.970 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:25.970 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:25.970 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:25.970 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:25.970 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.970 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.953+0000 7f934dffb640 1 -- 10.20.193.162:0/1748371072 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 684595093 0 0) 0x7f9330003610 con 0x7f9360164710 2026-02-24T19:17:25.970 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.953+0000 7f934dffb640 1 -- 10.20.193.162:0/1748371072 >> v1:10.20.193.103:6789/0 conn(0x7f9360142a00 legacy=0x7f9360148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:25.970 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.953+0000 7f934dffb640 1 -- 10.20.193.162:0/1748371072 >> v1:10.20.193.26:6789/0 conn(0x7f9360121d90 legacy=0x7f9360184bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:25.970 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.953+0000 7f934dffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:25.970 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.953+0000 7f934dffb640 1 monclient: found mon.b 2026-02-24T19:17:25.970 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.953+0000 7f934dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:25.970 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.953+0000 7f934dffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:25.970 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.953+0000 7f934dffb640 1 -- 10.20.193.162:0/1748371072 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f936011ce50 con 0x7f9360164710 2026-02-24T19:17:25.971 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.953+0000 7f934dffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:25.971 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.953+0000 7f934dffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:25.971 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.953+0000 7f934dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:25.971 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.953+0000 7f93675c0640 5 monclient: authenticate success, global_id 4156 2026-02-24T19:17:25.971 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.953+0000 7f93675c0640 10 monclient: _renew_subs 2026-02-24T19:17:25.971 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.953+0000 7f93675c0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:25.971 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.953+0000 7f93675c0640 1 -- 10.20.193.162:0/1748371072 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f936014fdc0 con 0x7f9360164710 2026-02-24T19:17:25.971 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.953+0000 7f93675c0640 10 client.4156.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:25.971 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.953+0000 7f93675c0640 10 monclient: _renew_subs 2026-02-24T19:17:25.971 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.953+0000 7f93675c0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:25.971 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.953+0000 7f93675c0640 1 -- 10.20.193.162:0/1748371072 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f93601503b0 con 0x7f9360164710 2026-02-24T19:17:25.971 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.953+0000 7f93675c0640 1 librados: init done 2026-02-24T19:17:25.972 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.953+0000 7f93675c0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:25.972 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.953+0000 7f93675c0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:25.972 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.953+0000 7f93675c0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:25.972 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.953+0000 7f93675c0640 1 -- 10.20.193.162:0/1748371072 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93601869e0 con 0x7f9360164710 2026-02-24T19:17:25.973 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.957+0000 7f934dffb640 1 -- 10.20.193.162:0/1748371072 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f935c003800 con 0x7f9360164710 2026-02-24T19:17:25.973 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.957+0000 7f934dffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:25.973 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.957+0000 7f934dffb640 1 -- 10.20.193.162:0/1748371072 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f935c004df0 con 0x7f9360164710 2026-02-24T19:17:25.973 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.957+0000 7f934dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:25.974 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.957+0000 7f934dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:25.974 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.957+0000 7f934f7fe640 4 set_mon_vals no callback set 2026-02-24T19:17:25.974 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.957+0000 7f934dffb640 10 monclient: dump: 2026-02-24T19:17:25.974 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:25.974 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:25.974 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.974 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:25.974 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:25.974 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:25.974 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:25.974 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:25.974 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:25.974 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:25.975 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.961+0000 7f934dffb640 1 -- 10.20.193.162:0/1748371072 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 3) ==== 101401+0+0 (unknown 3979941933 0 0) 0x7f935c01da20 con 0x7f9360164710 2026-02-24T19:17:25.975 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.961+0000 7f9365335640 10 monclient: get_auth_request con 0x7f9330077ca0 auth_method 0 2026-02-24T19:17:25.975 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.961+0000 7f934dffb640 10 client.4156.objecter ms_handle_connect 0x7f9330077ca0 2026-02-24T19:17:25.975 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.962+0000 7f934dffb640 1 -- 10.20.193.162:0/1748371072 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(10..10 src has 1..10) ==== 1640+0+0 (unknown 557605844 0 0) 0x7f935c0595b0 con 0x7f9360164710 2026-02-24T19:17:25.975 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.962+0000 7f934dffb640 10 client.4156.objecter ms_dispatch2 0x7f9360000b90 osd_map(10..10 src has 1..10) 2026-02-24T19:17:25.975 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.962+0000 7f934dffb640 3 client.4156.objecter handle_osd_map got epochs [10,10] > 0 2026-02-24T19:17:25.975 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.962+0000 7f934dffb640 3 client.4156.objecter handle_osd_map decoding full epoch 10 2026-02-24T19:17:25.975 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:25.962+0000 7f934dffb640 20 client.4156.objecter dump_active .. 0 homeless 2026-02-24T19:17:26.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.045+0000 7f934dffb640 1 -- 10.20.193.162:0/1748371072 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f935c05dd20 con 0x7f9360164710 2026-02-24T19:17:26.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.045+0000 7f934dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:26.047 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.045+0000 7f934dffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:26.158 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.156+0000 7f93675c0640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "fb377a45-1ce5-4e07-92cd-7f546cfad57f", "id": 8}] 2026-02-24T19:17:26.158 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.156+0000 7f93675c0640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "fb377a45-1ce5-4e07-92cd-7f546cfad57f", "id": 8}] 2026-02-24T19:17:26.158 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.156+0000 7f93675c0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:26.158 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.156+0000 7f93675c0640 1 -- 10.20.193.162:0/1748371072 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "osd new", "uuid": "fb377a45-1ce5-4e07-92cd-7f546cfad57f", "id": 8} v 0) -- 0x7f93600553a0 con 0x7f9360164710 2026-02-24T19:17:26.204 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.202+0000 7f934dffb640 1 -- 10.20.193.162:0/1748371072 <== mon.1 v1:10.20.193.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fb377a45-1ce5-4e07-92cd-7f546cfad57f", "id": 8}]=0 v11) ==== 112+0+2 (unknown 1935991944 0 3065575683) 0x7f93600553a0 con 0x7f9360164710 2026-02-24T19:17:26.204 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.202+0000 7f934dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "fb377a45-1ce5-4e07-92cd-7f546cfad57f", "id": 8}] 2026-02-24T19:17:26.204 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.202+0000 7f934dffb640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:26.205 INFO:teuthology.orchestra.run.trial162.stdout:8 2026-02-24T19:17:26.206 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.204+0000 7f93675c0640 10 librados: watch_flush enter 2026-02-24T19:17:26.207 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.204+0000 7f93675c0640 10 librados: watch_flush exit 2026-02-24T19:17:26.207 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.204+0000 7f93675c0640 20 client.4156.objecter shutdown clearing up homeless session... 2026-02-24T19:17:26.207 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.204+0000 7f93675c0640 10 client.4156.objecter successfully canceled tick 2026-02-24T19:17:26.207 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.204+0000 7f93675c0640 1 -- 10.20.193.162:0/1748371072 >> v1:10.20.193.162:6800/3889602630 conn(0x7f9330077ca0 legacy=0x7f9330098150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:26.207 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.204+0000 7f93675c0640 10 monclient: shutdown 2026-02-24T19:17:26.207 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.204+0000 7f93675c0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:26.207 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.204+0000 7f93675c0640 1 -- 10.20.193.162:0/1748371072 >> v1:10.20.193.70:6789/0 conn(0x7f9360164710 legacy=0x7f936011c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:26.207 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.204+0000 7f93675c0640 1 -- 10.20.193.162:0/1748371072 shutdown_connections 2026-02-24T19:17:26.207 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.204+0000 7f93675c0640 1 -- 10.20.193.162:0/1748371072 >> 10.20.193.162:0/1748371072 conn(0x7f9360057490 msgr2=0x7f936011f800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:26.207 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.204+0000 7f93675c0640 1 -- 10.20.193.162:0/1748371072 shutdown_connections 2026-02-24T19:17:26.208 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.204+0000 7f93675c0640 1 -- 10.20.193.162:0/1748371072 wait complete. 2026-02-24T19:17:26.208 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.204+0000 7f93675c0640 1 librados: shutdown 2026-02-24T19:17:26.216 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new 8079b2ca-96c3-4321-9f24-a87e8ea1e883 9 2026-02-24T19:17:26.283 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.281+0000 7fedc0967640 10 monclient: get_monmap_and_config 2026-02-24T19:17:26.283 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.281+0000 7fedc0967640 10 monclient: build_initial_monmap 2026-02-24T19:17:26.283 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.281+0000 7fedc0967640 10 monclient: monmap: 2026-02-24T19:17:26.283 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:26.283 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:26.283 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:17:26.282792+0000 2026-02-24T19:17:26.283 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:17:26.282792+0000 2026-02-24T19:17:26.284 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:26.284 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:26.284 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:26.284 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:26.284 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:26.284 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:26.286 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.281+0000 7fedc0967640 1 Processor -- start 2026-02-24T19:17:26.287 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.282+0000 7fedc0967640 1 -- start start 2026-02-24T19:17:26.287 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.282+0000 7fedc0967640 10 monclient: init 2026-02-24T19:17:26.287 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.282+0000 7fedc0967640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:26.287 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.282+0000 7fedc0967640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:26.287 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.282+0000 7fedc0967640 10 monclient(hunting): picked mon.noname-b con 0x7fedb8121d90 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:26.287 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.282+0000 7fedc0967640 10 monclient(hunting): picked mon.noname-a con 0x7fedb8142a00 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:26.287 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.282+0000 7fedc0967640 10 monclient(hunting): picked mon.noname-c con 0x7fedb8164710 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:26.287 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.282+0000 7fedc0967640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedb81864c0 con 0x7fedb8142a00 2026-02-24T19:17:26.287 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.282+0000 7fedc0967640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedb81876c0 con 0x7fedb8121d90 2026-02-24T19:17:26.287 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.282+0000 7fedc0967640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedb81888c0 con 0x7fedb8164710 2026-02-24T19:17:26.287 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.282+0000 7fedc0967640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:26.288 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.282+0000 7fedc0967640 10 monclient(hunting): authenticate will time out at 3621.918238s 2026-02-24T19:17:26.288 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.282+0000 7fedbdedb640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fedb8142a00 0x7fedb8162e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.162:49884/0 (socket says 10.20.193.162:49884) 2026-02-24T19:17:26.288 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.282+0000 7fedbeedd640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fedb8164710 0x7fedb8184bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.162:37502/0 (socket says 10.20.193.162:37502) 2026-02-24T19:17:26.288 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.282+0000 7fedbe6dc640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7fedb8121d90 0x7fedb8122160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.162:45238/0 (socket says 10.20.193.162:45238) 2026-02-24T19:17:26.288 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.282+0000 7fedbdedb640 1 -- 10.20.193.162:0/2197389606 learned_addr learned my addr 10.20.193.162:0/2197389606 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:26.288 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.284+0000 7fedbd6da640 1 -- 10.20.193.162:0/2197389606 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2698020147 0 0) 0x7fedb81888c0 con 0x7fedb8164710 2026-02-24T19:17:26.288 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.284+0000 7fedbd6da640 10 monclient(hunting): _negotiate 2026-02-24T19:17:26.288 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.284+0000 7fedbd6da640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:26.288 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.284+0000 7fedbd6da640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:26.288 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.284+0000 7fedbd6da640 10 monclient(hunting): my global_id is 4178 2026-02-24T19:17:26.288 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.284+0000 7fedbd6da640 1 -- 10.20.193.162:0/2197389606 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feda8003610 con 0x7fedb8164710 2026-02-24T19:17:26.288 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.284+0000 7fedbd6da640 1 -- 10.20.193.162:0/2197389606 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3126266018 0 0) 0x7fedb81876c0 con 0x7fedb8121d90 2026-02-24T19:17:26.289 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.284+0000 7fedbd6da640 10 monclient(hunting): _negotiate 2026-02-24T19:17:26.289 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.284+0000 7fedbd6da640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:26.289 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.284+0000 7fedbd6da640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:26.289 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.284+0000 7fedbd6da640 10 monclient(hunting): my global_id is 4159 2026-02-24T19:17:26.289 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.284+0000 7fedbd6da640 1 -- 10.20.193.162:0/2197389606 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedb81888c0 con 0x7fedb8121d90 2026-02-24T19:17:26.289 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.284+0000 7fedbd6da640 1 -- 10.20.193.162:0/2197389606 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 977060262 0 0) 0x7fedb81864c0 con 0x7fedb8142a00 2026-02-24T19:17:26.289 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.284+0000 7fedbd6da640 10 monclient(hunting): _negotiate 2026-02-24T19:17:26.289 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.284+0000 7fedbd6da640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:26.289 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.284+0000 7fedbd6da640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:26.289 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.284+0000 7fedbd6da640 10 monclient(hunting): my global_id is 4179 2026-02-24T19:17:26.289 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.284+0000 7fedbd6da640 1 -- 10.20.193.162:0/2197389606 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedb81876c0 con 0x7fedb8142a00 2026-02-24T19:17:26.297 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.285+0000 7fedbd6da640 1 -- 10.20.193.162:0/2197389606 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1763330937 0 0) 0x7feda8003610 con 0x7fedb8164710 2026-02-24T19:17:26.297 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.285+0000 7fedbd6da640 1 -- 10.20.193.162:0/2197389606 >> v1:10.20.193.70:6789/0 conn(0x7fedb8121d90 legacy=0x7fedb8122160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:26.297 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.285+0000 7fedbd6da640 1 -- 10.20.193.162:0/2197389606 >> v1:10.20.193.26:6789/0 conn(0x7fedb8142a00 legacy=0x7fedb8162e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:26.297 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.285+0000 7fedbd6da640 10 monclient: _finish_hunting 0 2026-02-24T19:17:26.297 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.285+0000 7fedbd6da640 1 monclient: found mon.noname-c 2026-02-24T19:17:26.297 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.285+0000 7fedbd6da640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:26.297 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.285+0000 7fedbd6da640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:17:26.297 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.285+0000 7fedbd6da640 1 -- 10.20.193.162:0/2197389606 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb8189b60 con 0x7fedb8164710 2026-02-24T19:17:26.297 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.285+0000 7fedbd6da640 10 monclient: _finish_auth 0 2026-02-24T19:17:26.297 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.285+0000 7fedbd6da640 10 monclient: _check_auth_tickets 2026-02-24T19:17:26.298 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.285+0000 7fedbd6da640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:26.298 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.285+0000 7fedbd6da640 1 -- 10.20.193.162:0/2197389606 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fedac003170 con 0x7fedb8164710 2026-02-24T19:17:26.298 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.285+0000 7fedbd6da640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:26.298 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.285+0000 7fedbd6da640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:26.298 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.285+0000 7fedbd6da640 10 monclient: dump: 2026-02-24T19:17:26.298 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:26.298 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:26.298 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.298 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.298 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:26.298 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:26.298 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:26.298 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:26.299 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:26.299 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:26.299 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.285+0000 7fedc0967640 5 monclient: authenticate success, global_id 4178 2026-02-24T19:17:26.299 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.285+0000 7fedc0967640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:26.299 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.286+0000 7fedbd6da640 1 -- 10.20.193.162:0/2197389606 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fedac0033b0 con 0x7fedb8164710 2026-02-24T19:17:26.299 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.286+0000 7fedbd6da640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:26.299 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.286+0000 7fedbd6da640 1 -- 10.20.193.162:0/2197389606 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fedac0037f0 con 0x7fedb8164710 2026-02-24T19:17:26.299 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.286+0000 7fedbd6da640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:26.299 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.286+0000 7fedbd6da640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:26.299 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.286+0000 7fedbd6da640 10 monclient: dump: 2026-02-24T19:17:26.299 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:26.299 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:26.300 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.300 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.300 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:26.300 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:26.300 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:26.300 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:26.300 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:26.300 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:26.300 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.286+0000 7fedc0967640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:26.300 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.286+0000 7fedc0967640 4 set_mon_vals no callback set 2026-02-24T19:17:26.300 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.286+0000 7fedc0967640 10 monclient: shutdown 2026-02-24T19:17:26.300 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.286+0000 7fedc0967640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:26.300 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.286+0000 7fedc0967640 1 -- 10.20.193.162:0/2197389606 >> v1:10.20.193.103:6789/0 conn(0x7fedb8164710 legacy=0x7fedb8184bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:26.301 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.286+0000 7fedc0967640 1 -- 10.20.193.162:0/2197389606 shutdown_connections 2026-02-24T19:17:26.301 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.286+0000 7fedc0967640 1 -- 10.20.193.162:0/2197389606 >> 10.20.193.162:0/2197389606 conn(0x7fedb8057490 msgr2=0x7fedb8057890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:26.301 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.286+0000 7fedc0967640 1 -- 10.20.193.162:0/2197389606 shutdown_connections 2026-02-24T19:17:26.301 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.286+0000 7fedc0967640 1 -- 10.20.193.162:0/2197389606 wait complete. 2026-02-24T19:17:26.301 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.287+0000 7fedc0967640 10 monclient: build_initial_monmap 2026-02-24T19:17:26.301 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.287+0000 7fedc0967640 10 monclient: monmap: 2026-02-24T19:17:26.301 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:26.301 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:26.301 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-24T19:17:26.301 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-24T19:17:26.301 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:26.301 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-24T19:17:26.302 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:26.302 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:26.302 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:26.302 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:26.302 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.287+0000 7fedc0967640 1 librados: starting msgr at 2026-02-24T19:17:26.302 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.287+0000 7fedc0967640 1 librados: starting objecter 2026-02-24T19:17:26.302 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.287+0000 7fedc0967640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:26.302 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.287+0000 7fedc0967640 1 Processor -- start 2026-02-24T19:17:26.302 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.287+0000 7fedc0967640 1 -- start start 2026-02-24T19:17:26.302 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.287+0000 7fedc0967640 1 librados: setting wanted keys 2026-02-24T19:17:26.302 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.287+0000 7fedc0967640 1 librados: calling monclient init 2026-02-24T19:17:26.302 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.287+0000 7fedc0967640 10 monclient: init 2026-02-24T19:17:26.302 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.287+0000 7fedc0967640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:26.303 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.287+0000 7fedc0967640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:26.303 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.287+0000 7fedc0967640 10 monclient(hunting): picked mon.noname-c con 0x7fedb8121d90 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:26.303 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.287+0000 7fedc0967640 10 monclient(hunting): picked mon.noname-a con 0x7fedb8142a00 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:26.303 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.287+0000 7fedc0967640 10 monclient(hunting): picked mon.noname-b con 0x7fedb8164710 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:26.303 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.287+0000 7fedc0967640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedb811c8e0 con 0x7fedb8142a00 2026-02-24T19:17:26.303 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.287+0000 7fedc0967640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedb811cab0 con 0x7fedb8164710 2026-02-24T19:17:26.303 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.287+0000 7fedc0967640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedb811cc80 con 0x7fedb8121d90 2026-02-24T19:17:26.303 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.287+0000 7fedc0967640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:26.303 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.287+0000 7fedc0967640 10 monclient(hunting): authenticate will time out at 3621.923414s 2026-02-24T19:17:26.303 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.287+0000 7fedbdedb640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fedb8142a00 0x7fedb816a520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.162:49900/0 (socket says 10.20.193.162:49900) 2026-02-24T19:17:26.303 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.287+0000 7fedbdedb640 1 -- 10.20.193.162:0/3545866184 learned_addr learned my addr 10.20.193.162:0/3545866184 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:26.303 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.287+0000 7feda2ffd640 10 client.?.objecter ms_handle_connect 0x7fedb8164710 2026-02-24T19:17:26.304 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.287+0000 7feda2ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:26.304 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.288+0000 7feda2ffd640 10 client.?.objecter ms_handle_connect 0x7fedb8142a00 2026-02-24T19:17:26.304 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.288+0000 7feda2ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:26.304 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.288+0000 7feda2ffd640 10 client.?.objecter ms_handle_connect 0x7fedb8121d90 2026-02-24T19:17:26.304 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.288+0000 7feda2ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:26.304 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.288+0000 7feda2ffd640 1 -- 10.20.193.162:0/3545866184 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1241044354 0 0) 0x7fedb811cab0 con 0x7fedb8164710 2026-02-24T19:17:26.304 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.288+0000 7feda2ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:26.304 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.288+0000 7feda2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:26.304 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.288+0000 7feda2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:26.304 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.288+0000 7feda2ffd640 10 monclient(hunting): my global_id is 4162 2026-02-24T19:17:26.304 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.289+0000 7feda2ffd640 1 -- 10.20.193.162:0/3545866184 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed88003610 con 0x7fedb8164710 2026-02-24T19:17:26.304 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.289+0000 7feda2ffd640 1 -- 10.20.193.162:0/3545866184 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2281217007 0 0) 0x7fedb811c8e0 con 0x7fedb8142a00 2026-02-24T19:17:26.305 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.289+0000 7feda2ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:26.305 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.289+0000 7feda2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:26.305 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.289+0000 7feda2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:26.305 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.289+0000 7feda2ffd640 10 monclient(hunting): my global_id is 4182 2026-02-24T19:17:26.305 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.289+0000 7feda2ffd640 1 -- 10.20.193.162:0/3545866184 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedb811cab0 con 0x7fedb8142a00 2026-02-24T19:17:26.305 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.289+0000 7feda2ffd640 1 -- 10.20.193.162:0/3545866184 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3789801559 0 0) 0x7fedb811cc80 con 0x7fedb8121d90 2026-02-24T19:17:26.305 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.289+0000 7feda2ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:26.305 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.289+0000 7feda2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:26.305 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.289+0000 7feda2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:26.305 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.289+0000 7feda2ffd640 10 monclient(hunting): my global_id is 4181 2026-02-24T19:17:26.305 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.289+0000 7feda2ffd640 1 -- 10.20.193.162:0/3545866184 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedb811c8e0 con 0x7fedb8121d90 2026-02-24T19:17:26.305 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.291+0000 7feda2ffd640 1 -- 10.20.193.162:0/3545866184 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 378070367 0 0) 0x7fedb811cab0 con 0x7fedb8142a00 2026-02-24T19:17:26.306 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.291+0000 7feda2ffd640 1 -- 10.20.193.162:0/3545866184 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fedb811cc80 con 0x7fedb8142a00 2026-02-24T19:17:26.306 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.291+0000 7feda2ffd640 1 -- 10.20.193.162:0/3545866184 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7feda4002fe0 con 0x7fedb8142a00 2026-02-24T19:17:26.306 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.291+0000 7feda2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:26.306 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.291+0000 7feda2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:26.306 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.291+0000 7feda2ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:26.306 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:26.306 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:26.306 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.306 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.306 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:26.306 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:26.306 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:26.306 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:26.307 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:26.307 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:26.307 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.291+0000 7feda2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:26.307 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.291+0000 7feda2ffd640 1 -- 10.20.193.162:0/3545866184 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1161118259 0 0) 0x7fed88003610 con 0x7fedb8164710 2026-02-24T19:17:26.307 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.291+0000 7feda2ffd640 1 -- 10.20.193.162:0/3545866184 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fedb811cab0 con 0x7fedb8164710 2026-02-24T19:17:26.307 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.291+0000 7feda2ffd640 1 -- 10.20.193.162:0/3545866184 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fedac003560 con 0x7fedb8164710 2026-02-24T19:17:26.307 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.291+0000 7feda2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:26.307 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.291+0000 7feda2ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:26.307 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.291+0000 7feda2ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:26.307 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:26.307 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:26.307 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.308 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.308 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:26.308 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:26.308 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:26.308 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:26.308 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:26.308 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:26.308 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.291+0000 7feda2ffd640 1 -- 10.20.193.162:0/3545866184 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2548173113 0 0) 0x7fedb811c8e0 con 0x7fedb8121d90 2026-02-24T19:17:26.308 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.292+0000 7feda2ffd640 1 -- 10.20.193.162:0/3545866184 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fed88003610 con 0x7fedb8121d90 2026-02-24T19:17:26.308 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.292+0000 7feda2ffd640 1 -- 10.20.193.162:0/3545866184 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fedb0003070 con 0x7fedb8121d90 2026-02-24T19:17:26.308 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.292+0000 7feda2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:26.308 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.292+0000 7feda2ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:26.308 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.292+0000 7feda2ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:26.309 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:26.309 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:26.309 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.309 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.309 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:26.309 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:26.309 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:26.309 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:26.309 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:26.309 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:26.309 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.292+0000 7feda2ffd640 1 -- 10.20.193.162:0/3545866184 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 206757878 0 0) 0x7fedb811cc80 con 0x7fedb8142a00 2026-02-24T19:17:26.309 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.292+0000 7feda2ffd640 1 -- 10.20.193.162:0/3545866184 >> v1:10.20.193.103:6789/0 conn(0x7fedb8121d90 legacy=0x7fedb8162e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:26.310 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.292+0000 7feda2ffd640 1 -- 10.20.193.162:0/3545866184 >> v1:10.20.193.70:6789/0 conn(0x7fedb8164710 legacy=0x7fedb811c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:26.310 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.292+0000 7feda2ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:26.310 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.292+0000 7feda2ffd640 1 monclient: found mon.a 2026-02-24T19:17:26.310 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.292+0000 7feda2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:26.310 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.292+0000 7feda2ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:26.310 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.292+0000 7feda2ffd640 1 -- 10.20.193.162:0/3545866184 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb811ce50 con 0x7fedb8142a00 2026-02-24T19:17:26.310 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.292+0000 7feda2ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:26.310 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.292+0000 7feda2ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:26.310 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.292+0000 7feda2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:26.310 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.292+0000 7fedc0967640 5 monclient: authenticate success, global_id 4182 2026-02-24T19:17:26.310 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.292+0000 7fedc0967640 10 monclient: _renew_subs 2026-02-24T19:17:26.310 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.292+0000 7fedc0967640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:26.310 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.292+0000 7fedc0967640 1 -- 10.20.193.162:0/3545866184 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fedb8171d50 con 0x7fedb8142a00 2026-02-24T19:17:26.311 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.292+0000 7fedc0967640 10 client.4182.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:26.311 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.292+0000 7fedc0967640 10 monclient: _renew_subs 2026-02-24T19:17:26.311 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.292+0000 7fedc0967640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:26.311 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.292+0000 7fedc0967640 1 -- 10.20.193.162:0/3545866184 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fedb8172390 con 0x7fedb8142a00 2026-02-24T19:17:26.311 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.292+0000 7fedc0967640 1 librados: init done 2026-02-24T19:17:26.311 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.293+0000 7fedc0967640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:26.311 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.293+0000 7fedc0967640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:26.311 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.293+0000 7fedc0967640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:26.311 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.293+0000 7fedc0967640 1 -- 10.20.193.162:0/3545866184 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedb8187be0 con 0x7fedb8142a00 2026-02-24T19:17:26.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.388+0000 7feda2ffd640 1 -- 10.20.193.162:0/3545866184 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feda4003180 con 0x7fedb8142a00 2026-02-24T19:17:26.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.388+0000 7feda2ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:26.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.388+0000 7feda2ffd640 1 -- 10.20.193.162:0/3545866184 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7feda4004a70 con 0x7fedb8142a00 2026-02-24T19:17:26.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.388+0000 7feda2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:26.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.388+0000 7feda2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:26.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.388+0000 7fedbced9640 4 set_mon_vals no callback set 2026-02-24T19:17:26.390 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.388+0000 7feda2ffd640 10 monclient: dump: 2026-02-24T19:17:26.391 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:26.391 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:26.391 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.391 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.391 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:26.391 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:26.391 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:26.391 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:26.391 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:26.391 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:26.392 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.389+0000 7feda2ffd640 1 -- 10.20.193.162:0/3545866184 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 3) ==== 101401+0+0 (unknown 3979941933 0 0) 0x7feda4004c50 con 0x7fedb8142a00 2026-02-24T19:17:26.392 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.389+0000 7fedbe6dc640 10 monclient: get_auth_request con 0x7fed88077d20 auth_method 0 2026-02-24T19:17:26.392 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.390+0000 7feda2ffd640 10 client.4182.objecter ms_handle_connect 0x7fed88077d20 2026-02-24T19:17:26.393 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.391+0000 7feda2ffd640 1 -- 10.20.193.162:0/3545866184 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(11..11 src has 1..11) ==== 1755+0+0 (unknown 1729120421 0 0) 0x7feda4059420 con 0x7fedb8142a00 2026-02-24T19:17:26.393 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.391+0000 7feda2ffd640 10 client.4182.objecter ms_dispatch2 0x7fedb8000b90 osd_map(11..11 src has 1..11) 2026-02-24T19:17:26.393 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.391+0000 7feda2ffd640 3 client.4182.objecter handle_osd_map got epochs [11,11] > 0 2026-02-24T19:17:26.394 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.391+0000 7feda2ffd640 3 client.4182.objecter handle_osd_map decoding full epoch 11 2026-02-24T19:17:26.394 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.391+0000 7feda2ffd640 20 client.4182.objecter dump_active .. 0 homeless 2026-02-24T19:17:26.394 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.391+0000 7feda2ffd640 1 -- 10.20.193.162:0/3545866184 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7feda4004a70 con 0x7fedb8142a00 2026-02-24T19:17:26.394 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.391+0000 7feda2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:26.394 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.391+0000 7feda2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:26.503 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.501+0000 7fedc0967640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "8079b2ca-96c3-4321-9f24-a87e8ea1e883", "id": 9}] 2026-02-24T19:17:26.503 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.501+0000 7fedc0967640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "8079b2ca-96c3-4321-9f24-a87e8ea1e883", "id": 9}] 2026-02-24T19:17:26.504 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.501+0000 7fedc0967640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:26.504 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.501+0000 7fedc0967640 1 -- 10.20.193.162:0/3545866184 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "osd new", "uuid": "8079b2ca-96c3-4321-9f24-a87e8ea1e883", "id": 9} v 0) -- 0x7fedb8187e00 con 0x7fedb8142a00 2026-02-24T19:17:26.517 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.515+0000 7feda2ffd640 1 -- 10.20.193.162:0/3545866184 <== mon.0 v1:10.20.193.26:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8079b2ca-96c3-4321-9f24-a87e8ea1e883", "id": 9}]=0 v12) ==== 112+0+2 (unknown 2188715025 0 2769969524) 0x7feda405db90 con 0x7fedb8142a00 2026-02-24T19:17:26.517 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.515+0000 7feda2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "8079b2ca-96c3-4321-9f24-a87e8ea1e883", "id": 9}] 2026-02-24T19:17:26.517 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.515+0000 7feda2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:26.517 INFO:teuthology.orchestra.run.trial162.stdout:9 2026-02-24T19:17:26.519 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.516+0000 7fedc0967640 10 librados: watch_flush enter 2026-02-24T19:17:26.519 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.516+0000 7fedc0967640 10 librados: watch_flush exit 2026-02-24T19:17:26.519 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.516+0000 7fedc0967640 20 client.4182.objecter shutdown clearing up homeless session... 2026-02-24T19:17:26.519 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.516+0000 7fedc0967640 10 client.4182.objecter successfully canceled tick 2026-02-24T19:17:26.519 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.516+0000 7fedc0967640 1 -- 10.20.193.162:0/3545866184 >> v1:10.20.193.162:6800/3889602630 conn(0x7fed88077d20 legacy=0x7fed880981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:26.519 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.516+0000 7fedc0967640 10 monclient: shutdown 2026-02-24T19:17:26.519 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.516+0000 7fedc0967640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:26.519 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.516+0000 7fedc0967640 1 -- 10.20.193.162:0/3545866184 >> v1:10.20.193.26:6789/0 conn(0x7fedb8142a00 legacy=0x7fedb816a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:26.519 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.516+0000 7fedc0967640 1 -- 10.20.193.162:0/3545866184 shutdown_connections 2026-02-24T19:17:26.519 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.516+0000 7fedc0967640 1 -- 10.20.193.162:0/3545866184 >> 10.20.193.162:0/3545866184 conn(0x7fedb8057490 msgr2=0x7fedb8163550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:26.519 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.516+0000 7fedc0967640 1 -- 10.20.193.162:0/3545866184 shutdown_connections 2026-02-24T19:17:26.520 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.516+0000 7fedc0967640 1 -- 10.20.193.162:0/3545866184 wait complete. 2026-02-24T19:17:26.520 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.516+0000 7fedc0967640 1 librados: shutdown 2026-02-24T19:17:26.526 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new 8df004a9-88e3-43f5-833d-dfc73a658ec3 10 2026-02-24T19:17:26.591 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.590+0000 7fcade074640 10 monclient: get_monmap_and_config 2026-02-24T19:17:26.592 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.590+0000 7fcade074640 10 monclient: build_initial_monmap 2026-02-24T19:17:26.592 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.590+0000 7fcade074640 10 monclient: monmap: 2026-02-24T19:17:26.592 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:26.592 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:26.592 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:17:26.591355+0000 2026-02-24T19:17:26.592 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:17:26.591355+0000 2026-02-24T19:17:26.592 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:26.592 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:26.592 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:26.592 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:26.592 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:26.593 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:26.595 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.590+0000 7fcade074640 1 Processor -- start 2026-02-24T19:17:26.595 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.590+0000 7fcade074640 1 -- start start 2026-02-24T19:17:26.595 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.590+0000 7fcade074640 10 monclient: init 2026-02-24T19:17:26.595 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.590+0000 7fcade074640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:26.595 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.590+0000 7fcade074640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:26.595 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.590+0000 7fcade074640 10 monclient(hunting): picked mon.noname-c con 0x7fcad8121d90 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:26.595 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.590+0000 7fcade074640 10 monclient(hunting): picked mon.noname-a con 0x7fcad8142a00 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:26.595 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.590+0000 7fcade074640 10 monclient(hunting): picked mon.noname-b con 0x7fcad8164710 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:26.595 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.590+0000 7fcade074640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcad81864c0 con 0x7fcad8142a00 2026-02-24T19:17:26.596 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.590+0000 7fcade074640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcad81876c0 con 0x7fcad8164710 2026-02-24T19:17:26.596 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.590+0000 7fcade074640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcad81888c0 con 0x7fcad8121d90 2026-02-24T19:17:26.596 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.590+0000 7fcade074640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:26.596 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.590+0000 7fcade074640 10 monclient(hunting): authenticate will time out at 3622.226620s 2026-02-24T19:17:26.596 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.591+0000 7fcad6ffd640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fcad8142a00 0x7fcad8162e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.162:49902/0 (socket says 10.20.193.162:49902) 2026-02-24T19:17:26.596 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.591+0000 7fcad6ffd640 1 -- 10.20.193.162:0/3440169671 learned_addr learned my addr 10.20.193.162:0/3440169671 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:26.596 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.592+0000 7fcad67fc640 1 -- 10.20.193.162:0/3440169671 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1531547041 0 0) 0x7fcad81864c0 con 0x7fcad8142a00 2026-02-24T19:17:26.596 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.592+0000 7fcad67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:26.596 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.592+0000 7fcad67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:26.596 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.592+0000 7fcad67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:26.596 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.592+0000 7fcad67fc640 10 monclient(hunting): my global_id is 4185 2026-02-24T19:17:26.596 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.592+0000 7fcad67fc640 1 -- 10.20.193.162:0/3440169671 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcabc003610 con 0x7fcad8142a00 2026-02-24T19:17:26.597 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.592+0000 7fcad67fc640 1 -- 10.20.193.162:0/3440169671 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 631535272 0 0) 0x7fcad81888c0 con 0x7fcad8121d90 2026-02-24T19:17:26.597 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.592+0000 7fcad67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:26.597 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.592+0000 7fcad67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:26.597 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.592+0000 7fcad67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:26.597 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.592+0000 7fcad67fc640 10 monclient(hunting): my global_id is 4184 2026-02-24T19:17:26.597 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.592+0000 7fcad67fc640 1 -- 10.20.193.162:0/3440169671 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcad81864c0 con 0x7fcad8121d90 2026-02-24T19:17:26.597 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.592+0000 7fcad67fc640 1 -- 10.20.193.162:0/3440169671 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 893778395 0 0) 0x7fcad81876c0 con 0x7fcad8164710 2026-02-24T19:17:26.597 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.592+0000 7fcad67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:26.597 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.592+0000 7fcad67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:26.597 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.592+0000 7fcad67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:26.597 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.592+0000 7fcad67fc640 10 monclient(hunting): my global_id is 4165 2026-02-24T19:17:26.597 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.592+0000 7fcad67fc640 1 -- 10.20.193.162:0/3440169671 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcad81888c0 con 0x7fcad8164710 2026-02-24T19:17:26.604 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.593+0000 7fcad67fc640 1 -- 10.20.193.162:0/3440169671 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4245483981 0 0) 0x7fcabc003610 con 0x7fcad8142a00 2026-02-24T19:17:26.604 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.593+0000 7fcad67fc640 1 -- 10.20.193.162:0/3440169671 >> v1:10.20.193.103:6789/0 conn(0x7fcad8121d90 legacy=0x7fcad8122160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:26.605 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.593+0000 7fcad67fc640 1 -- 10.20.193.162:0/3440169671 >> v1:10.20.193.70:6789/0 conn(0x7fcad8164710 legacy=0x7fcad8184bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:26.605 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.593+0000 7fcad67fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:26.605 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.593+0000 7fcad67fc640 1 monclient: found mon.noname-a 2026-02-24T19:17:26.605 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.593+0000 7fcad67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:26.605 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.593+0000 7fcad67fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:17:26.605 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.593+0000 7fcad67fc640 1 -- 10.20.193.162:0/3440169671 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad8189b60 con 0x7fcad8142a00 2026-02-24T19:17:26.605 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.593+0000 7fcad67fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:26.605 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.593+0000 7fcad67fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:26.605 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.593+0000 7fcad67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:26.605 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.593+0000 7fcad67fc640 1 -- 10.20.193.162:0/3440169671 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fcac8002d20 con 0x7fcad8142a00 2026-02-24T19:17:26.605 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.593+0000 7fcad67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:26.605 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.593+0000 7fcad67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:26.606 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.593+0000 7fcad67fc640 10 monclient: dump: 2026-02-24T19:17:26.606 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:26.606 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:26.606 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.606 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.606 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:26.606 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:26.606 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:26.606 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:26.606 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:26.606 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:26.606 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.593+0000 7fcade074640 5 monclient: authenticate success, global_id 4185 2026-02-24T19:17:26.607 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.593+0000 7fcade074640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:26.607 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.594+0000 7fcad67fc640 1 -- 10.20.193.162:0/3440169671 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcac8002f60 con 0x7fcad8142a00 2026-02-24T19:17:26.607 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.594+0000 7fcad67fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:26.607 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.594+0000 7fcad67fc640 1 -- 10.20.193.162:0/3440169671 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fcac80033a0 con 0x7fcad8142a00 2026-02-24T19:17:26.607 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.594+0000 7fcad67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:26.607 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.594+0000 7fcad67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:26.607 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.594+0000 7fcad67fc640 10 monclient: dump: 2026-02-24T19:17:26.607 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:26.607 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:26.607 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.607 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.607 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:26.607 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:26.608 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:26.608 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:26.608 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:26.608 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:26.608 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.594+0000 7fcade074640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:26.608 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.594+0000 7fcade074640 4 set_mon_vals no callback set 2026-02-24T19:17:26.608 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.594+0000 7fcade074640 10 monclient: shutdown 2026-02-24T19:17:26.608 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.594+0000 7fcade074640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:26.608 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.594+0000 7fcade074640 1 -- 10.20.193.162:0/3440169671 >> v1:10.20.193.26:6789/0 conn(0x7fcad8142a00 legacy=0x7fcad8162e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:26.608 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.594+0000 7fcade074640 1 -- 10.20.193.162:0/3440169671 shutdown_connections 2026-02-24T19:17:26.608 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.594+0000 7fcade074640 1 -- 10.20.193.162:0/3440169671 >> 10.20.193.162:0/3440169671 conn(0x7fcad8057490 msgr2=0x7fcad8057890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:26.608 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.594+0000 7fcade074640 1 -- 10.20.193.162:0/3440169671 shutdown_connections 2026-02-24T19:17:26.609 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.594+0000 7fcade074640 1 -- 10.20.193.162:0/3440169671 wait complete. 2026-02-24T19:17:26.609 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.595+0000 7fcade074640 10 monclient: build_initial_monmap 2026-02-24T19:17:26.609 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.595+0000 7fcade074640 10 monclient: monmap: 2026-02-24T19:17:26.609 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:26.609 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:26.609 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-24T19:17:26.609 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-24T19:17:26.609 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:26.609 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-24T19:17:26.609 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:26.609 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:26.609 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:26.609 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:26.610 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.595+0000 7fcade074640 1 librados: starting msgr at 2026-02-24T19:17:26.610 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.595+0000 7fcade074640 1 librados: starting objecter 2026-02-24T19:17:26.610 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.595+0000 7fcade074640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:26.610 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.595+0000 7fcade074640 1 Processor -- start 2026-02-24T19:17:26.610 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.595+0000 7fcade074640 1 -- start start 2026-02-24T19:17:26.610 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.595+0000 7fcade074640 1 librados: setting wanted keys 2026-02-24T19:17:26.610 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.595+0000 7fcade074640 1 librados: calling monclient init 2026-02-24T19:17:26.610 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.595+0000 7fcade074640 10 monclient: init 2026-02-24T19:17:26.610 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.595+0000 7fcade074640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:26.610 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.595+0000 7fcade074640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:26.610 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.595+0000 7fcade074640 10 monclient(hunting): picked mon.noname-a con 0x7fcad8121d90 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:26.610 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.595+0000 7fcade074640 10 monclient(hunting): picked mon.noname-b con 0x7fcad8142a00 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:26.610 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.595+0000 7fcade074640 10 monclient(hunting): picked mon.noname-c con 0x7fcad8164710 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:26.611 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.595+0000 7fcade074640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcad811c8e0 con 0x7fcad8121d90 2026-02-24T19:17:26.611 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.595+0000 7fcade074640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcad811cab0 con 0x7fcad8142a00 2026-02-24T19:17:26.611 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.595+0000 7fcade074640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcad811cc80 con 0x7fcad8164710 2026-02-24T19:17:26.611 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.595+0000 7fcade074640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:26.611 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.595+0000 7fcade074640 10 monclient(hunting): authenticate will time out at 3622.231570s 2026-02-24T19:17:26.611 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.595+0000 7fcad77fe640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fcad8121d90 0x7fcad8184bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.162:49916/0 (socket says 10.20.193.162:49916) 2026-02-24T19:17:26.611 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.595+0000 7fcad6ffd640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7fcad8142a00 0x7fcad81487a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.162:45268/0 (socket says 10.20.193.162:45268) 2026-02-24T19:17:26.611 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.595+0000 7fcad7fff640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fcad8164710 0x7fcad811c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.162:37528/0 (socket says 10.20.193.162:37528) 2026-02-24T19:17:26.611 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.595+0000 7fcad77fe640 1 -- 10.20.193.162:0/1372489370 learned_addr learned my addr 10.20.193.162:0/1372489370 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:26.611 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.596+0000 7fcab3fff640 10 client.?.objecter ms_handle_connect 0x7fcad8164710 2026-02-24T19:17:26.611 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.596+0000 7fcab3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:26.611 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.596+0000 7fcab3fff640 10 client.?.objecter ms_handle_connect 0x7fcad8121d90 2026-02-24T19:17:26.611 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.596+0000 7fcab3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:26.612 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.596+0000 7fcab3fff640 10 client.?.objecter ms_handle_connect 0x7fcad8142a00 2026-02-24T19:17:26.612 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.596+0000 7fcab3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:26.612 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.597+0000 7fcab3fff640 1 -- 10.20.193.162:0/1372489370 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 577445922 0 0) 0x7fcad811c8e0 con 0x7fcad8121d90 2026-02-24T19:17:26.612 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.597+0000 7fcab3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:26.612 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.597+0000 7fcab3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:26.612 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.597+0000 7fcab3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:26.612 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.597+0000 7fcab3fff640 10 monclient(hunting): my global_id is 4188 2026-02-24T19:17:26.612 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.597+0000 7fcab3fff640 1 -- 10.20.193.162:0/1372489370 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcaa8003610 con 0x7fcad8121d90 2026-02-24T19:17:26.612 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.597+0000 7fcab3fff640 1 -- 10.20.193.162:0/1372489370 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1754939218 0 0) 0x7fcad811cab0 con 0x7fcad8142a00 2026-02-24T19:17:26.612 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.597+0000 7fcab3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:26.612 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.597+0000 7fcab3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:26.612 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.597+0000 7fcab3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:26.613 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.597+0000 7fcab3fff640 10 monclient(hunting): my global_id is 4168 2026-02-24T19:17:26.613 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.597+0000 7fcab3fff640 1 -- 10.20.193.162:0/1372489370 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcad811c8e0 con 0x7fcad8142a00 2026-02-24T19:17:26.613 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.597+0000 7fcab3fff640 1 -- 10.20.193.162:0/1372489370 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1794402733 0 0) 0x7fcad811cc80 con 0x7fcad8164710 2026-02-24T19:17:26.613 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.597+0000 7fcab3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:26.613 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.597+0000 7fcab3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:26.613 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.597+0000 7fcab3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:26.613 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.597+0000 7fcab3fff640 10 monclient(hunting): my global_id is 4187 2026-02-24T19:17:26.613 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.597+0000 7fcab3fff640 1 -- 10.20.193.162:0/1372489370 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcad811cab0 con 0x7fcad8164710 2026-02-24T19:17:26.613 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.599+0000 7fcab3fff640 1 -- 10.20.193.162:0/1372489370 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 121611405 0 0) 0x7fcad811c8e0 con 0x7fcad8142a00 2026-02-24T19:17:26.613 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.599+0000 7fcab3fff640 1 -- 10.20.193.162:0/1372489370 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcad811cc80 con 0x7fcad8142a00 2026-02-24T19:17:26.613 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.599+0000 7fcab3fff640 1 -- 10.20.193.162:0/1372489370 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fcac8002c30 con 0x7fcad8142a00 2026-02-24T19:17:26.613 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.599+0000 7fcab3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:26.613 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.599+0000 7fcab3fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:26.614 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.599+0000 7fcab3fff640 10 monclient(hunting): dump: 2026-02-24T19:17:26.614 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:26.614 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:26.614 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.614 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.614 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:26.614 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:26.614 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:26.614 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:26.614 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:26.614 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:26.614 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.599+0000 7fcab3fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:26.615 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.599+0000 7fcab3fff640 1 -- 10.20.193.162:0/1372489370 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3072635774 0 0) 0x7fcaa8003610 con 0x7fcad8121d90 2026-02-24T19:17:26.615 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.599+0000 7fcab3fff640 1 -- 10.20.193.162:0/1372489370 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcad811c8e0 con 0x7fcad8121d90 2026-02-24T19:17:26.615 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.599+0000 7fcab3fff640 1 -- 10.20.193.162:0/1372489370 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fcac4003190 con 0x7fcad8121d90 2026-02-24T19:17:26.615 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.599+0000 7fcab3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:26.615 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.599+0000 7fcab3fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:26.615 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.599+0000 7fcab3fff640 10 monclient(hunting): dump: 2026-02-24T19:17:26.615 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:26.615 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:26.615 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.615 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.615 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:26.615 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:26.615 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:26.616 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:26.616 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:26.616 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:26.616 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.599+0000 7fcab3fff640 1 -- 10.20.193.162:0/1372489370 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2543465470 0 0) 0x7fcad811cab0 con 0x7fcad8164710 2026-02-24T19:17:26.616 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.599+0000 7fcab3fff640 1 -- 10.20.193.162:0/1372489370 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcaa8003610 con 0x7fcad8164710 2026-02-24T19:17:26.616 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.599+0000 7fcab3fff640 1 -- 10.20.193.162:0/1372489370 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fcacc003410 con 0x7fcad8164710 2026-02-24T19:17:26.616 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.599+0000 7fcab3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:26.616 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.599+0000 7fcab3fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:26.616 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.599+0000 7fcab3fff640 10 monclient(hunting): dump: 2026-02-24T19:17:26.616 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:26.616 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:26.616 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.617 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.617 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:26.617 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:26.617 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:26.617 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:26.617 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:26.617 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:26.617 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.601+0000 7fcab3fff640 1 -- 10.20.193.162:0/1372489370 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2606501639 0 0) 0x7fcad811cc80 con 0x7fcad8142a00 2026-02-24T19:17:26.617 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.601+0000 7fcab3fff640 1 -- 10.20.193.162:0/1372489370 >> v1:10.20.193.103:6789/0 conn(0x7fcad8164710 legacy=0x7fcad811c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:26.617 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.601+0000 7fcab3fff640 1 -- 10.20.193.162:0/1372489370 >> v1:10.20.193.26:6789/0 conn(0x7fcad8121d90 legacy=0x7fcad8184bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:26.617 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.601+0000 7fcab3fff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:26.617 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.601+0000 7fcab3fff640 1 monclient: found mon.b 2026-02-24T19:17:26.618 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.601+0000 7fcab3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:26.618 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.601+0000 7fcab3fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:26.618 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.601+0000 7fcab3fff640 1 -- 10.20.193.162:0/1372489370 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad811ce50 con 0x7fcad8142a00 2026-02-24T19:17:26.618 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.601+0000 7fcab3fff640 10 monclient: _finish_auth 0 2026-02-24T19:17:26.618 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.601+0000 7fcab3fff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:26.618 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.601+0000 7fcab3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:26.618 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.601+0000 7fcade074640 5 monclient: authenticate success, global_id 4168 2026-02-24T19:17:26.618 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.601+0000 7fcade074640 10 monclient: _renew_subs 2026-02-24T19:17:26.618 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.601+0000 7fcade074640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:26.618 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.601+0000 7fcade074640 1 -- 10.20.193.162:0/1372489370 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcad814ff80 con 0x7fcad8142a00 2026-02-24T19:17:26.618 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.601+0000 7fcade074640 10 client.4168.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:26.618 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.601+0000 7fcade074640 10 monclient: _renew_subs 2026-02-24T19:17:26.618 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.601+0000 7fcade074640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:26.619 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.601+0000 7fcade074640 1 -- 10.20.193.162:0/1372489370 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fcad8150520 con 0x7fcad8142a00 2026-02-24T19:17:26.619 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.601+0000 7fcade074640 1 librados: init done 2026-02-24T19:17:26.619 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.601+0000 7fcade074640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:26.619 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.601+0000 7fcade074640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:26.619 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.601+0000 7fcade074640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:26.619 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.601+0000 7fcade074640 1 -- 10.20.193.162:0/1372489370 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcad81869e0 con 0x7fcad8142a00 2026-02-24T19:17:26.621 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.606+0000 7fcab3fff640 1 -- 10.20.193.162:0/1372489370 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcac80028c0 con 0x7fcad8142a00 2026-02-24T19:17:26.621 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.606+0000 7fcab3fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:26.621 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.606+0000 7fcab3fff640 1 -- 10.20.193.162:0/1372489370 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fcac8004b80 con 0x7fcad8142a00 2026-02-24T19:17:26.621 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.606+0000 7fcab3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:26.621 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.606+0000 7fcab3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:26.621 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.606+0000 7fcad5ffb640 4 set_mon_vals no callback set 2026-02-24T19:17:26.621 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.606+0000 7fcab3fff640 10 monclient: dump: 2026-02-24T19:17:26.621 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:26.621 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:26.621 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.621 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.622 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:26.622 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:26.622 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:26.622 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:26.622 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:26.622 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:26.622 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.608+0000 7fcab3fff640 1 -- 10.20.193.162:0/1372489370 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 3) ==== 101401+0+0 (unknown 3979941933 0 0) 0x7fcac801d7b0 con 0x7fcad8142a00 2026-02-24T19:17:26.622 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.609+0000 7fcad77fe640 10 monclient: get_auth_request con 0x7fcaa8077cd0 auth_method 0 2026-02-24T19:17:26.622 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.609+0000 7fcab3fff640 10 client.4168.objecter ms_handle_connect 0x7fcaa8077cd0 2026-02-24T19:17:26.622 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.610+0000 7fcab3fff640 1 -- 10.20.193.162:0/1372489370 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(12..12 src has 1..12) ==== 1870+0+0 (unknown 2223410629 0 0) 0x7fcac80591e0 con 0x7fcad8142a00 2026-02-24T19:17:26.622 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.610+0000 7fcab3fff640 10 client.4168.objecter ms_dispatch2 0x7fcad8000b90 osd_map(12..12 src has 1..12) 2026-02-24T19:17:26.622 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.610+0000 7fcab3fff640 3 client.4168.objecter handle_osd_map got epochs [12,12] > 0 2026-02-24T19:17:26.623 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.610+0000 7fcab3fff640 3 client.4168.objecter handle_osd_map decoding full epoch 12 2026-02-24T19:17:26.623 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.610+0000 7fcab3fff640 20 client.4168.objecter dump_active .. 0 homeless 2026-02-24T19:17:26.694 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.692+0000 7fcab3fff640 1 -- 10.20.193.162:0/1372489370 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fcac805d950 con 0x7fcad8142a00 2026-02-24T19:17:26.694 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.692+0000 7fcab3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:26.694 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.692+0000 7fcab3fff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:26.807 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.805+0000 7fcade074640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "8df004a9-88e3-43f5-833d-dfc73a658ec3", "id": 10}] 2026-02-24T19:17:26.807 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.805+0000 7fcade074640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "8df004a9-88e3-43f5-833d-dfc73a658ec3", "id": 10}] 2026-02-24T19:17:26.807 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.805+0000 7fcade074640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:26.807 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.805+0000 7fcade074640 1 -- 10.20.193.162:0/1372489370 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "osd new", "uuid": "8df004a9-88e3-43f5-833d-dfc73a658ec3", "id": 10} v 0) -- 0x7fcad80553a0 con 0x7fcad8142a00 2026-02-24T19:17:26.851 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.850+0000 7fcab3fff640 1 -- 10.20.193.162:0/1372489370 <== mon.1 v1:10.20.193.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8df004a9-88e3-43f5-833d-dfc73a658ec3", "id": 10}]=0 v13) ==== 113+0+3 (unknown 3818980745 0 520826459) 0x7fcad80553a0 con 0x7fcad8142a00 2026-02-24T19:17:26.851 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.850+0000 7fcab3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "8df004a9-88e3-43f5-833d-dfc73a658ec3", "id": 10}] 2026-02-24T19:17:26.851 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.850+0000 7fcab3fff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:26.852 INFO:teuthology.orchestra.run.trial162.stdout:10 2026-02-24T19:17:26.853 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.851+0000 7fcade074640 10 librados: watch_flush enter 2026-02-24T19:17:26.853 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.851+0000 7fcade074640 10 librados: watch_flush exit 2026-02-24T19:17:26.853 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.851+0000 7fcade074640 20 client.4168.objecter shutdown clearing up homeless session... 2026-02-24T19:17:26.853 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.851+0000 7fcade074640 10 client.4168.objecter successfully canceled tick 2026-02-24T19:17:26.854 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.851+0000 7fcade074640 1 -- 10.20.193.162:0/1372489370 >> v1:10.20.193.162:6800/3889602630 conn(0x7fcaa8077cd0 legacy=0x7fcaa8098180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:26.854 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.851+0000 7fcade074640 10 monclient: shutdown 2026-02-24T19:17:26.854 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.851+0000 7fcade074640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:26.854 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.851+0000 7fcade074640 1 -- 10.20.193.162:0/1372489370 >> v1:10.20.193.70:6789/0 conn(0x7fcad8142a00 legacy=0x7fcad81487a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:26.854 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.851+0000 7fcade074640 1 -- 10.20.193.162:0/1372489370 shutdown_connections 2026-02-24T19:17:26.854 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.851+0000 7fcade074640 1 -- 10.20.193.162:0/1372489370 >> 10.20.193.162:0/1372489370 conn(0x7fcad8057490 msgr2=0x7fcad811f800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:26.854 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.851+0000 7fcade074640 1 -- 10.20.193.162:0/1372489370 shutdown_connections 2026-02-24T19:17:26.854 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.851+0000 7fcade074640 1 -- 10.20.193.162:0/1372489370 wait complete. 2026-02-24T19:17:26.854 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.851+0000 7fcade074640 1 librados: shutdown 2026-02-24T19:17:26.860 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new f3cf3a4b-1c26-480c-ba10-178f8542c1e7 11 2026-02-24T19:17:26.925 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.922+0000 7f395d8e8640 10 monclient: get_monmap_and_config 2026-02-24T19:17:26.926 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.922+0000 7f395d8e8640 10 monclient: build_initial_monmap 2026-02-24T19:17:26.926 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.922+0000 7f395d8e8640 10 monclient: monmap: 2026-02-24T19:17:26.926 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:26.926 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:26.926 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:17:26.924153+0000 2026-02-24T19:17:26.926 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:17:26.924153+0000 2026-02-24T19:17:26.926 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:26.926 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:26.926 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:26.926 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:26.927 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:26.927 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:26.927 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.923+0000 7f395d8e8640 1 Processor -- start 2026-02-24T19:17:26.927 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.923+0000 7f395d8e8640 1 -- start start 2026-02-24T19:17:26.927 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.923+0000 7f395d8e8640 10 monclient: init 2026-02-24T19:17:26.927 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.923+0000 7f395d8e8640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:26.927 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.923+0000 7f395d8e8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:26.927 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.923+0000 7f395d8e8640 10 monclient(hunting): picked mon.noname-b con 0x7f395805d9b0 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:26.927 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.923+0000 7f395d8e8640 10 monclient(hunting): picked mon.noname-c con 0x7f395805dd80 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:26.928 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.923+0000 7f395d8e8640 10 monclient(hunting): picked mon.noname-a con 0x7f39581649b0 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:26.928 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.923+0000 7f395d8e8640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f395805e200 con 0x7f39581649b0 2026-02-24T19:17:26.928 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.923+0000 7f395d8e8640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39581874c0 con 0x7f395805d9b0 2026-02-24T19:17:26.928 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.923+0000 7f395d8e8640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39581886a0 con 0x7f395805dd80 2026-02-24T19:17:26.928 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.923+0000 7f395d8e8640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:26.928 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.923+0000 7f395d8e8640 10 monclient(hunting): authenticate will time out at 3622.559402s 2026-02-24T19:17:26.928 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.923+0000 7f3956ffd640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f395805d9b0 0x7f395811b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.162:45276/0 (socket says 10.20.193.162:45276) 2026-02-24T19:17:26.928 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.923+0000 7f3956ffd640 1 -- 10.20.193.162:0/161647639 learned_addr learned my addr 10.20.193.162:0/161647639 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:26.935 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.925+0000 7f3955ffb640 1 -- 10.20.193.162:0/161647639 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2434029097 0 0) 0x7f39581874c0 con 0x7f395805d9b0 2026-02-24T19:17:26.935 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.925+0000 7f3955ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:26.936 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.925+0000 7f3955ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:26.936 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.925+0000 7f3955ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:26.936 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.925+0000 7f3955ffb640 10 monclient(hunting): my global_id is 4171 2026-02-24T19:17:26.936 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.925+0000 7f3955ffb640 1 -- 10.20.193.162:0/161647639 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3944003610 con 0x7f395805d9b0 2026-02-24T19:17:26.936 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.925+0000 7f3955ffb640 1 -- 10.20.193.162:0/161647639 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 744894209 0 0) 0x7f39581886a0 con 0x7f395805dd80 2026-02-24T19:17:26.936 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.925+0000 7f3955ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:26.936 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.925+0000 7f3955ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:26.936 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.925+0000 7f3955ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:26.936 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.925+0000 7f3955ffb640 10 monclient(hunting): my global_id is 4190 2026-02-24T19:17:26.936 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.925+0000 7f3955ffb640 1 -- 10.20.193.162:0/161647639 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39581874c0 con 0x7f395805dd80 2026-02-24T19:17:26.936 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.925+0000 7f3955ffb640 1 -- 10.20.193.162:0/161647639 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 351363672 0 0) 0x7f395805e200 con 0x7f39581649b0 2026-02-24T19:17:26.936 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.925+0000 7f3955ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:26.937 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.925+0000 7f3955ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:26.937 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.925+0000 7f3955ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:26.937 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.925+0000 7f3955ffb640 10 monclient(hunting): my global_id is 4191 2026-02-24T19:17:26.937 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.925+0000 7f3955ffb640 1 -- 10.20.193.162:0/161647639 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39581886a0 con 0x7f39581649b0 2026-02-24T19:17:26.937 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.926+0000 7f3955ffb640 1 -- 10.20.193.162:0/161647639 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1956951080 0 0) 0x7f3944003610 con 0x7f395805d9b0 2026-02-24T19:17:26.937 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.926+0000 7f3955ffb640 1 -- 10.20.193.162:0/161647639 >> v1:10.20.193.103:6789/0 conn(0x7f395805dd80 legacy=0x7f395811b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:26.937 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.926+0000 7f3955ffb640 1 -- 10.20.193.162:0/161647639 >> v1:10.20.193.26:6789/0 conn(0x7f39581649b0 legacy=0x7f3958184d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:26.937 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.926+0000 7f3955ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:26.937 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.926+0000 7f3955ffb640 1 monclient: found mon.noname-b 2026-02-24T19:17:26.937 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.926+0000 7f3955ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:26.937 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.926+0000 7f3955ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:17:26.937 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.926+0000 7f3955ffb640 1 -- 10.20.193.162:0/161647639 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3958189920 con 0x7f395805d9b0 2026-02-24T19:17:26.938 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.926+0000 7f3955ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:26.938 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.926+0000 7f3955ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:26.938 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.926+0000 7f3955ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:26.938 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.926+0000 7f3955ffb640 1 -- 10.20.193.162:0/161647639 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f394c002df0 con 0x7f395805d9b0 2026-02-24T19:17:26.938 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.926+0000 7f3955ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:26.938 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.926+0000 7f3955ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:26.938 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.926+0000 7f3955ffb640 10 monclient: dump: 2026-02-24T19:17:26.938 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:26.938 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:26.938 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.938 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.938 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:26.938 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:26.939 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:26.939 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:26.939 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:26.939 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:26.939 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.926+0000 7f395d8e8640 5 monclient: authenticate success, global_id 4171 2026-02-24T19:17:26.939 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.926+0000 7f395d8e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:26.939 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.927+0000 7f3955ffb640 1 -- 10.20.193.162:0/161647639 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f394c003030 con 0x7f395805d9b0 2026-02-24T19:17:26.939 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.927+0000 7f3955ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:26.939 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.927+0000 7f3955ffb640 1 -- 10.20.193.162:0/161647639 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f394c003470 con 0x7f395805d9b0 2026-02-24T19:17:26.939 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.927+0000 7f3955ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:26.939 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.927+0000 7f3955ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:26.939 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.927+0000 7f3955ffb640 10 monclient: dump: 2026-02-24T19:17:26.940 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:26.940 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:26.940 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.940 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.940 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:26.940 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:26.940 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:26.940 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:26.940 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:26.940 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:26.940 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.927+0000 7f395d8e8640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:26.940 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.927+0000 7f395d8e8640 4 set_mon_vals no callback set 2026-02-24T19:17:26.940 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.927+0000 7f395d8e8640 10 monclient: shutdown 2026-02-24T19:17:26.941 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.927+0000 7f395d8e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:26.941 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.927+0000 7f395d8e8640 1 -- 10.20.193.162:0/161647639 >> v1:10.20.193.70:6789/0 conn(0x7f395805d9b0 legacy=0x7f395811b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:26.941 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.927+0000 7f395d8e8640 1 -- 10.20.193.162:0/161647639 shutdown_connections 2026-02-24T19:17:26.941 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.927+0000 7f395d8e8640 1 -- 10.20.193.162:0/161647639 >> 10.20.193.162:0/161647639 conn(0x7f39580588d0 msgr2=0x7f3958058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:26.941 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.927+0000 7f395d8e8640 1 -- 10.20.193.162:0/161647639 shutdown_connections 2026-02-24T19:17:26.941 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.927+0000 7f395d8e8640 1 -- 10.20.193.162:0/161647639 wait complete. 2026-02-24T19:17:26.941 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.928+0000 7f395d8e8640 10 monclient: build_initial_monmap 2026-02-24T19:17:26.941 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.928+0000 7f395d8e8640 10 monclient: monmap: 2026-02-24T19:17:26.941 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:26.941 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:26.941 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-24T19:17:26.941 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-24T19:17:26.942 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:26.942 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-24T19:17:26.942 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:26.942 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:26.942 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:26.942 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:26.942 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.928+0000 7f395d8e8640 1 librados: starting msgr at 2026-02-24T19:17:26.942 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.928+0000 7f395d8e8640 1 librados: starting objecter 2026-02-24T19:17:26.942 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.928+0000 7f395d8e8640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:26.942 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.928+0000 7f395d8e8640 1 Processor -- start 2026-02-24T19:17:26.942 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.928+0000 7f395d8e8640 1 -- start start 2026-02-24T19:17:26.942 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.928+0000 7f395d8e8640 1 librados: setting wanted keys 2026-02-24T19:17:26.942 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.928+0000 7f395d8e8640 1 librados: calling monclient init 2026-02-24T19:17:26.943 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.928+0000 7f395d8e8640 10 monclient: init 2026-02-24T19:17:26.943 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.928+0000 7f395d8e8640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:26.943 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.928+0000 7f395d8e8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:26.943 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.928+0000 7f395d8e8640 10 monclient(hunting): picked mon.noname-b con 0x7f395805d9b0 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:26.943 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.928+0000 7f395d8e8640 10 monclient(hunting): picked mon.noname-c con 0x7f395805dd80 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:26.943 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.928+0000 7f395d8e8640 10 monclient(hunting): picked mon.noname-a con 0x7f39581649b0 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:26.943 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.928+0000 7f395d8e8640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3958102380 con 0x7f39581649b0 2026-02-24T19:17:26.943 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.928+0000 7f395d8e8640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3958109260 con 0x7f395805d9b0 2026-02-24T19:17:26.943 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.928+0000 7f395d8e8640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f395810a440 con 0x7f395805dd80 2026-02-24T19:17:26.943 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.928+0000 7f395d8e8640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:26.943 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.928+0000 7f395d8e8640 10 monclient(hunting): authenticate will time out at 3622.564515s 2026-02-24T19:17:26.943 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.928+0000 7f39577fe640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f39581649b0 0x7f39581630a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.162:49930/0 (socket says 10.20.193.162:49930) 2026-02-24T19:17:26.944 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.928+0000 7f39577fe640 1 -- 10.20.193.162:0/3945895506 learned_addr learned my addr 10.20.193.162:0/3945895506 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:26.944 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.929+0000 7f392ffff640 10 client.?.objecter ms_handle_connect 0x7f395805dd80 2026-02-24T19:17:26.944 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.929+0000 7f392ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:26.944 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.929+0000 7f392ffff640 10 client.?.objecter ms_handle_connect 0x7f39581649b0 2026-02-24T19:17:26.944 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.929+0000 7f392ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:26.944 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.929+0000 7f392ffff640 10 client.?.objecter ms_handle_connect 0x7f395805d9b0 2026-02-24T19:17:26.944 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.929+0000 7f392ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:26.944 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.930+0000 7f392ffff640 1 -- 10.20.193.162:0/3945895506 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 691347199 0 0) 0x7f3958109260 con 0x7f395805d9b0 2026-02-24T19:17:26.944 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.930+0000 7f392ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:26.944 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.930+0000 7f392ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:26.944 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.930+0000 7f392ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:26.944 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.930+0000 7f392ffff640 10 monclient(hunting): my global_id is 4174 2026-02-24T19:17:26.945 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.930+0000 7f392ffff640 1 -- 10.20.193.162:0/3945895506 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3928003610 con 0x7f395805d9b0 2026-02-24T19:17:26.945 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.930+0000 7f392ffff640 1 -- 10.20.193.162:0/3945895506 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3900944840 0 0) 0x7f395810a440 con 0x7f395805dd80 2026-02-24T19:17:26.945 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.930+0000 7f392ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:26.945 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.930+0000 7f392ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:26.945 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.930+0000 7f392ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:26.945 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.930+0000 7f392ffff640 10 monclient(hunting): my global_id is 4193 2026-02-24T19:17:26.945 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.930+0000 7f392ffff640 1 -- 10.20.193.162:0/3945895506 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3958109260 con 0x7f395805dd80 2026-02-24T19:17:26.945 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.930+0000 7f392ffff640 1 -- 10.20.193.162:0/3945895506 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 703572524 0 0) 0x7f3958102380 con 0x7f39581649b0 2026-02-24T19:17:26.945 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.930+0000 7f392ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:26.945 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.930+0000 7f392ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:26.945 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.930+0000 7f392ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:26.945 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.930+0000 7f392ffff640 10 monclient(hunting): my global_id is 4194 2026-02-24T19:17:26.945 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.930+0000 7f392ffff640 1 -- 10.20.193.162:0/3945895506 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f395810a440 con 0x7f39581649b0 2026-02-24T19:17:26.946 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.932+0000 7f392ffff640 1 -- 10.20.193.162:0/3945895506 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 136145167 0 0) 0x7f395810a440 con 0x7f39581649b0 2026-02-24T19:17:26.946 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.932+0000 7f392ffff640 1 -- 10.20.193.162:0/3945895506 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3958102380 con 0x7f39581649b0 2026-02-24T19:17:26.946 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.932+0000 7f392ffff640 1 -- 10.20.193.162:0/3945895506 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f39480033b0 con 0x7f39581649b0 2026-02-24T19:17:26.946 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.932+0000 7f392ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:26.946 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.932+0000 7f392ffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:26.946 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.932+0000 7f392ffff640 10 monclient(hunting): dump: 2026-02-24T19:17:26.946 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:26.946 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:26.946 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.946 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.946 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:26.946 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:26.946 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:26.947 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:26.947 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:26.947 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:26.947 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.932+0000 7f392ffff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:26.947 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.932+0000 7f392ffff640 1 -- 10.20.193.162:0/3945895506 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 969682182 0 0) 0x7f3958109260 con 0x7f395805dd80 2026-02-24T19:17:26.947 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.932+0000 7f392ffff640 1 -- 10.20.193.162:0/3945895506 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f395810a440 con 0x7f395805dd80 2026-02-24T19:17:26.947 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.932+0000 7f392ffff640 1 -- 10.20.193.162:0/3945895506 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f39400030b0 con 0x7f395805dd80 2026-02-24T19:17:26.947 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.932+0000 7f392ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:26.947 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.932+0000 7f392ffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:26.947 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.932+0000 7f392ffff640 10 monclient(hunting): dump: 2026-02-24T19:17:26.947 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:26.947 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:26.948 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.948 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.948 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:26.948 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:26.948 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:26.948 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:26.948 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:26.948 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:26.948 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.932+0000 7f392ffff640 1 -- 10.20.193.162:0/3945895506 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2029974383 0 0) 0x7f3928003610 con 0x7f395805d9b0 2026-02-24T19:17:26.948 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.932+0000 7f392ffff640 1 -- 10.20.193.162:0/3945895506 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3958109260 con 0x7f395805d9b0 2026-02-24T19:17:26.948 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.932+0000 7f392ffff640 1 -- 10.20.193.162:0/3945895506 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f394c003380 con 0x7f395805d9b0 2026-02-24T19:17:26.948 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.932+0000 7f392ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:26.949 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.932+0000 7f392ffff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:26.949 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.932+0000 7f392ffff640 10 monclient(hunting): dump: 2026-02-24T19:17:26.949 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:26.949 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:26.949 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.949 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.949 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:26.949 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:26.949 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:26.949 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:26.949 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:26.949 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:26.952 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.934+0000 7f392ffff640 1 -- 10.20.193.162:0/3945895506 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 376268720 0 0) 0x7f3958102380 con 0x7f39581649b0 2026-02-24T19:17:26.952 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.934+0000 7f392ffff640 1 -- 10.20.193.162:0/3945895506 >> v1:10.20.193.103:6789/0 conn(0x7f395805dd80 legacy=0x7f3958161980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:26.952 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.934+0000 7f392ffff640 1 -- 10.20.193.162:0/3945895506 >> v1:10.20.193.70:6789/0 conn(0x7f395805d9b0 legacy=0x7f3958101870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:26.952 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.934+0000 7f392ffff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:26.952 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.934+0000 7f392ffff640 1 monclient: found mon.a 2026-02-24T19:17:26.952 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.934+0000 7f392ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:26.953 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.934+0000 7f392ffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:26.953 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.934+0000 7f392ffff640 1 -- 10.20.193.162:0/3945895506 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f395810b620 con 0x7f39581649b0 2026-02-24T19:17:26.953 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.934+0000 7f392ffff640 10 monclient: _finish_auth 0 2026-02-24T19:17:26.953 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.934+0000 7f392ffff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:26.953 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.934+0000 7f392ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:26.953 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.934+0000 7f395d8e8640 5 monclient: authenticate success, global_id 4194 2026-02-24T19:17:26.953 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.934+0000 7f395d8e8640 10 monclient: _renew_subs 2026-02-24T19:17:26.953 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.934+0000 7f395d8e8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:26.953 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.934+0000 7f395d8e8640 1 -- 10.20.193.162:0/3945895506 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3958108250 con 0x7f39581649b0 2026-02-24T19:17:26.953 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.934+0000 7f395d8e8640 10 client.4194.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:26.953 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.934+0000 7f395d8e8640 10 monclient: _renew_subs 2026-02-24T19:17:26.953 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.934+0000 7f395d8e8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:26.954 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.934+0000 7f395d8e8640 1 -- 10.20.193.162:0/3945895506 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3958108890 con 0x7f39581649b0 2026-02-24T19:17:26.954 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.934+0000 7f395d8e8640 1 librados: init done 2026-02-24T19:17:26.954 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.934+0000 7f395d8e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:26.954 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.934+0000 7f395d8e8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:26.954 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.934+0000 7f395d8e8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:26.954 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.934+0000 7f395d8e8640 1 -- 10.20.193.162:0/3945895506 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3958188d70 con 0x7f39581649b0 2026-02-24T19:17:26.954 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.939+0000 7f392ffff640 1 -- 10.20.193.162:0/3945895506 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3948003550 con 0x7f39581649b0 2026-02-24T19:17:26.954 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.939+0000 7f392ffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:26.954 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.939+0000 7f392ffff640 1 -- 10.20.193.162:0/3945895506 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f3948003ce0 con 0x7f39581649b0 2026-02-24T19:17:26.954 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.939+0000 7f392ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:26.954 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.939+0000 7f392ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:26.954 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.939+0000 7f39557fa640 4 set_mon_vals no callback set 2026-02-24T19:17:26.955 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.939+0000 7f392ffff640 10 monclient: dump: 2026-02-24T19:17:26.955 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:26.955 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:26.955 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.955 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:26.955 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:26.955 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:26.955 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:26.955 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:26.955 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:26.955 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:26.955 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.942+0000 7f392ffff640 1 -- 10.20.193.162:0/3945895506 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 3) ==== 101401+0+0 (unknown 3979941933 0 0) 0x7f3948003ce0 con 0x7f39581649b0 2026-02-24T19:17:26.955 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.943+0000 7f3956ffd640 10 monclient: get_auth_request con 0x7f3928077d10 auth_method 0 2026-02-24T19:17:26.956 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.943+0000 7f392ffff640 10 client.4194.objecter ms_handle_connect 0x7f3928077d10 2026-02-24T19:17:26.956 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.943+0000 7f392ffff640 1 -- 10.20.193.162:0/3945895506 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(13..13 src has 1..13) ==== 1985+0+0 (unknown 1365459974 0 0) 0x7f3948059730 con 0x7f39581649b0 2026-02-24T19:17:26.956 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.943+0000 7f392ffff640 10 client.4194.objecter ms_dispatch2 0x7f3958000b90 osd_map(13..13 src has 1..13) 2026-02-24T19:17:26.956 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.943+0000 7f392ffff640 3 client.4194.objecter handle_osd_map got epochs [13,13] > 0 2026-02-24T19:17:26.956 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.943+0000 7f392ffff640 3 client.4194.objecter handle_osd_map decoding full epoch 13 2026-02-24T19:17:26.956 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:26.943+0000 7f392ffff640 20 client.4194.objecter dump_active .. 0 homeless 2026-02-24T19:17:27.026 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.024+0000 7f392ffff640 1 -- 10.20.193.162:0/3945895506 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f394805dea0 con 0x7f39581649b0 2026-02-24T19:17:27.026 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.024+0000 7f392ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:27.026 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.024+0000 7f392ffff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:27.136 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.134+0000 7f395d8e8640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "f3cf3a4b-1c26-480c-ba10-178f8542c1e7", "id": 11}] 2026-02-24T19:17:27.136 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.134+0000 7f395d8e8640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "f3cf3a4b-1c26-480c-ba10-178f8542c1e7", "id": 11}] 2026-02-24T19:17:27.136 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.134+0000 7f395d8e8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:27.137 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.134+0000 7f395d8e8640 1 -- 10.20.193.162:0/3945895506 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "osd new", "uuid": "f3cf3a4b-1c26-480c-ba10-178f8542c1e7", "id": 11} v 0) -- 0x7f3958108b80 con 0x7f39581649b0 2026-02-24T19:17:27.175 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.173+0000 7f392ffff640 1 -- 10.20.193.162:0/3945895506 <== mon.0 v1:10.20.193.26:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f3cf3a4b-1c26-480c-ba10-178f8542c1e7", "id": 11}]=0 v14) ==== 113+0+3 (unknown 1792902826 0 212448812) 0x7f394805d7a0 con 0x7f39581649b0 2026-02-24T19:17:27.175 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.173+0000 7f392ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "f3cf3a4b-1c26-480c-ba10-178f8542c1e7", "id": 11}] 2026-02-24T19:17:27.175 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.173+0000 7f392ffff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:27.175 INFO:teuthology.orchestra.run.trial162.stdout:11 2026-02-24T19:17:27.177 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.174+0000 7f395d8e8640 10 librados: watch_flush enter 2026-02-24T19:17:27.177 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.174+0000 7f395d8e8640 10 librados: watch_flush exit 2026-02-24T19:17:27.177 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.174+0000 7f395d8e8640 20 client.4194.objecter shutdown clearing up homeless session... 2026-02-24T19:17:27.177 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.174+0000 7f395d8e8640 10 client.4194.objecter successfully canceled tick 2026-02-24T19:17:27.177 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.174+0000 7f395d8e8640 1 -- 10.20.193.162:0/3945895506 >> v1:10.20.193.162:6800/3889602630 conn(0x7f3928077d10 legacy=0x7f39280981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.177 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.174+0000 7f395d8e8640 10 monclient: shutdown 2026-02-24T19:17:27.177 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.174+0000 7f395d8e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:27.178 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.174+0000 7f395d8e8640 1 -- 10.20.193.162:0/3945895506 >> v1:10.20.193.26:6789/0 conn(0x7f39581649b0 legacy=0x7f39581630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.178 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.174+0000 7f395d8e8640 1 -- 10.20.193.162:0/3945895506 shutdown_connections 2026-02-24T19:17:27.178 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.174+0000 7f395d8e8640 1 -- 10.20.193.162:0/3945895506 >> 10.20.193.162:0/3945895506 conn(0x7f39580588d0 msgr2=0x7f395805b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:27.178 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.174+0000 7f395d8e8640 1 -- 10.20.193.162:0/3945895506 shutdown_connections 2026-02-24T19:17:27.178 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.174+0000 7f395d8e8640 1 -- 10.20.193.162:0/3945895506 wait complete. 2026-02-24T19:17:27.178 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.174+0000 7f395d8e8640 1 librados: shutdown 2026-02-24T19:17:27.184 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new 0e06b2e9-9b29-4c6e-ab44-77fd24d945af 12 2026-02-24T19:17:27.250 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.248+0000 7f232a03c640 10 monclient: get_monmap_and_config 2026-02-24T19:17:27.250 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.248+0000 7f232a03c640 10 monclient: build_initial_monmap 2026-02-24T19:17:27.250 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.248+0000 7f232a03c640 10 monclient: monmap: 2026-02-24T19:17:27.250 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:27.250 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:27.250 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:17:27.249512+0000 2026-02-24T19:17:27.250 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:17:27.249512+0000 2026-02-24T19:17:27.250 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:27.250 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:27.250 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:27.251 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:27.251 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:27.251 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:27.253 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.248+0000 7f232a03c640 1 Processor -- start 2026-02-24T19:17:27.253 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.248+0000 7f232a03c640 1 -- start start 2026-02-24T19:17:27.253 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.248+0000 7f232a03c640 10 monclient: init 2026-02-24T19:17:27.253 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.248+0000 7f232a03c640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:27.253 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.248+0000 7f232a03c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:17:27.253 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.248+0000 7f232a03c640 10 monclient(hunting): picked mon.noname-b con 0x7f232411d730 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:27.254 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.248+0000 7f232a03c640 10 monclient(hunting): picked mon.noname-a con 0x7f23241406b0 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:27.254 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.248+0000 7f232a03c640 10 monclient(hunting): picked mon.noname-c con 0x7f2324162240 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:27.254 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.248+0000 7f232a03c640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2324183fd0 con 0x7f23241406b0 2026-02-24T19:17:27.254 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.248+0000 7f232a03c640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23241851d0 con 0x7f232411d730 2026-02-24T19:17:27.254 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.248+0000 7f232a03c640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23241863d0 con 0x7f2324162240 2026-02-24T19:17:27.254 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.248+0000 7f232a03c640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:27.254 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.248+0000 7f232a03c640 10 monclient(hunting): authenticate will time out at 3622.884866s 2026-02-24T19:17:27.254 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.249+0000 7f23237fe640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f232411d730 0x7f232411db00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.162:35306/0 (socket says 10.20.193.162:35306) 2026-02-24T19:17:27.254 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.249+0000 7f23237fe640 1 -- 10.20.193.162:0/2131001074 learned_addr learned my addr 10.20.193.162:0/2131001074 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:27.254 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.250+0000 7f23227fc640 1 -- 10.20.193.162:0/2131001074 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2878247470 0 0) 0x7f23241851d0 con 0x7f232411d730 2026-02-24T19:17:27.254 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.250+0000 7f23227fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.255 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.250+0000 7f23227fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.255 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.250+0000 7f23227fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.255 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.250+0000 7f23227fc640 10 monclient(hunting): my global_id is 4177 2026-02-24T19:17:27.255 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.250+0000 7f23227fc640 1 -- 10.20.193.162:0/2131001074 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2308003610 con 0x7f232411d730 2026-02-24T19:17:27.255 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.250+0000 7f23227fc640 1 -- 10.20.193.162:0/2131001074 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1451644651 0 0) 0x7f23241863d0 con 0x7f2324162240 2026-02-24T19:17:27.255 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.250+0000 7f23227fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.255 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.250+0000 7f23227fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.255 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.250+0000 7f23227fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.255 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.250+0000 7f23227fc640 10 monclient(hunting): my global_id is 4196 2026-02-24T19:17:27.255 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.250+0000 7f23227fc640 1 -- 10.20.193.162:0/2131001074 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23241851d0 con 0x7f2324162240 2026-02-24T19:17:27.255 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.250+0000 7f23227fc640 1 -- 10.20.193.162:0/2131001074 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2133783388 0 0) 0x7f2324183fd0 con 0x7f23241406b0 2026-02-24T19:17:27.255 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.250+0000 7f23227fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.255 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.250+0000 7f23227fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.256 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.250+0000 7f23227fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.256 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.250+0000 7f23227fc640 10 monclient(hunting): my global_id is 4197 2026-02-24T19:17:27.256 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.250+0000 7f23227fc640 1 -- 10.20.193.162:0/2131001074 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23241863d0 con 0x7f23241406b0 2026-02-24T19:17:27.262 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.252+0000 7f23227fc640 1 -- 10.20.193.162:0/2131001074 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3855604366 0 0) 0x7f2308003610 con 0x7f232411d730 2026-02-24T19:17:27.263 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.252+0000 7f23227fc640 1 -- 10.20.193.162:0/2131001074 >> v1:10.20.193.103:6789/0 conn(0x7f2324162240 legacy=0x7f23241826d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.263 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.252+0000 7f23227fc640 1 -- 10.20.193.162:0/2131001074 >> v1:10.20.193.26:6789/0 conn(0x7f23241406b0 legacy=0x7f2324160a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.263 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.252+0000 7f23227fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:27.263 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.252+0000 7f23227fc640 1 monclient: found mon.noname-b 2026-02-24T19:17:27.263 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.252+0000 7f23227fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:27.263 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.252+0000 7f23227fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:17:27.263 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.252+0000 7f23227fc640 1 -- 10.20.193.162:0/2131001074 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2324187670 con 0x7f232411d730 2026-02-24T19:17:27.263 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.252+0000 7f23227fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:27.263 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.252+0000 7f23227fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:27.263 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.252+0000 7f23227fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:27.264 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.252+0000 7f232a03c640 5 monclient: authenticate success, global_id 4177 2026-02-24T19:17:27.264 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.252+0000 7f232a03c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:27.264 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.252+0000 7f23227fc640 1 -- 10.20.193.162:0/2131001074 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2310002df0 con 0x7f232411d730 2026-02-24T19:17:27.264 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.252+0000 7f23227fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:27.264 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.252+0000 7f23227fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:27.264 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.252+0000 7f23227fc640 10 monclient: dump: 2026-02-24T19:17:27.264 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:27.264 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:27.264 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:27.264 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:27.264 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.264 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:27.264 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:27.265 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:27.265 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:27.265 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:27.265 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.252+0000 7f232a03c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:27.265 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.253+0000 7f23227fc640 1 -- 10.20.193.162:0/2131001074 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f23100030b0 con 0x7f232411d730 2026-02-24T19:17:27.265 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.253+0000 7f23227fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:27.265 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.253+0000 7f23227fc640 1 -- 10.20.193.162:0/2131001074 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f23100034b0 con 0x7f232411d730 2026-02-24T19:17:27.265 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.253+0000 7f23227fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:27.265 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.253+0000 7f23227fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:27.265 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.253+0000 7f23227fc640 10 monclient: dump: 2026-02-24T19:17:27.265 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:27.265 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:27.266 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:27.266 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:27.266 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.266 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:27.266 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:27.266 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:27.266 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:27.266 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:27.266 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.253+0000 7f232a03c640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:27.266 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.253+0000 7f232a03c640 4 set_mon_vals no callback set 2026-02-24T19:17:27.266 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.253+0000 7f232a03c640 10 monclient: shutdown 2026-02-24T19:17:27.266 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.253+0000 7f232a03c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:27.266 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.253+0000 7f232a03c640 1 -- 10.20.193.162:0/2131001074 >> v1:10.20.193.70:6789/0 conn(0x7f232411d730 legacy=0x7f232411db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.267 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.253+0000 7f232a03c640 1 -- 10.20.193.162:0/2131001074 shutdown_connections 2026-02-24T19:17:27.267 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.253+0000 7f232a03c640 1 -- 10.20.193.162:0/2131001074 >> 10.20.193.162:0/2131001074 conn(0x7f2324058d50 msgr2=0x7f2324059150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:27.267 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.253+0000 7f232a03c640 1 -- 10.20.193.162:0/2131001074 shutdown_connections 2026-02-24T19:17:27.267 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.253+0000 7f232a03c640 1 -- 10.20.193.162:0/2131001074 wait complete. 2026-02-24T19:17:27.267 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.253+0000 7f232a03c640 10 monclient: build_initial_monmap 2026-02-24T19:17:27.267 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.253+0000 7f232a03c640 10 monclient: monmap: 2026-02-24T19:17:27.267 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:27.267 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:27.267 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-24T19:17:27.267 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-24T19:17:27.267 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:27.267 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-24T19:17:27.267 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:27.268 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:27.268 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:27.268 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:27.268 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.253+0000 7f232a03c640 1 librados: starting msgr at 2026-02-24T19:17:27.268 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.253+0000 7f232a03c640 1 librados: starting objecter 2026-02-24T19:17:27.268 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.253+0000 7f232a03c640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:27.268 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.253+0000 7f232a03c640 1 Processor -- start 2026-02-24T19:17:27.268 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.253+0000 7f232a03c640 1 -- start start 2026-02-24T19:17:27.268 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.253+0000 7f232a03c640 1 librados: setting wanted keys 2026-02-24T19:17:27.268 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.253+0000 7f232a03c640 1 librados: calling monclient init 2026-02-24T19:17:27.268 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.253+0000 7f232a03c640 10 monclient: init 2026-02-24T19:17:27.268 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.254+0000 7f232a03c640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:27.268 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.254+0000 7f232a03c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:27.269 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.254+0000 7f232a03c640 10 monclient(hunting): picked mon.noname-a con 0x7f232411d730 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:27.269 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.254+0000 7f232a03c640 10 monclient(hunting): picked mon.noname-b con 0x7f23241406b0 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:27.269 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.254+0000 7f232a03c640 10 monclient(hunting): picked mon.noname-c con 0x7f2324162240 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:27.269 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.254+0000 7f232a03c640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f232412e740 con 0x7f232411d730 2026-02-24T19:17:27.269 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.254+0000 7f232a03c640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f232412f940 con 0x7f23241406b0 2026-02-24T19:17:27.269 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.254+0000 7f232a03c640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2324130b40 con 0x7f2324162240 2026-02-24T19:17:27.269 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.254+0000 7f232a03c640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:27.269 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.254+0000 7f232a03c640 10 monclient(hunting): authenticate will time out at 3622.890092s 2026-02-24T19:17:27.269 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.254+0000 7f2322ffd640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f23241406b0 0x7f2324160a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.162:35314/0 (socket says 10.20.193.162:35314) 2026-02-24T19:17:27.269 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.254+0000 7f2322ffd640 1 -- 10.20.193.162:0/1682879881 learned_addr learned my addr 10.20.193.162:0/1682879881 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:27.269 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.254+0000 7f22fffff640 10 client.?.objecter ms_handle_connect 0x7f23241406b0 2026-02-24T19:17:27.269 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.254+0000 7f22fffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:27.270 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.254+0000 7f22fffff640 10 client.?.objecter ms_handle_connect 0x7f2324162240 2026-02-24T19:17:27.270 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.254+0000 7f22fffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:27.270 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.254+0000 7f22fffff640 10 client.?.objecter ms_handle_connect 0x7f232411d730 2026-02-24T19:17:27.270 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.254+0000 7f22fffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:27.270 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.255+0000 7f22fffff640 1 -- 10.20.193.162:0/1682879881 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1254306717 0 0) 0x7f232412f940 con 0x7f23241406b0 2026-02-24T19:17:27.270 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.255+0000 7f22fffff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.270 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.255+0000 7f22fffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.270 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.255+0000 7f22fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.270 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.255+0000 7f22fffff640 10 monclient(hunting): my global_id is 4180 2026-02-24T19:17:27.270 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.255+0000 7f22fffff640 1 -- 10.20.193.162:0/1682879881 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22f4003610 con 0x7f23241406b0 2026-02-24T19:17:27.270 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.255+0000 7f22fffff640 1 -- 10.20.193.162:0/1682879881 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1786415420 0 0) 0x7f2324130b40 con 0x7f2324162240 2026-02-24T19:17:27.270 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.255+0000 7f22fffff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.270 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.255+0000 7f22fffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.271 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.255+0000 7f22fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.271 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.255+0000 7f22fffff640 10 monclient(hunting): my global_id is 4199 2026-02-24T19:17:27.271 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.255+0000 7f22fffff640 1 -- 10.20.193.162:0/1682879881 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f232412f940 con 0x7f2324162240 2026-02-24T19:17:27.271 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.255+0000 7f22fffff640 1 -- 10.20.193.162:0/1682879881 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 135604601 0 0) 0x7f232412e740 con 0x7f232411d730 2026-02-24T19:17:27.271 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.255+0000 7f22fffff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.271 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.255+0000 7f22fffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.271 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.255+0000 7f22fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.271 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.255+0000 7f22fffff640 10 monclient(hunting): my global_id is 4200 2026-02-24T19:17:27.271 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.255+0000 7f22fffff640 1 -- 10.20.193.162:0/1682879881 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2324130b40 con 0x7f232411d730 2026-02-24T19:17:27.271 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.258+0000 7f22fffff640 1 -- 10.20.193.162:0/1682879881 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2103712422 0 0) 0x7f22f4003610 con 0x7f23241406b0 2026-02-24T19:17:27.271 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.258+0000 7f22fffff640 1 -- 10.20.193.162:0/1682879881 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f232412e740 con 0x7f23241406b0 2026-02-24T19:17:27.271 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.258+0000 7f22fffff640 1 -- 10.20.193.162:0/1682879881 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2314003170 con 0x7f23241406b0 2026-02-24T19:17:27.272 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.258+0000 7f22fffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:27.272 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.258+0000 7f22fffff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:27.272 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.258+0000 7f22fffff640 10 monclient(hunting): dump: 2026-02-24T19:17:27.272 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:27.272 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:27.272 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:27.272 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:27.272 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.272 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:27.272 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:27.272 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:27.272 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:27.272 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:27.273 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.258+0000 7f22fffff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:27.273 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.258+0000 7f22fffff640 1 -- 10.20.193.162:0/1682879881 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 554282313 0 0) 0x7f232412f940 con 0x7f2324162240 2026-02-24T19:17:27.273 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.258+0000 7f22fffff640 1 -- 10.20.193.162:0/1682879881 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f22f4003610 con 0x7f2324162240 2026-02-24T19:17:27.273 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.258+0000 7f22fffff640 1 -- 10.20.193.162:0/1682879881 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1487221537 0 0) 0x7f2324130b40 con 0x7f232411d730 2026-02-24T19:17:27.273 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.258+0000 7f22fffff640 1 -- 10.20.193.162:0/1682879881 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f232412f940 con 0x7f232411d730 2026-02-24T19:17:27.273 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.258+0000 7f22fffff640 1 -- 10.20.193.162:0/1682879881 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2318003430 con 0x7f2324162240 2026-02-24T19:17:27.273 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.258+0000 7f22fffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:27.273 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.258+0000 7f22fffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:27.273 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.258+0000 7f22fffff640 10 monclient(hunting): dump: 2026-02-24T19:17:27.273 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:27.273 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:27.273 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:27.274 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:27.274 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.274 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:27.274 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:27.274 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:27.274 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:27.274 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:27.274 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.258+0000 7f22fffff640 1 -- 10.20.193.162:0/1682879881 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2310002c10 con 0x7f232411d730 2026-02-24T19:17:27.274 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.258+0000 7f22fffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:27.274 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.258+0000 7f22fffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:27.274 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.258+0000 7f22fffff640 10 monclient(hunting): dump: 2026-02-24T19:17:27.274 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:27.274 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:27.275 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:27.275 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:27.275 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.275 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:27.275 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:27.275 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:27.275 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:27.275 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:27.275 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.259+0000 7f22fffff640 1 -- 10.20.193.162:0/1682879881 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1675485423 0 0) 0x7f232412e740 con 0x7f23241406b0 2026-02-24T19:17:27.275 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.259+0000 7f22fffff640 1 -- 10.20.193.162:0/1682879881 >> v1:10.20.193.103:6789/0 conn(0x7f2324162240 legacy=0x7f232412cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.275 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.259+0000 7f22fffff640 1 -- 10.20.193.162:0/1682879881 >> v1:10.20.193.26:6789/0 conn(0x7f232411d730 legacy=0x7f23241826d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.275 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.259+0000 7f22fffff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:27.275 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.259+0000 7f22fffff640 1 monclient: found mon.b 2026-02-24T19:17:27.276 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.259+0000 7f22fffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:27.276 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.259+0000 7f22fffff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:27.276 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.259+0000 7f22fffff640 1 -- 10.20.193.162:0/1682879881 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2324131de0 con 0x7f23241406b0 2026-02-24T19:17:27.276 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.259+0000 7f22fffff640 10 monclient: _finish_auth 0 2026-02-24T19:17:27.276 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.259+0000 7f22fffff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:27.276 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.259+0000 7f22fffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:27.276 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.259+0000 7f232a03c640 5 monclient: authenticate success, global_id 4180 2026-02-24T19:17:27.276 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.259+0000 7f232a03c640 10 monclient: _renew_subs 2026-02-24T19:17:27.276 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.259+0000 7f232a03c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:27.276 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.259+0000 7f232a03c640 1 -- 10.20.193.162:0/1682879881 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2324130d70 con 0x7f23241406b0 2026-02-24T19:17:27.276 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.259+0000 7f232a03c640 10 client.4180.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:27.276 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.259+0000 7f232a03c640 10 monclient: _renew_subs 2026-02-24T19:17:27.277 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.259+0000 7f232a03c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:27.277 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.259+0000 7f232a03c640 1 -- 10.20.193.162:0/1682879881 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f23241313b0 con 0x7f23241406b0 2026-02-24T19:17:27.277 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.259+0000 7f232a03c640 1 librados: init done 2026-02-24T19:17:27.277 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.260+0000 7f232a03c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:27.277 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.260+0000 7f232a03c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:27.277 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.260+0000 7f232a03c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:27.277 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.260+0000 7f232a03c640 1 -- 10.20.193.162:0/1682879881 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2324185730 con 0x7f23241406b0 2026-02-24T19:17:27.352 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.350+0000 7f22fffff640 1 -- 10.20.193.162:0/1682879881 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f23140034e0 con 0x7f23241406b0 2026-02-24T19:17:27.352 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.350+0000 7f22fffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:27.352 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.350+0000 7f22fffff640 1 -- 10.20.193.162:0/1682879881 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2314003b50 con 0x7f23241406b0 2026-02-24T19:17:27.352 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.350+0000 7f22fffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:27.353 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.350+0000 7f22fffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:27.353 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.350+0000 7f22fffff640 10 monclient: dump: 2026-02-24T19:17:27.353 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:27.353 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:27.353 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:27.353 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:27.353 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.353 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:27.353 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:27.353 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:27.353 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:27.353 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:27.353 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.350+0000 7f2321ffb640 4 set_mon_vals no callback set 2026-02-24T19:17:27.354 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.351+0000 7f22fffff640 1 -- 10.20.193.162:0/1682879881 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 3) ==== 101401+0+0 (unknown 3979941933 0 0) 0x7f2314003d30 con 0x7f23241406b0 2026-02-24T19:17:27.354 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.352+0000 7f23237fe640 10 monclient: get_auth_request con 0x7f22f4077d50 auth_method 0 2026-02-24T19:17:27.354 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.352+0000 7f22fffff640 10 client.4180.objecter ms_handle_connect 0x7f22f4077d50 2026-02-24T19:17:27.357 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.354+0000 7f22fffff640 1 -- 10.20.193.162:0/1682879881 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(14..14 src has 1..14) ==== 2100+0+0 (unknown 23744502 0 0) 0x7f2314059490 con 0x7f23241406b0 2026-02-24T19:17:27.357 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.354+0000 7f22fffff640 10 client.4180.objecter ms_dispatch2 0x7f2324000b90 osd_map(14..14 src has 1..14) 2026-02-24T19:17:27.357 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.354+0000 7f22fffff640 3 client.4180.objecter handle_osd_map got epochs [14,14] > 0 2026-02-24T19:17:27.357 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.354+0000 7f22fffff640 3 client.4180.objecter handle_osd_map decoding full epoch 14 2026-02-24T19:17:27.357 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.355+0000 7f22fffff640 20 client.4180.objecter dump_active .. 0 homeless 2026-02-24T19:17:27.357 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.355+0000 7f22fffff640 1 -- 10.20.193.162:0/1682879881 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f231405dc00 con 0x7f23241406b0 2026-02-24T19:17:27.357 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.355+0000 7f22fffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:27.357 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.355+0000 7f22fffff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:27.468 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.466+0000 7f232a03c640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "0e06b2e9-9b29-4c6e-ab44-77fd24d945af", "id": 12}] 2026-02-24T19:17:27.468 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.466+0000 7f232a03c640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "0e06b2e9-9b29-4c6e-ab44-77fd24d945af", "id": 12}] 2026-02-24T19:17:27.468 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.466+0000 7f232a03c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:27.468 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.466+0000 7f232a03c640 1 -- 10.20.193.162:0/1682879881 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "osd new", "uuid": "0e06b2e9-9b29-4c6e-ab44-77fd24d945af", "id": 12} v 0) -- 0x7f23241316a0 con 0x7f23241406b0 2026-02-24T19:17:27.545 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.544+0000 7f22fffff640 1 -- 10.20.193.162:0/1682879881 <== mon.1 v1:10.20.193.70:6789/0 10 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 3958291397 0 0) 0x7f231405cdc0 con 0x7f23241406b0 2026-02-24T19:17:27.601 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.600+0000 7f22fffff640 1 -- 10.20.193.162:0/1682879881 <== mon.1 v1:10.20.193.70:6789/0 11 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0e06b2e9-9b29-4c6e-ab44-77fd24d945af", "id": 12}]=0 v15) ==== 113+0+3 (unknown 1665121323 0 944643765) 0x7f2314003b50 con 0x7f23241406b0 2026-02-24T19:17:27.602 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.600+0000 7f22fffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "0e06b2e9-9b29-4c6e-ab44-77fd24d945af", "id": 12}] 2026-02-24T19:17:27.602 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.600+0000 7f22fffff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:27.602 INFO:teuthology.orchestra.run.trial162.stdout:12 2026-02-24T19:17:27.603 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.601+0000 7f232a03c640 10 librados: watch_flush enter 2026-02-24T19:17:27.603 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.601+0000 7f232a03c640 10 librados: watch_flush exit 2026-02-24T19:17:27.604 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.601+0000 7f232a03c640 20 client.4180.objecter shutdown clearing up homeless session... 2026-02-24T19:17:27.604 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.601+0000 7f232a03c640 10 client.4180.objecter successfully canceled tick 2026-02-24T19:17:27.604 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.601+0000 7f232a03c640 1 -- 10.20.193.162:0/1682879881 >> v1:10.20.193.162:6800/3889602630 conn(0x7f22f4077d50 legacy=0x7f22f4098200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.604 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.601+0000 7f232a03c640 10 monclient: shutdown 2026-02-24T19:17:27.604 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.601+0000 7f232a03c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:27.604 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.601+0000 7f232a03c640 1 -- 10.20.193.162:0/1682879881 >> v1:10.20.193.70:6789/0 conn(0x7f23241406b0 legacy=0x7f2324160a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.604 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.601+0000 7f232a03c640 1 -- 10.20.193.162:0/1682879881 shutdown_connections 2026-02-24T19:17:27.604 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.601+0000 7f232a03c640 1 -- 10.20.193.162:0/1682879881 >> 10.20.193.162:0/1682879881 conn(0x7f2324058d50 msgr2=0x7f2324183f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:27.604 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.601+0000 7f232a03c640 1 -- 10.20.193.162:0/1682879881 shutdown_connections 2026-02-24T19:17:27.604 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.601+0000 7f232a03c640 1 -- 10.20.193.162:0/1682879881 wait complete. 2026-02-24T19:17:27.604 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.601+0000 7f232a03c640 1 librados: shutdown 2026-02-24T19:17:27.610 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new b1cbaf8b-36e9-4196-a08d-e6e72c2229e4 13 2026-02-24T19:17:27.674 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.673+0000 7f63e591a640 10 monclient: get_monmap_and_config 2026-02-24T19:17:27.675 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.673+0000 7f63e591a640 10 monclient: build_initial_monmap 2026-02-24T19:17:27.675 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.673+0000 7f63e591a640 10 monclient: monmap: 2026-02-24T19:17:27.675 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:27.675 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:27.675 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:17:27.674420+0000 2026-02-24T19:17:27.675 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:17:27.674420+0000 2026-02-24T19:17:27.675 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:27.675 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:27.675 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:27.675 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:27.675 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:27.676 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:27.678 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.673+0000 7f63e591a640 1 Processor -- start 2026-02-24T19:17:27.678 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.673+0000 7f63e591a640 1 -- start start 2026-02-24T19:17:27.678 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.673+0000 7f63e591a640 10 monclient: init 2026-02-24T19:17:27.678 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.673+0000 7f63e591a640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:27.678 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.673+0000 7f63e591a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:27.678 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.673+0000 7f63e591a640 10 monclient(hunting): picked mon.noname-c con 0x7f63e0121d90 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:27.678 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.673+0000 7f63e591a640 10 monclient(hunting): picked mon.noname-b con 0x7f63e0142a00 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:27.679 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.673+0000 7f63e591a640 10 monclient(hunting): picked mon.noname-a con 0x7f63e0164710 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:27.679 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.673+0000 7f63e591a640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e01864c0 con 0x7f63e0164710 2026-02-24T19:17:27.679 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.673+0000 7f63e591a640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e01876c0 con 0x7f63e0142a00 2026-02-24T19:17:27.679 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.673+0000 7f63e591a640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e01888c0 con 0x7f63e0121d90 2026-02-24T19:17:27.679 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.673+0000 7f63e591a640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:27.679 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.673+0000 7f63e591a640 10 monclient(hunting): authenticate will time out at 3623.309863s 2026-02-24T19:17:27.679 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.674+0000 7f63de7fc640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f63e0142a00 0x7f63e0162e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.162:35322/0 (socket says 10.20.193.162:35322) 2026-02-24T19:17:27.679 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.674+0000 7f63deffd640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f63e0121d90 0x7f63e0122160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.162:38104/0 (socket says 10.20.193.162:38104) 2026-02-24T19:17:27.679 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.674+0000 7f63de7fc640 1 -- 10.20.193.162:0/2772175974 learned_addr learned my addr 10.20.193.162:0/2772175974 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:27.679 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.675+0000 7f63ddffb640 1 -- 10.20.193.162:0/2772175974 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2259912067 0 0) 0x7f63e01864c0 con 0x7f63e0164710 2026-02-24T19:17:27.679 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.675+0000 7f63ddffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.679 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.675+0000 7f63ddffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.680 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.675+0000 7f63ddffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.680 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.675+0000 7f63ddffb640 10 monclient(hunting): my global_id is 4203 2026-02-24T19:17:27.680 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.675+0000 7f63ddffb640 1 -- 10.20.193.162:0/2772175974 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63cc003610 con 0x7f63e0164710 2026-02-24T19:17:27.680 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.675+0000 7f63ddffb640 1 -- 10.20.193.162:0/2772175974 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1653249091 0 0) 0x7f63e01876c0 con 0x7f63e0142a00 2026-02-24T19:17:27.680 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.675+0000 7f63ddffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.680 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.675+0000 7f63ddffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.680 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.675+0000 7f63ddffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.680 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.675+0000 7f63ddffb640 10 monclient(hunting): my global_id is 4183 2026-02-24T19:17:27.680 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.675+0000 7f63ddffb640 1 -- 10.20.193.162:0/2772175974 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63e01864c0 con 0x7f63e0142a00 2026-02-24T19:17:27.680 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.675+0000 7f63ddffb640 1 -- 10.20.193.162:0/2772175974 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2712751445 0 0) 0x7f63e01888c0 con 0x7f63e0121d90 2026-02-24T19:17:27.680 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.675+0000 7f63ddffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.680 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.675+0000 7f63ddffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.681 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.675+0000 7f63ddffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.681 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.675+0000 7f63ddffb640 10 monclient(hunting): my global_id is 4202 2026-02-24T19:17:27.681 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.675+0000 7f63ddffb640 1 -- 10.20.193.162:0/2772175974 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63e01876c0 con 0x7f63e0121d90 2026-02-24T19:17:27.688 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.677+0000 7f63ddffb640 1 -- 10.20.193.162:0/2772175974 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1823999978 0 0) 0x7f63cc003610 con 0x7f63e0164710 2026-02-24T19:17:27.688 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.677+0000 7f63ddffb640 1 -- 10.20.193.162:0/2772175974 >> v1:10.20.193.103:6789/0 conn(0x7f63e0121d90 legacy=0x7f63e0122160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.688 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.677+0000 7f63ddffb640 1 -- 10.20.193.162:0/2772175974 >> v1:10.20.193.70:6789/0 conn(0x7f63e0142a00 legacy=0x7f63e0162e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.688 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.677+0000 7f63ddffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:27.688 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.677+0000 7f63ddffb640 1 monclient: found mon.noname-a 2026-02-24T19:17:27.688 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.677+0000 7f63ddffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:27.688 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.677+0000 7f63ddffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:17:27.688 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.677+0000 7f63ddffb640 1 -- 10.20.193.162:0/2772175974 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e0189b60 con 0x7f63e0164710 2026-02-24T19:17:27.689 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.677+0000 7f63ddffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:27.689 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.677+0000 7f63ddffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:27.689 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.677+0000 7f63ddffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:27.689 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.677+0000 7f63ddffb640 1 -- 10.20.193.162:0/2772175974 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f63d0003170 con 0x7f63e0164710 2026-02-24T19:17:27.689 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.677+0000 7f63ddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:27.689 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.677+0000 7f63ddffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:27.689 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.677+0000 7f63ddffb640 10 monclient: dump: 2026-02-24T19:17:27.689 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:27.689 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:27.689 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:27.689 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:27.689 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.690 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:27.690 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:27.690 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:27.690 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:27.690 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:27.690 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.677+0000 7f63e591a640 5 monclient: authenticate success, global_id 4203 2026-02-24T19:17:27.690 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.677+0000 7f63e591a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:27.690 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63ddffb640 1 -- 10.20.193.162:0/2772175974 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f63d00033b0 con 0x7f63e0164710 2026-02-24T19:17:27.690 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63ddffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:27.690 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63ddffb640 1 -- 10.20.193.162:0/2772175974 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f63d00037f0 con 0x7f63e0164710 2026-02-24T19:17:27.690 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63ddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:27.690 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63ddffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:27.690 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63ddffb640 10 monclient: dump: 2026-02-24T19:17:27.691 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:27.691 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:27.691 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:27.691 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:27.691 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.691 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:27.691 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:27.691 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:27.691 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:27.691 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:27.691 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63e591a640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:27.691 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63e591a640 4 set_mon_vals no callback set 2026-02-24T19:17:27.691 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63e591a640 10 monclient: shutdown 2026-02-24T19:17:27.692 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63e591a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:27.692 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63e591a640 1 -- 10.20.193.162:0/2772175974 >> v1:10.20.193.26:6789/0 conn(0x7f63e0164710 legacy=0x7f63e0184bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.692 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63e591a640 1 -- 10.20.193.162:0/2772175974 shutdown_connections 2026-02-24T19:17:27.692 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63e591a640 1 -- 10.20.193.162:0/2772175974 >> 10.20.193.162:0/2772175974 conn(0x7f63e0057490 msgr2=0x7f63e0057890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:27.692 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63e591a640 1 -- 10.20.193.162:0/2772175974 shutdown_connections 2026-02-24T19:17:27.692 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63e591a640 1 -- 10.20.193.162:0/2772175974 wait complete. 2026-02-24T19:17:27.692 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63e591a640 10 monclient: build_initial_monmap 2026-02-24T19:17:27.692 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63e591a640 10 monclient: monmap: 2026-02-24T19:17:27.692 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:27.692 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:27.692 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-24T19:17:27.692 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-24T19:17:27.693 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:27.693 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-24T19:17:27.693 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:27.693 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:27.693 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:27.693 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:27.693 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63e591a640 1 librados: starting msgr at 2026-02-24T19:17:27.693 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63e591a640 1 librados: starting objecter 2026-02-24T19:17:27.693 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63e591a640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:27.693 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63e591a640 1 Processor -- start 2026-02-24T19:17:27.693 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63e591a640 1 -- start start 2026-02-24T19:17:27.693 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63e591a640 1 librados: setting wanted keys 2026-02-24T19:17:27.693 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63e591a640 1 librados: calling monclient init 2026-02-24T19:17:27.694 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63e591a640 10 monclient: init 2026-02-24T19:17:27.694 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63e591a640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:27.694 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63e591a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:27.694 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63e591a640 10 monclient(hunting): picked mon.noname-c con 0x7f63e0121d90 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:27.694 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63e591a640 10 monclient(hunting): picked mon.noname-a con 0x7f63e0142a00 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:27.694 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63e591a640 10 monclient(hunting): picked mon.noname-b con 0x7f63e0164710 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:27.694 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63e591a640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e011c8e0 con 0x7f63e0142a00 2026-02-24T19:17:27.694 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63e591a640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e011cab0 con 0x7f63e0164710 2026-02-24T19:17:27.694 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.678+0000 7f63e591a640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e011cc80 con 0x7f63e0121d90 2026-02-24T19:17:27.694 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.679+0000 7f63e591a640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:27.694 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.679+0000 7f63e591a640 10 monclient(hunting): authenticate will time out at 3623.315006s 2026-02-24T19:17:27.694 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.679+0000 7f63de7fc640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f63e0142a00 0x7f63e016a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.162:47312/0 (socket says 10.20.193.162:47312) 2026-02-24T19:17:27.695 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.679+0000 7f63de7fc640 1 -- 10.20.193.162:0/3134352962 learned_addr learned my addr 10.20.193.162:0/3134352962 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:27.695 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.679+0000 7f63b7fff640 10 client.?.objecter ms_handle_connect 0x7f63e0121d90 2026-02-24T19:17:27.695 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.679+0000 7f63b7fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:27.695 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.679+0000 7f63b7fff640 10 client.?.objecter ms_handle_connect 0x7f63e0142a00 2026-02-24T19:17:27.695 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.679+0000 7f63b7fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:27.695 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.680+0000 7f63b7fff640 10 client.?.objecter ms_handle_connect 0x7f63e0164710 2026-02-24T19:17:27.695 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.680+0000 7f63b7fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:27.695 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.680+0000 7f63b7fff640 1 -- 10.20.193.162:0/3134352962 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1831279094 0 0) 0x7f63e011cc80 con 0x7f63e0121d90 2026-02-24T19:17:27.695 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.680+0000 7f63b7fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.695 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.680+0000 7f63b7fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.695 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.680+0000 7f63b7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.695 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.680+0000 7f63b7fff640 10 monclient(hunting): my global_id is 4205 2026-02-24T19:17:27.696 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.680+0000 7f63b7fff640 1 -- 10.20.193.162:0/3134352962 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63b0003610 con 0x7f63e0121d90 2026-02-24T19:17:27.696 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.680+0000 7f63b7fff640 1 -- 10.20.193.162:0/3134352962 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3755059089 0 0) 0x7f63e011c8e0 con 0x7f63e0142a00 2026-02-24T19:17:27.696 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.680+0000 7f63b7fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.696 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.680+0000 7f63b7fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.696 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.680+0000 7f63b7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.696 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.680+0000 7f63b7fff640 10 monclient(hunting): my global_id is 4206 2026-02-24T19:17:27.696 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.680+0000 7f63b7fff640 1 -- 10.20.193.162:0/3134352962 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63e011cc80 con 0x7f63e0142a00 2026-02-24T19:17:27.696 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.680+0000 7f63b7fff640 1 -- 10.20.193.162:0/3134352962 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 442044995 0 0) 0x7f63e011cab0 con 0x7f63e0164710 2026-02-24T19:17:27.696 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.680+0000 7f63b7fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:27.696 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.680+0000 7f63b7fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:27.696 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.680+0000 7f63b7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:27.696 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.680+0000 7f63b7fff640 10 monclient(hunting): my global_id is 4186 2026-02-24T19:17:27.697 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.680+0000 7f63b7fff640 1 -- 10.20.193.162:0/3134352962 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63e011c8e0 con 0x7f63e0164710 2026-02-24T19:17:27.697 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.682+0000 7f63b7fff640 1 -- 10.20.193.162:0/3134352962 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 991963387 0 0) 0x7f63b0003610 con 0x7f63e0121d90 2026-02-24T19:17:27.697 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.682+0000 7f63b7fff640 1 -- 10.20.193.162:0/3134352962 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63e011cab0 con 0x7f63e0121d90 2026-02-24T19:17:27.697 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.682+0000 7f63b7fff640 1 -- 10.20.193.162:0/3134352962 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f63d4003060 con 0x7f63e0121d90 2026-02-24T19:17:27.697 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.682+0000 7f63b7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:27.697 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.682+0000 7f63b7fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:27.697 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.682+0000 7f63b7fff640 10 monclient(hunting): dump: 2026-02-24T19:17:27.697 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:27.697 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:27.697 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:27.697 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:27.697 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.697 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:27.697 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:27.698 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:27.698 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:27.698 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:27.698 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.682+0000 7f63b7fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:27.698 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.683+0000 7f63b7fff640 1 -- 10.20.193.162:0/3134352962 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3277388606 0 0) 0x7f63e011cc80 con 0x7f63e0142a00 2026-02-24T19:17:27.698 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.683+0000 7f63b7fff640 1 -- 10.20.193.162:0/3134352962 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63b0003610 con 0x7f63e0142a00 2026-02-24T19:17:27.698 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.683+0000 7f63b7fff640 1 -- 10.20.193.162:0/3134352962 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f63c8003130 con 0x7f63e0142a00 2026-02-24T19:17:27.698 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.683+0000 7f63b7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:27.698 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.683+0000 7f63b7fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:27.698 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.683+0000 7f63b7fff640 10 monclient(hunting): dump: 2026-02-24T19:17:27.698 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:27.698 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:27.699 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:27.699 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:27.699 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.699 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:27.699 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:27.699 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:27.699 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:27.699 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:27.699 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.683+0000 7f63b7fff640 1 -- 10.20.193.162:0/3134352962 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3623305275 0 0) 0x7f63e011c8e0 con 0x7f63e0164710 2026-02-24T19:17:27.699 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.683+0000 7f63b7fff640 1 -- 10.20.193.162:0/3134352962 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63e011cc80 con 0x7f63e0164710 2026-02-24T19:17:27.699 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.683+0000 7f63b7fff640 1 -- 10.20.193.162:0/3134352962 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f63d0003560 con 0x7f63e0164710 2026-02-24T19:17:27.699 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.683+0000 7f63b7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:27.699 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.683+0000 7f63b7fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:27.700 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.683+0000 7f63b7fff640 10 monclient(hunting): dump: 2026-02-24T19:17:27.700 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:27.700 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:27.700 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:27.700 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:27.700 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.700 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:27.700 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:27.700 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:27.700 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:27.700 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:27.700 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.684+0000 7f63b7fff640 1 -- 10.20.193.162:0/3134352962 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 976360628 0 0) 0x7f63e011cab0 con 0x7f63e0121d90 2026-02-24T19:17:27.701 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.684+0000 7f63b7fff640 1 -- 10.20.193.162:0/3134352962 >> v1:10.20.193.70:6789/0 conn(0x7f63e0164710 legacy=0x7f63e011c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.701 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.684+0000 7f63b7fff640 1 -- 10.20.193.162:0/3134352962 >> v1:10.20.193.26:6789/0 conn(0x7f63e0142a00 legacy=0x7f63e016a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.701 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.684+0000 7f63b7fff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:27.701 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.684+0000 7f63b7fff640 1 monclient: found mon.c 2026-02-24T19:17:27.701 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.684+0000 7f63b7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:27.701 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.684+0000 7f63b7fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:27.701 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.684+0000 7f63b7fff640 1 -- 10.20.193.162:0/3134352962 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e011ce50 con 0x7f63e0121d90 2026-02-24T19:17:27.701 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.684+0000 7f63b7fff640 10 monclient: _finish_auth 0 2026-02-24T19:17:27.701 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.684+0000 7f63b7fff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:27.701 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.684+0000 7f63b7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:27.701 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.684+0000 7f63e591a640 5 monclient: authenticate success, global_id 4205 2026-02-24T19:17:27.701 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.684+0000 7f63e591a640 10 monclient: _renew_subs 2026-02-24T19:17:27.701 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.684+0000 7f63e591a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:27.702 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.684+0000 7f63e591a640 1 -- 10.20.193.162:0/3134352962 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f63e0171db0 con 0x7f63e0121d90 2026-02-24T19:17:27.702 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.684+0000 7f63e591a640 10 client.4205.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:27.702 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.684+0000 7f63e591a640 10 monclient: _renew_subs 2026-02-24T19:17:27.702 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.684+0000 7f63e591a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:27.702 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.684+0000 7f63e591a640 1 -- 10.20.193.162:0/3134352962 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f63e01723a0 con 0x7f63e0121d90 2026-02-24T19:17:27.702 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.684+0000 7f63e591a640 1 librados: init done 2026-02-24T19:17:27.702 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.685+0000 7f63e591a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:27.702 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.685+0000 7f63e591a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:27.702 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.685+0000 7f63e591a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:27.702 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.685+0000 7f63e591a640 1 -- 10.20.193.162:0/3134352962 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63e0187be0 con 0x7f63e0121d90 2026-02-24T19:17:27.703 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.694+0000 7f63b7fff640 1 -- 10.20.193.162:0/3134352962 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f63d40048d0 con 0x7f63e0121d90 2026-02-24T19:17:27.704 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.694+0000 7f63b7fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:27.704 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.694+0000 7f63b7fff640 1 -- 10.20.193.162:0/3134352962 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f63d4004c20 con 0x7f63e0121d90 2026-02-24T19:17:27.704 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.694+0000 7f63b7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:27.704 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.694+0000 7f63b7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:27.704 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.694+0000 7f63dd7fa640 4 set_mon_vals no callback set 2026-02-24T19:17:27.704 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.694+0000 7f63b7fff640 10 monclient: dump: 2026-02-24T19:17:27.704 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:27.704 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:27.704 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:27.704 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:27.704 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:27.704 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:27.705 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:27.705 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:27.705 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:27.705 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:27.705 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.695+0000 7f63b7fff640 1 -- 10.20.193.162:0/3134352962 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 3958291397 0 0) 0x7f63d401da50 con 0x7f63e0121d90 2026-02-24T19:17:27.705 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.696+0000 7f63de7fc640 10 monclient: get_auth_request con 0x7f63b0077d30 auth_method 0 2026-02-24T19:17:27.705 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.696+0000 7f63b7fff640 10 client.4205.objecter ms_handle_connect 0x7f63b0077d30 2026-02-24T19:17:27.705 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.696+0000 7f63b7fff640 1 -- 10.20.193.162:0/3134352962 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(15..15 src has 1..15) ==== 2215+0+0 (unknown 773477082 0 0) 0x7f63d4059600 con 0x7f63e0121d90 2026-02-24T19:17:27.705 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.696+0000 7f63b7fff640 10 client.4205.objecter ms_dispatch2 0x7f63e0000b90 osd_map(15..15 src has 1..15) 2026-02-24T19:17:27.705 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.696+0000 7f63b7fff640 3 client.4205.objecter handle_osd_map got epochs [15,15] > 0 2026-02-24T19:17:27.705 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.696+0000 7f63b7fff640 3 client.4205.objecter handle_osd_map decoding full epoch 15 2026-02-24T19:17:27.705 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.696+0000 7f63b7fff640 20 client.4205.objecter dump_active .. 0 homeless 2026-02-24T19:17:27.784 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.782+0000 7f63b7fff640 1 -- 10.20.193.162:0/3134352962 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f63d405dd70 con 0x7f63e0121d90 2026-02-24T19:17:27.784 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.782+0000 7f63b7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:27.784 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.782+0000 7f63b7fff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:27.893 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.891+0000 7f63e591a640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "b1cbaf8b-36e9-4196-a08d-e6e72c2229e4", "id": 13}] 2026-02-24T19:17:27.894 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.891+0000 7f63e591a640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "b1cbaf8b-36e9-4196-a08d-e6e72c2229e4", "id": 13}] 2026-02-24T19:17:27.894 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.891+0000 7f63e591a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:27.894 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.891+0000 7f63e591a640 1 -- 10.20.193.162:0/3134352962 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "osd new", "uuid": "b1cbaf8b-36e9-4196-a08d-e6e72c2229e4", "id": 13} v 0) -- 0x7f63e00553a0 con 0x7f63e0121d90 2026-02-24T19:17:27.943 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.941+0000 7f63b7fff640 1 -- 10.20.193.162:0/3134352962 <== mon.2 v1:10.20.193.103:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b1cbaf8b-36e9-4196-a08d-e6e72c2229e4", "id": 13}]=0 v16) ==== 113+0+3 (unknown 2801970860 0 736921282) 0x7f63e00553a0 con 0x7f63e0121d90 2026-02-24T19:17:27.943 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.941+0000 7f63b7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "b1cbaf8b-36e9-4196-a08d-e6e72c2229e4", "id": 13}] 2026-02-24T19:17:27.943 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.941+0000 7f63b7fff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:27.943 INFO:teuthology.orchestra.run.trial162.stdout:13 2026-02-24T19:17:27.945 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.942+0000 7f63e591a640 10 librados: watch_flush enter 2026-02-24T19:17:27.945 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.942+0000 7f63e591a640 10 librados: watch_flush exit 2026-02-24T19:17:27.945 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.942+0000 7f63e591a640 20 client.4205.objecter shutdown clearing up homeless session... 2026-02-24T19:17:27.945 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.942+0000 7f63e591a640 10 client.4205.objecter successfully canceled tick 2026-02-24T19:17:27.945 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.942+0000 7f63e591a640 1 -- 10.20.193.162:0/3134352962 >> v1:10.20.193.162:6800/3889602630 conn(0x7f63b0077d30 legacy=0x7f63b00981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.945 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.942+0000 7f63e591a640 10 monclient: shutdown 2026-02-24T19:17:27.945 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.942+0000 7f63e591a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:27.945 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.942+0000 7f63e591a640 1 -- 10.20.193.162:0/3134352962 >> v1:10.20.193.103:6789/0 conn(0x7f63e0121d90 legacy=0x7f63e0162e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:27.945 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.942+0000 7f63e591a640 1 -- 10.20.193.162:0/3134352962 shutdown_connections 2026-02-24T19:17:27.946 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.942+0000 7f63e591a640 1 -- 10.20.193.162:0/3134352962 >> 10.20.193.162:0/3134352962 conn(0x7f63e0057490 msgr2=0x7f63e011f860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:27.946 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.942+0000 7f63e591a640 1 -- 10.20.193.162:0/3134352962 shutdown_connections 2026-02-24T19:17:27.946 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.942+0000 7f63e591a640 1 -- 10.20.193.162:0/3134352962 wait complete. 2026-02-24T19:17:27.946 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:27.942+0000 7f63e591a640 1 librados: shutdown 2026-02-24T19:17:27.954 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new 214e8bfc-c78d-45ac-9ec3-7685dd5684cc 14 2026-02-24T19:17:28.018 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.016+0000 7f904396b640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.018 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.016+0000 7f904396b640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.018 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.016+0000 7f904396b640 10 monclient: monmap: 2026-02-24T19:17:28.019 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:28.019 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:28.019 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:17:28.018125+0000 2026-02-24T19:17:28.019 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:17:28.018125+0000 2026-02-24T19:17:28.019 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.019 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:28.019 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:28.019 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:28.019 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:28.019 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:28.026 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.017+0000 7f904396b640 1 Processor -- start 2026-02-24T19:17:28.026 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.017+0000 7f904396b640 1 -- start start 2026-02-24T19:17:28.026 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.017+0000 7f904396b640 10 monclient: init 2026-02-24T19:17:28.026 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.017+0000 7f904396b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.026 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.017+0000 7f904396b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:28.026 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.017+0000 7f904396b640 10 monclient(hunting): picked mon.noname-a con 0x7f903c05d9b0 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:28.027 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.017+0000 7f904396b640 10 monclient(hunting): picked mon.noname-c con 0x7f903c05dd80 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:28.027 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.017+0000 7f904396b640 10 monclient(hunting): picked mon.noname-b con 0x7f903c1649b0 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:28.027 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.017+0000 7f904396b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f903c05e200 con 0x7f903c05d9b0 2026-02-24T19:17:28.027 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.017+0000 7f904396b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f903c1874c0 con 0x7f903c1649b0 2026-02-24T19:17:28.027 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.017+0000 7f904396b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f903c1886a0 con 0x7f903c05dd80 2026-02-24T19:17:28.027 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.017+0000 7f904396b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.027 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.017+0000 7f904396b640 10 monclient(hunting): authenticate will time out at 3623.653366s 2026-02-24T19:17:28.027 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.017+0000 7f90416e0640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f903c05d9b0 0x7f903c11b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.162:47316/0 (socket says 10.20.193.162:47316) 2026-02-24T19:17:28.027 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.017+0000 7f90416e0640 1 -- 10.20.193.162:0/4133639529 learned_addr learned my addr 10.20.193.162:0/4133639529 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:28.027 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.018+0000 7f902bfff640 1 -- 10.20.193.162:0/4133639529 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2444974685 0 0) 0x7f903c05e200 con 0x7f903c05d9b0 2026-02-24T19:17:28.027 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.018+0000 7f902bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.027 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.018+0000 7f902bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.028 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.018+0000 7f902bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.028 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.018+0000 7f902bfff640 10 monclient(hunting): my global_id is 4209 2026-02-24T19:17:28.028 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.018+0000 7f902bfff640 1 -- 10.20.193.162:0/4133639529 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9024003610 con 0x7f903c05d9b0 2026-02-24T19:17:28.028 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.019+0000 7f902bfff640 1 -- 10.20.193.162:0/4133639529 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1839302640 0 0) 0x7f903c1874c0 con 0x7f903c1649b0 2026-02-24T19:17:28.028 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.019+0000 7f902bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.028 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.019+0000 7f902bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.028 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.019+0000 7f902bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.028 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.019+0000 7f902bfff640 10 monclient(hunting): my global_id is 4189 2026-02-24T19:17:28.028 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.019+0000 7f902bfff640 1 -- 10.20.193.162:0/4133639529 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f903c05e200 con 0x7f903c1649b0 2026-02-24T19:17:28.028 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.019+0000 7f902bfff640 1 -- 10.20.193.162:0/4133639529 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2774761409 0 0) 0x7f903c1886a0 con 0x7f903c05dd80 2026-02-24T19:17:28.028 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.019+0000 7f902bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.028 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.019+0000 7f902bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.029 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.019+0000 7f902bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.029 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.019+0000 7f902bfff640 10 monclient(hunting): my global_id is 4208 2026-02-24T19:17:28.029 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.019+0000 7f902bfff640 1 -- 10.20.193.162:0/4133639529 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f903c1874c0 con 0x7f903c05dd80 2026-02-24T19:17:28.029 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.020+0000 7f902bfff640 1 -- 10.20.193.162:0/4133639529 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2728744543 0 0) 0x7f9024003610 con 0x7f903c05d9b0 2026-02-24T19:17:28.029 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.020+0000 7f902bfff640 1 -- 10.20.193.162:0/4133639529 >> v1:10.20.193.103:6789/0 conn(0x7f903c05dd80 legacy=0x7f903c11b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.029 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.020+0000 7f902bfff640 1 -- 10.20.193.162:0/4133639529 >> v1:10.20.193.70:6789/0 conn(0x7f903c1649b0 legacy=0x7f903c184d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.029 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.020+0000 7f902bfff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.029 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.020+0000 7f902bfff640 1 monclient: found mon.noname-a 2026-02-24T19:17:28.029 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.020+0000 7f902bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.029 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.020+0000 7f902bfff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:17:28.029 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.020+0000 7f902bfff640 1 -- 10.20.193.162:0/4133639529 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f903c189920 con 0x7f903c05d9b0 2026-02-24T19:17:28.029 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.020+0000 7f902bfff640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.029 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.020+0000 7f902bfff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.030 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.020+0000 7f902bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.030 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.020+0000 7f902bfff640 1 -- 10.20.193.162:0/4133639529 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f902c002df0 con 0x7f903c05d9b0 2026-02-24T19:17:28.030 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.020+0000 7f902bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.030 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.020+0000 7f902bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.030 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.020+0000 7f902bfff640 10 monclient: dump: 2026-02-24T19:17:28.030 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:28.030 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:28.030 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.030 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.030 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.030 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:28.030 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:28.030 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:28.031 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:28.031 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:28.031 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.020+0000 7f904396b640 5 monclient: authenticate success, global_id 4209 2026-02-24T19:17:28.031 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.020+0000 7f904396b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.031 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.021+0000 7f902bfff640 1 -- 10.20.193.162:0/4133639529 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f902c003030 con 0x7f903c05d9b0 2026-02-24T19:17:28.031 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.021+0000 7f902bfff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.031 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.021+0000 7f902bfff640 1 -- 10.20.193.162:0/4133639529 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f902c003470 con 0x7f903c05d9b0 2026-02-24T19:17:28.031 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.021+0000 7f902bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.031 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.021+0000 7f902bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.031 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.021+0000 7f902bfff640 10 monclient: dump: 2026-02-24T19:17:28.031 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:28.031 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:28.032 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.032 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.032 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.032 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:28.032 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:28.032 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:28.032 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:28.032 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:28.032 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.021+0000 7f904396b640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.032 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.021+0000 7f904396b640 4 set_mon_vals no callback set 2026-02-24T19:17:28.032 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.021+0000 7f904396b640 10 monclient: shutdown 2026-02-24T19:17:28.032 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.021+0000 7f904396b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.032 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.021+0000 7f904396b640 1 -- 10.20.193.162:0/4133639529 >> v1:10.20.193.26:6789/0 conn(0x7f903c05d9b0 legacy=0x7f903c11b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.033 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.021+0000 7f904396b640 1 -- 10.20.193.162:0/4133639529 shutdown_connections 2026-02-24T19:17:28.033 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.021+0000 7f904396b640 1 -- 10.20.193.162:0/4133639529 >> 10.20.193.162:0/4133639529 conn(0x7f903c0588d0 msgr2=0x7f903c058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.033 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.021+0000 7f904396b640 1 -- 10.20.193.162:0/4133639529 shutdown_connections 2026-02-24T19:17:28.033 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.021+0000 7f904396b640 1 -- 10.20.193.162:0/4133639529 wait complete. 2026-02-24T19:17:28.033 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.021+0000 7f904396b640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.033 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.021+0000 7f904396b640 10 monclient: monmap: 2026-02-24T19:17:28.033 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:28.033 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.033 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-24T19:17:28.033 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-24T19:17:28.033 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.033 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-24T19:17:28.034 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:28.034 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:28.034 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:28.034 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:28.034 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.021+0000 7f904396b640 1 librados: starting msgr at 2026-02-24T19:17:28.034 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.021+0000 7f904396b640 1 librados: starting objecter 2026-02-24T19:17:28.034 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.022+0000 7f904396b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.034 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.022+0000 7f904396b640 1 Processor -- start 2026-02-24T19:17:28.034 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.022+0000 7f904396b640 1 -- start start 2026-02-24T19:17:28.034 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.022+0000 7f904396b640 1 librados: setting wanted keys 2026-02-24T19:17:28.034 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.022+0000 7f904396b640 1 librados: calling monclient init 2026-02-24T19:17:28.034 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.022+0000 7f904396b640 10 monclient: init 2026-02-24T19:17:28.034 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.022+0000 7f904396b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.035 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.022+0000 7f904396b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:28.035 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.022+0000 7f904396b640 10 monclient(hunting): picked mon.noname-a con 0x7f903c05d9b0 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:28.035 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.022+0000 7f904396b640 10 monclient(hunting): picked mon.noname-b con 0x7f903c05dd80 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:28.035 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.022+0000 7f904396b640 10 monclient(hunting): picked mon.noname-c con 0x7f903c1649b0 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:28.035 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.022+0000 7f904396b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f903c102340 con 0x7f903c05d9b0 2026-02-24T19:17:28.035 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.022+0000 7f904396b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f903c109220 con 0x7f903c05dd80 2026-02-24T19:17:28.035 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.022+0000 7f904396b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f903c10a400 con 0x7f903c1649b0 2026-02-24T19:17:28.035 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.022+0000 7f904396b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.035 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.022+0000 7f904396b640 10 monclient(hunting): authenticate will time out at 3623.658269s 2026-02-24T19:17:28.035 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.022+0000 7f9040edf640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f903c05dd80 0x7f903c161980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.162:35354/0 (socket says 10.20.193.162:35354) 2026-02-24T19:17:28.035 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.022+0000 7f9040edf640 1 -- 10.20.193.162:0/2859507194 learned_addr learned my addr 10.20.193.162:0/2859507194 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:28.035 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.022+0000 7f9029ffb640 10 client.?.objecter ms_handle_connect 0x7f903c05dd80 2026-02-24T19:17:28.035 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.022+0000 7f9029ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.036 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.023+0000 7f9029ffb640 10 client.?.objecter ms_handle_connect 0x7f903c1649b0 2026-02-24T19:17:28.036 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.023+0000 7f9029ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.036 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.023+0000 7f9029ffb640 10 client.?.objecter ms_handle_connect 0x7f903c05d9b0 2026-02-24T19:17:28.036 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.023+0000 7f9029ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.036 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.023+0000 7f9029ffb640 1 -- 10.20.193.162:0/2859507194 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 163205746 0 0) 0x7f903c109220 con 0x7f903c05dd80 2026-02-24T19:17:28.036 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.023+0000 7f9029ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.036 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.023+0000 7f9029ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.036 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.023+0000 7f9029ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.036 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.023+0000 7f9029ffb640 10 monclient(hunting): my global_id is 4192 2026-02-24T19:17:28.036 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.023+0000 7f9029ffb640 1 -- 10.20.193.162:0/2859507194 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f900c003610 con 0x7f903c05dd80 2026-02-24T19:17:28.036 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.023+0000 7f9029ffb640 1 -- 10.20.193.162:0/2859507194 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 517906446 0 0) 0x7f903c10a400 con 0x7f903c1649b0 2026-02-24T19:17:28.036 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.023+0000 7f9029ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.036 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.023+0000 7f9029ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.037 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.023+0000 7f9029ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.037 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.023+0000 7f9029ffb640 10 monclient(hunting): my global_id is 4211 2026-02-24T19:17:28.037 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.023+0000 7f9029ffb640 1 -- 10.20.193.162:0/2859507194 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f903c109220 con 0x7f903c1649b0 2026-02-24T19:17:28.037 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.024+0000 7f9029ffb640 1 -- 10.20.193.162:0/2859507194 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 345474585 0 0) 0x7f903c102340 con 0x7f903c05d9b0 2026-02-24T19:17:28.037 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.024+0000 7f9029ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.037 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.024+0000 7f9029ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.037 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.024+0000 7f9029ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.037 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.024+0000 7f9029ffb640 10 monclient(hunting): my global_id is 4212 2026-02-24T19:17:28.037 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.024+0000 7f9029ffb640 1 -- 10.20.193.162:0/2859507194 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f903c10a400 con 0x7f903c05d9b0 2026-02-24T19:17:28.040 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.026+0000 7f9029ffb640 1 -- 10.20.193.162:0/2859507194 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1514758849 0 0) 0x7f900c003610 con 0x7f903c05dd80 2026-02-24T19:17:28.040 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.026+0000 7f9029ffb640 1 -- 10.20.193.162:0/2859507194 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f903c102340 con 0x7f903c05dd80 2026-02-24T19:17:28.040 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.026+0000 7f9029ffb640 1 -- 10.20.193.162:0/2859507194 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9030003170 con 0x7f903c05dd80 2026-02-24T19:17:28.040 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.026+0000 7f9029ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.041 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.026+0000 7f9029ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.041 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.026+0000 7f9029ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:28.041 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:28.041 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:28.041 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.041 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.041 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.041 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:28.041 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:28.041 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:28.041 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:28.041 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:28.041 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.026+0000 7f9029ffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.042 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.026+0000 7f9029ffb640 1 -- 10.20.193.162:0/2859507194 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 174223467 0 0) 0x7f903c10a400 con 0x7f903c05d9b0 2026-02-24T19:17:28.042 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.026+0000 7f9029ffb640 1 -- 10.20.193.162:0/2859507194 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f900c003610 con 0x7f903c05d9b0 2026-02-24T19:17:28.042 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.026+0000 7f9029ffb640 1 -- 10.20.193.162:0/2859507194 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f902c0031e0 con 0x7f903c05d9b0 2026-02-24T19:17:28.042 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.026+0000 7f9029ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.042 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.026+0000 7f9029ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.042 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.026+0000 7f9029ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:28.042 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:28.042 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:28.042 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.042 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.042 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.043 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:28.043 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:28.043 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:28.043 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:28.043 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:28.043 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.027+0000 7f9029ffb640 1 -- 10.20.193.162:0/2859507194 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2832448862 0 0) 0x7f903c109220 con 0x7f903c1649b0 2026-02-24T19:17:28.043 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.027+0000 7f9029ffb640 1 -- 10.20.193.162:0/2859507194 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f903c10a400 con 0x7f903c1649b0 2026-02-24T19:17:28.043 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.027+0000 7f9029ffb640 1 -- 10.20.193.162:0/2859507194 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9038003400 con 0x7f903c1649b0 2026-02-24T19:17:28.043 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.027+0000 7f9029ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.043 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.027+0000 7f9029ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.043 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.027+0000 7f9029ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:28.043 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:28.044 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:28.044 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.044 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.044 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.044 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:28.044 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:28.044 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:28.044 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:28.044 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:28.044 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.027+0000 7f9029ffb640 1 -- 10.20.193.162:0/2859507194 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2287744930 0 0) 0x7f903c102340 con 0x7f903c05dd80 2026-02-24T19:17:28.044 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.027+0000 7f9029ffb640 1 -- 10.20.193.162:0/2859507194 >> v1:10.20.193.103:6789/0 conn(0x7f903c1649b0 legacy=0x7f903c1630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.044 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.027+0000 7f9029ffb640 1 -- 10.20.193.162:0/2859507194 >> v1:10.20.193.26:6789/0 conn(0x7f903c05d9b0 legacy=0x7f903c101830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.044 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.027+0000 7f9029ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.045 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.027+0000 7f9029ffb640 1 monclient: found mon.b 2026-02-24T19:17:28.045 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.027+0000 7f9029ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.045 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.027+0000 7f9029ffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:28.045 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.027+0000 7f9029ffb640 1 -- 10.20.193.162:0/2859507194 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f903c10b5e0 con 0x7f903c05dd80 2026-02-24T19:17:28.045 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.027+0000 7f9029ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.045 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.027+0000 7f9029ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.045 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.027+0000 7f9029ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.045 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.027+0000 7f904396b640 5 monclient: authenticate success, global_id 4192 2026-02-24T19:17:28.045 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.027+0000 7f904396b640 10 monclient: _renew_subs 2026-02-24T19:17:28.045 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.027+0000 7f904396b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:28.045 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.027+0000 7f904396b640 1 -- 10.20.193.162:0/2859507194 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f903c10a5d0 con 0x7f903c05dd80 2026-02-24T19:17:28.045 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.027+0000 7f904396b640 10 client.4192.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.045 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.027+0000 7f904396b640 10 monclient: _renew_subs 2026-02-24T19:17:28.046 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.027+0000 7f904396b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:28.046 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.027+0000 7f904396b640 1 -- 10.20.193.162:0/2859507194 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f903c10ac10 con 0x7f903c05dd80 2026-02-24T19:17:28.046 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.027+0000 7f904396b640 1 librados: init done 2026-02-24T19:17:28.046 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.028+0000 7f904396b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.046 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.028+0000 7f904396b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.046 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.028+0000 7f904396b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:28.046 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.028+0000 7f904396b640 1 -- 10.20.193.162:0/2859507194 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f903c187b90 con 0x7f903c05dd80 2026-02-24T19:17:28.118 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.117+0000 7f9029ffb640 1 -- 10.20.193.162:0/2859507194 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f90300034e0 con 0x7f903c05dd80 2026-02-24T19:17:28.118 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.117+0000 7f9029ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.118 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.117+0000 7f9029ffb640 1 -- 10.20.193.162:0/2859507194 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9030003b50 con 0x7f903c05dd80 2026-02-24T19:17:28.119 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.117+0000 7f9029ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.119 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.117+0000 7f9029ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.119 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.117+0000 7f9029ffb640 10 monclient: dump: 2026-02-24T19:17:28.119 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:28.119 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:28.119 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.119 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.119 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.119 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:28.119 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:28.119 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:28.120 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:28.120 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:28.120 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.117+0000 7f902b7fe640 4 set_mon_vals no callback set 2026-02-24T19:17:28.120 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.117+0000 7f9029ffb640 1 -- 10.20.193.162:0/2859507194 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 3958291397 0 0) 0x7f9030003d30 con 0x7f903c05dd80 2026-02-24T19:17:28.120 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.118+0000 7f90416e0640 10 monclient: get_auth_request con 0x7f900c077e40 auth_method 0 2026-02-24T19:17:28.121 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.118+0000 7f9029ffb640 10 client.4192.objecter ms_handle_connect 0x7f900c077e40 2026-02-24T19:17:28.122 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.120+0000 7f9029ffb640 1 -- 10.20.193.162:0/2859507194 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(16..16 src has 1..16) ==== 2330+0+0 (unknown 4014319805 0 0) 0x7f90300594f0 con 0x7f903c05dd80 2026-02-24T19:17:28.122 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.120+0000 7f9029ffb640 10 client.4192.objecter ms_dispatch2 0x7f903c000b90 osd_map(16..16 src has 1..16) 2026-02-24T19:17:28.122 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.120+0000 7f9029ffb640 3 client.4192.objecter handle_osd_map got epochs [16,16] > 0 2026-02-24T19:17:28.122 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.120+0000 7f9029ffb640 3 client.4192.objecter handle_osd_map decoding full epoch 16 2026-02-24T19:17:28.122 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.120+0000 7f9029ffb640 20 client.4192.objecter dump_active .. 0 homeless 2026-02-24T19:17:28.122 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.120+0000 7f9029ffb640 1 -- 10.20.193.162:0/2859507194 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f903005dc60 con 0x7f903c05dd80 2026-02-24T19:17:28.123 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.120+0000 7f9029ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.123 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.120+0000 7f9029ffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:28.239 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.237+0000 7f904396b640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "214e8bfc-c78d-45ac-9ec3-7685dd5684cc", "id": 14}] 2026-02-24T19:17:28.239 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.237+0000 7f904396b640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "214e8bfc-c78d-45ac-9ec3-7685dd5684cc", "id": 14}] 2026-02-24T19:17:28.240 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.237+0000 7f904396b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:28.240 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.237+0000 7f904396b640 1 -- 10.20.193.162:0/2859507194 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "osd new", "uuid": "214e8bfc-c78d-45ac-9ec3-7685dd5684cc", "id": 14} v 0) -- 0x7f903c10af50 con 0x7f903c05dd80 2026-02-24T19:17:28.281 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.280+0000 7f9029ffb640 1 -- 10.20.193.162:0/2859507194 <== mon.1 v1:10.20.193.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "214e8bfc-c78d-45ac-9ec3-7685dd5684cc", "id": 14}]=0 v17) ==== 113+0+3 (unknown 3278716042 0 1367428999) 0x7f9030003b50 con 0x7f903c05dd80 2026-02-24T19:17:28.282 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.280+0000 7f9029ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "214e8bfc-c78d-45ac-9ec3-7685dd5684cc", "id": 14}] 2026-02-24T19:17:28.282 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.280+0000 7f9029ffb640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:28.282 INFO:teuthology.orchestra.run.trial162.stdout:14 2026-02-24T19:17:28.283 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.281+0000 7f904396b640 10 librados: watch_flush enter 2026-02-24T19:17:28.283 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.281+0000 7f904396b640 10 librados: watch_flush exit 2026-02-24T19:17:28.284 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.281+0000 7f904396b640 20 client.4192.objecter shutdown clearing up homeless session... 2026-02-24T19:17:28.284 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.281+0000 7f904396b640 10 client.4192.objecter successfully canceled tick 2026-02-24T19:17:28.284 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.281+0000 7f904396b640 1 -- 10.20.193.162:0/2859507194 >> v1:10.20.193.162:6800/3889602630 conn(0x7f900c077e40 legacy=0x7f900c0982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.284 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.281+0000 7f904396b640 10 monclient: shutdown 2026-02-24T19:17:28.284 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.281+0000 7f904396b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.284 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.281+0000 7f904396b640 1 -- 10.20.193.162:0/2859507194 >> v1:10.20.193.70:6789/0 conn(0x7f903c05dd80 legacy=0x7f903c161980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.284 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.281+0000 7f904396b640 1 -- 10.20.193.162:0/2859507194 shutdown_connections 2026-02-24T19:17:28.284 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.281+0000 7f904396b640 1 -- 10.20.193.162:0/2859507194 >> 10.20.193.162:0/2859507194 conn(0x7f903c0588d0 msgr2=0x7f903c05b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.284 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.281+0000 7f904396b640 1 -- 10.20.193.162:0/2859507194 shutdown_connections 2026-02-24T19:17:28.284 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.281+0000 7f904396b640 1 -- 10.20.193.162:0/2859507194 wait complete. 2026-02-24T19:17:28.284 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.281+0000 7f904396b640 1 librados: shutdown 2026-02-24T19:17:28.291 DEBUG:teuthology.orchestra.run.trial162:> sudo ceph --cluster ceph osd new 8c2eb0c6-abf0-42a7-bcab-83d0c9cf797b 15 2026-02-24T19:17:28.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.353+0000 7fd99367b640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.353+0000 7fd99367b640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.355 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.353+0000 7fd99367b640 10 monclient: monmap: 2026-02-24T19:17:28.356 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:28.356 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:28.356 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:17:28.355097+0000 2026-02-24T19:17:28.356 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:17:28.355097+0000 2026-02-24T19:17:28.356 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.356 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:28.356 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:28.356 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:28.356 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:28.356 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:28.359 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.354+0000 7fd99367b640 1 Processor -- start 2026-02-24T19:17:28.360 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.354+0000 7fd99367b640 1 -- start start 2026-02-24T19:17:28.360 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.354+0000 7fd99367b640 10 monclient: init 2026-02-24T19:17:28.360 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.354+0000 7fd99367b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.360 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.354+0000 7fd99367b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:28.360 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.354+0000 7fd99367b640 10 monclient(hunting): picked mon.noname-c con 0x7fd98c11c500 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:28.360 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.354+0000 7fd99367b640 10 monclient(hunting): picked mon.noname-b con 0x7fd98c11e420 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:28.360 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.354+0000 7fd99367b640 10 monclient(hunting): picked mon.noname-a con 0x7fd98c11ffc0 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:28.360 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.354+0000 7fd99367b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd98c120d10 con 0x7fd98c11ffc0 2026-02-24T19:17:28.360 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.354+0000 7fd99367b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd98c120f00 con 0x7fd98c11e420 2026-02-24T19:17:28.360 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.354+0000 7fd99367b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd98c1210f0 con 0x7fd98c11c500 2026-02-24T19:17:28.360 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.354+0000 7fd99367b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.361 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.354+0000 7fd99367b640 10 monclient(hunting): authenticate will time out at 3623.990367s 2026-02-24T19:17:28.361 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.354+0000 7fd9913f0640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fd98c11c500 0x7fd98c11c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.162:38128/0 (socket says 10.20.193.162:38128) 2026-02-24T19:17:28.361 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.354+0000 7fd9913f0640 1 -- 10.20.193.162:0/391170768 learned_addr learned my addr 10.20.193.162:0/391170768 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:28.361 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.355+0000 7fd97bfff640 1 -- 10.20.193.162:0/391170768 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 452646349 0 0) 0x7fd98c120f00 con 0x7fd98c11e420 2026-02-24T19:17:28.361 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.355+0000 7fd97bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.361 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.355+0000 7fd97bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.361 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.355+0000 7fd97bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.361 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.355+0000 7fd97bfff640 10 monclient(hunting): my global_id is 4195 2026-02-24T19:17:28.361 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.355+0000 7fd97bfff640 1 -- 10.20.193.162:0/391170768 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd974003610 con 0x7fd98c11e420 2026-02-24T19:17:28.361 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.355+0000 7fd97bfff640 1 -- 10.20.193.162:0/391170768 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1066890192 0 0) 0x7fd98c1210f0 con 0x7fd98c11c500 2026-02-24T19:17:28.361 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.356+0000 7fd97bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.361 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.356+0000 7fd97bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.361 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.356+0000 7fd97bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.362 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.356+0000 7fd97bfff640 10 monclient(hunting): my global_id is 4214 2026-02-24T19:17:28.362 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.356+0000 7fd97bfff640 1 -- 10.20.193.162:0/391170768 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd98c120f00 con 0x7fd98c11c500 2026-02-24T19:17:28.362 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.356+0000 7fd97bfff640 1 -- 10.20.193.162:0/391170768 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3681091967 0 0) 0x7fd98c120d10 con 0x7fd98c11ffc0 2026-02-24T19:17:28.362 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.356+0000 7fd97bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.362 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.356+0000 7fd97bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.362 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.356+0000 7fd97bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.362 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.356+0000 7fd97bfff640 10 monclient(hunting): my global_id is 4215 2026-02-24T19:17:28.362 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.356+0000 7fd97bfff640 1 -- 10.20.193.162:0/391170768 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd98c1210f0 con 0x7fd98c11ffc0 2026-02-24T19:17:28.362 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.357+0000 7fd97bfff640 1 -- 10.20.193.162:0/391170768 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4033331551 0 0) 0x7fd98c120f00 con 0x7fd98c11c500 2026-02-24T19:17:28.362 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.357+0000 7fd97bfff640 1 -- 10.20.193.162:0/391170768 >> v1:10.20.193.70:6789/0 conn(0x7fd98c11e420 legacy=0x7fd98c11e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.362 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.357+0000 7fd97bfff640 1 -- 10.20.193.162:0/391170768 >> v1:10.20.193.26:6789/0 conn(0x7fd98c11ffc0 legacy=0x7fd98c120420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.362 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.357+0000 7fd97bfff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.363 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.357+0000 7fd97bfff640 1 monclient: found mon.noname-c 2026-02-24T19:17:28.363 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.357+0000 7fd97bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.363 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.357+0000 7fd97bfff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:17:28.363 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.357+0000 7fd97bfff640 1 -- 10.20.193.162:0/391170768 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd98c121380 con 0x7fd98c11c500 2026-02-24T19:17:28.363 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.357+0000 7fd97bfff640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.363 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.357+0000 7fd97bfff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.363 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.357+0000 7fd97bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.363 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.357+0000 7fd97bfff640 1 -- 10.20.193.162:0/391170768 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd97c002df0 con 0x7fd98c11c500 2026-02-24T19:17:28.363 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.357+0000 7fd97bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.363 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.357+0000 7fd97bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:28.363 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.357+0000 7fd97bfff640 10 monclient: dump: 2026-02-24T19:17:28.363 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:28.363 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:28.364 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.364 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.364 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.364 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:28.364 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:28.364 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:28.364 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:28.364 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:28.364 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.357+0000 7fd99367b640 5 monclient: authenticate success, global_id 4214 2026-02-24T19:17:28.364 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.357+0000 7fd99367b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.370 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.358+0000 7fd97bfff640 1 -- 10.20.193.162:0/391170768 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd97c003030 con 0x7fd98c11c500 2026-02-24T19:17:28.371 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.358+0000 7fd97bfff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.371 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.358+0000 7fd97bfff640 1 -- 10.20.193.162:0/391170768 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd97c003470 con 0x7fd98c11c500 2026-02-24T19:17:28.371 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.358+0000 7fd97bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.371 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.358+0000 7fd97bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.371 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.358+0000 7fd97bfff640 10 monclient: dump: 2026-02-24T19:17:28.371 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:28.371 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:28.371 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.371 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.371 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.371 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:28.372 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:28.372 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:28.372 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:28.372 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:28.372 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.358+0000 7fd99367b640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.372 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.358+0000 7fd99367b640 4 set_mon_vals no callback set 2026-02-24T19:17:28.372 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.358+0000 7fd99367b640 10 monclient: shutdown 2026-02-24T19:17:28.372 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.358+0000 7fd99367b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.372 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.358+0000 7fd99367b640 1 -- 10.20.193.162:0/391170768 >> v1:10.20.193.103:6789/0 conn(0x7fd98c11c500 legacy=0x7fd98c11c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.372 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.358+0000 7fd99367b640 1 -- 10.20.193.162:0/391170768 shutdown_connections 2026-02-24T19:17:28.372 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.358+0000 7fd99367b640 1 -- 10.20.193.162:0/391170768 >> 10.20.193.162:0/391170768 conn(0x7fd98c0588d0 msgr2=0x7fd98c058cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.372 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.358+0000 7fd99367b640 1 -- 10.20.193.162:0/391170768 shutdown_connections 2026-02-24T19:17:28.373 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.358+0000 7fd99367b640 1 -- 10.20.193.162:0/391170768 wait complete. 2026-02-24T19:17:28.373 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.359+0000 7fd99367b640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.373 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.359+0000 7fd99367b640 10 monclient: monmap: 2026-02-24T19:17:28.373 INFO:teuthology.orchestra.run.trial162.stderr:epoch 0 2026-02-24T19:17:28.373 INFO:teuthology.orchestra.run.trial162.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.373 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 0.000000 2026-02-24T19:17:28.373 INFO:teuthology.orchestra.run.trial162.stderr:created 0.000000 2026-02-24T19:17:28.373 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.373 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 1 2026-02-24T19:17:28.373 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:28.373 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:28.373 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:28.373 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:28.374 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.359+0000 7fd99367b640 1 librados: starting msgr at 2026-02-24T19:17:28.374 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.359+0000 7fd99367b640 1 librados: starting objecter 2026-02-24T19:17:28.374 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.359+0000 7fd99367b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.374 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.359+0000 7fd99367b640 1 Processor -- start 2026-02-24T19:17:28.374 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.359+0000 7fd99367b640 1 -- start start 2026-02-24T19:17:28.374 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.359+0000 7fd99367b640 1 librados: setting wanted keys 2026-02-24T19:17:28.374 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.359+0000 7fd99367b640 1 librados: calling monclient init 2026-02-24T19:17:28.374 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.359+0000 7fd99367b640 10 monclient: init 2026-02-24T19:17:28.374 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.359+0000 7fd99367b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.374 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.359+0000 7fd99367b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:28.374 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.359+0000 7fd99367b640 10 monclient(hunting): picked mon.noname-a con 0x7fd98c11c500 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:28.374 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.359+0000 7fd99367b640 10 monclient(hunting): picked mon.noname-b con 0x7fd98c11e420 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:28.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.359+0000 7fd99367b640 10 monclient(hunting): picked mon.noname-c con 0x7fd98c11ffc0 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:28.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.359+0000 7fd99367b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd98c1796e0 con 0x7fd98c11c500 2026-02-24T19:17:28.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.359+0000 7fd99367b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd98c17a8c0 con 0x7fd98c11e420 2026-02-24T19:17:28.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.359+0000 7fd99367b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd98c17baa0 con 0x7fd98c11ffc0 2026-02-24T19:17:28.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.359+0000 7fd99367b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.359+0000 7fd99367b640 10 monclient(hunting): authenticate will time out at 3623.995488s 2026-02-24T19:17:28.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.359+0000 7fd990bef640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7fd98c11e420 0x7fd98c1768a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.162:35370/0 (socket says 10.20.193.162:35370) 2026-02-24T19:17:28.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.359+0000 7fd990bef640 1 -- 10.20.193.162:0/832086988 learned_addr learned my addr 10.20.193.162:0/832086988 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:17:28.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.359+0000 7fd9913f0640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fd98c11c500 0x7fd98c12fea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.162:47350/0 (socket says 10.20.193.162:47350) 2026-02-24T19:17:28.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.360+0000 7fd979ffb640 10 client.?.objecter ms_handle_connect 0x7fd98c11c500 2026-02-24T19:17:28.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.360+0000 7fd979ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.360+0000 7fd979ffb640 10 client.?.objecter ms_handle_connect 0x7fd98c11ffc0 2026-02-24T19:17:28.375 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.360+0000 7fd979ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.360+0000 7fd979ffb640 10 client.?.objecter ms_handle_connect 0x7fd98c11e420 2026-02-24T19:17:28.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.360+0000 7fd979ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.361+0000 7fd979ffb640 1 -- 10.20.193.162:0/832086988 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2519663969 0 0) 0x7fd98c17baa0 con 0x7fd98c11ffc0 2026-02-24T19:17:28.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.361+0000 7fd979ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.361+0000 7fd979ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.361+0000 7fd979ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.361+0000 7fd979ffb640 10 monclient(hunting): my global_id is 4217 2026-02-24T19:17:28.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.361+0000 7fd979ffb640 1 -- 10.20.193.162:0/832086988 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd95c003610 con 0x7fd98c11ffc0 2026-02-24T19:17:28.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.361+0000 7fd979ffb640 1 -- 10.20.193.162:0/832086988 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1099677624 0 0) 0x7fd98c1796e0 con 0x7fd98c11c500 2026-02-24T19:17:28.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.361+0000 7fd979ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.361+0000 7fd979ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.361+0000 7fd979ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.376 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.361+0000 7fd979ffb640 10 monclient(hunting): my global_id is 4218 2026-02-24T19:17:28.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.361+0000 7fd979ffb640 1 -- 10.20.193.162:0/832086988 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd98c17baa0 con 0x7fd98c11c500 2026-02-24T19:17:28.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.361+0000 7fd979ffb640 1 -- 10.20.193.162:0/832086988 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3320157123 0 0) 0x7fd98c17a8c0 con 0x7fd98c11e420 2026-02-24T19:17:28.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.361+0000 7fd979ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.361+0000 7fd979ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.361+0000 7fd979ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.361+0000 7fd979ffb640 10 monclient(hunting): my global_id is 4198 2026-02-24T19:17:28.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.361+0000 7fd979ffb640 1 -- 10.20.193.162:0/832086988 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd98c1796e0 con 0x7fd98c11e420 2026-02-24T19:17:28.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.363+0000 7fd979ffb640 1 -- 10.20.193.162:0/832086988 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3806236788 0 0) 0x7fd98c17baa0 con 0x7fd98c11c500 2026-02-24T19:17:28.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.363+0000 7fd979ffb640 1 -- 10.20.193.162:0/832086988 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd98c17a8c0 con 0x7fd98c11c500 2026-02-24T19:17:28.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.363+0000 7fd979ffb640 1 -- 10.20.193.162:0/832086988 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd97c003380 con 0x7fd98c11c500 2026-02-24T19:17:28.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.363+0000 7fd979ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.377 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.363+0000 7fd979ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.378 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.363+0000 7fd979ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:28.378 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:28.378 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:28.378 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.378 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.378 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.378 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:28.378 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:28.378 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:28.378 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:28.378 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:28.378 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.363+0000 7fd979ffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.378 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.363+0000 7fd979ffb640 1 -- 10.20.193.162:0/832086988 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2064980409 0 0) 0x7fd95c003610 con 0x7fd98c11ffc0 2026-02-24T19:17:28.379 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.363+0000 7fd979ffb640 1 -- 10.20.193.162:0/832086988 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd98c17baa0 con 0x7fd98c11ffc0 2026-02-24T19:17:28.379 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.363+0000 7fd979ffb640 1 -- 10.20.193.162:0/832086988 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd988003490 con 0x7fd98c11ffc0 2026-02-24T19:17:28.379 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.363+0000 7fd979ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.379 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.363+0000 7fd979ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.379 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.363+0000 7fd979ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:28.379 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:28.379 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:28.379 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.379 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.379 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.379 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:28.379 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:28.379 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:28.380 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:28.380 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:28.380 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.363+0000 7fd979ffb640 1 -- 10.20.193.162:0/832086988 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 472766864 0 0) 0x7fd98c1796e0 con 0x7fd98c11e420 2026-02-24T19:17:28.380 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.363+0000 7fd979ffb640 1 -- 10.20.193.162:0/832086988 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd95c003610 con 0x7fd98c11e420 2026-02-24T19:17:28.380 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.363+0000 7fd979ffb640 1 -- 10.20.193.162:0/832086988 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd9800030f0 con 0x7fd98c11e420 2026-02-24T19:17:28.380 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.363+0000 7fd979ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.380 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.363+0000 7fd979ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.380 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.363+0000 7fd979ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:28.380 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:28.380 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:28.380 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.380 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.380 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.381 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:28.381 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:28.381 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:28.381 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:28.381 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:28.381 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.364+0000 7fd979ffb640 1 -- 10.20.193.162:0/832086988 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1281581013 0 0) 0x7fd98c17a8c0 con 0x7fd98c11c500 2026-02-24T19:17:28.381 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.364+0000 7fd979ffb640 1 -- 10.20.193.162:0/832086988 >> v1:10.20.193.103:6789/0 conn(0x7fd98c11ffc0 legacy=0x7fd98c177fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.381 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.364+0000 7fd979ffb640 1 -- 10.20.193.162:0/832086988 >> v1:10.20.193.70:6789/0 conn(0x7fd98c11e420 legacy=0x7fd98c1768a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.381 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.364+0000 7fd979ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.381 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.364+0000 7fd979ffb640 1 monclient: found mon.a 2026-02-24T19:17:28.381 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.364+0000 7fd979ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.381 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.364+0000 7fd979ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:28.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.364+0000 7fd979ffb640 1 -- 10.20.193.162:0/832086988 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd98c17cc80 con 0x7fd98c11c500 2026-02-24T19:17:28.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.364+0000 7fd979ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.364+0000 7fd979ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.364+0000 7fd979ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.364+0000 7fd99367b640 5 monclient: authenticate success, global_id 4218 2026-02-24T19:17:28.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.364+0000 7fd99367b640 10 monclient: _renew_subs 2026-02-24T19:17:28.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.364+0000 7fd99367b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:28.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.364+0000 7fd99367b640 1 -- 10.20.193.162:0/832086988 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd98c17bc70 con 0x7fd98c11c500 2026-02-24T19:17:28.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.364+0000 7fd99367b640 10 client.4218.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.364+0000 7fd99367b640 10 monclient: _renew_subs 2026-02-24T19:17:28.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.364+0000 7fd99367b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:28.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.364+0000 7fd99367b640 1 -- 10.20.193.162:0/832086988 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd98c17c1e0 con 0x7fd98c11c500 2026-02-24T19:17:28.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.364+0000 7fd99367b640 1 librados: init done 2026-02-24T19:17:28.382 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.365+0000 7fd99367b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.383 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.365+0000 7fd99367b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.383 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.365+0000 7fd99367b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:28.383 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.365+0000 7fd99367b640 1 -- 10.20.193.162:0/832086988 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd98c18b3f0 con 0x7fd98c11c500 2026-02-24T19:17:28.459 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.457+0000 7fd979ffb640 1 -- 10.20.193.162:0/832086988 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd97c002fb0 con 0x7fd98c11c500 2026-02-24T19:17:28.459 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.457+0000 7fd979ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.460 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.457+0000 7fd979ffb640 1 -- 10.20.193.162:0/832086988 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd97c004e80 con 0x7fd98c11c500 2026-02-24T19:17:28.460 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.457+0000 7fd979ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.460 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.457+0000 7fd979ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.460 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.457+0000 7fd97b7fe640 4 set_mon_vals no callback set 2026-02-24T19:17:28.460 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.457+0000 7fd979ffb640 10 monclient: dump: 2026-02-24T19:17:28.460 INFO:teuthology.orchestra.run.trial162.stderr:epoch 1 2026-02-24T19:17:28.460 INFO:teuthology.orchestra.run.trial162.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:28.460 INFO:teuthology.orchestra.run.trial162.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.460 INFO:teuthology.orchestra.run.trial162.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.460 INFO:teuthology.orchestra.run.trial162.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.460 INFO:teuthology.orchestra.run.trial162.stderr:election_strategy: 3 2026-02-24T19:17:28.460 INFO:teuthology.orchestra.run.trial162.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:28.461 INFO:teuthology.orchestra.run.trial162.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:28.461 INFO:teuthology.orchestra.run.trial162.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:28.461 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:17:28.462 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.458+0000 7fd979ffb640 1 -- 10.20.193.162:0/832086988 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 3958291397 0 0) 0x7fd97c01dcb0 con 0x7fd98c11c500 2026-02-24T19:17:28.462 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.459+0000 7fd990bef640 10 monclient: get_auth_request con 0x7fd95c077d50 auth_method 0 2026-02-24T19:17:28.462 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.459+0000 7fd979ffb640 10 client.4218.objecter ms_handle_connect 0x7fd95c077d50 2026-02-24T19:17:28.462 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.459+0000 7fd979ffb640 1 -- 10.20.193.162:0/832086988 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(17..17 src has 1..17) ==== 2445+0+0 (unknown 952930636 0 0) 0x7fd97c0593a0 con 0x7fd98c11c500 2026-02-24T19:17:28.462 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.459+0000 7fd979ffb640 10 client.4218.objecter ms_dispatch2 0x7fd98c000b90 osd_map(17..17 src has 1..17) 2026-02-24T19:17:28.462 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.459+0000 7fd979ffb640 3 client.4218.objecter handle_osd_map got epochs [17,17] > 0 2026-02-24T19:17:28.462 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.459+0000 7fd979ffb640 3 client.4218.objecter handle_osd_map decoding full epoch 17 2026-02-24T19:17:28.462 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.459+0000 7fd979ffb640 20 client.4218.objecter dump_active .. 0 homeless 2026-02-24T19:17:28.463 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.460+0000 7fd979ffb640 1 -- 10.20.193.162:0/832086988 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fd97c05db10 con 0x7fd98c11c500 2026-02-24T19:17:28.463 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.460+0000 7fd979ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.463 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.460+0000 7fd979ffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.570+0000 7fd99367b640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "8c2eb0c6-abf0-42a7-bcab-83d0c9cf797b", "id": 15}] 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.570+0000 7fd99367b640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "8c2eb0c6-abf0-42a7-bcab-83d0c9cf797b", "id": 15}] 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.570+0000 7fd99367b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:17:28.572 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.570+0000 7fd99367b640 1 -- 10.20.193.162:0/832086988 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "osd new", "uuid": "8c2eb0c6-abf0-42a7-bcab-83d0c9cf797b", "id": 15} v 0) -- 0x7fd98c17c520 con 0x7fd98c11c500 2026-02-24T19:17:28.588 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.586+0000 7fd979ffb640 1 -- 10.20.193.162:0/832086988 <== mon.0 v1:10.20.193.26:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8c2eb0c6-abf0-42a7-bcab-83d0c9cf797b", "id": 15}]=0 v18) ==== 113+0+3 (unknown 702394048 0 1109645296) 0x7fd97c05d410 con 0x7fd98c11c500 2026-02-24T19:17:28.588 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.586+0000 7fd979ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "8c2eb0c6-abf0-42a7-bcab-83d0c9cf797b", "id": 15}] 2026-02-24T19:17:28.588 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.586+0000 7fd979ffb640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:28.588 INFO:teuthology.orchestra.run.trial162.stdout:15 2026-02-24T19:17:28.589 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.587+0000 7fd99367b640 10 librados: watch_flush enter 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.587+0000 7fd99367b640 10 librados: watch_flush exit 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.587+0000 7fd99367b640 20 client.4218.objecter shutdown clearing up homeless session... 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.587+0000 7fd99367b640 10 client.4218.objecter successfully canceled tick 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.587+0000 7fd99367b640 1 -- 10.20.193.162:0/832086988 >> v1:10.20.193.162:6800/3889602630 conn(0x7fd95c077d50 legacy=0x7fd95c098200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.587+0000 7fd99367b640 10 monclient: shutdown 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.587+0000 7fd99367b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.587+0000 7fd99367b640 1 -- 10.20.193.162:0/832086988 >> v1:10.20.193.26:6789/0 conn(0x7fd98c11c500 legacy=0x7fd98c12fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.587+0000 7fd99367b640 1 -- 10.20.193.162:0/832086988 shutdown_connections 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.587+0000 7fd99367b640 1 -- 10.20.193.162:0/832086988 >> 10.20.193.162:0/832086988 conn(0x7fd98c0588d0 msgr2=0x7fd98c11f170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.587+0000 7fd99367b640 1 -- 10.20.193.162:0/832086988 shutdown_connections 2026-02-24T19:17:28.590 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.587+0000 7fd99367b640 1 -- 10.20.193.162:0/832086988 wait complete. 2026-02-24T19:17:28.591 INFO:teuthology.orchestra.run.trial162.stderr:2026-02-24T19:17:28.587+0000 7fd99367b640 1 librados: shutdown 2026-02-24T19:17:28.597 DEBUG:tasks.ceph_manager:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:28.597 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-24T19:17:28.597 DEBUG:teuthology.orchestra.run.trial026:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 2026-02-24T19:17:28.600 INFO:tasks.ceph.osd.0:Started 2026-02-24T19:17:28.600 DEBUG:tasks.ceph_manager:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:28.600 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-24T19:17:28.600 DEBUG:teuthology.orchestra.run.trial026:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 2026-02-24T19:17:28.603 INFO:tasks.ceph.osd.4:Started 2026-02-24T19:17:28.603 DEBUG:tasks.ceph_manager:running osd.8 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.8.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:28.603 INFO:tasks.ceph.osd.8:Restarting daemon 2026-02-24T19:17:28.603 DEBUG:teuthology.orchestra.run.trial026:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.8.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 8 2026-02-24T19:17:28.605 INFO:tasks.ceph.osd.8:Started 2026-02-24T19:17:28.606 DEBUG:tasks.ceph_manager:running osd.12 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.12.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:28.606 INFO:tasks.ceph.osd.12:Restarting daemon 2026-02-24T19:17:28.606 DEBUG:teuthology.orchestra.run.trial026:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.12.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 12 2026-02-24T19:17:28.608 INFO:tasks.ceph.osd.12:Started 2026-02-24T19:17:28.608 DEBUG:tasks.ceph_manager:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:28.608 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-24T19:17:28.609 DEBUG:teuthology.orchestra.run.trial070:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 2026-02-24T19:17:28.611 INFO:tasks.ceph.osd.1:Started 2026-02-24T19:17:28.611 DEBUG:tasks.ceph_manager:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:28.611 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-24T19:17:28.611 DEBUG:teuthology.orchestra.run.trial070:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 2026-02-24T19:17:28.613 INFO:tasks.ceph.osd.5:Started 2026-02-24T19:17:28.614 DEBUG:tasks.ceph_manager:running osd.9 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.9.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:28.614 INFO:tasks.ceph.osd.9:Restarting daemon 2026-02-24T19:17:28.614 DEBUG:teuthology.orchestra.run.trial070:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.9.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 9 2026-02-24T19:17:28.616 INFO:tasks.ceph.osd.9:Started 2026-02-24T19:17:28.617 DEBUG:tasks.ceph_manager:running osd.13 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.13.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:28.617 INFO:tasks.ceph.osd.13:Restarting daemon 2026-02-24T19:17:28.617 DEBUG:teuthology.orchestra.run.trial070:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.13.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 13 2026-02-24T19:17:28.619 INFO:tasks.ceph.osd.13:Started 2026-02-24T19:17:28.620 DEBUG:tasks.ceph_manager:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:28.620 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-24T19:17:28.620 DEBUG:teuthology.orchestra.run.trial103:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 2026-02-24T19:17:28.622 INFO:tasks.ceph.osd.2:Started 2026-02-24T19:17:28.622 DEBUG:tasks.ceph_manager:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:28.623 INFO:tasks.ceph.osd.6:Restarting daemon 2026-02-24T19:17:28.623 DEBUG:teuthology.orchestra.run.trial103:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 2026-02-24T19:17:28.625 INFO:tasks.ceph.osd.6:Started 2026-02-24T19:17:28.625 DEBUG:tasks.ceph_manager:running osd.10 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.10.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:28.625 INFO:tasks.ceph.osd.10:Restarting daemon 2026-02-24T19:17:28.626 DEBUG:teuthology.orchestra.run.trial103:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.10.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 10 2026-02-24T19:17:28.628 INFO:tasks.ceph.osd.10:Started 2026-02-24T19:17:28.628 DEBUG:tasks.ceph_manager:running osd.14 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.14.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:28.628 INFO:tasks.ceph.osd.14:Restarting daemon 2026-02-24T19:17:28.628 DEBUG:teuthology.orchestra.run.trial103:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.14.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 14 2026-02-24T19:17:28.630 INFO:tasks.ceph.osd.14:Started 2026-02-24T19:17:28.631 DEBUG:tasks.ceph_manager:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:28.631 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-24T19:17:28.631 DEBUG:teuthology.orchestra.run.trial162:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 2026-02-24T19:17:28.633 INFO:tasks.ceph.osd.3:Started 2026-02-24T19:17:28.633 DEBUG:tasks.ceph_manager:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:28.634 INFO:tasks.ceph.osd.7:Restarting daemon 2026-02-24T19:17:28.634 DEBUG:teuthology.orchestra.run.trial162:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 2026-02-24T19:17:28.636 INFO:tasks.ceph.osd.7:Started 2026-02-24T19:17:28.636 DEBUG:tasks.ceph_manager:running osd.11 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.11.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:28.637 INFO:tasks.ceph.osd.11:Restarting daemon 2026-02-24T19:17:28.637 DEBUG:teuthology.orchestra.run.trial162:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.11.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 11 2026-02-24T19:17:28.639 INFO:tasks.ceph.osd.11:Started 2026-02-24T19:17:28.639 DEBUG:tasks.ceph_manager:running osd.15 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.15.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-24T19:17:28.639 INFO:tasks.ceph.osd.15:Restarting daemon 2026-02-24T19:17:28.640 DEBUG:teuthology.orchestra.run.trial162:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.15.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 15 2026-02-24T19:17:28.642 INFO:tasks.ceph.osd.15:Started 2026-02-24T19:17:28.642 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-24T19:17:28.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.712+0000 7f0d6584d640 10 monclient: get_monmap_and_config 2026-02-24T19:17:28.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.712+0000 7f0d6584d640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.712+0000 7f0d6584d640 10 monclient: monmap: 2026-02-24T19:17:28.714 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:17:28.714 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:28.714 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:17:28.713413+0000 2026-02-24T19:17:28.714 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:17:28.713413+0000 2026-02-24T19:17:28.714 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.714 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:17:28.714 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:28.714 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:28.714 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:28.715 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:17:28.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.713+0000 7f0d6584d640 1 Processor -- start 2026-02-24T19:17:28.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.713+0000 7f0d6584d640 1 -- start start 2026-02-24T19:17:28.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.713+0000 7f0d6584d640 10 monclient: init 2026-02-24T19:17:28.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.713+0000 7f0d6584d640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.713+0000 7f0d6584d640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:28.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.713+0000 7f0d6584d640 10 monclient(hunting): picked mon.noname-a con 0x7f0d60058da0 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:28.718 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.713+0000 7f0d6584d640 10 monclient(hunting): picked mon.noname-c con 0x7f0d60059170 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:28.718 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.713+0000 7f0d6584d640 10 monclient(hunting): picked mon.noname-b con 0x7f0d60159ee0 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:28.718 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.713+0000 7f0d6584d640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d6005d6e0 con 0x7f0d60058da0 2026-02-24T19:17:28.718 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.713+0000 7f0d6584d640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d60164100 con 0x7f0d60159ee0 2026-02-24T19:17:28.718 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.713+0000 7f0d6584d640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d600a8ff0 con 0x7f0d60059170 2026-02-24T19:17:28.718 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.713+0000 7f0d6584d640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.718 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.713+0000 7f0d6584d640 10 monclient(hunting): authenticate will time out at 3631.395620s 2026-02-24T19:17:28.718 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.714+0000 7f0d5effd640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f0d60058da0 0x7f0d6005cfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:50792/0 (socket says 10.20.193.26:50792) 2026-02-24T19:17:28.718 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.714+0000 7f0d5effd640 1 -- 10.20.193.26:0/2846162935 learned_addr learned my addr 10.20.193.26:0/2846162935 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:17:28.718 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.715+0000 7f0d5dffb640 1 -- 10.20.193.26:0/2846162935 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 634311640 0 0) 0x7f0d6005d6e0 con 0x7f0d60058da0 2026-02-24T19:17:28.718 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.715+0000 7f0d5dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.718 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.715+0000 7f0d5dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.719 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.715+0000 7f0d5dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.719 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.715+0000 7f0d5dffb640 10 monclient(hunting): my global_id is 4221 2026-02-24T19:17:28.719 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.715+0000 7f0d5dffb640 1 -- 10.20.193.26:0/2846162935 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d4c003610 con 0x7f0d60058da0 2026-02-24T19:17:28.719 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.715+0000 7f0d5dffb640 1 -- 10.20.193.26:0/2846162935 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 69435699 0 0) 0x7f0d60164100 con 0x7f0d60159ee0 2026-02-24T19:17:28.719 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.715+0000 7f0d5dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.719 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.715+0000 7f0d5dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.719 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.715+0000 7f0d5dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.719 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.715+0000 7f0d5dffb640 10 monclient(hunting): my global_id is 4201 2026-02-24T19:17:28.719 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.715+0000 7f0d5dffb640 1 -- 10.20.193.26:0/2846162935 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d6005d6e0 con 0x7f0d60159ee0 2026-02-24T19:17:28.719 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.716+0000 7f0d5dffb640 1 -- 10.20.193.26:0/2846162935 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2032523142 0 0) 0x7f0d600a8ff0 con 0x7f0d60059170 2026-02-24T19:17:28.719 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.716+0000 7f0d5dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.719 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.716+0000 7f0d5dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.720 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.716+0000 7f0d5dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.720 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.716+0000 7f0d5dffb640 10 monclient(hunting): my global_id is 4220 2026-02-24T19:17:28.720 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.716+0000 7f0d5dffb640 1 -- 10.20.193.26:0/2846162935 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d60164100 con 0x7f0d60059170 2026-02-24T19:17:28.724 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.717+0000 7f0d5dffb640 1 -- 10.20.193.26:0/2846162935 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1769825735 0 0) 0x7f0d4c003610 con 0x7f0d60058da0 2026-02-24T19:17:28.725 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.717+0000 7f0d5dffb640 1 -- 10.20.193.26:0/2846162935 >> v1:10.20.193.103:6789/0 conn(0x7f0d60059170 legacy=0x7f0d601597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.725 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.717+0000 7f0d5dffb640 1 -- 10.20.193.26:0/2846162935 >> v1:10.20.193.70:6789/0 conn(0x7f0d60159ee0 legacy=0x7f0d60163340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.725 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.717+0000 7f0d5dffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.725 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.717+0000 7f0d5dffb640 1 monclient: found mon.noname-a 2026-02-24T19:17:28.725 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.717+0000 7f0d5dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.725 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.717+0000 7f0d5dffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:17:28.725 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.717+0000 7f0d5dffb640 1 -- 10.20.193.26:0/2846162935 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d600a92d0 con 0x7f0d60058da0 2026-02-24T19:17:28.725 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.717+0000 7f0d5dffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.725 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.717+0000 7f0d5dffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.725 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.717+0000 7f0d5dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.726 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.717+0000 7f0d5dffb640 1 -- 10.20.193.26:0/2846162935 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f0d54002df0 con 0x7f0d60058da0 2026-02-24T19:17:28.726 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.717+0000 7f0d5dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.726 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.717+0000 7f0d5dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:28.726 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.717+0000 7f0d5dffb640 10 monclient: dump: 2026-02-24T19:17:28.726 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:17:28.726 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:28.726 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.726 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.726 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.726 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:17:28.726 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:28.726 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:28.726 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:28.727 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:17:28.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.717+0000 7f0d6584d640 5 monclient: authenticate success, global_id 4221 2026-02-24T19:17:28.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.717+0000 7f0d6584d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:28.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.718+0000 7f0d5dffb640 1 -- 10.20.193.26:0/2846162935 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0d54002fc0 con 0x7f0d60058da0 2026-02-24T19:17:28.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.718+0000 7f0d5dffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.718+0000 7f0d5dffb640 1 -- 10.20.193.26:0/2846162935 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f0d54003400 con 0x7f0d60058da0 2026-02-24T19:17:28.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.718+0000 7f0d5dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.718+0000 7f0d5dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.718+0000 7f0d5dffb640 10 monclient: dump: 2026-02-24T19:17:28.727 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:17:28.727 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:28.728 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.728 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.728 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.728 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:17:28.728 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:28.728 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:28.728 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:28.728 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:17:28.728 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.718+0000 7f0d6584d640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:28.728 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.718+0000 7f0d6584d640 4 set_mon_vals no callback set 2026-02-24T19:17:28.728 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.718+0000 7f0d6584d640 10 monclient: shutdown 2026-02-24T19:17:28.728 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.718+0000 7f0d6584d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.729 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.718+0000 7f0d6584d640 1 -- 10.20.193.26:0/2846162935 >> v1:10.20.193.26:6789/0 conn(0x7f0d60058da0 legacy=0x7f0d6005cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.729 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.718+0000 7f0d6584d640 1 -- 10.20.193.26:0/2846162935 shutdown_connections 2026-02-24T19:17:28.729 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.718+0000 7f0d6584d640 1 -- 10.20.193.26:0/2846162935 >> 10.20.193.26:0/2846162935 conn(0x7f0d600b65f0 msgr2=0x7f0d600b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.729 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.718+0000 7f0d6584d640 1 -- 10.20.193.26:0/2846162935 shutdown_connections 2026-02-24T19:17:28.729 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.718+0000 7f0d6584d640 1 -- 10.20.193.26:0/2846162935 wait complete. 2026-02-24T19:17:28.729 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.719+0000 7f0d6584d640 10 monclient: build_initial_monmap 2026-02-24T19:17:28.729 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.719+0000 7f0d6584d640 10 monclient: monmap: 2026-02-24T19:17:28.729 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:17:28.729 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:28.729 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:17:28.729 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:17:28.729 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:28.729 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:17:28.730 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:28.730 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:28.730 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:28.730 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:17:28.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.719+0000 7f0d6584d640 1 librados: starting msgr at 2026-02-24T19:17:28.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.719+0000 7f0d6584d640 1 librados: starting objecter 2026-02-24T19:17:28.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.719+0000 7f0d6584d640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:28.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.719+0000 7f0d6584d640 1 Processor -- start 2026-02-24T19:17:28.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.719+0000 7f0d6584d640 1 -- start start 2026-02-24T19:17:28.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.719+0000 7f0d6584d640 1 librados: setting wanted keys 2026-02-24T19:17:28.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.719+0000 7f0d6584d640 1 librados: calling monclient init 2026-02-24T19:17:28.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.719+0000 7f0d6584d640 10 monclient: init 2026-02-24T19:17:28.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.719+0000 7f0d6584d640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:28.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.719+0000 7f0d6584d640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:17:28.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.719+0000 7f0d6584d640 10 monclient(hunting): picked mon.noname-a con 0x7f0d60058da0 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:28.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.719+0000 7f0d6584d640 10 monclient(hunting): picked mon.noname-c con 0x7f0d60059170 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:28.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.719+0000 7f0d6584d640 10 monclient(hunting): picked mon.noname-b con 0x7f0d60159ee0 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:28.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.719+0000 7f0d6584d640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d600564e0 con 0x7f0d60058da0 2026-02-24T19:17:28.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.719+0000 7f0d6584d640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d600567c0 con 0x7f0d60159ee0 2026-02-24T19:17:28.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.719+0000 7f0d6584d640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d60056aa0 con 0x7f0d60059170 2026-02-24T19:17:28.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.719+0000 7f0d6584d640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:28.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.719+0000 7f0d6584d640 10 monclient(hunting): authenticate will time out at 3631.401678s 2026-02-24T19:17:28.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.720+0000 7f0d5f7fe640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f0d60159ee0 0x7f0d60057560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:38814/0 (socket says 10.20.193.26:38814) 2026-02-24T19:17:28.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.720+0000 7f0d5f7fe640 1 -- 10.20.193.26:0/19382699 learned_addr learned my addr 10.20.193.26:0/19382699 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:17:28.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.720+0000 7f0d37fff640 10 client.?.objecter ms_handle_connect 0x7f0d60159ee0 2026-02-24T19:17:28.732 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.720+0000 7f0d37fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.732 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.720+0000 7f0d37fff640 10 client.?.objecter ms_handle_connect 0x7f0d60059170 2026-02-24T19:17:28.732 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.720+0000 7f0d37fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.732 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.720+0000 7f0d37fff640 10 client.?.objecter ms_handle_connect 0x7f0d60058da0 2026-02-24T19:17:28.732 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.720+0000 7f0d37fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:28.732 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.721+0000 7f0d37fff640 1 -- 10.20.193.26:0/19382699 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1855540375 0 0) 0x7f0d600567c0 con 0x7f0d60159ee0 2026-02-24T19:17:28.732 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.721+0000 7f0d37fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.732 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.721+0000 7f0d37fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.732 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.721+0000 7f0d37fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.732 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.721+0000 7f0d37fff640 10 monclient(hunting): my global_id is 4204 2026-02-24T19:17:28.732 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.721+0000 7f0d37fff640 1 -- 10.20.193.26:0/19382699 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d30003610 con 0x7f0d60159ee0 2026-02-24T19:17:28.732 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.721+0000 7f0d37fff640 1 -- 10.20.193.26:0/19382699 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 265731844 0 0) 0x7f0d60056aa0 con 0x7f0d60059170 2026-02-24T19:17:28.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.721+0000 7f0d37fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.721+0000 7f0d37fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.721+0000 7f0d37fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.721+0000 7f0d37fff640 10 monclient(hunting): my global_id is 4223 2026-02-24T19:17:28.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.721+0000 7f0d37fff640 1 -- 10.20.193.26:0/19382699 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d600567c0 con 0x7f0d60059170 2026-02-24T19:17:28.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.721+0000 7f0d37fff640 1 -- 10.20.193.26:0/19382699 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1122009809 0 0) 0x7f0d600564e0 con 0x7f0d60058da0 2026-02-24T19:17:28.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.721+0000 7f0d37fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:28.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.721+0000 7f0d37fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:28.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.721+0000 7f0d37fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:28.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.721+0000 7f0d37fff640 10 monclient(hunting): my global_id is 4224 2026-02-24T19:17:28.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.721+0000 7f0d37fff640 1 -- 10.20.193.26:0/19382699 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d60056aa0 con 0x7f0d60058da0 2026-02-24T19:17:28.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.723+0000 7f0d37fff640 1 -- 10.20.193.26:0/19382699 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3337798699 0 0) 0x7f0d30003610 con 0x7f0d60159ee0 2026-02-24T19:17:28.734 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.723+0000 7f0d37fff640 1 -- 10.20.193.26:0/19382699 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0d600564e0 con 0x7f0d60159ee0 2026-02-24T19:17:28.734 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.723+0000 7f0d37fff640 1 -- 10.20.193.26:0/19382699 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f0d500033f0 con 0x7f0d60159ee0 2026-02-24T19:17:28.734 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.723+0000 7f0d37fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.734 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.723+0000 7f0d37fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:17:28.734 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.723+0000 7f0d37fff640 10 monclient(hunting): dump: 2026-02-24T19:17:28.734 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:17:28.734 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:28.734 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.734 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.734 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.734 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:17:28.734 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:28.734 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:28.735 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:28.735 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:17:28.735 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.723+0000 7f0d37fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:28.737 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.724+0000 7f0d37fff640 1 -- 10.20.193.26:0/19382699 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1697486003 0 0) 0x7f0d600567c0 con 0x7f0d60059170 2026-02-24T19:17:28.737 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.724+0000 7f0d37fff640 1 -- 10.20.193.26:0/19382699 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0d30003610 con 0x7f0d60059170 2026-02-24T19:17:28.737 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.724+0000 7f0d37fff640 1 -- 10.20.193.26:0/19382699 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f0d48003090 con 0x7f0d60059170 2026-02-24T19:17:28.737 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.724+0000 7f0d37fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.737 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.724+0000 7f0d37fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:28.737 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.724+0000 7f0d37fff640 10 monclient(hunting): dump: 2026-02-24T19:17:28.737 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:17:28.737 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:28.737 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.738 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.738 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.738 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:17:28.738 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:28.738 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:28.738 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:28.738 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:17:28.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.724+0000 7f0d37fff640 1 -- 10.20.193.26:0/19382699 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3447234679 0 0) 0x7f0d60056aa0 con 0x7f0d60058da0 2026-02-24T19:17:28.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.724+0000 7f0d37fff640 1 -- 10.20.193.26:0/19382699 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0d600567c0 con 0x7f0d60058da0 2026-02-24T19:17:28.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.724+0000 7f0d37fff640 1 -- 10.20.193.26:0/19382699 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f0d54003310 con 0x7f0d60058da0 2026-02-24T19:17:28.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.724+0000 7f0d37fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:28.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.724+0000 7f0d37fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:28.739 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.724+0000 7f0d37fff640 10 monclient(hunting): dump: 2026-02-24T19:17:28.739 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:17:28.739 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:28.739 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.739 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.739 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.739 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:17:28.739 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:28.739 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:28.739 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:28.739 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:17:28.739 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.725+0000 7f0d37fff640 1 -- 10.20.193.26:0/19382699 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 910076126 0 0) 0x7f0d600564e0 con 0x7f0d60159ee0 2026-02-24T19:17:28.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.725+0000 7f0d37fff640 1 -- 10.20.193.26:0/19382699 >> v1:10.20.193.103:6789/0 conn(0x7f0d60059170 legacy=0x7f0d6011e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.725+0000 7f0d37fff640 1 -- 10.20.193.26:0/19382699 >> v1:10.20.193.26:6789/0 conn(0x7f0d60058da0 legacy=0x7f0d60133620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.725+0000 7f0d37fff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:28.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.725+0000 7f0d37fff640 1 monclient: found mon.b 2026-02-24T19:17:28.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.725+0000 7f0d37fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:28.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.725+0000 7f0d37fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:28.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.725+0000 7f0d37fff640 1 -- 10.20.193.26:0/19382699 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d60056d80 con 0x7f0d60159ee0 2026-02-24T19:17:28.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.725+0000 7f0d37fff640 10 monclient: _finish_auth 0 2026-02-24T19:17:28.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.725+0000 7f0d37fff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:28.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.725+0000 7f0d37fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:28.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.725+0000 7f0d6584d640 5 monclient: authenticate success, global_id 4204 2026-02-24T19:17:28.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.725+0000 7f0d6584d640 10 monclient: _renew_subs 2026-02-24T19:17:28.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.725+0000 7f0d6584d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:28.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.725+0000 7f0d6584d640 1 -- 10.20.193.26:0/19382699 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0d60057060 con 0x7f0d60159ee0 2026-02-24T19:17:28.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.725+0000 7f0d6584d640 10 client.4204.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:28.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.725+0000 7f0d6584d640 10 monclient: _renew_subs 2026-02-24T19:17:28.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.725+0000 7f0d6584d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:28.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.725+0000 7f0d6584d640 1 -- 10.20.193.26:0/19382699 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0d60156600 con 0x7f0d60159ee0 2026-02-24T19:17:28.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.725+0000 7f0d6584d640 1 librados: init done 2026-02-24T19:17:28.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.725+0000 7f0d6584d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.725+0000 7f0d6584d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.725+0000 7f0d6584d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:28.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.725+0000 7f0d6584d640 1 -- 10.20.193.26:0/19382699 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d60156d20 con 0x7f0d60159ee0 2026-02-24T19:17:28.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.815+0000 7f0d37fff640 1 -- 10.20.193.26:0/19382699 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0d50003a80 con 0x7f0d60159ee0 2026-02-24T19:17:28.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.815+0000 7f0d37fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:28.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.815+0000 7f0d37fff640 1 -- 10.20.193.26:0/19382699 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f0d50003e50 con 0x7f0d60159ee0 2026-02-24T19:17:28.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.815+0000 7f0d37fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:28.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.815+0000 7f0d37fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:28.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.815+0000 7f0d37fff640 10 monclient: dump: 2026-02-24T19:17:28.817 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:17:28.818 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:28.818 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.818 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:28.818 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:28.818 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:17:28.818 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:28.818 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:28.818 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:28.818 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:17:28.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.815+0000 7f0d5d7fa640 4 set_mon_vals no callback set 2026-02-24T19:17:28.819 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.817+0000 7f0d37fff640 1 -- 10.20.193.26:0/19382699 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 3958291397 0 0) 0x7f0d50004030 con 0x7f0d60159ee0 2026-02-24T19:17:28.819 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.817+0000 7f0d5effd640 10 monclient: get_auth_request con 0x7f0d30077d90 auth_method 0 2026-02-24T19:17:28.819 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.817+0000 7f0d37fff640 10 client.4204.objecter ms_handle_connect 0x7f0d30077d90 2026-02-24T19:17:28.821 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.820+0000 7f0d37fff640 1 -- 10.20.193.26:0/19382699 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 2560+0+0 (unknown 77300011 0 0) 0x7f0d500597c0 con 0x7f0d60159ee0 2026-02-24T19:17:28.821 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.820+0000 7f0d37fff640 10 client.4204.objecter ms_dispatch2 0x7f0d60000b90 osd_map(18..18 src has 1..18) 2026-02-24T19:17:28.822 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.820+0000 7f0d37fff640 3 client.4204.objecter handle_osd_map got epochs [18,18] > 0 2026-02-24T19:17:28.822 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.820+0000 7f0d37fff640 3 client.4204.objecter handle_osd_map decoding full epoch 18 2026-02-24T19:17:28.822 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.820+0000 7f0d37fff640 20 client.4204.objecter dump_active .. 0 homeless 2026-02-24T19:17:28.823 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.822+0000 7f0d37fff640 1 -- 10.20.193.26:0/19382699 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f0d5005df30 con 0x7f0d60159ee0 2026-02-24T19:17:28.823 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.822+0000 7f0d37fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:28.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.822+0000 7f0d37fff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:28.933 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.932+0000 7f0d6584d640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:28.933 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.932+0000 7f0d6584d640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:28.933 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.932+0000 7f0d6584d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:17:28.933 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.932+0000 7f0d6584d640 1 -- 10.20.193.26:0/19382699 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d60158130 con 0x7f0d60159ee0 2026-02-24T19:17:28.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.952+0000 7f0d37fff640 1 -- 10.20.193.26:0/19382699 <== mon.1 v1:10.20.193.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12877 (unknown 3338201251 0 1129572664) 0x7f0d50003e50 con 0x7f0d60159ee0 2026-02-24T19:17:28.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.952+0000 7f0d37fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:28.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.952+0000 7f0d37fff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:28.954 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:17:28.954 INFO:teuthology.orchestra.run.trial026.stdout:{"epoch":18,"fsid":"33b2b598-dbc5-4d7a-8df7-657f0501fe9e","created":"2026-02-24T19:17:21.810535+0000","modified":"2026-02-24T19:17:28.575109+0000","last_up_change":"0.000000","last_in_change":"2026-02-24T19:17:28.575109+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e08ffdb8-0db6-4356-88b5-54397e40be58","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"08b117f7-0152-42bb-8a51-220b41a964ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3c37f6aa-25cb-43be-a75a-86a246086a85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a7e3939e-f8f5-4216-9700-27e229d1c4d9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"445d43ab-a28c-4afa-90ff-e451602e494f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"37303b3f-6b88-4c73-aaff-10055ec5cc85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ef2c9883-f17f-41ec-96b7-dbbe936b77d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3e4a495e-c742-43fc-991a-371a47ff87bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"fb377a45-1ce5-4e07-92cd-7f546cfad57f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"8079b2ca-96c3-4321-9f24-a87e8ea1e883","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"8df004a9-88e3-43f5-833d-dfc73a658ec3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"f3cf3a4b-1c26-480c-ba10-178f8542c1e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"0e06b2e9-9b29-4c6e-ab44-77fd24d945af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"b1cbaf8b-36e9-4196-a08d-e6e72c2229e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"214e8bfc-c78d-45ac-9ec3-7685dd5684cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"8c2eb0c6-abf0-42a7-bcab-83d0c9cf797b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T19:17:28.957 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.955+0000 7f0d6584d640 10 librados: watch_flush enter 2026-02-24T19:17:28.957 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.955+0000 7f0d6584d640 10 librados: watch_flush exit 2026-02-24T19:17:28.957 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.955+0000 7f0d6584d640 20 client.4204.objecter shutdown clearing up homeless session... 2026-02-24T19:17:28.957 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.955+0000 7f0d6584d640 10 client.4204.objecter successfully canceled tick 2026-02-24T19:17:28.957 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.955+0000 7f0d6584d640 1 -- 10.20.193.26:0/19382699 >> v1:10.20.193.162:6800/3889602630 conn(0x7f0d30077d90 legacy=0x7f0d30098240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.957 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.955+0000 7f0d6584d640 10 monclient: shutdown 2026-02-24T19:17:28.957 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.955+0000 7f0d6584d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:28.957 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.955+0000 7f0d6584d640 1 -- 10.20.193.26:0/19382699 >> v1:10.20.193.70:6789/0 conn(0x7f0d60159ee0 legacy=0x7f0d60057560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:28.957 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.955+0000 7f0d6584d640 1 -- 10.20.193.26:0/19382699 shutdown_connections 2026-02-24T19:17:28.957 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.955+0000 7f0d6584d640 1 -- 10.20.193.26:0/19382699 >> 10.20.193.26:0/19382699 conn(0x7f0d600b65f0 msgr2=0x7f0d60158650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:28.958 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.955+0000 7f0d6584d640 1 -- 10.20.193.26:0/19382699 shutdown_connections 2026-02-24T19:17:28.958 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.955+0000 7f0d6584d640 1 -- 10.20.193.26:0/19382699 wait complete. 2026-02-24T19:17:28.958 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:17:28.955+0000 7f0d6584d640 1 librados: shutdown 2026-02-24T19:17:28.966 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-24T19:17:28.966 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-24T19:17:30.577 DEBUG:teuthology.orchestra.run.trial026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-24T19:17:30.636 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.635+0000 7f627b65c640 10 monclient: get_monmap_and_config 2026-02-24T19:17:30.636 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.635+0000 7f627b65c640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.636 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.635+0000 7f627b65c640 10 monclient: monmap: 2026-02-24T19:17:30.637 INFO:teuthology.misc.health.trial026.stderr:epoch 0 2026-02-24T19:17:30.637 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:30.637 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:17:30.636200+0000 2026-02-24T19:17:30.637 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:17:30.636200+0000 2026-02-24T19:17:30.637 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.637 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:17:30.637 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:30.637 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:30.637 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:30.637 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:30.639 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.636+0000 7f627b65c640 1 Processor -- start 2026-02-24T19:17:30.639 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.636+0000 7f627b65c640 1 -- start start 2026-02-24T19:17:30.639 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.636+0000 7f627b65c640 10 monclient: init 2026-02-24T19:17:30.639 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.636+0000 7f627b65c640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.639 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.636+0000 7f627b65c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:17:30.639 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.636+0000 7f627b65c640 10 monclient(hunting): picked mon.noname-c con 0x7f6274055bf0 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:30.639 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.636+0000 7f627b65c640 10 monclient(hunting): picked mon.noname-a con 0x7f6274164040 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:30.640 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.636+0000 7f627b65c640 10 monclient(hunting): picked mon.noname-b con 0x7f6274055fc0 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:30.640 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.636+0000 7f627b65c640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62740b3a00 con 0x7f6274164040 2026-02-24T19:17:30.640 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.636+0000 7f627b65c640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62740b3c70 con 0x7f6274055fc0 2026-02-24T19:17:30.640 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.636+0000 7f627b65c640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62740b3f50 con 0x7f6274055bf0 2026-02-24T19:17:30.640 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.636+0000 7f627b65c640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.640 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.636+0000 7f627b65c640 10 monclient(hunting): authenticate will time out at 3633.318825s 2026-02-24T19:17:30.640 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.637+0000 7f62793d1640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f6274055bf0 0x7f62740b1f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:42956/0 (socket says 10.20.193.26:42956) 2026-02-24T19:17:30.640 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.637+0000 7f62793d1640 1 -- 10.20.193.26:0/3288170455 learned_addr learned my addr 10.20.193.26:0/3288170455 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:17:30.641 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.639+0000 7f6263fff640 1 -- 10.20.193.26:0/3288170455 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3649835448 0 0) 0x7f62740b3f50 con 0x7f6274055bf0 2026-02-24T19:17:30.641 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.639+0000 7f6263fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.641 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.639+0000 7f6263fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.641 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.639+0000 7f6263fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.642 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.639+0000 7f6263fff640 10 monclient(hunting): my global_id is 4226 2026-02-24T19:17:30.642 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.639+0000 7f6263fff640 1 -- 10.20.193.26:0/3288170455 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f625c003610 con 0x7f6274055bf0 2026-02-24T19:17:30.642 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.640+0000 7f6263fff640 1 -- 10.20.193.26:0/3288170455 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2950445187 0 0) 0x7f62740b3c70 con 0x7f6274055fc0 2026-02-24T19:17:30.642 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.640+0000 7f6263fff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.642 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.640+0000 7f6263fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.642 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.640+0000 7f6263fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.642 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.640+0000 7f6263fff640 10 monclient(hunting): my global_id is 4207 2026-02-24T19:17:30.642 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.640+0000 7f6263fff640 1 -- 10.20.193.26:0/3288170455 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62740b3f50 con 0x7f6274055fc0 2026-02-24T19:17:30.646 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.641+0000 7f6263fff640 1 -- 10.20.193.26:0/3288170455 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 289481849 0 0) 0x7f625c003610 con 0x7f6274055bf0 2026-02-24T19:17:30.646 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.641+0000 7f6263fff640 1 -- 10.20.193.26:0/3288170455 >> v1:10.20.193.70:6789/0 conn(0x7f6274055fc0 legacy=0x7f62740b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.646 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.641+0000 7f6263fff640 1 -- 10.20.193.26:0/3288170455 >> v1:10.20.193.26:6789/0 conn(0x7f6274164040 legacy=0x7f6274056690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:17:30.646 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.641+0000 7f6263fff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.646 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.641+0000 7f6263fff640 1 monclient: found mon.noname-c 2026-02-24T19:17:30.646 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.641+0000 7f6263fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.646 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.641+0000 7f6263fff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:17:30.646 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.641+0000 7f6263fff640 1 -- 10.20.193.26:0/3288170455 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62740b4230 con 0x7f6274055bf0 2026-02-24T19:17:30.646 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.641+0000 7f6263fff640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.646 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.641+0000 7f6263fff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.647 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.641+0000 7f6263fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.647 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.641+0000 7f6263fff640 1 -- 10.20.193.26:0/3288170455 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6264002df0 con 0x7f6274055bf0 2026-02-24T19:17:30.647 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.641+0000 7f6263fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.647 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.641+0000 7f6263fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:30.647 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.641+0000 7f6263fff640 10 monclient: dump: 2026-02-24T19:17:30.647 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:17:30.647 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:30.647 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:30.647 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:30.647 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.647 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:17:30.647 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:30.648 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:30.648 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:30.648 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:30.648 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.641+0000 7f627b65c640 5 monclient: authenticate success, global_id 4226 2026-02-24T19:17:30.648 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.641+0000 7f627b65c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:30.648 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.642+0000 7f6263fff640 1 -- 10.20.193.26:0/3288170455 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6264003000 con 0x7f6274055bf0 2026-02-24T19:17:30.648 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.642+0000 7f6263fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.648 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.642+0000 7f6263fff640 1 -- 10.20.193.26:0/3288170455 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6264003440 con 0x7f6274055bf0 2026-02-24T19:17:30.648 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.642+0000 7f6263fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.648 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.642+0000 7f6263fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:30.648 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.642+0000 7f6263fff640 10 monclient: dump: 2026-02-24T19:17:30.648 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:17:30.649 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:30.649 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:30.649 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:30.649 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.649 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:17:30.649 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:30.649 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:30.649 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:30.649 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:30.649 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.642+0000 7f627b65c640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:30.649 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.642+0000 7f627b65c640 4 set_mon_vals no callback set 2026-02-24T19:17:30.649 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.642+0000 7f627b65c640 10 monclient: shutdown 2026-02-24T19:17:30.649 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.642+0000 7f627b65c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.650 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.642+0000 7f627b65c640 1 -- 10.20.193.26:0/3288170455 >> v1:10.20.193.103:6789/0 conn(0x7f6274055bf0 legacy=0x7f62740b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.650 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.642+0000 7f627b65c640 1 -- 10.20.193.26:0/3288170455 shutdown_connections 2026-02-24T19:17:30.650 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.642+0000 7f627b65c640 1 -- 10.20.193.26:0/3288170455 >> 10.20.193.26:0/3288170455 conn(0x7f62740b7bb0 msgr2=0x7f62740b7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.650 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.642+0000 7f627b65c640 1 -- 10.20.193.26:0/3288170455 shutdown_connections 2026-02-24T19:17:30.650 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.643+0000 7f627b65c640 1 -- 10.20.193.26:0/3288170455 wait complete. 2026-02-24T19:17:30.650 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.643+0000 7f627b65c640 10 monclient: build_initial_monmap 2026-02-24T19:17:30.650 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.643+0000 7f627b65c640 10 monclient: monmap: 2026-02-24T19:17:30.650 INFO:teuthology.misc.health.trial026.stderr:epoch 0 2026-02-24T19:17:30.650 INFO:teuthology.misc.health.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:30.650 INFO:teuthology.misc.health.trial026.stderr:last_changed 0.000000 2026-02-24T19:17:30.650 INFO:teuthology.misc.health.trial026.stderr:created 0.000000 2026-02-24T19:17:30.650 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:30.651 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 1 2026-02-24T19:17:30.651 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:30.651 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:30.651 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:30.651 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:30.651 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.643+0000 7f627b65c640 1 librados: starting msgr at 2026-02-24T19:17:30.651 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.643+0000 7f627b65c640 1 librados: starting objecter 2026-02-24T19:17:30.651 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.643+0000 7f627b65c640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:30.651 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.643+0000 7f627b65c640 1 Processor -- start 2026-02-24T19:17:30.651 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.643+0000 7f627b65c640 1 -- start start 2026-02-24T19:17:30.651 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.643+0000 7f627b65c640 1 librados: setting wanted keys 2026-02-24T19:17:30.651 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.643+0000 7f627b65c640 1 librados: calling monclient init 2026-02-24T19:17:30.651 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.643+0000 7f627b65c640 10 monclient: init 2026-02-24T19:17:30.652 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.644+0000 7f627b65c640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:30.652 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.644+0000 7f627b65c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:30.652 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.644+0000 7f627b65c640 10 monclient(hunting): picked mon.noname-c con 0x7f6274055bf0 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:30.652 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.644+0000 7f627b65c640 10 monclient(hunting): picked mon.noname-b con 0x7f6274055fc0 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:30.652 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.644+0000 7f627b65c640 10 monclient(hunting): picked mon.noname-a con 0x7f6274164040 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:30.652 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.644+0000 7f627b65c640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f627412a990 con 0x7f6274164040 2026-02-24T19:17:30.652 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.644+0000 7f627b65c640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6274129610 con 0x7f6274055fc0 2026-02-24T19:17:30.652 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.644+0000 7f627b65c640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62741298f0 con 0x7f6274055bf0 2026-02-24T19:17:30.652 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.644+0000 7f627b65c640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:30.652 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.644+0000 7f627b65c640 10 monclient(hunting): authenticate will time out at 3633.326106s 2026-02-24T19:17:30.652 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.644+0000 7f62793d1640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f6274055bf0 0x7f627413a810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:42962/0 (socket says 10.20.193.26:42962) 2026-02-24T19:17:30.652 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.644+0000 7f62793d1640 1 -- 10.20.193.26:0/3899074483 learned_addr learned my addr 10.20.193.26:0/3899074483 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:17:30.653 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.644+0000 7f6261ffb640 10 client.?.objecter ms_handle_connect 0x7f6274055bf0 2026-02-24T19:17:30.653 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.644+0000 7f6261ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.653 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.644+0000 7f6261ffb640 10 client.?.objecter ms_handle_connect 0x7f6274055fc0 2026-02-24T19:17:30.653 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.644+0000 7f6261ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.653 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.645+0000 7f6261ffb640 10 client.?.objecter ms_handle_connect 0x7f6274164040 2026-02-24T19:17:30.653 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.645+0000 7f6261ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:30.656 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.645+0000 7f6261ffb640 1 -- 10.20.193.26:0/3899074483 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3198612324 0 0) 0x7f6274129610 con 0x7f6274055fc0 2026-02-24T19:17:30.657 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.645+0000 7f6261ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.657 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.645+0000 7f6261ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.657 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.645+0000 7f6261ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.657 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.645+0000 7f6261ffb640 10 monclient(hunting): my global_id is 4210 2026-02-24T19:17:30.657 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.646+0000 7f6261ffb640 1 -- 10.20.193.26:0/3899074483 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6244003610 con 0x7f6274055fc0 2026-02-24T19:17:30.657 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.646+0000 7f6261ffb640 1 -- 10.20.193.26:0/3899074483 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2534790130 0 0) 0x7f62741298f0 con 0x7f6274055bf0 2026-02-24T19:17:30.657 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.646+0000 7f6261ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.657 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.646+0000 7f6261ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.657 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.646+0000 7f6261ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.657 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.646+0000 7f6261ffb640 10 monclient(hunting): my global_id is 4229 2026-02-24T19:17:30.658 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.646+0000 7f6261ffb640 1 -- 10.20.193.26:0/3899074483 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6274129610 con 0x7f6274055bf0 2026-02-24T19:17:30.658 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.647+0000 7f6261ffb640 1 -- 10.20.193.26:0/3899074483 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1014523672 0 0) 0x7f62740b3f50 con 0x7f6274164040 2026-02-24T19:17:30.658 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.647+0000 7f6261ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:17:30.658 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.647+0000 7f6261ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:30.658 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.647+0000 7f6261ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:30.658 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.647+0000 7f6261ffb640 10 monclient(hunting): my global_id is 4227 2026-02-24T19:17:30.658 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.647+0000 7f6261ffb640 1 -- 10.20.193.26:0/3899074483 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62741298f0 con 0x7f6274164040 2026-02-24T19:17:30.658 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.648+0000 7f6261ffb640 1 -- 10.20.193.26:0/3899074483 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 102574676 0 0) 0x7f6274129610 con 0x7f6274055bf0 2026-02-24T19:17:30.658 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.648+0000 7f6261ffb640 1 -- 10.20.193.26:0/3899074483 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f62740b3f50 con 0x7f6274055bf0 2026-02-24T19:17:30.658 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.648+0000 7f6261ffb640 1 -- 10.20.193.26:0/3899074483 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6264003350 con 0x7f6274055bf0 2026-02-24T19:17:30.658 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.648+0000 7f6261ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.658 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.648+0000 7f6261ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:30.658 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.648+0000 7f6261ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:30.659 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:17:30.659 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:30.659 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:30.659 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:30.659 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.659 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:17:30.659 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:30.659 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:30.659 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:30.659 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:30.659 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.648+0000 7f6261ffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:30.659 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f6261ffb640 1 -- 10.20.193.26:0/3899074483 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3408709852 0 0) 0x7f6244003610 con 0x7f6274055fc0 2026-02-24T19:17:30.660 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f6261ffb640 1 -- 10.20.193.26:0/3899074483 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6274129610 con 0x7f6274055fc0 2026-02-24T19:17:30.660 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f6261ffb640 1 -- 10.20.193.26:0/3899074483 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6268002ed0 con 0x7f6274055fc0 2026-02-24T19:17:30.660 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f6261ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.660 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f6261ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:30.660 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f6261ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:30.660 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:17:30.660 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:30.660 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:30.660 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:30.660 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.660 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:17:30.660 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:30.660 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:30.661 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:30.661 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:30.661 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f6261ffb640 1 -- 10.20.193.26:0/3899074483 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1838817483 0 0) 0x7f62741298f0 con 0x7f6274164040 2026-02-24T19:17:30.661 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f6261ffb640 1 -- 10.20.193.26:0/3899074483 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6244003610 con 0x7f6274164040 2026-02-24T19:17:30.661 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f6261ffb640 1 -- 10.20.193.26:0/3899074483 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6270003430 con 0x7f6274164040 2026-02-24T19:17:30.661 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f6261ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:30.661 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f6261ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:30.661 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f6261ffb640 10 monclient(hunting): dump: 2026-02-24T19:17:30.661 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:17:30.661 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:30.661 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:30.661 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:30.662 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.662 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:17:30.662 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:30.662 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:30.662 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:30.662 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:30.662 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f6261ffb640 1 -- 10.20.193.26:0/3899074483 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1728823261 0 0) 0x7f62740b3f50 con 0x7f6274055bf0 2026-02-24T19:17:30.662 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f6261ffb640 1 -- 10.20.193.26:0/3899074483 >> v1:10.20.193.70:6789/0 conn(0x7f6274055fc0 legacy=0x7f62740b99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.662 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f6261ffb640 1 -- 10.20.193.26:0/3899074483 >> v1:10.20.193.26:6789/0 conn(0x7f6274164040 legacy=0x7f6274119d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.662 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f6261ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:17:30.662 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f6261ffb640 1 monclient: found mon.c 2026-02-24T19:17:30.662 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f6261ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:30.663 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f6261ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:30.663 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f6261ffb640 1 -- 10.20.193.26:0/3899074483 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6274129bd0 con 0x7f6274055bf0 2026-02-24T19:17:30.663 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f6261ffb640 10 monclient: _finish_auth 0 2026-02-24T19:17:30.663 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f6261ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:17:30.663 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f6261ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:30.663 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f627b65c640 5 monclient: authenticate success, global_id 4229 2026-02-24T19:17:30.663 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f627b65c640 10 monclient: _renew_subs 2026-02-24T19:17:30.663 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f627b65c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:30.663 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f627b65c640 1 -- 10.20.193.26:0/3899074483 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6274129eb0 con 0x7f6274055bf0 2026-02-24T19:17:30.663 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f627b65c640 10 client.4229.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:30.663 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f627b65c640 10 monclient: _renew_subs 2026-02-24T19:17:30.663 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f627b65c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:30.663 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f627b65c640 1 -- 10.20.193.26:0/3899074483 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f627413af20 con 0x7f6274055bf0 2026-02-24T19:17:30.663 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.649+0000 7f627b65c640 1 librados: init done 2026-02-24T19:17:30.664 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.650+0000 7f627b65c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.664 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.650+0000 7f627b65c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.664 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.650+0000 7f627b65c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:30.664 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.650+0000 7f627b65c640 1 -- 10.20.193.26:0/3899074483 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f627412d840 con 0x7f6274055bf0 2026-02-24T19:17:30.746 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.745+0000 7f6261ffb640 1 -- 10.20.193.26:0/3899074483 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6264003000 con 0x7f6274055bf0 2026-02-24T19:17:30.746 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.745+0000 7f6261ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:30.746 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.745+0000 7f6261ffb640 1 -- 10.20.193.26:0/3899074483 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6264004e80 con 0x7f6274055bf0 2026-02-24T19:17:30.746 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.745+0000 7f6261ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:30.746 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.745+0000 7f6261ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:30.747 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.745+0000 7f6261ffb640 10 monclient: dump: 2026-02-24T19:17:30.747 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:17:30.747 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:30.747 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:30.747 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:30.747 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:30.747 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:17:30.747 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:30.747 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:30.747 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:30.747 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:30.747 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.745+0000 7f62637fe640 4 set_mon_vals no callback set 2026-02-24T19:17:30.748 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.746+0000 7f6261ffb640 1 -- 10.20.193.26:0/3899074483 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 3958291397 0 0) 0x7f626401dcb0 con 0x7f6274055bf0 2026-02-24T19:17:30.748 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.746+0000 7f6278bd0640 10 monclient: get_auth_request con 0x7f6244077e40 auth_method 0 2026-02-24T19:17:30.748 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.746+0000 7f6261ffb640 10 client.4229.objecter ms_handle_connect 0x7f6244077e40 2026-02-24T19:17:30.749 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.748+0000 7f6261ffb640 1 -- 10.20.193.26:0/3899074483 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 2560+0+0 (unknown 77300011 0 0) 0x7f6264059470 con 0x7f6274055bf0 2026-02-24T19:17:30.749 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.748+0000 7f6261ffb640 10 client.4229.objecter ms_dispatch2 0x7f6274000b90 osd_map(18..18 src has 1..18) 2026-02-24T19:17:30.749 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.748+0000 7f6261ffb640 3 client.4229.objecter handle_osd_map got epochs [18,18] > 0 2026-02-24T19:17:30.749 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.748+0000 7f6261ffb640 3 client.4229.objecter handle_osd_map decoding full epoch 18 2026-02-24T19:17:30.749 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.748+0000 7f6261ffb640 20 client.4229.objecter dump_active .. 0 homeless 2026-02-24T19:17:30.750 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.749+0000 7f6261ffb640 1 -- 10.20.193.26:0/3899074483 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f626405dbe0 con 0x7f6274055bf0 2026-02-24T19:17:30.750 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.749+0000 7f6261ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:30.750 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.749+0000 7f6261ffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:30.863 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.862+0000 7f627b65c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:30.864 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.862+0000 7f627b65c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:30.864 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.862+0000 7f627b65c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:30.864 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.862+0000 7f627b65c640 1 -- 10.20.193.26:0/3899074483 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f627412d560 con 0x7f6274055bf0 2026-02-24T19:17:30.885 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.884+0000 7f6261ffb640 1 -- 10.20.193.26:0/3899074483 <== mon.2 v1:10.20.193.103:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12877 (unknown 3338201251 0 1129572664) 0x7f626405d4e0 con 0x7f6274055bf0 2026-02-24T19:17:30.886 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.884+0000 7f6261ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:30.886 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.884+0000 7f6261ffb640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:30.886 INFO:teuthology.misc.health.trial026.stdout: 2026-02-24T19:17:30.886 INFO:teuthology.misc.health.trial026.stdout:{"epoch":18,"fsid":"33b2b598-dbc5-4d7a-8df7-657f0501fe9e","created":"2026-02-24T19:17:21.810535+0000","modified":"2026-02-24T19:17:28.575109+0000","last_up_change":"0.000000","last_in_change":"2026-02-24T19:17:28.575109+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e08ffdb8-0db6-4356-88b5-54397e40be58","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"08b117f7-0152-42bb-8a51-220b41a964ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3c37f6aa-25cb-43be-a75a-86a246086a85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a7e3939e-f8f5-4216-9700-27e229d1c4d9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"445d43ab-a28c-4afa-90ff-e451602e494f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"37303b3f-6b88-4c73-aaff-10055ec5cc85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ef2c9883-f17f-41ec-96b7-dbbe936b77d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3e4a495e-c742-43fc-991a-371a47ff87bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"fb377a45-1ce5-4e07-92cd-7f546cfad57f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"8079b2ca-96c3-4321-9f24-a87e8ea1e883","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"8df004a9-88e3-43f5-833d-dfc73a658ec3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"f3cf3a4b-1c26-480c-ba10-178f8542c1e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"0e06b2e9-9b29-4c6e-ab44-77fd24d945af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"b1cbaf8b-36e9-4196-a08d-e6e72c2229e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"214e8bfc-c78d-45ac-9ec3-7685dd5684cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"8c2eb0c6-abf0-42a7-bcab-83d0c9cf797b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T19:17:30.889 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.887+0000 7f627b65c640 10 librados: watch_flush enter 2026-02-24T19:17:30.889 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.887+0000 7f627b65c640 10 librados: watch_flush exit 2026-02-24T19:17:30.889 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.887+0000 7f627b65c640 20 client.4229.objecter shutdown clearing up homeless session... 2026-02-24T19:17:30.889 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.887+0000 7f627b65c640 10 client.4229.objecter successfully canceled tick 2026-02-24T19:17:30.889 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.887+0000 7f627b65c640 1 -- 10.20.193.26:0/3899074483 >> v1:10.20.193.162:6800/3889602630 conn(0x7f6244077e40 legacy=0x7f62440982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.889 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.887+0000 7f627b65c640 10 monclient: shutdown 2026-02-24T19:17:30.890 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.887+0000 7f627b65c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:30.890 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.887+0000 7f627b65c640 1 -- 10.20.193.26:0/3899074483 >> v1:10.20.193.103:6789/0 conn(0x7f6274055bf0 legacy=0x7f627413a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:30.890 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.887+0000 7f627b65c640 1 -- 10.20.193.26:0/3899074483 shutdown_connections 2026-02-24T19:17:30.890 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.887+0000 7f627b65c640 1 -- 10.20.193.26:0/3899074483 >> 10.20.193.26:0/3899074483 conn(0x7f62740b7bb0 msgr2=0x7f6274156790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:30.890 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.887+0000 7f627b65c640 1 -- 10.20.193.26:0/3899074483 shutdown_connections 2026-02-24T19:17:30.890 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.887+0000 7f627b65c640 1 -- 10.20.193.26:0/3899074483 wait complete. 2026-02-24T19:17:30.890 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:30.887+0000 7f627b65c640 1 librados: shutdown 2026-02-24T19:17:30.897 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-24T19:17:38.507 DEBUG:teuthology.orchestra.run.trial026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-24T19:17:38.570 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.568+0000 7fa3bc0a7640 10 monclient: get_monmap_and_config 2026-02-24T19:17:38.570 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.568+0000 7fa3bc0a7640 10 monclient: build_initial_monmap 2026-02-24T19:17:38.570 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.568+0000 7fa3bc0a7640 10 monclient: monmap: 2026-02-24T19:17:38.570 INFO:teuthology.misc.health.trial026.stderr:epoch 0 2026-02-24T19:17:38.570 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:38.570 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:17:38.569700+0000 2026-02-24T19:17:38.570 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:17:38.569700+0000 2026-02-24T19:17:38.570 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:38.570 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:17:38.571 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:38.571 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:38.571 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:38.571 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:38.572 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.569+0000 7fa3bc0a7640 1 Processor -- start 2026-02-24T19:17:38.572 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.569+0000 7fa3bc0a7640 1 -- start start 2026-02-24T19:17:38.573 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.569+0000 7fa3bc0a7640 10 monclient: init 2026-02-24T19:17:38.573 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.569+0000 7fa3bc0a7640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:38.573 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.569+0000 7fa3bc0a7640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:38.573 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.569+0000 7fa3bc0a7640 10 monclient(hunting): picked mon.noname-a con 0x7fa3b4159b90 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:38.573 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.569+0000 7fa3bc0a7640 10 monclient(hunting): picked mon.noname-b con 0x7fa3b4057640 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:38.573 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.569+0000 7fa3bc0a7640 10 monclient(hunting): picked mon.noname-c con 0x7fa3b41a7980 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:38.573 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.569+0000 7fa3bc0a7640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b4159f60 con 0x7fa3b4159b90 2026-02-24T19:17:38.573 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.569+0000 7fa3bc0a7640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b405cca0 con 0x7fa3b4057640 2026-02-24T19:17:38.573 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.569+0000 7fa3bc0a7640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b405cf80 con 0x7fa3b41a7980 2026-02-24T19:17:38.573 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.569+0000 7fa3bc0a7640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:38.573 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.569+0000 7fa3bc0a7640 10 monclient(hunting): authenticate will time out at 3641.251917s 2026-02-24T19:17:38.573 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.570+0000 7fa3b9e1c640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fa3b4159b90 0x7fa3b40b4cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:44550/0 (socket says 10.20.193.26:44550) 2026-02-24T19:17:38.574 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.570+0000 7fa3b9e1c640 1 -- 10.20.193.26:0/1559350272 learned_addr learned my addr 10.20.193.26:0/1559350272 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:17:38.578 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.572+0000 7fa3b8e1a640 1 -- 10.20.193.26:0/1559350272 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2700939563 0 0) 0x7fa3b4159f60 con 0x7fa3b4159b90 2026-02-24T19:17:38.578 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.572+0000 7fa3b8e1a640 10 monclient(hunting): _negotiate 2026-02-24T19:17:38.578 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.572+0000 7fa3b8e1a640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:38.578 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.572+0000 7fa3b8e1a640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:38.579 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.572+0000 7fa3b8e1a640 10 monclient(hunting): my global_id is 4230 2026-02-24T19:17:38.579 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.572+0000 7fa3b8e1a640 1 -- 10.20.193.26:0/1559350272 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa39c003610 con 0x7fa3b4159b90 2026-02-24T19:17:38.579 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.572+0000 7fa3b8e1a640 1 -- 10.20.193.26:0/1559350272 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3250357400 0 0) 0x7fa3b405cca0 con 0x7fa3b4057640 2026-02-24T19:17:38.579 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.572+0000 7fa3b8e1a640 10 monclient(hunting): _negotiate 2026-02-24T19:17:38.579 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.572+0000 7fa3b8e1a640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:38.579 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.572+0000 7fa3b8e1a640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:38.579 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.572+0000 7fa3b8e1a640 10 monclient(hunting): my global_id is 4213 2026-02-24T19:17:38.579 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.572+0000 7fa3b8e1a640 1 -- 10.20.193.26:0/1559350272 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3b4159f60 con 0x7fa3b4057640 2026-02-24T19:17:38.579 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.572+0000 7fa3b8e1a640 1 -- 10.20.193.26:0/1559350272 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1921833512 0 0) 0x7fa3b405cf80 con 0x7fa3b41a7980 2026-02-24T19:17:38.579 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.572+0000 7fa3b8e1a640 10 monclient(hunting): _negotiate 2026-02-24T19:17:38.579 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.572+0000 7fa3b8e1a640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:38.579 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.572+0000 7fa3b8e1a640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:38.579 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.572+0000 7fa3b8e1a640 10 monclient(hunting): my global_id is 4232 2026-02-24T19:17:38.580 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.572+0000 7fa3b8e1a640 1 -- 10.20.193.26:0/1559350272 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3b405cca0 con 0x7fa3b41a7980 2026-02-24T19:17:38.580 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.573+0000 7fa3b8e1a640 1 -- 10.20.193.26:0/1559350272 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3061555800 0 0) 0x7fa39c003610 con 0x7fa3b4159b90 2026-02-24T19:17:38.580 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.573+0000 7fa3b8e1a640 1 -- 10.20.193.26:0/1559350272 >> v1:10.20.193.103:6789/0 conn(0x7fa3b41a7980 legacy=0x7fa3b41c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:38.580 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.573+0000 7fa3b8e1a640 1 -- 10.20.193.26:0/1559350272 >> v1:10.20.193.70:6789/0 conn(0x7fa3b4057640 legacy=0x7fa3b4057a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:38.580 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.573+0000 7fa3b8e1a640 10 monclient: _finish_hunting 0 2026-02-24T19:17:38.580 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.573+0000 7fa3b8e1a640 1 monclient: found mon.noname-a 2026-02-24T19:17:38.580 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.573+0000 7fa3b8e1a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:38.580 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.573+0000 7fa3b8e1a640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:17:38.580 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.573+0000 7fa3b8e1a640 1 -- 10.20.193.26:0/1559350272 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b405d260 con 0x7fa3b4159b90 2026-02-24T19:17:38.580 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.573+0000 7fa3b8e1a640 10 monclient: _finish_auth 0 2026-02-24T19:17:38.580 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.573+0000 7fa3b8e1a640 10 monclient: _check_auth_tickets 2026-02-24T19:17:38.580 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.573+0000 7fa3b8e1a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:38.581 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.574+0000 7fa3b8e1a640 1 -- 10.20.193.26:0/1559350272 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa3a4002df0 con 0x7fa3b4159b90 2026-02-24T19:17:38.581 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.574+0000 7fa3b8e1a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:38.581 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.574+0000 7fa3b8e1a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:38.581 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.574+0000 7fa3b8e1a640 10 monclient: dump: 2026-02-24T19:17:38.581 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:17:38.581 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:38.581 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:38.581 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:38.581 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:38.581 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:17:38.581 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:38.581 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:38.581 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:38.582 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:38.582 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.574+0000 7fa3bc0a7640 5 monclient: authenticate success, global_id 4230 2026-02-24T19:17:38.582 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.574+0000 7fa3bc0a7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:38.582 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.574+0000 7fa3b8e1a640 1 -- 10.20.193.26:0/1559350272 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa3a4002fc0 con 0x7fa3b4159b90 2026-02-24T19:17:38.582 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.574+0000 7fa3b8e1a640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:38.582 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.574+0000 7fa3b8e1a640 1 -- 10.20.193.26:0/1559350272 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa3a4003400 con 0x7fa3b4159b90 2026-02-24T19:17:38.582 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.574+0000 7fa3bc0a7640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:38.582 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.574+0000 7fa3bc0a7640 4 set_mon_vals no callback set 2026-02-24T19:17:38.582 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.574+0000 7fa3b8e1a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:38.582 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.574+0000 7fa3b8e1a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:38.582 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.574+0000 7fa3b8e1a640 10 monclient: dump: 2026-02-24T19:17:38.582 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:17:38.582 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:38.583 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:38.583 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:38.583 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:38.583 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:17:38.583 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:38.583 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:38.583 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:38.583 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:38.583 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.575+0000 7fa3bc0a7640 10 monclient: shutdown 2026-02-24T19:17:38.583 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.575+0000 7fa3bc0a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:38.583 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.575+0000 7fa3bc0a7640 1 -- 10.20.193.26:0/1559350272 >> v1:10.20.193.26:6789/0 conn(0x7fa3b4159b90 legacy=0x7fa3b40b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:38.583 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.575+0000 7fa3bc0a7640 1 -- 10.20.193.26:0/1559350272 shutdown_connections 2026-02-24T19:17:38.583 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.575+0000 7fa3bc0a7640 1 -- 10.20.193.26:0/1559350272 >> 10.20.193.26:0/1559350272 conn(0x7fa3b40b3830 msgr2=0x7fa3b40b3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:38.584 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.575+0000 7fa3bc0a7640 1 -- 10.20.193.26:0/1559350272 shutdown_connections 2026-02-24T19:17:38.584 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.575+0000 7fa3bc0a7640 1 -- 10.20.193.26:0/1559350272 wait complete. 2026-02-24T19:17:38.584 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.575+0000 7fa3bc0a7640 10 monclient: build_initial_monmap 2026-02-24T19:17:38.584 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.575+0000 7fa3bc0a7640 10 monclient: monmap: 2026-02-24T19:17:38.584 INFO:teuthology.misc.health.trial026.stderr:epoch 0 2026-02-24T19:17:38.584 INFO:teuthology.misc.health.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:38.584 INFO:teuthology.misc.health.trial026.stderr:last_changed 0.000000 2026-02-24T19:17:38.584 INFO:teuthology.misc.health.trial026.stderr:created 0.000000 2026-02-24T19:17:38.584 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:38.584 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 1 2026-02-24T19:17:38.584 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:38.584 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:38.584 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:38.585 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:38.585 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.575+0000 7fa3bc0a7640 1 librados: starting msgr at 2026-02-24T19:17:38.585 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.575+0000 7fa3bc0a7640 1 librados: starting objecter 2026-02-24T19:17:38.585 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.575+0000 7fa3bc0a7640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:38.585 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.575+0000 7fa3bc0a7640 1 Processor -- start 2026-02-24T19:17:38.585 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.575+0000 7fa3bc0a7640 1 -- start start 2026-02-24T19:17:38.585 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.575+0000 7fa3bc0a7640 1 librados: setting wanted keys 2026-02-24T19:17:38.585 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.575+0000 7fa3bc0a7640 1 librados: calling monclient init 2026-02-24T19:17:38.585 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.575+0000 7fa3bc0a7640 10 monclient: init 2026-02-24T19:17:38.585 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.576+0000 7fa3bc0a7640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:38.585 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.576+0000 7fa3bc0a7640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:38.585 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.576+0000 7fa3bc0a7640 10 monclient(hunting): picked mon.noname-a con 0x7fa3b4057640 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:38.585 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.576+0000 7fa3bc0a7640 10 monclient(hunting): picked mon.noname-b con 0x7fa3b4159b90 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:38.586 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.576+0000 7fa3bc0a7640 10 monclient(hunting): picked mon.noname-c con 0x7fa3b41a7980 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:38.586 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.576+0000 7fa3bc0a7640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b4186be0 con 0x7fa3b4057640 2026-02-24T19:17:38.586 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.576+0000 7fa3bc0a7640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b4186ec0 con 0x7fa3b4159b90 2026-02-24T19:17:38.586 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.576+0000 7fa3bc0a7640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b41871a0 con 0x7fa3b41a7980 2026-02-24T19:17:38.586 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.576+0000 7fa3bc0a7640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:38.586 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.576+0000 7fa3bc0a7640 10 monclient(hunting): authenticate will time out at 3641.258239s 2026-02-24T19:17:38.586 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.576+0000 7fa3b9e1c640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fa3b4057640 0x7fa3b4166d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:44554/0 (socket says 10.20.193.26:44554) 2026-02-24T19:17:38.586 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.576+0000 7fa3b9e1c640 1 -- 10.20.193.26:0/811349728 learned_addr learned my addr 10.20.193.26:0/811349728 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:17:38.586 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.576+0000 7fa3a27fc640 10 client.?.objecter ms_handle_connect 0x7fa3b4057640 2026-02-24T19:17:38.586 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.576+0000 7fa3a27fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:38.586 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.576+0000 7fa3a27fc640 10 client.?.objecter ms_handle_connect 0x7fa3b41a7980 2026-02-24T19:17:38.586 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.576+0000 7fa3a27fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:38.587 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.577+0000 7fa3a27fc640 10 client.?.objecter ms_handle_connect 0x7fa3b4159b90 2026-02-24T19:17:38.587 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.577+0000 7fa3a27fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:38.590 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.577+0000 7fa3a27fc640 1 -- 10.20.193.26:0/811349728 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4001835377 0 0) 0x7fa3b4186be0 con 0x7fa3b4057640 2026-02-24T19:17:38.590 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.577+0000 7fa3a27fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:38.590 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.577+0000 7fa3a27fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:38.590 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.577+0000 7fa3a27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:38.590 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.577+0000 7fa3a27fc640 10 monclient(hunting): my global_id is 4233 2026-02-24T19:17:38.590 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.577+0000 7fa3a27fc640 1 -- 10.20.193.26:0/811349728 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa384003610 con 0x7fa3b4057640 2026-02-24T19:17:38.590 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.578+0000 7fa3a27fc640 1 -- 10.20.193.26:0/811349728 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2241790582 0 0) 0x7fa3b41871a0 con 0x7fa3b41a7980 2026-02-24T19:17:38.590 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.578+0000 7fa3a27fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:38.591 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.578+0000 7fa3a27fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:38.591 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.578+0000 7fa3a27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:38.591 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.578+0000 7fa3a27fc640 10 monclient(hunting): my global_id is 4235 2026-02-24T19:17:38.591 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.578+0000 7fa3a27fc640 1 -- 10.20.193.26:0/811349728 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3b4186be0 con 0x7fa3b41a7980 2026-02-24T19:17:38.591 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.578+0000 7fa3a27fc640 1 -- 10.20.193.26:0/811349728 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2129709101 0 0) 0x7fa3b4186ec0 con 0x7fa3b4159b90 2026-02-24T19:17:38.591 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.578+0000 7fa3a27fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:38.591 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.578+0000 7fa3a27fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:38.591 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.578+0000 7fa3a27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:38.591 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.578+0000 7fa3a27fc640 10 monclient(hunting): my global_id is 4216 2026-02-24T19:17:38.591 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.578+0000 7fa3a27fc640 1 -- 10.20.193.26:0/811349728 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3b41871a0 con 0x7fa3b4159b90 2026-02-24T19:17:38.591 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.580+0000 7fa3a27fc640 1 -- 10.20.193.26:0/811349728 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4057435803 0 0) 0x7fa3b4186be0 con 0x7fa3b41a7980 2026-02-24T19:17:38.591 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.580+0000 7fa3a27fc640 1 -- 10.20.193.26:0/811349728 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa3b4186ec0 con 0x7fa3b41a7980 2026-02-24T19:17:38.591 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.580+0000 7fa3a27fc640 1 -- 10.20.193.26:0/811349728 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa3b0003330 con 0x7fa3b41a7980 2026-02-24T19:17:38.592 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.580+0000 7fa3a27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:38.592 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.580+0000 7fa3a27fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:38.592 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.580+0000 7fa3a27fc640 10 monclient(hunting): dump: 2026-02-24T19:17:38.592 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:17:38.592 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:38.592 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:38.592 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:38.592 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:38.592 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:17:38.592 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:38.592 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:38.592 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:38.593 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:38.593 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.580+0000 7fa3a27fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:38.593 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.580+0000 7fa3a27fc640 1 -- 10.20.193.26:0/811349728 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 733310001 0 0) 0x7fa384003610 con 0x7fa3b4057640 2026-02-24T19:17:38.593 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.580+0000 7fa3a27fc640 1 -- 10.20.193.26:0/811349728 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa3b4186be0 con 0x7fa3b4057640 2026-02-24T19:17:38.593 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.580+0000 7fa3a27fc640 1 -- 10.20.193.26:0/811349728 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa3a4003310 con 0x7fa3b4057640 2026-02-24T19:17:38.593 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.580+0000 7fa3a27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:38.593 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.580+0000 7fa3a27fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:38.593 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.580+0000 7fa3a27fc640 10 monclient(hunting): dump: 2026-02-24T19:17:38.593 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:17:38.593 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:38.593 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:38.593 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:38.594 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:38.594 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:17:38.594 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:38.594 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:38.594 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:38.594 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:38.594 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.581+0000 7fa3a27fc640 1 -- 10.20.193.26:0/811349728 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4172045708 0 0) 0x7fa3b41871a0 con 0x7fa3b4159b90 2026-02-24T19:17:38.594 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.581+0000 7fa3a27fc640 1 -- 10.20.193.26:0/811349728 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa384003610 con 0x7fa3b4159b90 2026-02-24T19:17:38.594 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.581+0000 7fa3a27fc640 1 -- 10.20.193.26:0/811349728 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa3a8003070 con 0x7fa3b4159b90 2026-02-24T19:17:38.594 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.581+0000 7fa3a27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:38.594 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.581+0000 7fa3a27fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:38.594 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.581+0000 7fa3a27fc640 10 monclient(hunting): dump: 2026-02-24T19:17:38.594 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:17:38.595 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:38.595 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:38.595 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:38.595 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:38.595 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:17:38.595 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:38.595 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:38.595 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:38.595 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:38.595 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.582+0000 7fa3a27fc640 1 -- 10.20.193.26:0/811349728 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 746506311 0 0) 0x7fa3b4186ec0 con 0x7fa3b41a7980 2026-02-24T19:17:38.595 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.582+0000 7fa3a27fc640 1 -- 10.20.193.26:0/811349728 >> v1:10.20.193.70:6789/0 conn(0x7fa3b4159b90 legacy=0x7fa3b418b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:38.595 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.582+0000 7fa3a27fc640 1 -- 10.20.193.26:0/811349728 >> v1:10.20.193.26:6789/0 conn(0x7fa3b4057640 legacy=0x7fa3b4166d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:38.595 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.582+0000 7fa3a27fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:38.596 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.582+0000 7fa3a27fc640 1 monclient: found mon.c 2026-02-24T19:17:38.596 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.582+0000 7fa3a27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:38.596 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.582+0000 7fa3a27fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:38.596 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.582+0000 7fa3a27fc640 1 -- 10.20.193.26:0/811349728 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b4187480 con 0x7fa3b41a7980 2026-02-24T19:17:38.596 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.582+0000 7fa3a27fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:38.596 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.582+0000 7fa3a27fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:38.596 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.582+0000 7fa3a27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:38.596 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.582+0000 7fa3bc0a7640 5 monclient: authenticate success, global_id 4235 2026-02-24T19:17:38.596 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.582+0000 7fa3bc0a7640 10 monclient: _renew_subs 2026-02-24T19:17:38.596 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.582+0000 7fa3bc0a7640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:38.596 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.582+0000 7fa3bc0a7640 1 -- 10.20.193.26:0/811349728 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b4187760 con 0x7fa3b41a7980 2026-02-24T19:17:38.596 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.582+0000 7fa3bc0a7640 10 client.4235.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:38.596 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.582+0000 7fa3bc0a7640 10 monclient: _renew_subs 2026-02-24T19:17:38.597 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.582+0000 7fa3bc0a7640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:38.597 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.582+0000 7fa3bc0a7640 1 -- 10.20.193.26:0/811349728 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa3b4187d50 con 0x7fa3b41a7980 2026-02-24T19:17:38.597 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.582+0000 7fa3bc0a7640 1 librados: init done 2026-02-24T19:17:38.597 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.582+0000 7fa3bc0a7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:38.597 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.582+0000 7fa3bc0a7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:38.597 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.582+0000 7fa3bc0a7640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:38.597 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.582+0000 7fa3bc0a7640 1 -- 10.20.193.26:0/811349728 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3b405a550 con 0x7fa3b41a7980 2026-02-24T19:17:38.598 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.590+0000 7fa3a27fc640 1 -- 10.20.193.26:0/811349728 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa3b0003a80 con 0x7fa3b41a7980 2026-02-24T19:17:38.599 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.590+0000 7fa3a27fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:38.599 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.590+0000 7fa3a27fc640 1 -- 10.20.193.26:0/811349728 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa3b0003dd0 con 0x7fa3b41a7980 2026-02-24T19:17:38.599 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.590+0000 7fa3a27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:38.599 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.590+0000 7fa3a27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:38.599 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.590+0000 7fa3a27fc640 10 monclient: dump: 2026-02-24T19:17:38.599 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:17:38.599 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:38.599 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:38.599 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:38.599 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:38.599 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:17:38.600 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:38.600 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:38.600 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:38.600 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:38.600 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.590+0000 7fa3a3fff640 4 set_mon_vals no callback set 2026-02-24T19:17:38.600 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.591+0000 7fa3a27fc640 1 -- 10.20.193.26:0/811349728 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 3958291397 0 0) 0x7fa3b001cc00 con 0x7fa3b41a7980 2026-02-24T19:17:38.600 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.591+0000 7fa3b9e1c640 10 monclient: get_auth_request con 0x7fa384077e70 auth_method 0 2026-02-24T19:17:38.600 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.592+0000 7fa3a27fc640 10 client.4235.objecter ms_handle_connect 0x7fa384077e70 2026-02-24T19:17:38.600 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.592+0000 7fa3a27fc640 1 -- 10.20.193.26:0/811349728 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 2560+0+0 (unknown 77300011 0 0) 0x7fa3b0058400 con 0x7fa3b41a7980 2026-02-24T19:17:38.600 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.592+0000 7fa3a27fc640 10 client.4235.objecter ms_dispatch2 0x7fa3b4000b90 osd_map(18..18 src has 1..18) 2026-02-24T19:17:38.600 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.592+0000 7fa3a27fc640 3 client.4235.objecter handle_osd_map got epochs [18,18] > 0 2026-02-24T19:17:38.600 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.592+0000 7fa3a27fc640 3 client.4235.objecter handle_osd_map decoding full epoch 18 2026-02-24T19:17:38.600 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.592+0000 7fa3a27fc640 20 client.4235.objecter dump_active .. 0 homeless 2026-02-24T19:17:38.681 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.679+0000 7fa3a27fc640 1 -- 10.20.193.26:0/811349728 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fa3b005cb70 con 0x7fa3b41a7980 2026-02-24T19:17:38.681 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.679+0000 7fa3a27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:38.681 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.679+0000 7fa3a27fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:38.795 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.793+0000 7fa3bc0a7640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:38.795 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.793+0000 7fa3bc0a7640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:38.795 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.793+0000 7fa3bc0a7640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:38.795 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.793+0000 7fa3bc0a7640 1 -- 10.20.193.26:0/811349728 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3b4059640 con 0x7fa3b41a7980 2026-02-24T19:17:38.802 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.801+0000 7fa3a27fc640 1 -- 10.20.193.26:0/811349728 <== mon.2 v1:10.20.193.103:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12877 (unknown 3338201251 0 1129572664) 0x7fa3b005c470 con 0x7fa3b41a7980 2026-02-24T19:17:38.803 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.801+0000 7fa3a27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:38.803 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.801+0000 7fa3a27fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:38.803 INFO:teuthology.misc.health.trial026.stdout: 2026-02-24T19:17:38.803 INFO:teuthology.misc.health.trial026.stdout:{"epoch":18,"fsid":"33b2b598-dbc5-4d7a-8df7-657f0501fe9e","created":"2026-02-24T19:17:21.810535+0000","modified":"2026-02-24T19:17:28.575109+0000","last_up_change":"0.000000","last_in_change":"2026-02-24T19:17:28.575109+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e08ffdb8-0db6-4356-88b5-54397e40be58","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"08b117f7-0152-42bb-8a51-220b41a964ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3c37f6aa-25cb-43be-a75a-86a246086a85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a7e3939e-f8f5-4216-9700-27e229d1c4d9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"445d43ab-a28c-4afa-90ff-e451602e494f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"37303b3f-6b88-4c73-aaff-10055ec5cc85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ef2c9883-f17f-41ec-96b7-dbbe936b77d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3e4a495e-c742-43fc-991a-371a47ff87bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"fb377a45-1ce5-4e07-92cd-7f546cfad57f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"8079b2ca-96c3-4321-9f24-a87e8ea1e883","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"8df004a9-88e3-43f5-833d-dfc73a658ec3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"f3cf3a4b-1c26-480c-ba10-178f8542c1e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"0e06b2e9-9b29-4c6e-ab44-77fd24d945af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"b1cbaf8b-36e9-4196-a08d-e6e72c2229e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"214e8bfc-c78d-45ac-9ec3-7685dd5684cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"8c2eb0c6-abf0-42a7-bcab-83d0c9cf797b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T19:17:38.806 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.804+0000 7fa3bc0a7640 10 librados: watch_flush enter 2026-02-24T19:17:38.806 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.804+0000 7fa3bc0a7640 10 librados: watch_flush exit 2026-02-24T19:17:38.806 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.804+0000 7fa3bc0a7640 20 client.4235.objecter shutdown clearing up homeless session... 2026-02-24T19:17:38.806 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.804+0000 7fa3bc0a7640 10 client.4235.objecter successfully canceled tick 2026-02-24T19:17:38.806 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.804+0000 7fa3bc0a7640 1 -- 10.20.193.26:0/811349728 >> v1:10.20.193.162:6800/3889602630 conn(0x7fa384077e70 legacy=0x7fa384098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:38.806 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.804+0000 7fa3bc0a7640 10 monclient: shutdown 2026-02-24T19:17:38.806 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.804+0000 7fa3bc0a7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:38.807 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.804+0000 7fa3bc0a7640 1 -- 10.20.193.26:0/811349728 >> v1:10.20.193.103:6789/0 conn(0x7fa3b41a7980 legacy=0x7fa3b4188270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:38.807 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.804+0000 7fa3bc0a7640 1 -- 10.20.193.26:0/811349728 shutdown_connections 2026-02-24T19:17:38.807 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.804+0000 7fa3bc0a7640 1 -- 10.20.193.26:0/811349728 >> 10.20.193.26:0/811349728 conn(0x7fa3b40b3830 msgr2=0x7fa3b40b3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:38.807 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.804+0000 7fa3bc0a7640 1 -- 10.20.193.26:0/811349728 shutdown_connections 2026-02-24T19:17:38.807 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.804+0000 7fa3bc0a7640 1 -- 10.20.193.26:0/811349728 wait complete. 2026-02-24T19:17:38.807 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:38.804+0000 7fa3bc0a7640 1 librados: shutdown 2026-02-24T19:17:38.814 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-24T19:17:39.033 INFO:tasks.ceph.osd.4.trial026.stderr:--00:00:00:10.388 44892-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:39.035 INFO:tasks.ceph.osd.12.trial026.stderr:--00:00:00:10.380 44899-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:39.075 INFO:tasks.ceph.osd.2.trial103.stderr:--00:00:00:10.407 44619-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:39.075 INFO:tasks.ceph.osd.10.trial103.stderr:--00:00:00:10.400 44621-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:39.076 INFO:tasks.ceph.osd.14.trial103.stderr:--00:00:00:10.400 44622-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:39.076 INFO:tasks.ceph.osd.6.trial103.stderr:--00:00:00:10.405 44620-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:39.186 INFO:tasks.ceph.osd.1.trial070.stderr:--00:00:00:10.527 44506-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:39.189 INFO:tasks.ceph.osd.9.trial070.stderr:--00:00:00:10.528 44508-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:39.190 INFO:tasks.ceph.osd.15.trial162.stderr:--00:00:00:10.502 45138-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:39.191 INFO:tasks.ceph.osd.3.trial162.stderr:--00:00:00:10.506 45135-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:39.198 INFO:tasks.ceph.osd.13.trial070.stderr:--00:00:00:10.531 44509-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:39.207 INFO:tasks.ceph.osd.0.trial026.stderr:--00:00:00:10.561 44891-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:39.237 INFO:tasks.ceph.osd.8.trial026.stderr:--00:00:00:10.587 44894-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:39.242 INFO:tasks.ceph.osd.5.trial070.stderr:--00:00:00:10.582 44507-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:39.246 INFO:tasks.ceph.osd.7.trial162.stderr:--00:00:00:10.561 45136-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:39.324 INFO:tasks.ceph.osd.11.trial162.stderr:--00:00:00:10.639 45137-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/2a/71fbaf235122720abc4dd581df8a808259025c.debug 2026-02-24T19:17:41.132 INFO:tasks.ceph.osd.4.trial026.stderr:==00:00:00:12.486 44892== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.142 INFO:tasks.ceph.osd.12.trial026.stderr:==00:00:00:12.488 44899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.204 INFO:tasks.ceph.osd.4.trial026.stderr:==00:00:00:12.559 44892== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.213 INFO:tasks.ceph.osd.12.trial026.stderr:==00:00:00:12.559 44899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.218 INFO:tasks.ceph.osd.10.trial103.stderr:==00:00:00:12.544 44621== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.220 INFO:tasks.ceph.osd.2.trial103.stderr:==00:00:00:12.552 44619== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.234 INFO:tasks.ceph.osd.4.trial026.stderr:==00:00:00:12.589 44892== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.242 INFO:tasks.ceph.osd.12.trial026.stderr:==00:00:00:12.588 44899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.247 INFO:tasks.ceph.osd.6.trial103.stderr:==00:00:00:12.576 44620== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.256 INFO:tasks.ceph.osd.14.trial103.stderr:==00:00:00:12.580 44622== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.267 INFO:tasks.ceph.osd.4.trial026.stderr:==00:00:00:12.622 44892== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.278 INFO:tasks.ceph.osd.12.trial026.stderr:==00:00:00:12.624 44899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.296 INFO:tasks.ceph.osd.2.trial103.stderr:==00:00:00:12.629 44619== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.297 INFO:tasks.ceph.osd.10.trial103.stderr:==00:00:00:12.622 44621== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.300 INFO:tasks.ceph.osd.4.trial026.stderr:==00:00:00:12.655 44892== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.308 INFO:tasks.ceph.osd.12.trial026.stderr:==00:00:00:12.654 44899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.315 INFO:tasks.ceph.osd.0.trial026.stderr:==00:00:00:12.670 44891== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.319 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:12.631 45138== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.322 INFO:tasks.ceph.osd.9.trial070.stderr:==00:00:00:12.661 44508== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.324 INFO:tasks.ceph.osd.1.trial070.stderr:==00:00:00:12.665 44506== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.325 INFO:tasks.ceph.osd.6.trial103.stderr:==00:00:00:12.654 44620== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.330 INFO:tasks.ceph.osd.14.trial103.stderr:==00:00:00:12.654 44622== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.330 INFO:tasks.ceph.osd.8.trial026.stderr:==00:00:00:12.680 44894== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.333 INFO:tasks.ceph.osd.2.trial103.stderr:==00:00:00:12.665 44619== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.333 INFO:tasks.ceph.osd.10.trial103.stderr:==00:00:00:12.658 44621== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.340 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:12.655 45135== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.344 INFO:tasks.ceph.osd.4.trial026.stderr:==00:00:00:12.698 44892== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.351 INFO:tasks.ceph.osd.12.trial026.stderr:==00:00:00:12.698 44899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.354 INFO:tasks.ceph.osd.14.trial103.stderr:==00:00:00:12.679 44622== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.354 INFO:tasks.ceph.osd.6.trial103.stderr:==00:00:00:12.683 44620== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.358 INFO:tasks.ceph.osd.2.trial103.stderr:==00:00:00:12.690 44619== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.358 INFO:tasks.ceph.osd.10.trial103.stderr:==00:00:00:12.684 44621== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.359 INFO:tasks.ceph.osd.4.trial026.stderr:==00:00:00:12.713 44892== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.365 INFO:tasks.ceph.osd.13.trial070.stderr:==00:00:00:12.698 44509== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.367 INFO:tasks.ceph.osd.12.trial026.stderr:==00:00:00:12.713 44899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.375 INFO:tasks.ceph.osd.0.trial026.stderr:==00:00:00:12.729 44891== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.381 INFO:tasks.ceph.osd.10.trial103.stderr:==00:00:00:12.706 44621== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.383 INFO:tasks.ceph.osd.6.trial103.stderr:==00:00:00:12.712 44620== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.385 INFO:tasks.ceph.osd.14.trial103.stderr:==00:00:00:12.710 44622== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.386 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:12.701 45136== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.394 INFO:tasks.ceph.osd.2.trial103.stderr:==00:00:00:12.726 44619== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.397 INFO:tasks.ceph.osd.0.trial026.stderr:==00:00:00:12.752 44891== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.400 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:12.712 45138== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.400 INFO:tasks.ceph.osd.8.trial026.stderr:==00:00:00:12.750 44894== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.401 INFO:tasks.ceph.osd.9.trial070.stderr:==00:00:00:12.740 44508== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.402 INFO:tasks.ceph.osd.5.trial070.stderr:==00:00:00:12.743 44507== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.405 INFO:tasks.ceph.osd.1.trial070.stderr:==00:00:00:12.746 44506== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.419 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:12.735 45135== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.422 INFO:tasks.ceph.osd.10.trial103.stderr:==00:00:00:12.747 44621== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.423 INFO:tasks.ceph.osd.6.trial103.stderr:==00:00:00:12.752 44620== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.425 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:12.737 45138== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.426 INFO:tasks.ceph.osd.13.trial070.stderr:==00:00:00:12.759 44509== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.426 INFO:tasks.ceph.osd.14.trial103.stderr:==00:00:00:12.751 44622== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.427 INFO:tasks.ceph.osd.0.trial026.stderr:==00:00:00:12.781 44891== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.427 INFO:tasks.ceph.osd.1.trial070.stderr:==00:00:00:12.767 44506== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.427 INFO:tasks.ceph.osd.9.trial070.stderr:==00:00:00:12.765 44508== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.430 INFO:tasks.ceph.osd.2.trial103.stderr:==00:00:00:12.763 44619== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.431 INFO:tasks.ceph.osd.8.trial026.stderr:==00:00:00:12.781 44894== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.438 INFO:tasks.ceph.osd.10.trial103.stderr:==00:00:00:12.763 44621== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.443 INFO:tasks.ceph.osd.6.trial103.stderr:==00:00:00:12.772 44620== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.445 INFO:tasks.ceph.osd.2.trial103.stderr:==00:00:00:12.777 44619== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.448 INFO:tasks.ceph.osd.1.trial070.stderr:==00:00:00:12.789 44506== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.449 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:12.764 45135== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.451 INFO:tasks.ceph.osd.0.trial026.stderr:==00:00:00:12.806 44891== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.453 INFO:tasks.ceph.osd.13.trial070.stderr:==00:00:00:12.787 44509== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.454 INFO:tasks.ceph.osd.9.trial070.stderr:==00:00:00:12.793 44508== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.455 INFO:tasks.ceph.osd.14.trial103.stderr:==00:00:00:12.780 44622== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.458 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:12.773 45136== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.459 INFO:tasks.ceph.osd.6.trial103.stderr:==00:00:00:12.788 44620== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.462 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:12.774 45138== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.463 INFO:tasks.ceph.osd.8.trial026.stderr:==00:00:00:12.813 44894== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.464 INFO:tasks.ceph.osd.4.trial026.stderr:2026-02-24T19:17:41.459+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:41.470 INFO:tasks.ceph.osd.5.trial070.stderr:==00:00:00:12.810 44507== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.471 INFO:tasks.ceph.osd.14.trial103.stderr:==00:00:00:12.796 44622== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.475 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:12.790 45137== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.480 INFO:tasks.ceph.osd.1.trial070.stderr:==00:00:00:12.819 44506== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.482 INFO:tasks.ceph.osd.12.trial026.stderr:2026-02-24T19:17:41.474+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:41.484 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:12.799 45136== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.487 INFO:tasks.ceph.osd.9.trial070.stderr:==00:00:00:12.826 44508== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.488 INFO:tasks.ceph.osd.13.trial070.stderr:==00:00:00:12.821 44509== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.489 INFO:tasks.ceph.osd.0.trial026.stderr:==00:00:00:12.844 44891== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.494 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:12.809 45135== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.495 INFO:tasks.ceph.osd.8.trial026.stderr:==00:00:00:12.845 44894== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.496 INFO:tasks.ceph.osd.5.trial070.stderr:==00:00:00:12.836 44507== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.505 INFO:tasks.ceph.osd.0.trial026.stderr:==00:00:00:12.859 44891== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.505 INFO:tasks.ceph.osd.1.trial070.stderr:==00:00:00:12.846 44506== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.512 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:12.824 45138== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.517 INFO:tasks.ceph.osd.13.trial070.stderr:==00:00:00:12.851 44509== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.519 INFO:tasks.ceph.osd.9.trial070.stderr:==00:00:00:12.858 44508== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.520 INFO:tasks.ceph.osd.1.trial070.stderr:==00:00:00:12.861 44506== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.522 INFO:tasks.ceph.osd.5.trial070.stderr:==00:00:00:12.863 44507== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.529 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:12.844 45136== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.534 INFO:tasks.ceph.osd.9.trial070.stderr:==00:00:00:12.873 44508== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.537 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:12.852 45135== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.540 INFO:tasks.ceph.osd.2.trial103.stderr:2026-02-24T19:17:41.536+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:41.540 INFO:tasks.ceph.osd.10.trial103.stderr:2026-02-24T19:17:41.536+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:41.541 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:12.855 45137== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.542 INFO:tasks.ceph.osd.8.trial026.stderr:==00:00:00:12.892 44894== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.549 INFO:tasks.ceph.osd.13.trial070.stderr:==00:00:00:12.882 44509== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.549 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:12.861 45138== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.553 INFO:tasks.ceph.osd.6.trial103.stderr:2026-02-24T19:17:41.548+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:41.554 INFO:tasks.ceph.osd.5.trial070.stderr:==00:00:00:12.895 44507== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.555 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:12.870 45136== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.557 INFO:tasks.ceph.osd.8.trial026.stderr:==00:00:00:12.907 44894== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.563 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:12.876 45138== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.564 INFO:tasks.ceph.osd.13.trial070.stderr:==00:00:00:12.897 44509== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.570 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:12.885 45137== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.571 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:12.886 45135== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.575 INFO:tasks.ceph.osd.14.trial103.stderr:2026-02-24T19:17:41.571+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:41.586 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:12.901 45135== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.592 INFO:tasks.ceph.osd.5.trial070.stderr:==00:00:00:12.933 44507== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.597 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:12.912 45136== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.603 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:12.918 45137== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.607 INFO:tasks.ceph.osd.5.trial070.stderr:==00:00:00:12.948 44507== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.612 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:12.927 45136== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.626 INFO:tasks.ceph.osd.1.trial070.stderr:2026-02-24T19:17:41.621+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:41.627 INFO:tasks.ceph.osd.0.trial026.stderr:2026-02-24T19:17:41.622+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:41.640 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:12.955 45137== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.644 INFO:tasks.ceph.osd.9.trial070.stderr:2026-02-24T19:17:41.638+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:41.664 INFO:tasks.ceph.osd.13.trial070.stderr:2026-02-24T19:17:41.658+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:41.684 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:12.999 45137== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.690 INFO:tasks.ceph.osd.8.trial026.stderr:2026-02-24T19:17:41.685+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:41.693 INFO:tasks.ceph.osd.15.trial162.stderr:2026-02-24T19:17:41.688+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:41.698 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:13.013 45137== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.702 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-24T19:17:41.698+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:41.707 INFO:tasks.ceph.osd.5.trial070.stderr:2026-02-24T19:17:41.701+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:41.732 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-24T19:17:41.727+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:41.734 INFO:tasks.ceph.osd.4.trial026.stderr:==00:00:00:13.089 44892== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.746 INFO:tasks.ceph.osd.12.trial026.stderr:==00:00:00:13.092 44899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.804 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-24T19:17:41.800+0000 787f4c0 -1 Falling back to public interface 2026-02-24T19:17:41.810 INFO:tasks.ceph.osd.10.trial103.stderr:==00:00:00:13.135 44621== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.814 INFO:tasks.ceph.osd.2.trial103.stderr:==00:00:00:13.147 44619== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.815 INFO:tasks.ceph.osd.4.trial026.stderr:==00:00:00:13.170 44892== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.825 INFO:tasks.ceph.osd.6.trial103.stderr:==00:00:00:13.154 44620== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.826 INFO:tasks.ceph.osd.12.trial026.stderr:==00:00:00:13.173 44899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.854 INFO:tasks.ceph.osd.14.trial103.stderr:==00:00:00:13.179 44622== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.893 INFO:tasks.ceph.osd.1.trial070.stderr:==00:00:00:13.233 44506== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.894 INFO:tasks.ceph.osd.4.trial026.stderr:==00:00:00:13.249 44892== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.898 INFO:tasks.ceph.osd.0.trial026.stderr:==00:00:00:13.252 44891== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.898 INFO:tasks.ceph.osd.12.trial026.stderr:==00:00:00:13.244 44899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.900 INFO:tasks.ceph.osd.10.trial103.stderr:==00:00:00:13.225 44621== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.911 INFO:tasks.ceph.osd.2.trial103.stderr:==00:00:00:13.243 44619== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.914 INFO:tasks.ceph.osd.6.trial103.stderr:==00:00:00:13.243 44620== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.919 INFO:tasks.ceph.osd.9.trial070.stderr:==00:00:00:13.258 44508== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.935 INFO:tasks.ceph.osd.4.trial026.stderr:==00:00:00:13.290 44892== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.942 INFO:tasks.ceph.osd.14.trial103.stderr:==00:00:00:13.267 44622== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.943 INFO:tasks.ceph.osd.13.trial070.stderr:==00:00:00:13.276 44509== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.948 INFO:tasks.ceph.osd.12.trial026.stderr:==00:00:00:13.294 44899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.960 INFO:tasks.ceph.osd.8.trial026.stderr:==00:00:00:13.310 44894== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.965 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:13.277 45138== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.967 INFO:tasks.ceph.osd.10.trial103.stderr:==00:00:00:13.292 44621== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.967 INFO:tasks.ceph.osd.6.trial103.stderr:==00:00:00:13.297 44620== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.968 INFO:tasks.ceph.osd.2.trial103.stderr:==00:00:00:13.300 44619== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.976 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:13.291 45135== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.984 INFO:tasks.ceph.osd.5.trial070.stderr:==00:00:00:13.325 44507== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.986 INFO:tasks.ceph.osd.6.trial103.stderr:==00:00:00:13.315 44620== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.986 INFO:tasks.ceph.osd.1.trial070.stderr:==00:00:00:13.327 44506== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.992 INFO:tasks.ceph.osd.4.trial026.stderr:==00:00:00:13.346 44892== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.993 INFO:tasks.ceph.osd.0.trial026.stderr:==00:00:00:13.348 44891== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.994 INFO:tasks.ceph.osd.2.trial103.stderr:==00:00:00:13.326 44619== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:41.996 INFO:tasks.ceph.osd.12.trial026.stderr:==00:00:00:13.342 44899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.001 INFO:tasks.ceph.osd.9.trial070.stderr:==00:00:00:13.340 44508== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.002 INFO:tasks.ceph.osd.10.trial103.stderr:==00:00:00:13.328 44621== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.005 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:13.320 45136== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.010 INFO:tasks.ceph.osd.6.trial103.stderr:==00:00:00:13.339 44620== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.012 INFO:tasks.ceph.osd.14.trial103.stderr:==00:00:00:13.336 44622== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.020 INFO:tasks.ceph.osd.2.trial103.stderr:==00:00:00:13.352 44619== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.032 INFO:tasks.ceph.osd.13.trial070.stderr:==00:00:00:13.366 44509== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.035 INFO:tasks.ceph.osd.6.trial103.stderr:==00:00:00:13.364 44620== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.039 INFO:tasks.ceph.osd.4.trial026.stderr:==00:00:00:13.393 44892== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.042 INFO:tasks.ceph.osd.8.trial026.stderr:==00:00:00:13.392 44894== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.043 INFO:tasks.ceph.osd.1.trial070.stderr:==00:00:00:13.384 44506== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.044 INFO:tasks.ceph.osd.12.trial026.stderr:==00:00:00:13.390 44899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.052 INFO:tasks.ceph.osd.2.trial103.stderr:==00:00:00:13.384 44619== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.053 INFO:tasks.ceph.osd.10.trial103.stderr:==00:00:00:13.378 44621== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.054 INFO:tasks.ceph.osd.9.trial070.stderr:==00:00:00:13.393 44508== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.061 INFO:tasks.ceph.osd.14.trial103.stderr:==00:00:00:13.386 44622== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.062 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:13.374 45138== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.070 INFO:tasks.ceph.osd.6.trial103.stderr:==00:00:00:13.399 44620== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.070 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:13.386 45135== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.073 INFO:tasks.ceph.osd.2.trial103.stderr:==00:00:00:13.405 44619== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.077 INFO:tasks.ceph.osd.5.trial070.stderr:==00:00:00:13.417 44507== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.078 INFO:tasks.ceph.osd.0.trial026.stderr:==00:00:00:13.432 44891== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.082 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:13.397 45137== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.085 INFO:tasks.ceph.osd.1.trial070.stderr:==00:00:00:13.426 44506== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.087 INFO:tasks.ceph.osd.4.trial026.stderr:==00:00:00:13.441 44892== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.087 INFO:tasks.ceph.osd.12.trial026.stderr:==00:00:00:13.433 44899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.091 INFO:tasks.ceph.osd.10.trial103.stderr:==00:00:00:13.417 44621== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.097 INFO:tasks.ceph.osd.9.trial070.stderr:==00:00:00:13.436 44508== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.099 INFO:tasks.ceph.osd.13.trial070.stderr:==00:00:00:13.432 44509== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.105 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:13.421 45136== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.108 INFO:tasks.ceph.osd.6.trial103.stderr:==00:00:00:13.437 44620== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.112 INFO:tasks.ceph.osd.2.trial103.stderr:==00:00:00:13.444 44619== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.112 INFO:tasks.ceph.osd.14.trial103.stderr:==00:00:00:13.437 44622== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.114 INFO:tasks.ceph.osd.0.trial026.stderr:==00:00:00:13.468 44891== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.115 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:13.427 45138== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.118 INFO:tasks.ceph.osd.8.trial026.stderr:==00:00:00:13.468 44894== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.121 INFO:tasks.ceph.osd.1.trial070.stderr:==00:00:00:13.462 44506== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.124 INFO:tasks.ceph.osd.10.trial103.stderr:==00:00:00:13.450 44621== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.127 INFO:tasks.ceph.osd.4.trial026.stderr:==00:00:00:13.481 44892== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.127 INFO:tasks.ceph.osd.12.trial026.stderr:==00:00:00:13.473 44899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.133 INFO:tasks.ceph.osd.9.trial070.stderr:==00:00:00:13.472 44508== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.133 INFO:tasks.ceph.osd.13.trial070.stderr:==00:00:00:13.467 44509== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.137 INFO:tasks.ceph.osd.6.trial103.stderr:==00:00:00:13.466 44620== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.137 INFO:tasks.ceph.osd.2.trial103.stderr:==00:00:00:13.469 44619== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.149 INFO:tasks.ceph.osd.0.trial026.stderr:==00:00:00:13.503 44891== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.151 INFO:tasks.ceph.osd.5.trial070.stderr:==00:00:00:13.492 44507== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.152 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:13.464 45138== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.153 INFO:tasks.ceph.osd.8.trial026.stderr:==00:00:00:13.503 44894== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.153 INFO:tasks.ceph.osd.1.trial070.stderr:==00:00:00:13.494 44506== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.155 INFO:tasks.ceph.osd.14.trial103.stderr:==00:00:00:13.480 44622== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.158 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:13.473 45135== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.160 INFO:tasks.ceph.osd.10.trial103.stderr:==00:00:00:13.486 44621== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.162 INFO:tasks.ceph.osd.13.trial070.stderr:==00:00:00:13.496 44509== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.162 INFO:tasks.ceph.osd.9.trial070.stderr:==00:00:00:13.501 44508== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.163 INFO:tasks.ceph.osd.4.trial026.stderr:==00:00:00:13.517 44892== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.166 INFO:tasks.ceph.osd.12.trial026.stderr:==00:00:00:13.512 44899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.174 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:13.489 45137== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.180 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:13.492 45138== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.183 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:13.498 45136== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.190 INFO:tasks.ceph.osd.0.trial026.stderr:==00:00:00:13.544 44891== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.190 INFO:tasks.ceph.osd.1.trial070.stderr:==00:00:00:13.531 44506== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.193 INFO:tasks.ceph.osd.8.trial026.stderr:==00:00:00:13.544 44894== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.195 INFO:tasks.ceph.osd.9.trial070.stderr:==00:00:00:13.534 44508== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.195 INFO:tasks.ceph.osd.13.trial070.stderr:==00:00:00:13.528 44509== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.196 INFO:tasks.ceph.osd.5.trial070.stderr:==00:00:00:13.536 44507== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.196 INFO:tasks.ceph.osd.14.trial103.stderr:==00:00:00:13.521 44622== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.200 INFO:tasks.ceph.osd.10.trial103.stderr:==00:00:00:13.526 44621== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.207 INFO:tasks.ceph.osd.1.trial070.stderr:==00:00:00:13.548 44506== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.207 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:13.523 45135== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.215 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:13.527 45138== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.215 INFO:tasks.ceph.osd.13.trial070.stderr:==00:00:00:13.548 44509== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.219 INFO:tasks.ceph.osd.9.trial070.stderr:==00:00:00:13.558 44508== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.228 INFO:tasks.ceph.osd.5.trial070.stderr:==00:00:00:13.568 44507== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.228 INFO:tasks.ceph.osd.1.trial070.stderr:==00:00:00:13.569 44506== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.229 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:13.544 45136== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.236 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:13.548 45138== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.237 INFO:tasks.ceph.osd.0.trial026.stderr:==00:00:00:13.591 44891== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.237 INFO:tasks.ceph.osd.8.trial026.stderr:==00:00:00:13.587 44894== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.245 INFO:tasks.ceph.osd.14.trial103.stderr:==00:00:00:13.570 44622== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.247 INFO:tasks.ceph.osd.13.trial070.stderr:==00:00:00:13.580 44509== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.251 INFO:tasks.ceph.osd.9.trial070.stderr:==00:00:00:13.590 44508== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.252 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:13.567 45135== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.253 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:13.568 45137== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.263 INFO:tasks.ceph.osd.6.trial103.stderr:==00:00:00:13.592 44620== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.263 INFO:tasks.ceph.osd.0.trial026.stderr:==00:00:00:13.618 44891== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.264 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:13.576 45138== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.265 INFO:tasks.ceph.osd.5.trial070.stderr:==00:00:00:13.605 44507== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.268 INFO:tasks.ceph.osd.2.trial103.stderr:==00:00:00:13.600 44619== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.271 INFO:tasks.ceph.osd.8.trial026.stderr:==00:00:00:13.621 44894== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.271 INFO:tasks.ceph.osd.13.trial070.stderr:==00:00:00:13.604 44509== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.273 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:13.588 45136== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.278 INFO:tasks.ceph.osd.14.trial103.stderr:==00:00:00:13.603 44622== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.294 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:13.609 45137== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.302 INFO:tasks.ceph.osd.12.trial026.stderr:==00:00:00:13.648 44899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.302 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:13.618 45135== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.304 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:13.616 45138== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.309 INFO:tasks.ceph.osd.5.trial070.stderr:==00:00:00:13.649 44507== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.310 INFO:tasks.ceph.osd.4.trial026.stderr:==00:00:00:13.665 44892== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.313 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:13.629 45136== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.314 INFO:tasks.ceph.osd.8.trial026.stderr:==00:00:00:13.664 44894== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.314 INFO:tasks.ceph.osd.0.trial026.stderr:==00:00:00:13.668 44891== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.316 INFO:tasks.ceph.osd.6.trial103.stderr:==00:00:00:13.645 44620== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.320 INFO:tasks.ceph.osd.2.trial103.stderr:==00:00:00:13.652 44619== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.334 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:13.649 45137== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.342 INFO:tasks.ceph.osd.12.trial026.stderr:==00:00:00:13.688 44899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.345 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:13.660 45135== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.346 INFO:tasks.ceph.osd.1.trial070.stderr:==00:00:00:13.687 44506== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.347 INFO:tasks.ceph.osd.8.trial026.stderr:==00:00:00:13.697 44894== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.350 INFO:tasks.ceph.osd.6.trial103.stderr:==00:00:00:13.679 44620== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.353 INFO:tasks.ceph.osd.4.trial026.stderr:==00:00:00:13.708 44892== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.354 INFO:tasks.ceph.osd.2.trial103.stderr:==00:00:00:13.686 44619== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.357 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:13.672 45136== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.358 INFO:tasks.ceph.osd.10.trial103.stderr:==00:00:00:13.683 44621== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.366 INFO:tasks.ceph.osd.9.trial070.stderr:==00:00:00:13.705 44508== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.367 INFO:tasks.ceph.osd.5.trial070.stderr:==00:00:00:13.708 44507== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.373 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:13.688 45137== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.376 INFO:tasks.ceph.osd.12.trial026.stderr:==00:00:00:13.722 44899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.386 INFO:tasks.ceph.osd.6.trial103.stderr:==00:00:00:13.715 44620== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.386 INFO:tasks.ceph.osd.2.trial103.stderr:==00:00:00:13.718 44619== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.389 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:13.705 45135== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.390 INFO:tasks.ceph.osd.2.trial103.stderr:==00:00:00:13.723 44619== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.391 INFO:tasks.ceph.osd.6.trial103.stderr:==00:00:00:13.720 44620== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.394 INFO:tasks.ceph.osd.13.trial070.stderr:==00:00:00:13.727 44509== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.406 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:13.722 45136== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.408 INFO:tasks.ceph.osd.4.trial026.stderr:==00:00:00:13.762 44892== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.408 INFO:tasks.ceph.osd.1.trial070.stderr:==00:00:00:13.749 44506== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.412 INFO:tasks.ceph.osd.10.trial103.stderr:==00:00:00:13.738 44621== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.421 INFO:tasks.ceph.osd.14.trial103.stderr:==00:00:00:13.746 44622== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.422 INFO:tasks.ceph.osd.5.trial070.stderr:==00:00:00:13.763 44507== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.423 INFO:tasks.ceph.osd.12.trial026.stderr:==00:00:00:13.769 44899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.427 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:13.739 45138== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.428 INFO:tasks.ceph.osd.12.trial026.stderr:==00:00:00:13.774 44899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.428 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:13.743 45137== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.433 INFO:tasks.ceph.osd.9.trial070.stderr:==00:00:00:13.772 44508== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.443 INFO:tasks.ceph.osd.4.trial026.stderr:==00:00:00:13.798 44892== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.444 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:13.760 45135== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.445 INFO:tasks.ceph.osd.1.trial070.stderr:==00:00:00:13.785 44506== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.448 INFO:tasks.ceph.osd.10.trial103.stderr:==00:00:00:13.773 44621== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.448 INFO:tasks.ceph.osd.4.trial026.stderr:==00:00:00:13.803 44892== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.452 INFO:tasks.ceph.osd.0.trial026.stderr:==00:00:00:13.806 44891== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.453 INFO:tasks.ceph.osd.13.trial070.stderr:==00:00:00:13.786 44509== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.462 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:13.778 45136== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.463 INFO:tasks.ceph.osd.9.trial070.stderr:==00:00:00:13.802 44508== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.469 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:13.784 45137== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.471 INFO:tasks.ceph.osd.1.trial070.stderr:==00:00:00:13.812 44506== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.473 INFO:tasks.ceph.osd.14.trial103.stderr:==00:00:00:13.798 44622== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.475 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:13.787 45138== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.477 INFO:tasks.ceph.osd.1.trial070.stderr:==00:00:00:13.817 44506== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.480 INFO:tasks.ceph.osd.10.trial103.stderr:==00:00:00:13.805 44621== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.485 INFO:tasks.ceph.osd.10.trial103.stderr:==00:00:00:13.810 44621== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.487 INFO:tasks.ceph.osd.13.trial070.stderr:==00:00:00:13.821 44509== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.491 INFO:tasks.ceph.osd.8.trial026.stderr:==00:00:00:13.841 44894== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.498 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:13.810 45138== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.507 INFO:tasks.ceph.osd.0.trial026.stderr:==00:00:00:13.861 44891== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.507 INFO:tasks.ceph.osd.9.trial070.stderr:==00:00:00:13.846 44508== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.507 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:13.822 45137== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.512 INFO:tasks.ceph.osd.9.trial070.stderr:==00:00:00:13.851 44508== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.516 INFO:tasks.ceph.osd.14.trial103.stderr:==00:00:00:13.841 44622== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.530 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:13.842 45138== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.530 INFO:tasks.ceph.osd.13.trial070.stderr:==00:00:00:13.863 44509== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.534 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:13.846 45138== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.535 INFO:tasks.ceph.osd.13.trial070.stderr:==00:00:00:13.868 44509== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.542 INFO:tasks.ceph.osd.0.trial026.stderr:==00:00:00:13.897 44891== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.552 INFO:tasks.ceph.osd.8.trial026.stderr:==00:00:00:13.902 44894== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.555 INFO:tasks.ceph.osd.14.trial103.stderr:==00:00:00:13.880 44622== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.561 INFO:tasks.ceph.osd.14.trial103.stderr:==00:00:00:13.885 44622== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.565 INFO:tasks.ceph.osd.5.trial070.stderr:==00:00:00:13.905 44507== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.579 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:13.894 45135== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.579 INFO:tasks.ceph.osd.0.trial026.stderr:==00:00:00:13.933 44891== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.584 INFO:tasks.ceph.osd.0.trial026.stderr:==00:00:00:13.938 44891== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.595 INFO:tasks.ceph.osd.8.trial026.stderr:==00:00:00:13.945 44894== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.605 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:13.920 45136== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.622 INFO:tasks.ceph.osd.5.trial070.stderr:==00:00:00:13.962 44507== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.631 INFO:tasks.ceph.osd.8.trial026.stderr:==00:00:00:13.981 44894== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.636 INFO:tasks.ceph.osd.8.trial026.stderr:==00:00:00:13.986 44894== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.638 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:13.953 45135== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.657 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:13.972 45137== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.662 INFO:tasks.ceph.osd.5.trial070.stderr:==00:00:00:14.003 44507== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.665 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:13.980 45136== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.677 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:13.992 45135== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.698 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:14.013 45136== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.699 INFO:tasks.ceph.osd.5.trial070.stderr:==00:00:00:14.040 44507== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.704 INFO:tasks.ceph.osd.5.trial070.stderr:==00:00:00:14.045 44507== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.705 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:14.020 45135== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.709 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:14.025 45135== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.720 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:14.035 45137== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.727 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:14.042 45136== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.731 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:14.046 45136== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.757 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:14.072 45137== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.797 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:14.111 45137== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:42.802 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:14.117 45137== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:44.667 INFO:tasks.ceph.osd.2.trial103.stderr:==00:00:00:15.999 44619== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:44.668 INFO:tasks.ceph.osd.6.trial103.stderr:==00:00:00:15.996 44620== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:44.730 INFO:tasks.ceph.osd.12.trial026.stderr:==00:00:00:16.076 44899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:44.731 INFO:tasks.ceph.osd.4.trial026.stderr:==00:00:00:16.085 44892== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:44.739 INFO:tasks.ceph.osd.1.trial070.stderr:==00:00:00:16.080 44506== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:44.763 INFO:tasks.ceph.osd.10.trial103.stderr:==00:00:00:16.088 44621== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:44.777 INFO:tasks.ceph.osd.9.trial070.stderr:==00:00:00:16.116 44508== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:44.784 INFO:tasks.ceph.osd.13.trial070.stderr:==00:00:00:16.117 44509== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:44.828 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:16.140 45138== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:44.846 INFO:tasks.ceph.osd.14.trial103.stderr:==00:00:00:16.171 44622== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:44.870 INFO:tasks.ceph.osd.0.trial026.stderr:==00:00:00:16.225 44891== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:44.924 INFO:tasks.ceph.osd.8.trial026.stderr:==00:00:00:16.274 44894== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:45.003 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:16.318 45135== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:45.005 INFO:tasks.ceph.osd.5.trial070.stderr:==00:00:00:16.346 44507== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:45.020 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:16.336 45136== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:45.105 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:16.420 45137== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:46.420 DEBUG:teuthology.orchestra.run.trial026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-24T19:17:46.484 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.482+0000 7f05f627b640 10 monclient: get_monmap_and_config 2026-02-24T19:17:46.484 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.482+0000 7f05f627b640 10 monclient: build_initial_monmap 2026-02-24T19:17:46.484 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.482+0000 7f05f627b640 10 monclient: monmap: 2026-02-24T19:17:46.484 INFO:teuthology.misc.health.trial026.stderr:epoch 0 2026-02-24T19:17:46.484 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:46.484 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:17:46.484260+0000 2026-02-24T19:17:46.484 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:17:46.484260+0000 2026-02-24T19:17:46.484 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:46.484 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:17:46.484 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:46.484 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:46.484 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:46.484 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:46.484 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.482+0000 7f05f627b640 1 Processor -- start 2026-02-24T19:17:46.484 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.483+0000 7f05f627b640 1 -- start start 2026-02-24T19:17:46.484 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.483+0000 7f05f627b640 10 monclient: init 2026-02-24T19:17:46.485 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.483+0000 7f05f627b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:46.485 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.483+0000 7f05f627b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:46.485 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.483+0000 7f05f627b640 10 monclient(hunting): picked mon.noname-b con 0x7f05f0058da0 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:46.485 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.483+0000 7f05f627b640 10 monclient(hunting): picked mon.noname-c con 0x7f05f00b0410 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:46.485 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.483+0000 7f05f627b640 10 monclient(hunting): picked mon.noname-a con 0x7f05f01626a0 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:46.485 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.483+0000 7f05f627b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f01655c0 con 0x7f05f01626a0 2026-02-24T19:17:46.485 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.483+0000 7f05f627b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f00b12b0 con 0x7f05f0058da0 2026-02-24T19:17:46.485 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.483+0000 7f05f627b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f00b1590 con 0x7f05f00b0410 2026-02-24T19:17:46.485 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.483+0000 7f05f627b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:46.485 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.483+0000 7f05f627b640 10 monclient(hunting): authenticate will time out at 3649.166580s 2026-02-24T19:17:46.485 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.483+0000 7f05effff640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f05f01626a0 0x7f05f01c6d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:41516/0 (socket says 10.20.193.26:41516) 2026-02-24T19:17:46.485 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.483+0000 7f05effff640 1 -- 10.20.193.26:0/997262700 learned_addr learned my addr 10.20.193.26:0/997262700 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:17:46.486 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.485+0000 7f05ee7fc640 1 -- 10.20.193.26:0/997262700 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3429529571 0 0) 0x7f05f01655c0 con 0x7f05f01626a0 2026-02-24T19:17:46.487 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.485+0000 7f05ee7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:46.487 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.485+0000 7f05ee7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:46.487 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.485+0000 7f05ee7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:46.487 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.485+0000 7f05ee7fc640 10 monclient(hunting): my global_id is 4284 2026-02-24T19:17:46.487 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.485+0000 7f05ee7fc640 1 -- 10.20.193.26:0/997262700 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05d4003610 con 0x7f05f01626a0 2026-02-24T19:17:46.487 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.485+0000 7f05ee7fc640 1 -- 10.20.193.26:0/997262700 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3927631667 0 0) 0x7f05f00b12b0 con 0x7f05f0058da0 2026-02-24T19:17:46.487 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.485+0000 7f05ee7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:46.487 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.485+0000 7f05ee7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:46.487 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.485+0000 7f05ee7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:46.487 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.485+0000 7f05ee7fc640 10 monclient(hunting): my global_id is 4267 2026-02-24T19:17:46.487 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.485+0000 7f05ee7fc640 1 -- 10.20.193.26:0/997262700 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05f01655c0 con 0x7f05f0058da0 2026-02-24T19:17:46.487 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.485+0000 7f05ee7fc640 1 -- 10.20.193.26:0/997262700 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 514818384 0 0) 0x7f05f00b1590 con 0x7f05f00b0410 2026-02-24T19:17:46.487 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.485+0000 7f05ee7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:17:46.487 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.485+0000 7f05ee7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:46.487 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.485+0000 7f05ee7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:46.487 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.485+0000 7f05ee7fc640 10 monclient(hunting): my global_id is 4286 2026-02-24T19:17:46.487 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.485+0000 7f05ee7fc640 1 -- 10.20.193.26:0/997262700 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05f00b12b0 con 0x7f05f00b0410 2026-02-24T19:17:46.488 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.486+0000 7f05ee7fc640 1 -- 10.20.193.26:0/997262700 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 848159873 0 0) 0x7f05d4003610 con 0x7f05f01626a0 2026-02-24T19:17:46.488 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.486+0000 7f05ee7fc640 1 -- 10.20.193.26:0/997262700 >> v1:10.20.193.103:6789/0 conn(0x7f05f00b0410 legacy=0x7f05f0164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:46.488 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.486+0000 7f05ee7fc640 1 -- 10.20.193.26:0/997262700 >> v1:10.20.193.70:6789/0 conn(0x7f05f0058da0 legacy=0x7f05f01647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:46.488 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.486+0000 7f05ee7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:17:46.488 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.486+0000 7f05ee7fc640 1 monclient: found mon.noname-a 2026-02-24T19:17:46.488 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.486+0000 7f05ee7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:46.488 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.486+0000 7f05ee7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:17:46.488 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.486+0000 7f05ee7fc640 1 -- 10.20.193.26:0/997262700 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f00b1870 con 0x7f05f01626a0 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.486+0000 7f05ee7fc640 10 monclient: _finish_auth 0 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.486+0000 7f05ee7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.486+0000 7f05ee7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.486+0000 7f05ee7fc640 1 -- 10.20.193.26:0/997262700 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f05e4003170 con 0x7f05f01626a0 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.486+0000 7f05f627b640 5 monclient: authenticate success, global_id 4284 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.486+0000 7f05f627b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.486+0000 7f05ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.486+0000 7f05ee7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.486+0000 7f05ee7fc640 10 monclient: dump: 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.486+0000 7f05f627b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.487+0000 7f05ee7fc640 1 -- 10.20.193.26:0/997262700 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f05e4003340 con 0x7f05f01626a0 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.487+0000 7f05ee7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.487+0000 7f05ee7fc640 1 -- 10.20.193.26:0/997262700 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f05e4003780 con 0x7f05f01626a0 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.487+0000 7f05ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.487+0000 7f05ee7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.487+0000 7f05ee7fc640 10 monclient: dump: 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:46.489 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:46.490 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.487+0000 7f05f627b640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:46.490 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.487+0000 7f05f627b640 4 set_mon_vals no callback set 2026-02-24T19:17:46.490 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.487+0000 7f05f627b640 10 monclient: shutdown 2026-02-24T19:17:46.490 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.487+0000 7f05f627b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:46.490 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.487+0000 7f05f627b640 1 -- 10.20.193.26:0/997262700 >> v1:10.20.193.26:6789/0 conn(0x7f05f01626a0 legacy=0x7f05f01c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:46.490 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.488+0000 7f05f627b640 1 -- 10.20.193.26:0/997262700 shutdown_connections 2026-02-24T19:17:46.490 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.488+0000 7f05f627b640 1 -- 10.20.193.26:0/997262700 >> 10.20.193.26:0/997262700 conn(0x7f05f00b65f0 msgr2=0x7f05f00b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:46.490 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.488+0000 7f05f627b640 1 -- 10.20.193.26:0/997262700 shutdown_connections 2026-02-24T19:17:46.490 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.488+0000 7f05f627b640 1 -- 10.20.193.26:0/997262700 wait complete. 2026-02-24T19:17:46.490 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.488+0000 7f05f627b640 10 monclient: build_initial_monmap 2026-02-24T19:17:46.490 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.488+0000 7f05f627b640 10 monclient: monmap: 2026-02-24T19:17:46.490 INFO:teuthology.misc.health.trial026.stderr:epoch 0 2026-02-24T19:17:46.490 INFO:teuthology.misc.health.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:46.490 INFO:teuthology.misc.health.trial026.stderr:last_changed 0.000000 2026-02-24T19:17:46.490 INFO:teuthology.misc.health.trial026.stderr:created 0.000000 2026-02-24T19:17:46.490 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:46.490 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 1 2026-02-24T19:17:46.490 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:46.490 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:46.490 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:46.490 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:46.490 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.488+0000 7f05f627b640 1 librados: starting msgr at 2026-02-24T19:17:46.490 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.488+0000 7f05f627b640 1 librados: starting objecter 2026-02-24T19:17:46.491 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.488+0000 7f05f627b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:46.491 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.488+0000 7f05f627b640 1 Processor -- start 2026-02-24T19:17:46.491 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.488+0000 7f05f627b640 1 -- start start 2026-02-24T19:17:46.491 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.488+0000 7f05f627b640 1 librados: setting wanted keys 2026-02-24T19:17:46.491 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.488+0000 7f05f627b640 1 librados: calling monclient init 2026-02-24T19:17:46.491 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.488+0000 7f05f627b640 10 monclient: init 2026-02-24T19:17:46.491 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.489+0000 7f05f627b640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:46.491 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.489+0000 7f05f627b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:17:46.491 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.489+0000 7f05f627b640 10 monclient(hunting): picked mon.noname-b con 0x7f05f0058da0 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:46.491 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.489+0000 7f05f627b640 10 monclient(hunting): picked mon.noname-c con 0x7f05f00b0410 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:46.491 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.489+0000 7f05f627b640 10 monclient(hunting): picked mon.noname-a con 0x7f05f01626a0 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:46.491 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.489+0000 7f05f627b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f01f8c10 con 0x7f05f01626a0 2026-02-24T19:17:46.491 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.489+0000 7f05f627b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f0139470 con 0x7f05f0058da0 2026-02-24T19:17:46.491 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.489+0000 7f05f627b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f0139750 con 0x7f05f00b0410 2026-02-24T19:17:46.491 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.489+0000 7f05f627b640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:46.491 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.489+0000 7f05f627b640 10 monclient(hunting): authenticate will time out at 3649.172294s 2026-02-24T19:17:46.491 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.489+0000 7f05ef7fe640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f05f0058da0 0x7f05f0138c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:35478/0 (socket says 10.20.193.26:35478) 2026-02-24T19:17:46.491 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.489+0000 7f05ef7fe640 1 -- 10.20.193.26:0/3081489189 learned_addr learned my addr 10.20.193.26:0/3081489189 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:17:46.491 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.489+0000 7f05cbfff640 10 client.?.objecter ms_handle_connect 0x7f05f0058da0 2026-02-24T19:17:46.491 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.489+0000 7f05cbfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:46.491 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.489+0000 7f05cbfff640 10 client.?.objecter ms_handle_connect 0x7f05f00b0410 2026-02-24T19:17:46.491 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.489+0000 7f05cbfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:46.492 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.490+0000 7f05cbfff640 10 client.?.objecter ms_handle_connect 0x7f05f01626a0 2026-02-24T19:17:46.492 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.490+0000 7f05cbfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:46.492 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.490+0000 7f05cbfff640 1 -- 10.20.193.26:0/3081489189 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 510431409 0 0) 0x7f05f0139750 con 0x7f05f00b0410 2026-02-24T19:17:46.493 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.490+0000 7f05cbfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:46.493 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.490+0000 7f05cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:46.493 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.490+0000 7f05cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:46.493 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.490+0000 7f05cbfff640 10 monclient(hunting): my global_id is 4289 2026-02-24T19:17:46.493 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.491+0000 7f05cbfff640 1 -- 10.20.193.26:0/3081489189 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05c0003610 con 0x7f05f00b0410 2026-02-24T19:17:46.493 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.491+0000 7f05cbfff640 1 -- 10.20.193.26:0/3081489189 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 420053352 0 0) 0x7f05f0139470 con 0x7f05f0058da0 2026-02-24T19:17:46.493 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.491+0000 7f05cbfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:46.493 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.491+0000 7f05cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:46.493 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.491+0000 7f05cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:46.493 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.491+0000 7f05cbfff640 10 monclient(hunting): my global_id is 4270 2026-02-24T19:17:46.493 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.491+0000 7f05cbfff640 1 -- 10.20.193.26:0/3081489189 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05f0139750 con 0x7f05f0058da0 2026-02-24T19:17:46.494 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.492+0000 7f05cbfff640 1 -- 10.20.193.26:0/3081489189 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1398129758 0 0) 0x7f05f01f8c10 con 0x7f05f01626a0 2026-02-24T19:17:46.494 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.492+0000 7f05cbfff640 10 monclient(hunting): _negotiate 2026-02-24T19:17:46.494 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.492+0000 7f05cbfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:46.494 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.492+0000 7f05cbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:46.494 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.492+0000 7f05cbfff640 10 monclient(hunting): my global_id is 4287 2026-02-24T19:17:46.494 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.492+0000 7f05cbfff640 1 -- 10.20.193.26:0/3081489189 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05f0139470 con 0x7f05f01626a0 2026-02-24T19:17:46.495 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.493+0000 7f05cbfff640 1 -- 10.20.193.26:0/3081489189 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1901850892 0 0) 0x7f05c0003610 con 0x7f05f00b0410 2026-02-24T19:17:46.495 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.493+0000 7f05cbfff640 1 -- 10.20.193.26:0/3081489189 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f05f01f8c10 con 0x7f05f00b0410 2026-02-24T19:17:46.495 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.493+0000 7f05cbfff640 1 -- 10.20.193.26:0/3081489189 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f05e0003060 con 0x7f05f00b0410 2026-02-24T19:17:46.495 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.493+0000 7f05cbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:46.495 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.493+0000 7f05cbfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:17:46.495 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.493+0000 7f05cbfff640 10 monclient(hunting): dump: 2026-02-24T19:17:46.495 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:17:46.495 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:46.495 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:46.495 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:46.495 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:46.495 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:17:46.495 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:46.495 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:46.495 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:46.495 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:46.495 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.493+0000 7f05cbfff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:46.496 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.494+0000 7f05cbfff640 1 -- 10.20.193.26:0/3081489189 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1980119697 0 0) 0x7f05f0139750 con 0x7f05f0058da0 2026-02-24T19:17:46.496 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.494+0000 7f05cbfff640 1 -- 10.20.193.26:0/3081489189 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f05c0003610 con 0x7f05f0058da0 2026-02-24T19:17:46.496 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.494+0000 7f05cbfff640 1 -- 10.20.193.26:0/3081489189 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f05dc003170 con 0x7f05f0058da0 2026-02-24T19:17:46.496 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.494+0000 7f05cbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:46.496 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.494+0000 7f05cbfff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:17:46.496 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.494+0000 7f05cbfff640 10 monclient(hunting): dump: 2026-02-24T19:17:46.496 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:17:46.496 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:46.496 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:46.496 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:46.496 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:46.496 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:17:46.496 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:46.496 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:46.496 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:46.496 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:46.497 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.495+0000 7f05cbfff640 1 -- 10.20.193.26:0/3081489189 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3240662351 0 0) 0x7f05f0139470 con 0x7f05f01626a0 2026-02-24T19:17:46.497 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.495+0000 7f05cbfff640 1 -- 10.20.193.26:0/3081489189 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f05f0139750 con 0x7f05f01626a0 2026-02-24T19:17:46.497 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.495+0000 7f05cbfff640 1 -- 10.20.193.26:0/3081489189 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f05e4003690 con 0x7f05f01626a0 2026-02-24T19:17:46.497 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.495+0000 7f05cbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:46.497 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.495+0000 7f05cbfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:46.497 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.495+0000 7f05cbfff640 10 monclient(hunting): dump: 2026-02-24T19:17:46.497 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:17:46.497 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:46.497 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:46.497 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:46.497 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:46.497 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:17:46.497 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:46.497 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:46.497 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:46.497 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:46.497 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.495+0000 7f05cbfff640 1 -- 10.20.193.26:0/3081489189 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1822515000 0 0) 0x7f05f01f8c10 con 0x7f05f00b0410 2026-02-24T19:17:46.497 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.495+0000 7f05cbfff640 1 -- 10.20.193.26:0/3081489189 >> v1:10.20.193.70:6789/0 conn(0x7f05f0058da0 legacy=0x7f05f0138c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:46.497 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.495+0000 7f05cbfff640 1 -- 10.20.193.26:0/3081489189 >> v1:10.20.193.26:6789/0 conn(0x7f05f01626a0 legacy=0x7f05f0159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:46.497 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.495+0000 7f05cbfff640 10 monclient: _finish_hunting 0 2026-02-24T19:17:46.497 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.495+0000 7f05cbfff640 1 monclient: found mon.c 2026-02-24T19:17:46.497 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.495+0000 7f05cbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:46.497 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.495+0000 7f05cbfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:46.497 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.495+0000 7f05cbfff640 1 -- 10.20.193.26:0/3081489189 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f01f8e80 con 0x7f05f00b0410 2026-02-24T19:17:46.498 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.495+0000 7f05cbfff640 10 monclient: _finish_auth 0 2026-02-24T19:17:46.498 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.495+0000 7f05cbfff640 10 monclient: _check_auth_tickets 2026-02-24T19:17:46.498 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.495+0000 7f05cbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:46.498 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.495+0000 7f05f627b640 5 monclient: authenticate success, global_id 4289 2026-02-24T19:17:46.498 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.495+0000 7f05f627b640 10 monclient: _renew_subs 2026-02-24T19:17:46.498 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.495+0000 7f05f627b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:46.498 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.495+0000 7f05f627b640 1 -- 10.20.193.26:0/3081489189 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f05f01f9160 con 0x7f05f00b0410 2026-02-24T19:17:46.498 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.495+0000 7f05f627b640 10 client.4289.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:46.498 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.495+0000 7f05f627b640 10 monclient: _renew_subs 2026-02-24T19:17:46.498 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.495+0000 7f05f627b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:46.498 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.495+0000 7f05f627b640 1 -- 10.20.193.26:0/3081489189 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f05f0139a30 con 0x7f05f00b0410 2026-02-24T19:17:46.498 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.495+0000 7f05f627b640 1 librados: init done 2026-02-24T19:17:46.498 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.496+0000 7f05f627b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:46.498 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.496+0000 7f05f627b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:46.498 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.496+0000 7f05f627b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:46.498 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.496+0000 7f05f627b640 1 -- 10.20.193.26:0/3081489189 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05f015ebd0 con 0x7f05f00b0410 2026-02-24T19:17:46.505 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.503+0000 7f05cbfff640 1 -- 10.20.193.26:0/3081489189 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f05e0003200 con 0x7f05f00b0410 2026-02-24T19:17:46.505 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.503+0000 7f05cbfff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:46.505 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.503+0000 7f05cbfff640 1 -- 10.20.193.26:0/3081489189 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f05e0003920 con 0x7f05f00b0410 2026-02-24T19:17:46.505 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.503+0000 7f05cbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:46.505 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.503+0000 7f05edffb640 4 set_mon_vals no callback set 2026-02-24T19:17:46.505 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.503+0000 7f05cbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:46.505 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.503+0000 7f05cbfff640 10 monclient: dump: 2026-02-24T19:17:46.505 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:17:46.505 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:46.505 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:46.505 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:46.505 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:46.505 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:17:46.505 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:46.505 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:46.505 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:46.506 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:46.506 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.504+0000 7f05cbfff640 1 -- 10.20.193.26:0/3081489189 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 3958291397 0 0) 0x7f05e001c750 con 0x7f05f00b0410 2026-02-24T19:17:46.506 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.505+0000 7f05ef7fe640 10 monclient: get_auth_request con 0x7f05c0077d90 auth_method 0 2026-02-24T19:17:46.507 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.505+0000 7f05cbfff640 10 client.4289.objecter ms_handle_connect 0x7f05c0077d90 2026-02-24T19:17:46.507 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.505+0000 7f05cbfff640 1 -- 10.20.193.26:0/3081489189 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 2560+0+0 (unknown 77300011 0 0) 0x7f05e0058280 con 0x7f05f00b0410 2026-02-24T19:17:46.507 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.505+0000 7f05cbfff640 10 client.4289.objecter ms_dispatch2 0x7f05f0000b90 osd_map(18..18 src has 1..18) 2026-02-24T19:17:46.507 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.505+0000 7f05cbfff640 3 client.4289.objecter handle_osd_map got epochs [18,18] > 0 2026-02-24T19:17:46.507 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.505+0000 7f05cbfff640 3 client.4289.objecter handle_osd_map decoding full epoch 18 2026-02-24T19:17:46.507 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.505+0000 7f05cbfff640 20 client.4289.objecter dump_active .. 0 homeless 2026-02-24T19:17:46.597 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.595+0000 7f05cbfff640 1 -- 10.20.193.26:0/3081489189 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f05e005c9f0 con 0x7f05f00b0410 2026-02-24T19:17:46.597 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.595+0000 7f05cbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:46.597 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.595+0000 7f05cbfff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:46.711 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.710+0000 7f05f627b640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:46.711 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.710+0000 7f05f627b640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:46.711 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.710+0000 7f05f627b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:46.711 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.710+0000 7f05f627b640 1 -- 10.20.193.26:0/3081489189 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05f01639c0 con 0x7f05f00b0410 2026-02-24T19:17:46.720 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.718+0000 7f05cbfff640 1 -- 10.20.193.26:0/3081489189 <== mon.2 v1:10.20.193.103:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12877 (unknown 3338201251 0 1129572664) 0x7f05e005c2f0 con 0x7f05f00b0410 2026-02-24T19:17:46.720 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.718+0000 7f05cbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:46.720 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.718+0000 7f05cbfff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:46.720 INFO:teuthology.misc.health.trial026.stdout: 2026-02-24T19:17:46.720 INFO:teuthology.misc.health.trial026.stdout:{"epoch":18,"fsid":"33b2b598-dbc5-4d7a-8df7-657f0501fe9e","created":"2026-02-24T19:17:21.810535+0000","modified":"2026-02-24T19:17:28.575109+0000","last_up_change":"0.000000","last_in_change":"2026-02-24T19:17:28.575109+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e08ffdb8-0db6-4356-88b5-54397e40be58","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"08b117f7-0152-42bb-8a51-220b41a964ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3c37f6aa-25cb-43be-a75a-86a246086a85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a7e3939e-f8f5-4216-9700-27e229d1c4d9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"445d43ab-a28c-4afa-90ff-e451602e494f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"37303b3f-6b88-4c73-aaff-10055ec5cc85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ef2c9883-f17f-41ec-96b7-dbbe936b77d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3e4a495e-c742-43fc-991a-371a47ff87bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"fb377a45-1ce5-4e07-92cd-7f546cfad57f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"8079b2ca-96c3-4321-9f24-a87e8ea1e883","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"8df004a9-88e3-43f5-833d-dfc73a658ec3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"f3cf3a4b-1c26-480c-ba10-178f8542c1e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"0e06b2e9-9b29-4c6e-ab44-77fd24d945af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"b1cbaf8b-36e9-4196-a08d-e6e72c2229e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"214e8bfc-c78d-45ac-9ec3-7685dd5684cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"8c2eb0c6-abf0-42a7-bcab-83d0c9cf797b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T19:17:46.723 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.720+0000 7f05f627b640 10 librados: watch_flush enter 2026-02-24T19:17:46.723 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.721+0000 7f05f627b640 10 librados: watch_flush exit 2026-02-24T19:17:46.723 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.721+0000 7f05f627b640 20 client.4289.objecter shutdown clearing up homeless session... 2026-02-24T19:17:46.723 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.721+0000 7f05f627b640 10 client.4289.objecter successfully canceled tick 2026-02-24T19:17:46.723 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.721+0000 7f05f627b640 1 -- 10.20.193.26:0/3081489189 >> v1:10.20.193.162:6800/3889602630 conn(0x7f05c0077d90 legacy=0x7f05c0098240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:46.723 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.721+0000 7f05f627b640 10 monclient: shutdown 2026-02-24T19:17:46.723 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.721+0000 7f05f627b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:46.723 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.721+0000 7f05f627b640 1 -- 10.20.193.26:0/3081489189 >> v1:10.20.193.103:6789/0 conn(0x7f05f00b0410 legacy=0x7f05f00af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:46.723 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.721+0000 7f05f627b640 1 -- 10.20.193.26:0/3081489189 shutdown_connections 2026-02-24T19:17:46.723 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.721+0000 7f05f627b640 1 -- 10.20.193.26:0/3081489189 >> 10.20.193.26:0/3081489189 conn(0x7f05f00b65f0 msgr2=0x7f05f0162b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:46.723 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.721+0000 7f05f627b640 1 -- 10.20.193.26:0/3081489189 shutdown_connections 2026-02-24T19:17:46.723 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.721+0000 7f05f627b640 1 -- 10.20.193.26:0/3081489189 wait complete. 2026-02-24T19:17:46.723 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:46.721+0000 7f05f627b640 1 librados: shutdown 2026-02-24T19:17:46.731 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-24T19:17:46.935 INFO:tasks.ceph.osd.2.trial103.stderr:==00:00:00:18.268 44619== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:46.939 INFO:tasks.ceph.osd.6.trial103.stderr:==00:00:00:18.268 44620== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:46.945 INFO:tasks.ceph.osd.12.trial026.stderr:==00:00:00:18.292 44899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:46.958 INFO:tasks.ceph.osd.6.trial103.stderr:==00:00:00:18.288 44620== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:46.962 INFO:tasks.ceph.osd.6.trial103.stderr:==00:00:00:18.291 44620== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:46.968 INFO:tasks.ceph.osd.2.trial103.stderr:==00:00:00:18.300 44619== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:46.970 INFO:tasks.ceph.osd.4.trial026.stderr:==00:00:00:18.324 44892== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:46.970 INFO:tasks.ceph.osd.2.trial103.stderr:==00:00:00:18.303 44619== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:46.976 INFO:tasks.ceph.osd.12.trial026.stderr:==00:00:00:18.322 44899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:46.979 INFO:tasks.ceph.osd.12.trial026.stderr:==00:00:00:18.325 44899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.002 INFO:tasks.ceph.osd.10.trial103.stderr:==00:00:00:18.328 44621== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.005 INFO:tasks.ceph.osd.4.trial026.stderr:==00:00:00:18.359 44892== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.006 INFO:tasks.ceph.osd.9.trial070.stderr:==00:00:00:18.344 44508== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.008 INFO:tasks.ceph.osd.4.trial026.stderr:==00:00:00:18.362 44892== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.013 INFO:tasks.ceph.osd.1.trial070.stderr:==00:00:00:18.353 44506== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.035 INFO:tasks.ceph.osd.10.trial103.stderr:==00:00:00:18.360 44621== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.036 INFO:tasks.ceph.osd.9.trial070.stderr:==00:00:00:18.375 44508== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.038 INFO:tasks.ceph.osd.10.trial103.stderr:==00:00:00:18.364 44621== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.039 INFO:tasks.ceph.osd.9.trial070.stderr:==00:00:00:18.378 44508== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.040 INFO:tasks.ceph.osd.1.trial070.stderr:==00:00:00:18.381 44506== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.043 INFO:tasks.ceph.osd.1.trial070.stderr:==00:00:00:18.383 44506== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.050 INFO:tasks.ceph.osd.13.trial070.stderr:==00:00:00:18.383 44509== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.086 INFO:tasks.ceph.osd.14.trial103.stderr:==00:00:00:18.411 44622== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.094 INFO:tasks.ceph.osd.13.trial070.stderr:==00:00:00:18.427 44509== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.097 INFO:tasks.ceph.osd.13.trial070.stderr:==00:00:00:18.431 44509== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.119 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:18.431 45138== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.120 INFO:tasks.ceph.osd.0.trial026.stderr:==00:00:00:18.474 44891== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.123 INFO:tasks.ceph.osd.14.trial103.stderr:==00:00:00:18.448 44622== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.126 INFO:tasks.ceph.osd.14.trial103.stderr:==00:00:00:18.451 44622== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.147 INFO:tasks.ceph.osd.0.trial026.stderr:==00:00:00:18.502 44891== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.150 INFO:tasks.ceph.osd.0.trial026.stderr:==00:00:00:18.504 44891== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.156 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:18.468 45138== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.158 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:18.471 45138== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.174 INFO:tasks.ceph.osd.8.trial026.stderr:==00:00:00:18.524 44894== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.210 INFO:tasks.ceph.osd.8.trial026.stderr:==00:00:00:18.560 44894== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.213 INFO:tasks.ceph.osd.8.trial026.stderr:==00:00:00:18.563 44894== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.227 INFO:tasks.ceph.osd.5.trial070.stderr:==00:00:00:18.567 44507== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.234 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:18.549 45135== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.247 INFO:tasks.ceph.osd.5.trial070.stderr:==00:00:00:18.588 44507== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.250 INFO:tasks.ceph.osd.5.trial070.stderr:==00:00:00:18.591 44507== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.262 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:18.578 45136== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.265 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:18.580 45135== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.267 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:18.583 45135== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.290 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:18.605 45136== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.292 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:18.607 45136== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.333 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:18.647 45137== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.374 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:18.689 45137== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:47.377 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:18.692 45137== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:48.545 INFO:tasks.ceph.osd.6.trial103.stderr:==00:00:00:19.874 44620== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:48.546 INFO:tasks.ceph.osd.2.trial103.stderr:==00:00:00:19.878 44619== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:48.579 INFO:tasks.ceph.osd.12.trial026.stderr:==00:00:00:19.925 44899== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:48.626 INFO:tasks.ceph.osd.4.trial026.stderr:==00:00:00:19.981 44892== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:48.649 INFO:tasks.ceph.osd.1.trial070.stderr:==00:00:00:19.989 44506== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:48.653 INFO:tasks.ceph.osd.9.trial070.stderr:==00:00:00:19.991 44508== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:48.659 INFO:tasks.ceph.osd.10.trial103.stderr:==00:00:00:19.985 44621== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:48.709 INFO:tasks.ceph.osd.13.trial070.stderr:==00:00:00:20.042 44509== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:48.742 INFO:tasks.ceph.osd.14.trial103.stderr:==00:00:00:20.067 44622== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:48.755 INFO:tasks.ceph.osd.0.trial026.stderr:==00:00:00:20.110 44891== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:48.774 INFO:tasks.ceph.osd.15.trial162.stderr:==00:00:00:20.086 45138== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:48.821 INFO:tasks.ceph.osd.8.trial026.stderr:==00:00:00:20.171 44894== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:48.861 INFO:tasks.ceph.osd.5.trial070.stderr:==00:00:00:20.202 44507== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:48.891 INFO:tasks.ceph.osd.3.trial162.stderr:==00:00:00:20.206 45135== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:48.930 INFO:tasks.ceph.osd.7.trial162.stderr:==00:00:00:20.246 45136== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:48.999 INFO:tasks.ceph.osd.11.trial162.stderr:==00:00:00:20.314 45137== Warning: unimplemented fcntl command: 1038 2026-02-24T19:17:51.300 INFO:tasks.ceph.osd.6.trial103.stderr:2026-02-24T19:17:51.296+0000 787f4c0 -1 osd.6 0 log_to_monitors true 2026-02-24T19:17:51.328 INFO:tasks.ceph.osd.2.trial103.stderr:2026-02-24T19:17:51.322+0000 787f4c0 -1 osd.2 0 log_to_monitors true 2026-02-24T19:17:51.368 INFO:tasks.ceph.osd.12.trial026.stderr:2026-02-24T19:17:51.365+0000 787f4c0 -1 osd.12 0 log_to_monitors true 2026-02-24T19:17:51.395 INFO:tasks.ceph.osd.4.trial026.stderr:2026-02-24T19:17:51.392+0000 787f4c0 -1 osd.4 0 log_to_monitors true 2026-02-24T19:17:51.406 INFO:tasks.ceph.osd.10.trial103.stderr:2026-02-24T19:17:51.403+0000 787f4c0 -1 osd.10 0 log_to_monitors true 2026-02-24T19:17:51.411 INFO:tasks.ceph.osd.1.trial070.stderr:2026-02-24T19:17:51.405+0000 787f4c0 -1 osd.1 0 log_to_monitors true 2026-02-24T19:17:51.434 INFO:tasks.ceph.osd.9.trial070.stderr:2026-02-24T19:17:51.429+0000 787f4c0 -1 osd.9 0 log_to_monitors true 2026-02-24T19:17:51.467 INFO:tasks.ceph.osd.13.trial070.stderr:2026-02-24T19:17:51.462+0000 787f4c0 -1 osd.13 0 log_to_monitors true 2026-02-24T19:17:51.513 INFO:tasks.ceph.osd.14.trial103.stderr:2026-02-24T19:17:51.510+0000 787f4c0 -1 osd.14 0 log_to_monitors true 2026-02-24T19:17:51.517 INFO:tasks.ceph.osd.0.trial026.stderr:2026-02-24T19:17:51.513+0000 787f4c0 -1 osd.0 0 log_to_monitors true 2026-02-24T19:17:51.540 INFO:tasks.ceph.osd.15.trial162.stderr:2026-02-24T19:17:51.537+0000 787f4c0 -1 osd.15 0 log_to_monitors true 2026-02-24T19:17:51.595 INFO:tasks.ceph.osd.8.trial026.stderr:2026-02-24T19:17:51.592+0000 787f4c0 -1 osd.8 0 log_to_monitors true 2026-02-24T19:17:51.653 INFO:tasks.ceph.osd.5.trial070.stderr:2026-02-24T19:17:51.648+0000 787f4c0 -1 osd.5 0 log_to_monitors true 2026-02-24T19:17:51.672 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-24T19:17:51.668+0000 787f4c0 -1 osd.3 0 log_to_monitors true 2026-02-24T19:17:51.710 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-24T19:17:51.706+0000 787f4c0 -1 osd.7 0 log_to_monitors true 2026-02-24T19:17:51.805 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-24T19:17:51.802+0000 787f4c0 -1 osd.11 0 log_to_monitors true 2026-02-24T19:17:53.880 INFO:tasks.ceph.osd.2.trial103.stderr:2026-02-24T19:17:53.876+0000 df79640 -1 osd.2 0 waiting for initial osdmap 2026-02-24T19:17:53.904 INFO:tasks.ceph.osd.12.trial026.stderr:2026-02-24T19:17:53.901+0000 cf66640 -1 osd.12 0 waiting for initial osdmap 2026-02-24T19:17:53.907 INFO:tasks.ceph.osd.6.trial103.stderr:2026-02-24T19:17:53.905+0000 cf66640 -1 osd.6 0 waiting for initial osdmap 2026-02-24T19:17:53.921 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-24T19:17:53.918+0000 cf66640 -1 osd.7 0 waiting for initial osdmap 2026-02-24T19:17:53.960 INFO:tasks.ceph.osd.13.trial070.stderr:2026-02-24T19:17:53.955+0000 df79640 -1 osd.13 0 waiting for initial osdmap 2026-02-24T19:17:53.961 INFO:tasks.ceph.osd.14.trial103.stderr:2026-02-24T19:17:53.957+0000 df79640 -1 osd.14 0 waiting for initial osdmap 2026-02-24T19:17:53.964 INFO:tasks.ceph.osd.8.trial026.stderr:2026-02-24T19:17:53.961+0000 df79640 -1 osd.8 0 waiting for initial osdmap 2026-02-24T19:17:53.971 INFO:tasks.ceph.osd.15.trial162.stderr:2026-02-24T19:17:53.965+0000 df79640 -1 osd.15 0 waiting for initial osdmap 2026-02-24T19:17:53.973 INFO:tasks.ceph.osd.0.trial026.stderr:2026-02-24T19:17:53.970+0000 cf66640 -1 osd.0 0 waiting for initial osdmap 2026-02-24T19:17:53.979 INFO:tasks.ceph.osd.1.trial070.stderr:2026-02-24T19:17:53.975+0000 df79640 -1 osd.1 0 waiting for initial osdmap 2026-02-24T19:17:53.984 INFO:tasks.ceph.osd.5.trial070.stderr:2026-02-24T19:17:53.979+0000 cf66640 -1 osd.5 0 waiting for initial osdmap 2026-02-24T19:17:53.985 INFO:tasks.ceph.osd.4.trial026.stderr:2026-02-24T19:17:53.983+0000 df79640 -1 osd.4 0 waiting for initial osdmap 2026-02-24T19:17:53.986 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-24T19:17:53.982+0000 df79640 -1 osd.11 0 waiting for initial osdmap 2026-02-24T19:17:53.988 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-24T19:17:53.985+0000 df79640 -1 osd.3 0 waiting for initial osdmap 2026-02-24T19:17:53.990 INFO:tasks.ceph.osd.9.trial070.stderr:2026-02-24T19:17:53.985+0000 df79640 -1 osd.9 0 waiting for initial osdmap 2026-02-24T19:17:53.997 INFO:tasks.ceph.osd.10.trial103.stderr:2026-02-24T19:17:53.993+0000 df79640 -1 osd.10 0 waiting for initial osdmap 2026-02-24T19:17:54.141 INFO:tasks.ceph.osd.2.trial103.stderr:2026-02-24T19:17:54.133+0000 12561640 -1 osd.2 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:54.142 INFO:tasks.ceph.osd.6.trial103.stderr:2026-02-24T19:17:54.135+0000 12561640 -1 osd.6 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:54.144 INFO:tasks.ceph.osd.12.trial026.stderr:2026-02-24T19:17:54.136+0000 16969640 -1 osd.12 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:54.147 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-24T19:17:54.140+0000 16569640 -1 osd.7 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:54.150 INFO:tasks.ceph.osd.14.trial103.stderr:2026-02-24T19:17:54.143+0000 16969640 -1 osd.14 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:54.151 INFO:tasks.ceph.osd.8.trial026.stderr:2026-02-24T19:17:54.144+0000 16569640 -1 osd.8 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:54.153 INFO:tasks.ceph.osd.13.trial070.stderr:2026-02-24T19:17:54.144+0000 12561640 -1 osd.13 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:54.157 INFO:tasks.ceph.osd.0.trial026.stderr:2026-02-24T19:17:54.150+0000 16569640 -1 osd.0 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:54.167 INFO:tasks.ceph.osd.1.trial070.stderr:2026-02-24T19:17:54.158+0000 12561640 -1 osd.1 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:54.171 INFO:tasks.ceph.osd.4.trial026.stderr:2026-02-24T19:17:54.164+0000 16569640 -1 osd.4 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:54.186 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-24T19:17:54.178+0000 16569640 -1 osd.3 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:54.188 INFO:tasks.ceph.osd.15.trial162.stderr:2026-02-24T19:17:54.180+0000 12561640 -1 osd.15 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:54.190 INFO:tasks.ceph.osd.5.trial070.stderr:2026-02-24T19:17:54.181+0000 16569640 -1 osd.5 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:54.190 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-24T19:17:54.182+0000 16969640 -1 osd.11 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:54.193 INFO:tasks.ceph.osd.10.trial103.stderr:2026-02-24T19:17:54.185+0000 16569640 -1 osd.10 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:54.200 INFO:tasks.ceph.osd.9.trial070.stderr:2026-02-24T19:17:54.190+0000 12561640 -1 osd.9 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-24T19:17:54.343 DEBUG:teuthology.orchestra.run.trial026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-24T19:17:54.407 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.406+0000 7f26c4d2c640 10 monclient: get_monmap_and_config 2026-02-24T19:17:54.407 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.406+0000 7f26c4d2c640 10 monclient: build_initial_monmap 2026-02-24T19:17:54.408 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.406+0000 7f26c4d2c640 10 monclient: monmap: 2026-02-24T19:17:54.408 INFO:teuthology.misc.health.trial026.stderr:epoch 0 2026-02-24T19:17:54.408 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:54.408 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:17:54.407245+0000 2026-02-24T19:17:54.408 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:17:54.407245+0000 2026-02-24T19:17:54.408 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:54.408 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:17:54.408 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:54.408 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:54.408 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:54.409 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:54.411 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.407+0000 7f26c4d2c640 1 Processor -- start 2026-02-24T19:17:54.411 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.407+0000 7f26c4d2c640 1 -- start start 2026-02-24T19:17:54.411 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.407+0000 7f26c4d2c640 10 monclient: init 2026-02-24T19:17:54.411 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.407+0000 7f26c4d2c640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:54.411 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.407+0000 7f26c4d2c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:17:54.411 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.407+0000 7f26c4d2c640 10 monclient(hunting): picked mon.noname-a con 0x7f26c0055bf0 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:54.411 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.407+0000 7f26c4d2c640 10 monclient(hunting): picked mon.noname-b con 0x7f26c0164040 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:54.411 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.407+0000 7f26c4d2c640 10 monclient(hunting): picked mon.noname-c con 0x7f26c0055fc0 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:54.411 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.407+0000 7f26c4d2c640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26c00b3a00 con 0x7f26c0055bf0 2026-02-24T19:17:54.411 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.407+0000 7f26c4d2c640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26c00b3c70 con 0x7f26c0164040 2026-02-24T19:17:54.411 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.407+0000 7f26c4d2c640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26c00b3f50 con 0x7f26c0055fc0 2026-02-24T19:17:54.411 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.407+0000 7f26c4d2c640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:54.412 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.407+0000 7f26c4d2c640 10 monclient(hunting): authenticate will time out at 3657.089848s 2026-02-24T19:17:54.412 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.408+0000 7f26be575640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f26c0055bf0 0x7f26c00b1f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:47728/0 (socket says 10.20.193.26:47728) 2026-02-24T19:17:54.412 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.408+0000 7f26be575640 1 -- 10.20.193.26:0/4052129523 learned_addr learned my addr 10.20.193.26:0/4052129523 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:17:54.412 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.409+0000 7f26bd573640 1 -- 10.20.193.26:0/4052129523 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3524349294 0 0) 0x7f26c00b3a00 con 0x7f26c0055bf0 2026-02-24T19:17:54.412 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.409+0000 7f26bd573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:54.412 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.409+0000 7f26bd573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:54.412 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.409+0000 7f26bd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:54.412 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.409+0000 7f26bd573640 10 monclient(hunting): my global_id is 4332 2026-02-24T19:17:54.412 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.409+0000 7f26bd573640 1 -- 10.20.193.26:0/4052129523 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26ac003610 con 0x7f26c0055bf0 2026-02-24T19:17:54.412 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.409+0000 7f26bd573640 1 -- 10.20.193.26:0/4052129523 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2333271682 0 0) 0x7f26c00b3f50 con 0x7f26c0055fc0 2026-02-24T19:17:54.412 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.409+0000 7f26bd573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:54.412 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.409+0000 7f26bd573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:54.412 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.409+0000 7f26bd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:54.412 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.409+0000 7f26bd573640 10 monclient(hunting): my global_id is 4340 2026-02-24T19:17:54.412 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.409+0000 7f26bd573640 1 -- 10.20.193.26:0/4052129523 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26c00b3a00 con 0x7f26c0055fc0 2026-02-24T19:17:54.412 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.409+0000 7f26bd573640 1 -- 10.20.193.26:0/4052129523 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4024263924 0 0) 0x7f26c00b3c70 con 0x7f26c0164040 2026-02-24T19:17:54.412 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.409+0000 7f26bd573640 10 monclient(hunting): _negotiate 2026-02-24T19:17:54.412 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.409+0000 7f26bd573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:54.412 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.409+0000 7f26bd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:54.412 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.409+0000 7f26bd573640 10 monclient(hunting): my global_id is 4321 2026-02-24T19:17:54.412 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.409+0000 7f26bd573640 1 -- 10.20.193.26:0/4052129523 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26c00b3f50 con 0x7f26c0164040 2026-02-24T19:17:54.413 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.411+0000 7f26bd573640 1 -- 10.20.193.26:0/4052129523 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 976567963 0 0) 0x7f26ac003610 con 0x7f26c0055bf0 2026-02-24T19:17:54.413 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.411+0000 7f26bd573640 1 -- 10.20.193.26:0/4052129523 >> v1:10.20.193.103:6789/0 conn(0x7f26c0055fc0 legacy=0x7f26c00b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.413 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.411+0000 7f26bd573640 1 -- 10.20.193.26:0/4052129523 >> v1:10.20.193.70:6789/0 conn(0x7f26c0164040 legacy=0x7f26c0056690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.413 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.411+0000 7f26bd573640 10 monclient: _finish_hunting 0 2026-02-24T19:17:54.413 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.411+0000 7f26bd573640 1 monclient: found mon.noname-a 2026-02-24T19:17:54.414 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.411+0000 7f26bd573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:54.414 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.411+0000 7f26bd573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:17:54.414 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.411+0000 7f26bd573640 1 -- 10.20.193.26:0/4052129523 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c00b4230 con 0x7f26c0055bf0 2026-02-24T19:17:54.414 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.411+0000 7f26bd573640 10 monclient: _finish_auth 0 2026-02-24T19:17:54.414 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.411+0000 7f26bd573640 10 monclient: _check_auth_tickets 2026-02-24T19:17:54.414 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.411+0000 7f26bd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:54.414 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.411+0000 7f26bd573640 1 -- 10.20.193.26:0/4052129523 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f26b4002df0 con 0x7f26c0055bf0 2026-02-24T19:17:54.414 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.411+0000 7f26c4d2c640 5 monclient: authenticate success, global_id 4332 2026-02-24T19:17:54.414 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.411+0000 7f26c4d2c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:54.414 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.411+0000 7f26bd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:54.414 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.411+0000 7f26bd573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:54.414 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.411+0000 7f26bd573640 10 monclient: dump: 2026-02-24T19:17:54.414 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:17:54.414 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:54.414 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:54.414 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:54.414 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:54.414 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:17:54.414 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:54.414 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:54.414 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:54.414 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:54.414 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.411+0000 7f26c4d2c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:17:54.414 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.412+0000 7f26bd573640 1 -- 10.20.193.26:0/4052129523 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f26b4002fc0 con 0x7f26c0055bf0 2026-02-24T19:17:54.414 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.412+0000 7f26bd573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:54.415 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.412+0000 7f26bd573640 1 -- 10.20.193.26:0/4052129523 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f26b4003400 con 0x7f26c0055bf0 2026-02-24T19:17:54.415 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.412+0000 7f26bd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:54.415 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.412+0000 7f26bd573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:17:54.415 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.412+0000 7f26bd573640 10 monclient: dump: 2026-02-24T19:17:54.415 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:17:54.415 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:54.415 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:54.415 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:54.415 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:54.415 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:17:54.415 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:54.415 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:54.415 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:54.415 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:54.415 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.412+0000 7f26c4d2c640 10 monclient: get_monmap_and_config success 2026-02-24T19:17:54.415 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.412+0000 7f26c4d2c640 4 set_mon_vals no callback set 2026-02-24T19:17:54.415 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.412+0000 7f26c4d2c640 10 monclient: shutdown 2026-02-24T19:17:54.415 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.412+0000 7f26c4d2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:54.415 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.412+0000 7f26c4d2c640 1 -- 10.20.193.26:0/4052129523 >> v1:10.20.193.26:6789/0 conn(0x7f26c0055bf0 legacy=0x7f26c00b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.415 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.412+0000 7f26c4d2c640 1 -- 10.20.193.26:0/4052129523 shutdown_connections 2026-02-24T19:17:54.415 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.412+0000 7f26c4d2c640 1 -- 10.20.193.26:0/4052129523 >> 10.20.193.26:0/4052129523 conn(0x7f26c00b7bb0 msgr2=0x7f26c00b7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:54.415 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.412+0000 7f26c4d2c640 1 -- 10.20.193.26:0/4052129523 shutdown_connections 2026-02-24T19:17:54.415 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.412+0000 7f26c4d2c640 1 -- 10.20.193.26:0/4052129523 wait complete. 2026-02-24T19:17:54.416 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.413+0000 7f26c4d2c640 10 monclient: build_initial_monmap 2026-02-24T19:17:54.417 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.413+0000 7f26c4d2c640 10 monclient: monmap: 2026-02-24T19:17:54.417 INFO:teuthology.misc.health.trial026.stderr:epoch 0 2026-02-24T19:17:54.417 INFO:teuthology.misc.health.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:17:54.417 INFO:teuthology.misc.health.trial026.stderr:last_changed 0.000000 2026-02-24T19:17:54.417 INFO:teuthology.misc.health.trial026.stderr:created 0.000000 2026-02-24T19:17:54.417 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:17:54.417 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 1 2026-02-24T19:17:54.417 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:17:54.417 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:17:54.417 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:17:54.417 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:54.417 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.413+0000 7f26c4d2c640 1 librados: starting msgr at 2026-02-24T19:17:54.417 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.413+0000 7f26c4d2c640 1 librados: starting objecter 2026-02-24T19:17:54.417 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.413+0000 7f26c4d2c640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:17:54.417 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.413+0000 7f26c4d2c640 1 Processor -- start 2026-02-24T19:17:54.417 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.413+0000 7f26c4d2c640 1 -- start start 2026-02-24T19:17:54.417 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.413+0000 7f26c4d2c640 1 librados: setting wanted keys 2026-02-24T19:17:54.417 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.413+0000 7f26c4d2c640 1 librados: calling monclient init 2026-02-24T19:17:54.417 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.413+0000 7f26c4d2c640 10 monclient: init 2026-02-24T19:17:54.417 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.413+0000 7f26c4d2c640 10 monclient: _reopen_session rank -1 2026-02-24T19:17:54.417 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.413+0000 7f26c4d2c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:17:54.417 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.413+0000 7f26c4d2c640 10 monclient(hunting): picked mon.noname-c con 0x7f26c0055bf0 addr v1:10.20.193.103:6789/0 2026-02-24T19:17:54.417 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.413+0000 7f26c4d2c640 10 monclient(hunting): picked mon.noname-b con 0x7f26c0055fc0 addr v1:10.20.193.70:6789/0 2026-02-24T19:17:54.417 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.413+0000 7f26c4d2c640 10 monclient(hunting): picked mon.noname-a con 0x7f26c0164040 addr v1:10.20.193.26:6789/0 2026-02-24T19:17:54.417 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.413+0000 7f26c4d2c640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26c013cd20 con 0x7f26c0164040 2026-02-24T19:17:54.418 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.413+0000 7f26c4d2c640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26c013d000 con 0x7f26c0055fc0 2026-02-24T19:17:54.418 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.413+0000 7f26c4d2c640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26c013d2e0 con 0x7f26c0055bf0 2026-02-24T19:17:54.418 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.413+0000 7f26c4d2c640 10 monclient(hunting): _renew_subs 2026-02-24T19:17:54.418 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.413+0000 7f26c4d2c640 10 monclient(hunting): authenticate will time out at 3657.095863s 2026-02-24T19:17:54.418 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.414+0000 7f26bed76640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f26c0164040 0x7f26c014bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:47734/0 (socket says 10.20.193.26:47734) 2026-02-24T19:17:54.418 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.414+0000 7f26bed76640 1 -- 10.20.193.26:0/2303702919 learned_addr learned my addr 10.20.193.26:0/2303702919 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:17:54.418 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.414+0000 7f26a6ffd640 10 client.?.objecter ms_handle_connect 0x7f26c0164040 2026-02-24T19:17:54.418 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.414+0000 7f26a6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:54.418 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.414+0000 7f26a6ffd640 10 client.?.objecter ms_handle_connect 0x7f26c0055bf0 2026-02-24T19:17:54.418 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.414+0000 7f26a6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:54.418 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.415+0000 7f26a6ffd640 1 -- 10.20.193.26:0/2303702919 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2171758308 0 0) 0x7f26c013cd20 con 0x7f26c0164040 2026-02-24T19:17:54.418 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.415+0000 7f26a6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:54.418 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.415+0000 7f26a6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:54.418 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.415+0000 7f26a6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:54.418 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.415+0000 7f26a6ffd640 10 monclient(hunting): my global_id is 4335 2026-02-24T19:17:54.418 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.415+0000 7f26a6ffd640 1 -- 10.20.193.26:0/2303702919 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f268c003610 con 0x7f26c0164040 2026-02-24T19:17:54.418 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.415+0000 7f26a6ffd640 1 -- 10.20.193.26:0/2303702919 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 22492239 0 0) 0x7f26c013d2e0 con 0x7f26c0055bf0 2026-02-24T19:17:54.418 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.415+0000 7f26a6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:17:54.418 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.415+0000 7f26a6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:17:54.418 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.415+0000 7f26a6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:17:54.418 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.415+0000 7f26a6ffd640 10 monclient(hunting): my global_id is 4343 2026-02-24T19:17:54.418 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.415+0000 7f26a6ffd640 1 -- 10.20.193.26:0/2303702919 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26c013cd20 con 0x7f26c0055bf0 2026-02-24T19:17:54.419 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.417+0000 7f26a6ffd640 1 -- 10.20.193.26:0/2303702919 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2313574627 0 0) 0x7f268c003610 con 0x7f26c0164040 2026-02-24T19:17:54.419 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.417+0000 7f26a6ffd640 1 -- 10.20.193.26:0/2303702919 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f26c013d2e0 con 0x7f26c0164040 2026-02-24T19:17:54.419 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.417+0000 7f26a6ffd640 1 -- 10.20.193.26:0/2303702919 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f26b0003490 con 0x7f26c0164040 2026-02-24T19:17:54.419 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.417+0000 7f26a6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:54.419 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.417+0000 7f26a6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:17:54.419 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.417+0000 7f26a6ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:54.419 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:17:54.419 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:54.419 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:54.419 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:54.419 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:54.419 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:17:54.419 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:54.419 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:54.419 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:54.420 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:54.420 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.417+0000 7f26a6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:17:54.420 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.417+0000 7f26a6ffd640 1 -- 10.20.193.26:0/2303702919 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4271811053 0 0) 0x7f26c013cd20 con 0x7f26c0055bf0 2026-02-24T19:17:54.420 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.417+0000 7f26a6ffd640 1 -- 10.20.193.26:0/2303702919 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f268c003610 con 0x7f26c0055bf0 2026-02-24T19:17:54.420 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.417+0000 7f26a6ffd640 1 -- 10.20.193.26:0/2303702919 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f26b4003310 con 0x7f26c0055bf0 2026-02-24T19:17:54.420 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.417+0000 7f26a6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:17:54.420 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.417+0000 7f26a6ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:54.420 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.417+0000 7f26a6ffd640 10 monclient(hunting): dump: 2026-02-24T19:17:54.420 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:17:54.420 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:54.420 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:54.420 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:54.420 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:54.420 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:17:54.420 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:54.420 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:54.420 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:54.420 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:54.421 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.418+0000 7f26a6ffd640 10 client.?.objecter ms_handle_connect 0x7f26c0055fc0 2026-02-24T19:17:54.421 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.418+0000 7f26a6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:17:54.421 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.419+0000 7f26a6ffd640 1 -- 10.20.193.26:0/2303702919 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3112582315 0 0) 0x7f268c003610 con 0x7f26c0055bf0 2026-02-24T19:17:54.421 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.419+0000 7f26a6ffd640 1 -- 10.20.193.26:0/2303702919 >> v1:10.20.193.70:6789/0 conn(0x7f26c0055fc0 legacy=0x7f26c00b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.421 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.419+0000 7f26a6ffd640 1 -- 10.20.193.26:0/2303702919 >> v1:10.20.193.26:6789/0 conn(0x7f26c0164040 legacy=0x7f26c014bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.421 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.419+0000 7f26a6ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:17:54.421 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.419+0000 7f26a6ffd640 1 monclient: found mon.c 2026-02-24T19:17:54.421 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.419+0000 7f26a6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:17:54.421 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.419+0000 7f26a6ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:54.421 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.419+0000 7f26a6ffd640 1 -- 10.20.193.26:0/2303702919 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c013d5c0 con 0x7f26c0055bf0 2026-02-24T19:17:54.421 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.419+0000 7f26a6ffd640 10 monclient: _finish_auth 0 2026-02-24T19:17:54.421 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.419+0000 7f26a6ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:17:54.421 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.419+0000 7f26a6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:17:54.421 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.419+0000 7f26c4d2c640 5 monclient: authenticate success, global_id 4343 2026-02-24T19:17:54.421 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.419+0000 7f26c4d2c640 10 monclient: _renew_subs 2026-02-24T19:17:54.422 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.419+0000 7f26c4d2c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:54.422 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.419+0000 7f26c4d2c640 1 -- 10.20.193.26:0/2303702919 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f26c013d8a0 con 0x7f26c0055bf0 2026-02-24T19:17:54.422 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.419+0000 7f26c4d2c640 10 client.4343.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:17:54.422 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.419+0000 7f26c4d2c640 10 monclient: _renew_subs 2026-02-24T19:17:54.422 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.419+0000 7f26c4d2c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:54.422 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.419+0000 7f26c4d2c640 1 -- 10.20.193.26:0/2303702919 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f26c0156c70 con 0x7f26c0055bf0 2026-02-24T19:17:54.422 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.419+0000 7f26c4d2c640 1 librados: init done 2026-02-24T19:17:54.422 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.420+0000 7f26c4d2c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:54.422 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.420+0000 7f26c4d2c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:54.422 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.420+0000 7f26c4d2c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:54.422 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.420+0000 7f26c4d2c640 1 -- 10.20.193.26:0/2303702919 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26c0139600 con 0x7f26c0055bf0 2026-02-24T19:17:54.428 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.427+0000 7f26a6ffd640 1 -- 10.20.193.26:0/2303702919 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f26b4002fc0 con 0x7f26c0055bf0 2026-02-24T19:17:54.428 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.427+0000 7f26a6ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:17:54.428 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.427+0000 7f26a6ffd640 1 -- 10.20.193.26:0/2303702919 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f26b4004b80 con 0x7f26c0055bf0 2026-02-24T19:17:54.428 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.427+0000 7f26a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:17:54.428 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.427+0000 7f26a6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:17:54.428 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.427+0000 7f26a6ffd640 10 monclient: dump: 2026-02-24T19:17:54.428 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:17:54.428 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:17:54.428 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:54.428 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:17:54.428 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:17:54.428 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:17:54.428 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:17:54.428 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:17:54.428 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:17:54.428 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:17:54.428 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.427+0000 7f26bcd72640 4 set_mon_vals no callback set 2026-02-24T19:17:54.429 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.427+0000 7f26a6ffd640 1 -- 10.20.193.26:0/2303702919 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 4) ==== 101507+0+0 (unknown 3958291397 0 0) 0x7f26b401d9b0 con 0x7f26c0055bf0 2026-02-24T19:17:54.429 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.428+0000 7f26bdd74640 10 monclient: get_auth_request con 0x7f268c077bf0 auth_method 0 2026-02-24T19:17:54.429 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.428+0000 7f26a6ffd640 10 client.4343.objecter ms_handle_connect 0x7f268c077bf0 2026-02-24T19:17:54.430 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.429+0000 7f26a6ffd640 1 -- 10.20.193.26:0/2303702919 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 5128+0+0 (unknown 565623280 0 0) 0x7f26b4059460 con 0x7f26c0055bf0 2026-02-24T19:17:54.430 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.429+0000 7f26a6ffd640 10 client.4343.objecter ms_dispatch2 0x7f26c0000b90 osd_map(20..20 src has 1..20) 2026-02-24T19:17:54.430 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.429+0000 7f26a6ffd640 3 client.4343.objecter handle_osd_map got epochs [20,20] > 0 2026-02-24T19:17:54.430 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.429+0000 7f26a6ffd640 3 client.4343.objecter handle_osd_map decoding full epoch 20 2026-02-24T19:17:54.430 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.429+0000 7f26a6ffd640 20 client.4343.objecter dump_active .. 0 homeless 2026-02-24T19:17:54.518 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.517+0000 7f26a6ffd640 1 -- 10.20.193.26:0/2303702919 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f26b405dbd0 con 0x7f26c0055bf0 2026-02-24T19:17:54.518 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.517+0000 7f26a6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:17:54.518 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.517+0000 7f26a6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:17:54.621 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.620+0000 7f26c4d2c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:54.621 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.620+0000 7f26c4d2c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:54.622 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.620+0000 7f26c4d2c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:17:54.622 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.620+0000 7f26c4d2c640 1 -- 10.20.193.26:0/2303702919 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f26c0160c90 con 0x7f26c0055bf0 2026-02-24T19:17:54.628 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.627+0000 7f26a6ffd640 1 -- 10.20.193.26:0/2303702919 <== mon.2 v1:10.20.193.103:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+12877 (unknown 3413328019 0 4193873575) 0x7f26b405d4d0 con 0x7f26c0055bf0 2026-02-24T19:17:54.628 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.627+0000 7f26a6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:17:54.628 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.627+0000 7f26a6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:17:54.629 INFO:teuthology.misc.health.trial026.stdout: 2026-02-24T19:17:54.629 INFO:teuthology.misc.health.trial026.stdout:{"epoch":20,"fsid":"33b2b598-dbc5-4d7a-8df7-657f0501fe9e","created":"2026-02-24T19:17:21.810535+0000","modified":"2026-02-24T19:17:53.737889+0000","last_up_change":"0.000000","last_in_change":"2026-02-24T19:17:28.575109+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e08ffdb8-0db6-4356-88b5-54397e40be58","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"08b117f7-0152-42bb-8a51-220b41a964ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3c37f6aa-25cb-43be-a75a-86a246086a85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a7e3939e-f8f5-4216-9700-27e229d1c4d9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"445d43ab-a28c-4afa-90ff-e451602e494f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"37303b3f-6b88-4c73-aaff-10055ec5cc85","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ef2c9883-f17f-41ec-96b7-dbbe936b77d3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3e4a495e-c742-43fc-991a-371a47ff87bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"fb377a45-1ce5-4e07-92cd-7f546cfad57f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"8079b2ca-96c3-4321-9f24-a87e8ea1e883","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"8df004a9-88e3-43f5-833d-dfc73a658ec3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"f3cf3a4b-1c26-480c-ba10-178f8542c1e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"0e06b2e9-9b29-4c6e-ab44-77fd24d945af","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"b1cbaf8b-36e9-4196-a08d-e6e72c2229e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"214e8bfc-c78d-45ac-9ec3-7685dd5684cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"8c2eb0c6-abf0-42a7-bcab-83d0c9cf797b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T19:17:54.630 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.629+0000 7f26c4d2c640 10 librados: watch_flush enter 2026-02-24T19:17:54.630 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.629+0000 7f26c4d2c640 10 librados: watch_flush exit 2026-02-24T19:17:54.630 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.629+0000 7f26c4d2c640 20 client.4343.objecter shutdown clearing up homeless session... 2026-02-24T19:17:54.630 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.629+0000 7f26c4d2c640 10 client.4343.objecter successfully canceled tick 2026-02-24T19:17:54.630 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.629+0000 7f26c4d2c640 1 -- 10.20.193.26:0/2303702919 >> v1:10.20.193.162:6800/3889602630 conn(0x7f268c077bf0 legacy=0x7f268c0980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.630 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.629+0000 7f26c4d2c640 10 monclient: shutdown 2026-02-24T19:17:54.630 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.629+0000 7f26c4d2c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:17:54.630 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.629+0000 7f26c4d2c640 1 -- 10.20.193.26:0/2303702919 >> v1:10.20.193.103:6789/0 conn(0x7f26c0055bf0 legacy=0x7f26c01399c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:17:54.630 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.629+0000 7f26c4d2c640 1 -- 10.20.193.26:0/2303702919 shutdown_connections 2026-02-24T19:17:54.630 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.629+0000 7f26c4d2c640 1 -- 10.20.193.26:0/2303702919 >> 10.20.193.26:0/2303702919 conn(0x7f26c00b7bb0 msgr2=0x7f26c00b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:17:54.630 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.629+0000 7f26c4d2c640 1 -- 10.20.193.26:0/2303702919 shutdown_connections 2026-02-24T19:17:54.630 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.629+0000 7f26c4d2c640 1 -- 10.20.193.26:0/2303702919 wait complete. 2026-02-24T19:17:54.630 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:17:54.629+0000 7f26c4d2c640 1 librados: shutdown 2026-02-24T19:17:54.637 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-24T19:18:02.249 DEBUG:teuthology.orchestra.run.trial026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-24T19:18:02.310 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.309+0000 7fb04f91a640 10 monclient: get_monmap_and_config 2026-02-24T19:18:02.310 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.309+0000 7fb04f91a640 10 monclient: build_initial_monmap 2026-02-24T19:18:02.310 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.309+0000 7fb04f91a640 10 monclient: monmap: 2026-02-24T19:18:02.311 INFO:teuthology.misc.health.trial026.stderr:epoch 0 2026-02-24T19:18:02.311 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:02.311 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:18:02.310075+0000 2026-02-24T19:18:02.311 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:18:02.310075+0000 2026-02-24T19:18:02.311 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:02.311 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:18:02.311 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:02.311 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:02.311 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:02.311 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:18:02.314 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.309+0000 7fb04f91a640 1 Processor -- start 2026-02-24T19:18:02.314 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.309+0000 7fb04f91a640 1 -- start start 2026-02-24T19:18:02.314 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.309+0000 7fb04f91a640 10 monclient: init 2026-02-24T19:18:02.314 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.310+0000 7fb04f91a640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:02.314 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.310+0000 7fb04f91a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:18:02.314 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.310+0000 7fb04f91a640 10 monclient(hunting): picked mon.noname-c con 0x7fb048159b90 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:02.314 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.310+0000 7fb04f91a640 10 monclient(hunting): picked mon.noname-a con 0x7fb048057640 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:02.314 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.310+0000 7fb04f91a640 10 monclient(hunting): picked mon.noname-b con 0x7fb0481a7980 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:02.314 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.310+0000 7fb04f91a640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb048159f60 con 0x7fb048057640 2026-02-24T19:18:02.315 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.310+0000 7fb04f91a640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb04805cca0 con 0x7fb0481a7980 2026-02-24T19:18:02.315 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.310+0000 7fb04f91a640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb04805cf80 con 0x7fb048159b90 2026-02-24T19:18:02.315 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.310+0000 7fb04f91a640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:02.315 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.310+0000 7fb04f91a640 10 monclient(hunting): authenticate will time out at 3664.992378s 2026-02-24T19:18:02.315 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.310+0000 7fb04de90640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7fb0481a7980 0x7fb0481c7d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:59304/0 (socket says 10.20.193.26:59304) 2026-02-24T19:18:02.315 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.310+0000 7fb04de90640 1 -- 10.20.193.26:0/2667129201 learned_addr learned my addr 10.20.193.26:0/2667129201 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:02.315 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.312+0000 7fb037fff640 1 -- 10.20.193.26:0/2667129201 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3821451122 0 0) 0x7fb04805cf80 con 0x7fb048159b90 2026-02-24T19:18:02.315 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.312+0000 7fb037fff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:02.315 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.312+0000 7fb037fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:02.315 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.312+0000 7fb037fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:02.315 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.312+0000 7fb037fff640 10 monclient(hunting): my global_id is 4352 2026-02-24T19:18:02.315 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.312+0000 7fb037fff640 1 -- 10.20.193.26:0/2667129201 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb030003610 con 0x7fb048159b90 2026-02-24T19:18:02.316 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.312+0000 7fb037fff640 1 -- 10.20.193.26:0/2667129201 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 8215513 0 0) 0x7fb04805cca0 con 0x7fb0481a7980 2026-02-24T19:18:02.316 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.312+0000 7fb037fff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:02.316 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.312+0000 7fb037fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:02.316 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.312+0000 7fb037fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:02.316 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.312+0000 7fb037fff640 10 monclient(hunting): my global_id is 4333 2026-02-24T19:18:02.316 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.312+0000 7fb037fff640 1 -- 10.20.193.26:0/2667129201 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb04805cf80 con 0x7fb0481a7980 2026-02-24T19:18:02.316 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.312+0000 7fb037fff640 1 -- 10.20.193.26:0/2667129201 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3054139581 0 0) 0x7fb048159f60 con 0x7fb048057640 2026-02-24T19:18:02.316 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.312+0000 7fb037fff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:02.316 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.312+0000 7fb037fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:02.316 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.312+0000 7fb037fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:02.316 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.312+0000 7fb037fff640 10 monclient(hunting): my global_id is 4344 2026-02-24T19:18:02.316 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.312+0000 7fb037fff640 1 -- 10.20.193.26:0/2667129201 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb04805cca0 con 0x7fb048057640 2026-02-24T19:18:02.321 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.314+0000 7fb037fff640 1 -- 10.20.193.26:0/2667129201 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1011782664 0 0) 0x7fb04805cf80 con 0x7fb0481a7980 2026-02-24T19:18:02.322 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.314+0000 7fb037fff640 1 -- 10.20.193.26:0/2667129201 >> v1:10.20.193.103:6789/0 conn(0x7fb048159b90 legacy=0x7fb0480b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:02.322 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.314+0000 7fb037fff640 1 -- 10.20.193.26:0/2667129201 >> v1:10.20.193.26:6789/0 conn(0x7fb048057640 legacy=0x7fb048057a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:02.322 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.314+0000 7fb037fff640 10 monclient: _finish_hunting 0 2026-02-24T19:18:02.322 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.314+0000 7fb037fff640 1 monclient: found mon.noname-b 2026-02-24T19:18:02.322 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.314+0000 7fb037fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:02.322 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.314+0000 7fb037fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:18:02.322 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.314+0000 7fb037fff640 1 -- 10.20.193.26:0/2667129201 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb04805d260 con 0x7fb0481a7980 2026-02-24T19:18:02.322 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.314+0000 7fb037fff640 10 monclient: _finish_auth 0 2026-02-24T19:18:02.322 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.314+0000 7fb037fff640 10 monclient: _check_auth_tickets 2026-02-24T19:18:02.322 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.314+0000 7fb037fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:02.322 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.314+0000 7fb037fff640 1 -- 10.20.193.26:0/2667129201 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fb044003170 con 0x7fb0481a7980 2026-02-24T19:18:02.322 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.314+0000 7fb037fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:02.323 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.314+0000 7fb037fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:02.323 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.314+0000 7fb037fff640 10 monclient: dump: 2026-02-24T19:18:02.323 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:18:02.323 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:02.323 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:02.323 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:02.323 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:02.323 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:18:02.323 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:02.323 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:02.323 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:02.323 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:18:02.323 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.314+0000 7fb04f91a640 5 monclient: authenticate success, global_id 4333 2026-02-24T19:18:02.324 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.314+0000 7fb04f91a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:02.324 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.315+0000 7fb037fff640 1 -- 10.20.193.26:0/2667129201 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb044003340 con 0x7fb0481a7980 2026-02-24T19:18:02.324 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.315+0000 7fb037fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:02.324 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.315+0000 7fb037fff640 1 -- 10.20.193.26:0/2667129201 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fb044003780 con 0x7fb0481a7980 2026-02-24T19:18:02.324 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.315+0000 7fb037fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:02.324 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.315+0000 7fb037fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:02.324 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.315+0000 7fb037fff640 10 monclient: dump: 2026-02-24T19:18:02.324 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:18:02.324 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:02.324 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:02.324 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:02.324 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:02.324 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:18:02.325 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:02.325 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:02.325 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:02.325 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:18:02.325 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.315+0000 7fb04f91a640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:02.325 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.315+0000 7fb04f91a640 4 set_mon_vals no callback set 2026-02-24T19:18:02.325 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.315+0000 7fb04f91a640 10 monclient: shutdown 2026-02-24T19:18:02.325 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.315+0000 7fb04f91a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:02.325 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.315+0000 7fb04f91a640 1 -- 10.20.193.26:0/2667129201 >> v1:10.20.193.70:6789/0 conn(0x7fb0481a7980 legacy=0x7fb0481c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:02.325 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.315+0000 7fb04f91a640 1 -- 10.20.193.26:0/2667129201 shutdown_connections 2026-02-24T19:18:02.325 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.315+0000 7fb04f91a640 1 -- 10.20.193.26:0/2667129201 >> 10.20.193.26:0/2667129201 conn(0x7fb0480b3830 msgr2=0x7fb0480b3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:02.325 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.315+0000 7fb04f91a640 1 -- 10.20.193.26:0/2667129201 shutdown_connections 2026-02-24T19:18:02.325 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.315+0000 7fb04f91a640 1 -- 10.20.193.26:0/2667129201 wait complete. 2026-02-24T19:18:02.325 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.315+0000 7fb04f91a640 10 monclient: build_initial_monmap 2026-02-24T19:18:02.325 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.315+0000 7fb04f91a640 10 monclient: monmap: 2026-02-24T19:18:02.326 INFO:teuthology.misc.health.trial026.stderr:epoch 0 2026-02-24T19:18:02.326 INFO:teuthology.misc.health.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:02.326 INFO:teuthology.misc.health.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:02.326 INFO:teuthology.misc.health.trial026.stderr:created 0.000000 2026-02-24T19:18:02.326 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:02.326 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 1 2026-02-24T19:18:02.326 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:02.326 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:02.326 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:02.326 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:18:02.326 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.315+0000 7fb04f91a640 1 librados: starting msgr at 2026-02-24T19:18:02.326 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.315+0000 7fb04f91a640 1 librados: starting objecter 2026-02-24T19:18:02.326 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.316+0000 7fb04f91a640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:02.326 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.316+0000 7fb04f91a640 1 Processor -- start 2026-02-24T19:18:02.327 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.316+0000 7fb04f91a640 1 -- start start 2026-02-24T19:18:02.327 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.316+0000 7fb04f91a640 1 librados: setting wanted keys 2026-02-24T19:18:02.327 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.316+0000 7fb04f91a640 1 librados: calling monclient init 2026-02-24T19:18:02.327 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.316+0000 7fb04f91a640 10 monclient: init 2026-02-24T19:18:02.327 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.316+0000 7fb04f91a640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:02.327 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.316+0000 7fb04f91a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:18:02.327 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.316+0000 7fb04f91a640 10 monclient(hunting): picked mon.noname-a con 0x7fb048057640 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:02.327 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.316+0000 7fb04f91a640 10 monclient(hunting): picked mon.noname-c con 0x7fb048159b90 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:02.327 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.316+0000 7fb04f91a640 10 monclient(hunting): picked mon.noname-b con 0x7fb0481a7980 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:02.327 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.316+0000 7fb04f91a640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0480af570 con 0x7fb048057640 2026-02-24T19:18:02.327 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.316+0000 7fb04f91a640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0480b2980 con 0x7fb0481a7980 2026-02-24T19:18:02.327 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.316+0000 7fb04f91a640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0480b2c60 con 0x7fb048159b90 2026-02-24T19:18:02.327 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.316+0000 7fb04f91a640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:02.327 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.316+0000 7fb04f91a640 10 monclient(hunting): authenticate will time out at 3664.998457s 2026-02-24T19:18:02.328 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.316+0000 7fb04d68f640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fb048057640 0x7fb0480b2040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:46590/0 (socket says 10.20.193.26:46590) 2026-02-24T19:18:02.328 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.316+0000 7fb04d68f640 1 -- 10.20.193.26:0/360135981 learned_addr learned my addr 10.20.193.26:0/360135981 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:02.328 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.316+0000 7fb035ffb640 10 client.?.objecter ms_handle_connect 0x7fb048057640 2026-02-24T19:18:02.328 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.316+0000 7fb035ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:02.328 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.317+0000 7fb035ffb640 10 client.?.objecter ms_handle_connect 0x7fb048159b90 2026-02-24T19:18:02.328 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.317+0000 7fb035ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:02.328 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.317+0000 7fb035ffb640 10 client.?.objecter ms_handle_connect 0x7fb0481a7980 2026-02-24T19:18:02.328 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.317+0000 7fb035ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:02.328 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.317+0000 7fb035ffb640 1 -- 10.20.193.26:0/360135981 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 729726022 0 0) 0x7fb0480af570 con 0x7fb048057640 2026-02-24T19:18:02.328 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.317+0000 7fb035ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:02.328 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.317+0000 7fb035ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:02.328 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.317+0000 7fb035ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:02.328 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.317+0000 7fb035ffb640 10 monclient(hunting): my global_id is 4347 2026-02-24T19:18:02.328 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.317+0000 7fb035ffb640 1 -- 10.20.193.26:0/360135981 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb018003610 con 0x7fb048057640 2026-02-24T19:18:02.329 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.318+0000 7fb035ffb640 1 -- 10.20.193.26:0/360135981 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2721680782 0 0) 0x7fb0480b2c60 con 0x7fb048159b90 2026-02-24T19:18:02.329 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.318+0000 7fb035ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:02.329 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.318+0000 7fb035ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:02.329 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.318+0000 7fb035ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:02.329 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.318+0000 7fb035ffb640 10 monclient(hunting): my global_id is 4355 2026-02-24T19:18:02.329 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.318+0000 7fb035ffb640 1 -- 10.20.193.26:0/360135981 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0480af570 con 0x7fb048159b90 2026-02-24T19:18:02.329 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.318+0000 7fb035ffb640 1 -- 10.20.193.26:0/360135981 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3928579326 0 0) 0x7fb0480b2980 con 0x7fb0481a7980 2026-02-24T19:18:02.329 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.318+0000 7fb035ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:02.329 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.318+0000 7fb035ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:02.329 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.318+0000 7fb035ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:02.329 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.318+0000 7fb035ffb640 10 monclient(hunting): my global_id is 4336 2026-02-24T19:18:02.329 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.318+0000 7fb035ffb640 1 -- 10.20.193.26:0/360135981 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0480b2c60 con 0x7fb0481a7980 2026-02-24T19:18:02.329 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.320+0000 7fb035ffb640 1 -- 10.20.193.26:0/360135981 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1078643778 0 0) 0x7fb018003610 con 0x7fb048057640 2026-02-24T19:18:02.329 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.320+0000 7fb035ffb640 1 -- 10.20.193.26:0/360135981 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb0480b2980 con 0x7fb048057640 2026-02-24T19:18:02.329 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.320+0000 7fb035ffb640 1 -- 10.20.193.26:0/360135981 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fb0380030f0 con 0x7fb048057640 2026-02-24T19:18:02.330 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.320+0000 7fb035ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:02.330 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.320+0000 7fb035ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:02.330 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.320+0000 7fb035ffb640 10 monclient(hunting): dump: 2026-02-24T19:18:02.330 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:18:02.330 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:02.330 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:02.330 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:02.330 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:02.330 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:18:02.330 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:02.330 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:02.330 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:02.330 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:18:02.330 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.320+0000 7fb035ffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:02.332 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb035ffb640 1 -- 10.20.193.26:0/360135981 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 730092013 0 0) 0x7fb0480af570 con 0x7fb048159b90 2026-02-24T19:18:02.333 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb035ffb640 1 -- 10.20.193.26:0/360135981 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb018003610 con 0x7fb048159b90 2026-02-24T19:18:02.333 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb035ffb640 1 -- 10.20.193.26:0/360135981 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fb03c003060 con 0x7fb048159b90 2026-02-24T19:18:02.333 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb035ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:02.333 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb035ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:02.333 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb035ffb640 10 monclient(hunting): dump: 2026-02-24T19:18:02.333 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:18:02.333 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:02.333 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:02.333 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:02.333 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:02.333 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:18:02.333 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:02.334 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:02.334 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:02.334 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:18:02.334 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb035ffb640 1 -- 10.20.193.26:0/360135981 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1586102958 0 0) 0x7fb0480b2c60 con 0x7fb0481a7980 2026-02-24T19:18:02.334 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb035ffb640 1 -- 10.20.193.26:0/360135981 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb0480af570 con 0x7fb0481a7980 2026-02-24T19:18:02.334 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb035ffb640 1 -- 10.20.193.26:0/360135981 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fb044003690 con 0x7fb0481a7980 2026-02-24T19:18:02.334 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb035ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:02.334 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb035ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:02.334 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb035ffb640 10 monclient(hunting): dump: 2026-02-24T19:18:02.334 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:18:02.334 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:02.334 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:02.334 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:02.335 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:02.335 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:18:02.335 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:02.335 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:02.335 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:02.335 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:18:02.335 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb035ffb640 1 -- 10.20.193.26:0/360135981 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3515541756 0 0) 0x7fb0480b2980 con 0x7fb048057640 2026-02-24T19:18:02.335 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb035ffb640 1 -- 10.20.193.26:0/360135981 >> v1:10.20.193.103:6789/0 conn(0x7fb048159b90 legacy=0x7fb048187d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:02.335 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb035ffb640 1 -- 10.20.193.26:0/360135981 >> v1:10.20.193.70:6789/0 conn(0x7fb0481a7980 legacy=0x7fb04818bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:02.335 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb035ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:18:02.335 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb035ffb640 1 monclient: found mon.a 2026-02-24T19:18:02.335 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb035ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:02.335 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb035ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:02.335 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb035ffb640 1 -- 10.20.193.26:0/360135981 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0480af7e0 con 0x7fb048057640 2026-02-24T19:18:02.336 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb035ffb640 10 monclient: _finish_auth 0 2026-02-24T19:18:02.336 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb035ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:18:02.336 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb035ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:02.336 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb04f91a640 5 monclient: authenticate success, global_id 4347 2026-02-24T19:18:02.336 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb04f91a640 10 monclient: _renew_subs 2026-02-24T19:18:02.336 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb04f91a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:02.336 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb04f91a640 1 -- 10.20.193.26:0/360135981 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb0480afac0 con 0x7fb048057640 2026-02-24T19:18:02.336 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb04f91a640 10 client.4347.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:02.336 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb04f91a640 10 monclient: _renew_subs 2026-02-24T19:18:02.336 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb04f91a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:02.336 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb04f91a640 1 -- 10.20.193.26:0/360135981 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb048173ea0 con 0x7fb048057640 2026-02-24T19:18:02.336 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.321+0000 7fb04f91a640 1 librados: init done 2026-02-24T19:18:02.336 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.322+0000 7fb04f91a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:02.336 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.322+0000 7fb04f91a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:02.337 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.322+0000 7fb04f91a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:02.337 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.322+0000 7fb04f91a640 1 -- 10.20.193.26:0/360135981 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb048160a30 con 0x7fb048057640 2026-02-24T19:18:02.415 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.414+0000 7fb035ffb640 1 -- 10.20.193.26:0/360135981 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb0380034a0 con 0x7fb048057640 2026-02-24T19:18:02.415 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.414+0000 7fb035ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:02.415 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.414+0000 7fb035ffb640 1 -- 10.20.193.26:0/360135981 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fb038003b50 con 0x7fb048057640 2026-02-24T19:18:02.416 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.414+0000 7fb035ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:02.416 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.414+0000 7fb035ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:02.416 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.414+0000 7fb035ffb640 10 monclient: dump: 2026-02-24T19:18:02.416 INFO:teuthology.misc.health.trial026.stderr:epoch 1 2026-02-24T19:18:02.416 INFO:teuthology.misc.health.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:02.416 INFO:teuthology.misc.health.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:02.416 INFO:teuthology.misc.health.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:02.416 INFO:teuthology.misc.health.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:02.416 INFO:teuthology.misc.health.trial026.stderr:election_strategy: 3 2026-02-24T19:18:02.416 INFO:teuthology.misc.health.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:02.416 INFO:teuthology.misc.health.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:02.416 INFO:teuthology.misc.health.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:02.417 INFO:teuthology.misc.health.trial026.stderr: 2026-02-24T19:18:02.417 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.414+0000 7fb0377fe640 4 set_mon_vals no callback set 2026-02-24T19:18:02.417 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.414+0000 7fb035ffb640 1 -- 10.20.193.26:0/360135981 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fb038003d30 con 0x7fb048057640 2026-02-24T19:18:02.417 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.415+0000 7fb04ce8e640 10 monclient: get_auth_request con 0x7fb018077dd0 auth_method 0 2026-02-24T19:18:02.418 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.415+0000 7fb035ffb640 10 client.4347.objecter ms_handle_connect 0x7fb018077dd0 2026-02-24T19:18:02.419 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.417+0000 7fb035ffb640 1 -- 10.20.193.26:0/360135981 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 7757+0+0 (unknown 3594664483 0 0) 0x7fb038093180 con 0x7fb048057640 2026-02-24T19:18:02.419 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.417+0000 7fb035ffb640 10 client.4347.objecter ms_dispatch2 0x7fb048000b90 osd_map(25..25 src has 1..25) 2026-02-24T19:18:02.419 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.417+0000 7fb035ffb640 3 client.4347.objecter handle_osd_map got epochs [25,25] > 0 2026-02-24T19:18:02.419 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.417+0000 7fb035ffb640 3 client.4347.objecter handle_osd_map decoding full epoch 25 2026-02-24T19:18:02.419 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.418+0000 7fb035ffb640 20 client.4347.objecter dump_active .. 0 homeless 2026-02-24T19:18:02.419 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.418+0000 7fb035ffb640 1 -- 10.20.193.26:0/360135981 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fb03805dbb0 con 0x7fb048057640 2026-02-24T19:18:02.419 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.418+0000 7fb035ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:02.419 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.418+0000 7fb035ffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:02.527 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.526+0000 7fb04f91a640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:18:02.528 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.526+0000 7fb04f91a640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:18:02.528 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.526+0000 7fb04f91a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:02.528 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.526+0000 7fb04f91a640 1 -- 10.20.193.26:0/360135981 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb04805a550 con 0x7fb048057640 2026-02-24T19:18:02.577 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.575+0000 7fb035ffb640 1 -- 10.20.193.26:0/360135981 <== mon.0 v1:10.20.193.26:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18949 (unknown 780366164 0 3038728502) 0x7fb038003b50 con 0x7fb048057640 2026-02-24T19:18:02.577 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.575+0000 7fb035ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:18:02.577 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.575+0000 7fb035ffb640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:02.577 INFO:teuthology.misc.health.trial026.stdout: 2026-02-24T19:18:02.578 INFO:teuthology.misc.health.trial026.stdout:{"epoch":25,"fsid":"33b2b598-dbc5-4d7a-8df7-657f0501fe9e","created":"2026-02-24T19:17:21.810535+0000","modified":"2026-02-24T19:17:59.227682+0000","last_up_change":"2026-02-24T19:17:54.877686+0000","last_in_change":"2026-02-24T19:17:28.575109+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T19:17:56.803348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e08ffdb8-0db6-4356-88b5-54397e40be58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6808","nonce":4098203721}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6809","nonce":4098203721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6811","nonce":4098203721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6810","nonce":4098203721}]},"public_addr":"10.20.193.26:6808/4098203721","cluster_addr":"10.20.193.26:6809/4098203721","heartbeat_back_addr":"10.20.193.26:6811/4098203721","heartbeat_front_addr":"10.20.193.26:6810/4098203721","state":["exists","up"]},{"osd":1,"uuid":"08b117f7-0152-42bb-8a51-220b41a964ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6800","nonce":268803542}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6801","nonce":268803542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6803","nonce":268803542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6802","nonce":268803542}]},"public_addr":"10.20.193.70:6800/268803542","cluster_addr":"10.20.193.70:6801/268803542","heartbeat_back_addr":"10.20.193.70:6803/268803542","heartbeat_front_addr":"10.20.193.70:6802/268803542","state":["exists","up"]},{"osd":2,"uuid":"3c37f6aa-25cb-43be-a75a-86a246086a85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6800","nonce":3800806982}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6802","nonce":3800806982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6806","nonce":3800806982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6804","nonce":3800806982}]},"public_addr":"10.20.193.103:6800/3800806982","cluster_addr":"10.20.193.103:6802/3800806982","heartbeat_back_addr":"10.20.193.103:6806/3800806982","heartbeat_front_addr":"10.20.193.103:6804/3800806982","state":["exists","up"]},{"osd":3,"uuid":"a7e3939e-f8f5-4216-9700-27e229d1c4d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6805","nonce":920272754}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6806","nonce":920272754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6808","nonce":920272754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6807","nonce":920272754}]},"public_addr":"10.20.193.162:6805/920272754","cluster_addr":"10.20.193.162:6806/920272754","heartbeat_back_addr":"10.20.193.162:6808/920272754","heartbeat_front_addr":"10.20.193.162:6807/920272754","state":["exists","up"]},{"osd":4,"uuid":"445d43ab-a28c-4afa-90ff-e451602e494f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6800","nonce":3717327686}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6801","nonce":3717327686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6803","nonce":3717327686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6802","nonce":3717327686}]},"public_addr":"10.20.193.26:6800/3717327686","cluster_addr":"10.20.193.26:6801/3717327686","heartbeat_back_addr":"10.20.193.26:6803/3717327686","heartbeat_front_addr":"10.20.193.26:6802/3717327686","state":["exists","up"]},{"osd":5,"uuid":"37303b3f-6b88-4c73-aaff-10055ec5cc85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6812","nonce":1419227842}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6813","nonce":1419227842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6815","nonce":1419227842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6814","nonce":1419227842}]},"public_addr":"10.20.193.70:6812/1419227842","cluster_addr":"10.20.193.70:6813/1419227842","heartbeat_back_addr":"10.20.193.70:6815/1419227842","heartbeat_front_addr":"10.20.193.70:6814/1419227842","state":["exists","up"]},{"osd":6,"uuid":"ef2c9883-f17f-41ec-96b7-dbbe936b77d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6808","nonce":3149418268}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6809","nonce":3149418268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6811","nonce":3149418268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6810","nonce":3149418268}]},"public_addr":"10.20.193.103:6808/3149418268","cluster_addr":"10.20.193.103:6809/3149418268","heartbeat_back_addr":"10.20.193.103:6811/3149418268","heartbeat_front_addr":"10.20.193.103:6810/3149418268","state":["exists","up"]},{"osd":7,"uuid":"3e4a495e-c742-43fc-991a-371a47ff87bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6809","nonce":2963240067}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6810","nonce":2963240067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6812","nonce":2963240067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6811","nonce":2963240067}]},"public_addr":"10.20.193.162:6809/2963240067","cluster_addr":"10.20.193.162:6810/2963240067","heartbeat_back_addr":"10.20.193.162:6812/2963240067","heartbeat_front_addr":"10.20.193.162:6811/2963240067","state":["exists","up"]},{"osd":8,"uuid":"fb377a45-1ce5-4e07-92cd-7f546cfad57f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6812","nonce":1933830164}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6813","nonce":1933830164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6815","nonce":1933830164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6814","nonce":1933830164}]},"public_addr":"10.20.193.26:6812/1933830164","cluster_addr":"10.20.193.26:6813/1933830164","heartbeat_back_addr":"10.20.193.26:6815/1933830164","heartbeat_front_addr":"10.20.193.26:6814/1933830164","state":["exists","up"]},{"osd":9,"uuid":"8079b2ca-96c3-4321-9f24-a87e8ea1e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6804","nonce":3709696191}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6805","nonce":3709696191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6807","nonce":3709696191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6806","nonce":3709696191}]},"public_addr":"10.20.193.70:6804/3709696191","cluster_addr":"10.20.193.70:6805/3709696191","heartbeat_back_addr":"10.20.193.70:6807/3709696191","heartbeat_front_addr":"10.20.193.70:6806/3709696191","state":["exists","up"]},{"osd":10,"uuid":"8df004a9-88e3-43f5-833d-dfc73a658ec3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6801","nonce":3185480373}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6803","nonce":3185480373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6807","nonce":3185480373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6805","nonce":3185480373}]},"public_addr":"10.20.193.103:6801/3185480373","cluster_addr":"10.20.193.103:6803/3185480373","heartbeat_back_addr":"10.20.193.103:6807/3185480373","heartbeat_front_addr":"10.20.193.103:6805/3185480373","state":["exists","up"]},{"osd":11,"uuid":"f3cf3a4b-1c26-480c-ba10-178f8542c1e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6813","nonce":1717662802}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6814","nonce":1717662802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6816","nonce":1717662802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6815","nonce":1717662802}]},"public_addr":"10.20.193.162:6813/1717662802","cluster_addr":"10.20.193.162:6814/1717662802","heartbeat_back_addr":"10.20.193.162:6816/1717662802","heartbeat_front_addr":"10.20.193.162:6815/1717662802","state":["exists","up"]},{"osd":12,"uuid":"0e06b2e9-9b29-4c6e-ab44-77fd24d945af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6804","nonce":2128192173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6805","nonce":2128192173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6807","nonce":2128192173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6806","nonce":2128192173}]},"public_addr":"10.20.193.26:6804/2128192173","cluster_addr":"10.20.193.26:6805/2128192173","heartbeat_back_addr":"10.20.193.26:6807/2128192173","heartbeat_front_addr":"10.20.193.26:6806/2128192173","state":["exists","up"]},{"osd":13,"uuid":"b1cbaf8b-36e9-4196-a08d-e6e72c2229e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6808","nonce":2949423039}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6809","nonce":2949423039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6811","nonce":2949423039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6810","nonce":2949423039}]},"public_addr":"10.20.193.70:6808/2949423039","cluster_addr":"10.20.193.70:6809/2949423039","heartbeat_back_addr":"10.20.193.70:6811/2949423039","heartbeat_front_addr":"10.20.193.70:6810/2949423039","state":["exists","up"]},{"osd":14,"uuid":"214e8bfc-c78d-45ac-9ec3-7685dd5684cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6812","nonce":1276189911}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6813","nonce":1276189911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6815","nonce":1276189911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6814","nonce":1276189911}]},"public_addr":"10.20.193.103:6812/1276189911","cluster_addr":"10.20.193.103:6813/1276189911","heartbeat_back_addr":"10.20.193.103:6815/1276189911","heartbeat_front_addr":"10.20.193.103:6814/1276189911","state":["exists","up"]},{"osd":15,"uuid":"8c2eb0c6-abf0-42a7-bcab-83d0c9cf797b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6801","nonce":3445416924}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6802","nonce":3445416924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6804","nonce":3445416924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6803","nonce":3445416924}]},"public_addr":"10.20.193.162:6801/3445416924","cluster_addr":"10.20.193.162:6802/3445416924","heartbeat_back_addr":"10.20.193.162:6804/3445416924","heartbeat_front_addr":"10.20.193.162:6803/3445416924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.943088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.818374+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.712635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:53.063441+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.745019+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:53.046388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.670956+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:53.091882+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:53.000309+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.773039+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.840607+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:53.229086+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.734626+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.874415+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.926522+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.903220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T19:18:02.579 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.577+0000 7fb04f91a640 10 librados: watch_flush enter 2026-02-24T19:18:02.579 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.577+0000 7fb04f91a640 10 librados: watch_flush exit 2026-02-24T19:18:02.579 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.577+0000 7fb04f91a640 20 client.4347.objecter shutdown clearing up homeless session... 2026-02-24T19:18:02.579 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.577+0000 7fb04f91a640 10 client.4347.objecter successfully canceled tick 2026-02-24T19:18:02.579 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.577+0000 7fb04f91a640 1 -- 10.20.193.26:0/360135981 >> v1:10.20.193.162:6800/3889602630 conn(0x7fb018077dd0 legacy=0x7fb018098280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:02.579 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.577+0000 7fb04f91a640 10 monclient: shutdown 2026-02-24T19:18:02.579 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.577+0000 7fb04f91a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:02.580 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.577+0000 7fb04f91a640 1 -- 10.20.193.26:0/360135981 >> v1:10.20.193.26:6789/0 conn(0x7fb048057640 legacy=0x7fb0480b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:02.580 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.577+0000 7fb04f91a640 1 -- 10.20.193.26:0/360135981 shutdown_connections 2026-02-24T19:18:02.580 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.577+0000 7fb04f91a640 1 -- 10.20.193.26:0/360135981 >> 10.20.193.26:0/360135981 conn(0x7fb0480b3830 msgr2=0x7fb0480b3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:02.580 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.577+0000 7fb04f91a640 1 -- 10.20.193.26:0/360135981 shutdown_connections 2026-02-24T19:18:02.580 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.577+0000 7fb04f91a640 1 -- 10.20.193.26:0/360135981 wait complete. 2026-02-24T19:18:02.580 INFO:teuthology.misc.health.trial026.stderr:2026-02-24T19:18:02.577+0000 7fb04f91a640 1 librados: shutdown 2026-02-24T19:18:02.586 DEBUG:teuthology.misc:16 of 16 OSDs are up 2026-02-24T19:18:02.586 INFO:tasks.ceph:Creating RBD pool 2026-02-24T19:18:02.587 DEBUG:teuthology.orchestra.run.trial026:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-24T19:18:02.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.651+0000 7fd36dbed640 10 monclient: get_monmap_and_config 2026-02-24T19:18:02.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.651+0000 7fd36dbed640 10 monclient: build_initial_monmap 2026-02-24T19:18:02.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.651+0000 7fd36dbed640 10 monclient: monmap: 2026-02-24T19:18:02.653 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:02.653 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:02.653 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:02.652683+0000 2026-02-24T19:18:02.653 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:02.652683+0000 2026-02-24T19:18:02.653 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:02.653 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:02.653 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:02.654 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:02.654 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:02.654 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:02.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.652+0000 7fd36dbed640 1 Processor -- start 2026-02-24T19:18:02.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.652+0000 7fd36dbed640 1 -- start start 2026-02-24T19:18:02.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.652+0000 7fd36dbed640 10 monclient: init 2026-02-24T19:18:02.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.652+0000 7fd36dbed640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:02.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.652+0000 7fd36dbed640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:18:02.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.652+0000 7fd36dbed640 10 monclient(hunting): picked mon.noname-c con 0x7fd36815a2a0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:02.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.652+0000 7fd36dbed640 10 monclient(hunting): picked mon.noname-a con 0x7fd3680b3b10 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:02.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.652+0000 7fd36dbed640 10 monclient(hunting): picked mon.noname-b con 0x7fd368056b00 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:02.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.652+0000 7fd36dbed640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd368160e50 con 0x7fd3680b3b10 2026-02-24T19:18:02.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.652+0000 7fd36dbed640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd368059be0 con 0x7fd368056b00 2026-02-24T19:18:02.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.652+0000 7fd36dbed640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd368059ec0 con 0x7fd36815a2a0 2026-02-24T19:18:02.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.652+0000 7fd36dbed640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:02.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.652+0000 7fd36dbed640 10 monclient(hunting): authenticate will time out at 3665.334989s 2026-02-24T19:18:02.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.653+0000 7fd366ffd640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fd3680b3b10 0x7fd368160740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:46598/0 (socket says 10.20.193.26:46598) 2026-02-24T19:18:02.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.653+0000 7fd366ffd640 1 -- 10.20.193.26:0/579954370 learned_addr learned my addr 10.20.193.26:0/579954370 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:02.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.654+0000 7fd3667fc640 1 -- 10.20.193.26:0/579954370 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4004924284 0 0) 0x7fd368160e50 con 0x7fd3680b3b10 2026-02-24T19:18:02.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.654+0000 7fd3667fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:02.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.654+0000 7fd3667fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:02.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.654+0000 7fd3667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:02.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.654+0000 7fd3667fc640 10 monclient(hunting): my global_id is 4350 2026-02-24T19:18:02.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.654+0000 7fd3667fc640 1 -- 10.20.193.26:0/579954370 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd34c0058a0 con 0x7fd3680b3b10 2026-02-24T19:18:02.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.654+0000 7fd3667fc640 1 -- 10.20.193.26:0/579954370 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1953588819 0 0) 0x7fd368059be0 con 0x7fd368056b00 2026-02-24T19:18:02.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.654+0000 7fd3667fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:02.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.654+0000 7fd3667fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:02.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.654+0000 7fd3667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:02.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.654+0000 7fd3667fc640 10 monclient(hunting): my global_id is 4339 2026-02-24T19:18:02.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.654+0000 7fd3667fc640 1 -- 10.20.193.26:0/579954370 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd368160e50 con 0x7fd368056b00 2026-02-24T19:18:02.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.655+0000 7fd3667fc640 1 -- 10.20.193.26:0/579954370 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 242810887 0 0) 0x7fd368059ec0 con 0x7fd36815a2a0 2026-02-24T19:18:02.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.655+0000 7fd3667fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:02.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.655+0000 7fd3667fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:02.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.655+0000 7fd3667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:02.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.655+0000 7fd3667fc640 10 monclient(hunting): my global_id is 4358 2026-02-24T19:18:02.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.655+0000 7fd3667fc640 1 -- 10.20.193.26:0/579954370 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd368059be0 con 0x7fd36815a2a0 2026-02-24T19:18:02.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.656+0000 7fd3667fc640 1 -- 10.20.193.26:0/579954370 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 640572697 0 0) 0x7fd34c0058a0 con 0x7fd3680b3b10 2026-02-24T19:18:02.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.656+0000 7fd3667fc640 1 -- 10.20.193.26:0/579954370 >> v1:10.20.193.103:6789/0 conn(0x7fd36815a2a0 legacy=0x7fd368160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:02.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.656+0000 7fd3667fc640 1 -- 10.20.193.26:0/579954370 >> v1:10.20.193.70:6789/0 conn(0x7fd368056b00 legacy=0x7fd3681c5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:02.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.656+0000 7fd3667fc640 10 monclient: _finish_hunting 0 2026-02-24T19:18:02.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.656+0000 7fd3667fc640 1 monclient: found mon.noname-a 2026-02-24T19:18:02.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.656+0000 7fd3667fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:02.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.656+0000 7fd3667fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:18:02.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.656+0000 7fd3667fc640 1 -- 10.20.193.26:0/579954370 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3680b0fb0 con 0x7fd3680b3b10 2026-02-24T19:18:02.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.656+0000 7fd3667fc640 10 monclient: _finish_auth 0 2026-02-24T19:18:02.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.656+0000 7fd3667fc640 10 monclient: _check_auth_tickets 2026-02-24T19:18:02.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.656+0000 7fd3667fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:02.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.656+0000 7fd3667fc640 1 -- 10.20.193.26:0/579954370 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd358002df0 con 0x7fd3680b3b10 2026-02-24T19:18:02.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.656+0000 7fd3667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:02.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.656+0000 7fd3667fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:02.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.656+0000 7fd3667fc640 10 monclient: dump: 2026-02-24T19:18:02.660 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:02.660 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:02.660 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:02.660 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:02.660 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:02.660 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:02.660 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:02.661 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:02.661 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:02.661 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:02.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.656+0000 7fd36dbed640 5 monclient: authenticate success, global_id 4350 2026-02-24T19:18:02.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.656+0000 7fd36dbed640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:02.665 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.657+0000 7fd3667fc640 1 -- 10.20.193.26:0/579954370 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd358002fc0 con 0x7fd3680b3b10 2026-02-24T19:18:02.665 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.657+0000 7fd3667fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:02.665 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.657+0000 7fd3667fc640 1 -- 10.20.193.26:0/579954370 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd358003400 con 0x7fd3680b3b10 2026-02-24T19:18:02.665 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.657+0000 7fd3667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:02.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.657+0000 7fd3667fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:02.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.657+0000 7fd3667fc640 10 monclient: dump: 2026-02-24T19:18:02.666 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:02.666 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:02.666 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:02.666 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:02.666 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:02.666 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:02.666 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:02.666 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:02.666 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:02.666 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:02.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.657+0000 7fd36dbed640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:02.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.657+0000 7fd36dbed640 4 set_mon_vals no callback set 2026-02-24T19:18:02.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.657+0000 7fd36dbed640 10 monclient: shutdown 2026-02-24T19:18:02.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.657+0000 7fd36dbed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:02.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.657+0000 7fd36dbed640 1 -- 10.20.193.26:0/579954370 >> v1:10.20.193.26:6789/0 conn(0x7fd3680b3b10 legacy=0x7fd368160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:02.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.657+0000 7fd36dbed640 1 -- 10.20.193.26:0/579954370 shutdown_connections 2026-02-24T19:18:02.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.657+0000 7fd36dbed640 1 -- 10.20.193.26:0/579954370 >> 10.20.193.26:0/579954370 conn(0x7fd3680b2f10 msgr2=0x7fd3680b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:02.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.657+0000 7fd36dbed640 1 -- 10.20.193.26:0/579954370 shutdown_connections 2026-02-24T19:18:02.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.657+0000 7fd36dbed640 1 -- 10.20.193.26:0/579954370 wait complete. 2026-02-24T19:18:02.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.658+0000 7fd36dbed640 10 monclient: build_initial_monmap 2026-02-24T19:18:02.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.658+0000 7fd36dbed640 10 monclient: monmap: 2026-02-24T19:18:02.667 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:02.667 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:02.667 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:02.668 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:02.668 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:02.668 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:02.668 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:02.668 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:02.668 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:02.668 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:02.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.658+0000 7fd36dbed640 1 librados: starting msgr at 2026-02-24T19:18:02.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.658+0000 7fd36dbed640 1 librados: starting objecter 2026-02-24T19:18:02.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.658+0000 7fd36dbed640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:02.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.658+0000 7fd36dbed640 1 Processor -- start 2026-02-24T19:18:02.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.658+0000 7fd36dbed640 1 -- start start 2026-02-24T19:18:02.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.658+0000 7fd36dbed640 1 librados: setting wanted keys 2026-02-24T19:18:02.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.658+0000 7fd36dbed640 1 librados: calling monclient init 2026-02-24T19:18:02.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.658+0000 7fd36dbed640 10 monclient: init 2026-02-24T19:18:02.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.658+0000 7fd36dbed640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:02.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.658+0000 7fd36dbed640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:18:02.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.658+0000 7fd36dbed640 10 monclient(hunting): picked mon.noname-a con 0x7fd368056b00 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:02.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.658+0000 7fd36dbed640 10 monclient(hunting): picked mon.noname-c con 0x7fd3680b3b10 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:02.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.658+0000 7fd36dbed640 10 monclient(hunting): picked mon.noname-b con 0x7fd36815a2a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:02.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.658+0000 7fd36dbed640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd36815e560 con 0x7fd368056b00 2026-02-24T19:18:02.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.658+0000 7fd36dbed640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd36815e840 con 0x7fd36815a2a0 2026-02-24T19:18:02.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.658+0000 7fd36dbed640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd36815eb20 con 0x7fd3680b3b10 2026-02-24T19:18:02.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.658+0000 7fd36dbed640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:02.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.658+0000 7fd36dbed640 10 monclient(hunting): authenticate will time out at 3665.340853s 2026-02-24T19:18:02.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.659+0000 7fd366ffd640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fd3680b3b10 0x7fd36815f600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:55346/0 (socket says 10.20.193.26:55346) 2026-02-24T19:18:02.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.659+0000 7fd366ffd640 1 -- 10.20.193.26:0/2198578732 learned_addr learned my addr 10.20.193.26:0/2198578732 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:02.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.659+0000 7fd343fff640 10 client.?.objecter ms_handle_connect 0x7fd36815a2a0 2026-02-24T19:18:02.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.659+0000 7fd343fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:02.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.659+0000 7fd343fff640 10 client.?.objecter ms_handle_connect 0x7fd368056b00 2026-02-24T19:18:02.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.659+0000 7fd343fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:02.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.659+0000 7fd343fff640 10 client.?.objecter ms_handle_connect 0x7fd3680b3b10 2026-02-24T19:18:02.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.659+0000 7fd343fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:02.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.660+0000 7fd343fff640 1 -- 10.20.193.26:0/2198578732 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3031868408 0 0) 0x7fd36815eb20 con 0x7fd3680b3b10 2026-02-24T19:18:02.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.660+0000 7fd343fff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:02.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.660+0000 7fd343fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:02.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.660+0000 7fd343fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:02.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.660+0000 7fd343fff640 10 monclient(hunting): my global_id is 4361 2026-02-24T19:18:02.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.660+0000 7fd343fff640 1 -- 10.20.193.26:0/2198578732 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd338003610 con 0x7fd3680b3b10 2026-02-24T19:18:02.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.660+0000 7fd343fff640 1 -- 10.20.193.26:0/2198578732 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3565879820 0 0) 0x7fd36815e560 con 0x7fd368056b00 2026-02-24T19:18:02.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.660+0000 7fd343fff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:02.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.660+0000 7fd343fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:02.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.660+0000 7fd343fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:02.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.660+0000 7fd343fff640 10 monclient(hunting): my global_id is 4353 2026-02-24T19:18:02.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.660+0000 7fd343fff640 1 -- 10.20.193.26:0/2198578732 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd36815eb20 con 0x7fd368056b00 2026-02-24T19:18:02.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.660+0000 7fd343fff640 1 -- 10.20.193.26:0/2198578732 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3779170731 0 0) 0x7fd36815e840 con 0x7fd36815a2a0 2026-02-24T19:18:02.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.660+0000 7fd343fff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:02.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.660+0000 7fd343fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:02.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.660+0000 7fd343fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:02.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.660+0000 7fd343fff640 10 monclient(hunting): my global_id is 4342 2026-02-24T19:18:02.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.660+0000 7fd343fff640 1 -- 10.20.193.26:0/2198578732 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd36815e560 con 0x7fd36815a2a0 2026-02-24T19:18:02.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.663+0000 7fd343fff640 1 -- 10.20.193.26:0/2198578732 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2820445820 0 0) 0x7fd338003610 con 0x7fd3680b3b10 2026-02-24T19:18:02.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.663+0000 7fd343fff640 1 -- 10.20.193.26:0/2198578732 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd36815e840 con 0x7fd3680b3b10 2026-02-24T19:18:02.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.663+0000 7fd343fff640 1 -- 10.20.193.26:0/2198578732 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd358003310 con 0x7fd3680b3b10 2026-02-24T19:18:02.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.663+0000 7fd343fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:02.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.663+0000 7fd343fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:02.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.663+0000 7fd343fff640 10 monclient(hunting): dump: 2026-02-24T19:18:02.672 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:02.672 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:02.672 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:02.672 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:02.672 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:02.672 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:02.672 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:02.672 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:02.672 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:02.672 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:02.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.663+0000 7fd343fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:02.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.663+0000 7fd343fff640 1 -- 10.20.193.26:0/2198578732 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3551140554 0 0) 0x7fd36815eb20 con 0x7fd368056b00 2026-02-24T19:18:02.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.663+0000 7fd343fff640 1 -- 10.20.193.26:0/2198578732 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd338003610 con 0x7fd368056b00 2026-02-24T19:18:02.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.663+0000 7fd343fff640 1 -- 10.20.193.26:0/2198578732 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd354002fb0 con 0x7fd368056b00 2026-02-24T19:18:02.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.663+0000 7fd343fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:02.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.663+0000 7fd343fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:02.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.663+0000 7fd343fff640 10 monclient(hunting): dump: 2026-02-24T19:18:02.673 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:02.673 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:02.673 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:02.673 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:02.673 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:02.673 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:02.673 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:02.673 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:02.673 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:02.673 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:02.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.663+0000 7fd343fff640 1 -- 10.20.193.26:0/2198578732 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2805194381 0 0) 0x7fd36815e560 con 0x7fd36815a2a0 2026-02-24T19:18:02.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.663+0000 7fd343fff640 1 -- 10.20.193.26:0/2198578732 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd36815eb20 con 0x7fd36815a2a0 2026-02-24T19:18:02.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.663+0000 7fd343fff640 1 -- 10.20.193.26:0/2198578732 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd35c003430 con 0x7fd36815a2a0 2026-02-24T19:18:02.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.663+0000 7fd343fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:02.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.663+0000 7fd343fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:02.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.663+0000 7fd343fff640 10 monclient(hunting): dump: 2026-02-24T19:18:02.674 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:02.674 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:02.674 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:02.674 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:02.674 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:02.674 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:02.674 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:02.674 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:02.674 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:02.674 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:02.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.664+0000 7fd343fff640 1 -- 10.20.193.26:0/2198578732 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3338753995 0 0) 0x7fd36815e840 con 0x7fd3680b3b10 2026-02-24T19:18:02.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.664+0000 7fd343fff640 1 -- 10.20.193.26:0/2198578732 >> v1:10.20.193.70:6789/0 conn(0x7fd36815a2a0 legacy=0x7fd368156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:02.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.664+0000 7fd343fff640 1 -- 10.20.193.26:0/2198578732 >> v1:10.20.193.26:6789/0 conn(0x7fd368056b00 legacy=0x7fd3681fe8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:02.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.664+0000 7fd343fff640 10 monclient: _finish_hunting 0 2026-02-24T19:18:02.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.664+0000 7fd343fff640 1 monclient: found mon.c 2026-02-24T19:18:02.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.664+0000 7fd343fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:02.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.664+0000 7fd343fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:02.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.664+0000 7fd343fff640 1 -- 10.20.193.26:0/2198578732 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36815ee00 con 0x7fd3680b3b10 2026-02-24T19:18:02.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.664+0000 7fd343fff640 10 monclient: _finish_auth 0 2026-02-24T19:18:02.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.664+0000 7fd343fff640 10 monclient: _check_auth_tickets 2026-02-24T19:18:02.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.664+0000 7fd343fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:02.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.664+0000 7fd36dbed640 5 monclient: authenticate success, global_id 4361 2026-02-24T19:18:02.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.664+0000 7fd36dbed640 10 monclient: _renew_subs 2026-02-24T19:18:02.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.664+0000 7fd36dbed640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:02.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.664+0000 7fd36dbed640 1 -- 10.20.193.26:0/2198578732 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd3681feff0 con 0x7fd3680b3b10 2026-02-24T19:18:02.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.665+0000 7fd36dbed640 10 client.4361.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:02.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.665+0000 7fd36dbed640 10 monclient: _renew_subs 2026-02-24T19:18:02.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.665+0000 7fd36dbed640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:02.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.665+0000 7fd36dbed640 1 -- 10.20.193.26:0/2198578732 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd36815fd10 con 0x7fd3680b3b10 2026-02-24T19:18:02.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.665+0000 7fd36dbed640 1 librados: init done 2026-02-24T19:18:02.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.665+0000 7fd36dbed640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:02.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.665+0000 7fd36dbed640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:02.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.665+0000 7fd36dbed640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:02.678 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.665+0000 7fd36dbed640 1 -- 10.20.193.26:0/2198578732 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3681594c0 con 0x7fd3680b3b10 2026-02-24T19:18:02.759 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.758+0000 7fd343fff640 1 -- 10.20.193.26:0/2198578732 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd358002f70 con 0x7fd3680b3b10 2026-02-24T19:18:02.759 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.758+0000 7fd343fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:02.760 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.758+0000 7fd343fff640 1 -- 10.20.193.26:0/2198578732 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd358004b80 con 0x7fd3680b3b10 2026-02-24T19:18:02.760 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.758+0000 7fd343fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:02.760 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.758+0000 7fd343fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:02.760 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.758+0000 7fd365ffb640 4 set_mon_vals no callback set 2026-02-24T19:18:02.760 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.758+0000 7fd343fff640 10 monclient: dump: 2026-02-24T19:18:02.760 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:02.760 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:02.760 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:02.760 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:02.760 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:02.760 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:02.760 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:02.760 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:02.760 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:02.761 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:02.761 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.759+0000 7fd343fff640 1 -- 10.20.193.26:0/2198578732 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fd358004d60 con 0x7fd3680b3b10 2026-02-24T19:18:02.761 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.760+0000 7fd3677fe640 10 monclient: get_auth_request con 0x7fd338077f60 auth_method 0 2026-02-24T19:18:02.761 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.760+0000 7fd343fff640 10 client.4361.objecter ms_handle_connect 0x7fd338077f60 2026-02-24T19:18:02.762 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.760+0000 7fd343fff640 1 -- 10.20.193.26:0/2198578732 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 7757+0+0 (unknown 3594664483 0 0) 0x7fd358093160 con 0x7fd3680b3b10 2026-02-24T19:18:02.762 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.760+0000 7fd343fff640 10 client.4361.objecter ms_dispatch2 0x7fd368000b90 osd_map(25..25 src has 1..25) 2026-02-24T19:18:02.762 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.760+0000 7fd343fff640 3 client.4361.objecter handle_osd_map got epochs [25,25] > 0 2026-02-24T19:18:02.762 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.760+0000 7fd343fff640 3 client.4361.objecter handle_osd_map decoding full epoch 25 2026-02-24T19:18:02.762 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.761+0000 7fd343fff640 20 client.4361.objecter dump_active .. 0 homeless 2026-02-24T19:18:02.763 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.762+0000 7fd343fff640 1 -- 10.20.193.26:0/2198578732 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fd358004b80 con 0x7fd3680b3b10 2026-02-24T19:18:02.763 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.762+0000 7fd343fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:02.763 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.762+0000 7fd343fff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:02.867 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.866+0000 7fd36dbed640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-24T19:18:02.867 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.866+0000 7fd36dbed640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-24T19:18:02.867 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.866+0000 7fd36dbed640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:02.867 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:02.866+0000 7fd36dbed640 1 -- 10.20.193.26:0/2198578732 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7fd3681625a0 con 0x7fd3680b3b10 2026-02-24T19:18:04.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.553+0000 7fd343fff640 1 -- 10.20.193.26:0/2198578732 <== mon.2 v1:10.20.193.103:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v26) ==== 109+0+0 (unknown 437888687 0 0) 0x7fd35805db90 con 0x7fd3680b3b10 2026-02-24T19:18:04.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.553+0000 7fd343fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-24T19:18:04.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.553+0000 7fd343fff640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2026-02-24T19:18:04.555 INFO:teuthology.orchestra.run.trial026.stderr:pool 'rbd' created 2026-02-24T19:18:04.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.556+0000 7fd36dbed640 10 librados: watch_flush enter 2026-02-24T19:18:04.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.556+0000 7fd36dbed640 10 librados: watch_flush exit 2026-02-24T19:18:04.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.556+0000 7fd36dbed640 20 client.4361.objecter shutdown clearing up homeless session... 2026-02-24T19:18:04.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.556+0000 7fd36dbed640 10 client.4361.objecter successfully canceled tick 2026-02-24T19:18:04.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.556+0000 7fd36dbed640 1 -- 10.20.193.26:0/2198578732 >> v1:10.20.193.162:6800/3889602630 conn(0x7fd338077f60 legacy=0x7fd338098410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:04.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.556+0000 7fd36dbed640 10 monclient: shutdown 2026-02-24T19:18:04.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.556+0000 7fd36dbed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:04.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.556+0000 7fd36dbed640 1 -- 10.20.193.26:0/2198578732 >> v1:10.20.193.103:6789/0 conn(0x7fd3680b3b10 legacy=0x7fd36815f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:04.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.556+0000 7fd36dbed640 1 -- 10.20.193.26:0/2198578732 shutdown_connections 2026-02-24T19:18:04.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.556+0000 7fd36dbed640 1 -- 10.20.193.26:0/2198578732 >> 10.20.193.26:0/2198578732 conn(0x7fd3680b2f10 msgr2=0x7fd368162ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:04.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.556+0000 7fd36dbed640 1 -- 10.20.193.26:0/2198578732 shutdown_connections 2026-02-24T19:18:04.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.556+0000 7fd36dbed640 1 -- 10.20.193.26:0/2198578732 wait complete. 2026-02-24T19:18:04.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.556+0000 7fd36dbed640 1 librados: shutdown 2026-02-24T19:18:04.566 DEBUG:teuthology.orchestra.run.trial026:> rbd --cluster ceph pool init rbd 2026-02-24T19:18:04.599 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.598+0000 7fc931c98300 10 monclient: get_monmap_and_config 2026-02-24T19:18:04.599 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.598+0000 7fc931c98300 10 monclient: build_initial_monmap 2026-02-24T19:18:04.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.598+0000 7fc931c98300 10 monclient: monmap: 2026-02-24T19:18:04.600 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:04.600 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:04.600 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:04.599379+0000 2026-02-24T19:18:04.600 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:04.599379+0000 2026-02-24T19:18:04.600 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:04.600 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:04.600 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:04.600 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:04.600 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:04.600 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:04.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.599+0000 7fc931c98300 1 Processor -- start 2026-02-24T19:18:04.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.599+0000 7fc931c98300 1 -- start start 2026-02-24T19:18:04.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.599+0000 7fc931c98300 10 monclient: init 2026-02-24T19:18:04.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.599+0000 7fc931c98300 10 monclient: _reopen_session rank -1 2026-02-24T19:18:04.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.599+0000 7fc931c98300 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:18:04.603 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.599+0000 7fc931c98300 10 monclient(hunting): picked mon.noname-b con 0x558af3de55d0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:04.603 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.599+0000 7fc931c98300 10 monclient(hunting): picked mon.noname-c con 0x558af3ecedc0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:04.603 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.599+0000 7fc931c98300 10 monclient(hunting): picked mon.noname-a con 0x558af3de59a0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:04.603 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.599+0000 7fc931c98300 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x558af3c3e0c0 con 0x558af3de59a0 2026-02-24T19:18:04.603 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.599+0000 7fc931c98300 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x558af3c4da80 con 0x558af3de55d0 2026-02-24T19:18:04.603 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.599+0000 7fc931c98300 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x558af3deae90 con 0x558af3ecedc0 2026-02-24T19:18:04.603 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.599+0000 7fc931c98300 10 monclient(hunting): _renew_subs 2026-02-24T19:18:04.603 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.599+0000 7fc931c98300 10 monclient(hunting): authenticate will time out at 3667.281747s 2026-02-24T19:18:04.603 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.600+0000 7fc92bfff640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x558af3de55d0 0x558af3ece6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:59334/0 (socket says 10.20.193.26:59334) 2026-02-24T19:18:04.603 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.600+0000 7fc92bfff640 1 -- 10.20.193.26:0/2219795425 learned_addr learned my addr 10.20.193.26:0/2219795425 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:04.603 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.601+0000 7fc92affd640 1 -- 10.20.193.26:0/2219795425 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2316926392 0 0) 0x558af3c4da80 con 0x558af3de55d0 2026-02-24T19:18:04.603 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.601+0000 7fc92affd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:04.604 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.601+0000 7fc92affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:04.604 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.601+0000 7fc92affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:04.604 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.601+0000 7fc92affd640 10 monclient(hunting): my global_id is 4348 2026-02-24T19:18:04.604 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.601+0000 7fc92affd640 1 -- 10.20.193.26:0/2219795425 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc914001e10 con 0x558af3de55d0 2026-02-24T19:18:04.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.603+0000 7fc92affd640 1 -- 10.20.193.26:0/2219795425 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 249400987 0 0) 0x7fc914001e10 con 0x558af3de55d0 2026-02-24T19:18:04.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.603+0000 7fc92affd640 1 -- 10.20.193.26:0/2219795425 >> v1:10.20.193.103:6789/0 conn(0x558af3ecedc0 legacy=0x558af3ed8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:04.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.603+0000 7fc92affd640 1 -- 10.20.193.26:0/2219795425 >> v1:10.20.193.26:6789/0 conn(0x558af3de59a0 legacy=0x558af3f3dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:04.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.603+0000 7fc92affd640 10 monclient: _finish_hunting 0 2026-02-24T19:18:04.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.603+0000 7fc92affd640 1 monclient: found mon.noname-b 2026-02-24T19:18:04.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.603+0000 7fc92affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:04.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.603+0000 7fc92affd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:18:04.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.603+0000 7fc92affd640 1 -- 10.20.193.26:0/2219795425 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558af3deb170 con 0x558af3de55d0 2026-02-24T19:18:04.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.603+0000 7fc92affd640 10 monclient: _finish_auth 0 2026-02-24T19:18:04.608 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.603+0000 7fc92affd640 10 monclient: _check_auth_tickets 2026-02-24T19:18:04.608 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.603+0000 7fc92affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:04.608 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.603+0000 7fc92affd640 1 -- 10.20.193.26:0/2219795425 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc91c0015f0 con 0x558af3de55d0 2026-02-24T19:18:04.608 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.603+0000 7fc92affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:04.608 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.603+0000 7fc92affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:04.608 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.603+0000 7fc92affd640 10 monclient: dump: 2026-02-24T19:18:04.608 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:04.608 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:04.608 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:04.608 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:04.608 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:04.608 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:04.608 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:04.609 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:04.609 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:04.609 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:04.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.603+0000 7fc931c98300 5 monclient: authenticate success, global_id 4348 2026-02-24T19:18:04.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.603+0000 7fc931c98300 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:04.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.604+0000 7fc92affd640 1 -- 10.20.193.26:0/2219795425 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc91c001800 con 0x558af3de55d0 2026-02-24T19:18:04.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.604+0000 7fc92affd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:04.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.604+0000 7fc92affd640 1 -- 10.20.193.26:0/2219795425 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc91c001c40 con 0x558af3de55d0 2026-02-24T19:18:04.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.604+0000 7fc92affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:04.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.604+0000 7fc92affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:04.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.604+0000 7fc92affd640 10 monclient: dump: 2026-02-24T19:18:04.609 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:04.609 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:04.609 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:04.610 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:04.610 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:04.610 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:04.610 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:04.610 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:04.610 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:04.610 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:04.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.604+0000 7fc931c98300 10 monclient: get_monmap_and_config success 2026-02-24T19:18:04.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.604+0000 7fc931c98300 4 set_mon_vals no callback set 2026-02-24T19:18:04.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.604+0000 7fc931c98300 10 monclient: shutdown 2026-02-24T19:18:04.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.604+0000 7fc931c98300 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:04.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.604+0000 7fc931c98300 1 -- 10.20.193.26:0/2219795425 >> v1:10.20.193.70:6789/0 conn(0x558af3de55d0 legacy=0x558af3ece6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:04.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.604+0000 7fc931c98300 1 -- 10.20.193.26:0/2219795425 shutdown_connections 2026-02-24T19:18:04.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.604+0000 7fc931c98300 1 -- 10.20.193.26:0/2219795425 >> 10.20.193.26:0/2219795425 conn(0x558af3e2fed0 msgr2=0x558af3e302d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:04.611 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.604+0000 7fc931c98300 1 -- 10.20.193.26:0/2219795425 shutdown_connections 2026-02-24T19:18:04.611 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.604+0000 7fc931c98300 1 -- 10.20.193.26:0/2219795425 wait complete. 2026-02-24T19:18:04.611 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.604+0000 7fc931c98300 10 monclient: build_initial_monmap 2026-02-24T19:18:04.611 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.604+0000 7fc931c98300 10 monclient: monmap: 2026-02-24T19:18:04.611 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:04.611 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:04.611 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:04.611 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:04.611 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:04.611 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:04.611 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:04.611 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:04.611 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:04.612 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:04.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.604+0000 7fc931c98300 1 librados: starting msgr at 2026-02-24T19:18:04.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.605+0000 7fc931c98300 1 librados: starting objecter 2026-02-24T19:18:04.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.605+0000 7fc931c98300 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:04.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.605+0000 7fc931c98300 1 Processor -- start 2026-02-24T19:18:04.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.605+0000 7fc931c98300 1 -- start start 2026-02-24T19:18:04.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.605+0000 7fc931c98300 1 librados: setting wanted keys 2026-02-24T19:18:04.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.605+0000 7fc931c98300 1 librados: calling monclient init 2026-02-24T19:18:04.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.605+0000 7fc931c98300 10 monclient: init 2026-02-24T19:18:04.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.605+0000 7fc931c98300 10 monclient: _reopen_session rank -1 2026-02-24T19:18:04.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.605+0000 7fc931c98300 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:18:04.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.605+0000 7fc931c98300 10 monclient(hunting): picked mon.noname-b con 0x558af3de55d0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:04.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.605+0000 7fc931c98300 10 monclient(hunting): picked mon.noname-a con 0x558af3de59a0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:04.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.605+0000 7fc931c98300 10 monclient(hunting): picked mon.noname-c con 0x558af3ecedc0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:04.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.605+0000 7fc931c98300 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x558af3e29860 con 0x558af3de59a0 2026-02-24T19:18:04.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.605+0000 7fc931c98300 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x558af3ed4f80 con 0x558af3de55d0 2026-02-24T19:18:04.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.605+0000 7fc931c98300 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x558af3ed5260 con 0x558af3ecedc0 2026-02-24T19:18:04.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.605+0000 7fc931c98300 10 monclient(hunting): _renew_subs 2026-02-24T19:18:04.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.605+0000 7fc931c98300 10 monclient(hunting): authenticate will time out at 3667.287622s 2026-02-24T19:18:04.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.605+0000 7fc92b7fe640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x558af3de59a0 0x558af3ee9f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:46638/0 (socket says 10.20.193.26:46638) 2026-02-24T19:18:04.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.605+0000 7fc92b7fe640 1 -- 10.20.193.26:0/1579927784 learned_addr learned my addr 10.20.193.26:0/1579927784 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:04.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.606+0000 7fc91bfff640 10 client.?.objecter ms_handle_connect 0x558af3de59a0 2026-02-24T19:18:04.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.606+0000 7fc91bfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:04.615 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.606+0000 7fc91bfff640 10 client.?.objecter ms_handle_connect 0x558af3ecedc0 2026-02-24T19:18:04.615 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.606+0000 7fc91bfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:04.616 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.606+0000 7fc91bfff640 10 client.?.objecter ms_handle_connect 0x558af3de55d0 2026-02-24T19:18:04.616 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.606+0000 7fc91bfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:04.616 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.607+0000 7fc91bfff640 1 -- 10.20.193.26:0/1579927784 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2273019249 0 0) 0x558af3e29860 con 0x558af3de59a0 2026-02-24T19:18:04.616 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.607+0000 7fc91bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:04.616 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.607+0000 7fc91bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:04.616 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.607+0000 7fc91bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:04.616 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.607+0000 7fc91bfff640 10 monclient(hunting): my global_id is 4359 2026-02-24T19:18:04.616 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.607+0000 7fc91bfff640 1 -- 10.20.193.26:0/1579927784 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc910001e10 con 0x558af3de59a0 2026-02-24T19:18:04.616 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.608+0000 7fc91bfff640 1 -- 10.20.193.26:0/1579927784 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2618680193 0 0) 0x558af3ed4f80 con 0x558af3de55d0 2026-02-24T19:18:04.616 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.608+0000 7fc91bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:04.616 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.608+0000 7fc91bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:04.616 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.608+0000 7fc91bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:04.617 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.608+0000 7fc91bfff640 10 monclient(hunting): my global_id is 4351 2026-02-24T19:18:04.617 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.608+0000 7fc91bfff640 1 -- 10.20.193.26:0/1579927784 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x558af3e29860 con 0x558af3de55d0 2026-02-24T19:18:04.617 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.610+0000 7fc91bfff640 1 -- 10.20.193.26:0/1579927784 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2942708104 0 0) 0x7fc910001e10 con 0x558af3de59a0 2026-02-24T19:18:04.617 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.610+0000 7fc91bfff640 1 -- 10.20.193.26:0/1579927784 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x558af3ed4f80 con 0x558af3de59a0 2026-02-24T19:18:04.617 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.610+0000 7fc91bfff640 1 -- 10.20.193.26:0/1579927784 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc9200018f0 con 0x558af3de59a0 2026-02-24T19:18:04.617 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.610+0000 7fc91bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:04.617 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.610+0000 7fc91bfff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:04.617 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.610+0000 7fc91bfff640 10 monclient(hunting): dump: 2026-02-24T19:18:04.617 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:04.617 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:04.617 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:04.617 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:04.617 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:04.617 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:04.618 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:04.618 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:04.618 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:04.618 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:04.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.610+0000 7fc91bfff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:04.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.610+0000 7fc91bfff640 1 -- 10.20.193.26:0/1579927784 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2336434811 0 0) 0x558af3e29860 con 0x558af3de55d0 2026-02-24T19:18:04.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.610+0000 7fc91bfff640 1 -- 10.20.193.26:0/1579927784 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc910001e10 con 0x558af3de55d0 2026-02-24T19:18:04.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.610+0000 7fc91bfff640 1 -- 10.20.193.26:0/1579927784 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc91c001950 con 0x558af3de55d0 2026-02-24T19:18:04.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.610+0000 7fc91bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:04.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.610+0000 7fc91bfff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:04.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.610+0000 7fc91bfff640 10 monclient(hunting): dump: 2026-02-24T19:18:04.618 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:04.618 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:04.618 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:04.619 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:04.619 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:04.619 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:04.619 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:04.619 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:04.619 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:04.619 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:04.619 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.612+0000 7fc91bfff640 1 -- 10.20.193.26:0/1579927784 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 536245406 0 0) 0x558af3ed4f80 con 0x558af3de59a0 2026-02-24T19:18:04.619 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.612+0000 7fc91bfff640 1 -- 10.20.193.26:0/1579927784 >> v1:10.20.193.103:6789/0 conn(0x558af3ecedc0 legacy=0x558af3ec0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:04.619 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.612+0000 7fc91bfff640 1 -- 10.20.193.26:0/1579927784 >> v1:10.20.193.70:6789/0 conn(0x558af3de55d0 legacy=0x558af3e29150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:04.619 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.612+0000 7fc91bfff640 10 monclient: _finish_hunting 0 2026-02-24T19:18:04.619 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.612+0000 7fc91bfff640 1 monclient: found mon.a 2026-02-24T19:18:04.619 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.612+0000 7fc91bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:04.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.612+0000 7fc91bfff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:04.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.612+0000 7fc91bfff640 1 -- 10.20.193.26:0/1579927784 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558af3ed5540 con 0x558af3de59a0 2026-02-24T19:18:04.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.612+0000 7fc91bfff640 10 monclient: _finish_auth 0 2026-02-24T19:18:04.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.612+0000 7fc91bfff640 10 monclient: _check_auth_tickets 2026-02-24T19:18:04.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.612+0000 7fc91bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:04.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.612+0000 7fc931c98300 5 monclient: authenticate success, global_id 4359 2026-02-24T19:18:04.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.612+0000 7fc931c98300 10 monclient: _renew_subs 2026-02-24T19:18:04.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.612+0000 7fc931c98300 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:04.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.612+0000 7fc931c98300 1 -- 10.20.193.26:0/1579927784 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x558af3ed5820 con 0x558af3de59a0 2026-02-24T19:18:04.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.612+0000 7fc931c98300 10 client.4359.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:04.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.612+0000 7fc931c98300 10 monclient: _renew_subs 2026-02-24T19:18:04.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.612+0000 7fc931c98300 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:04.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.612+0000 7fc931c98300 1 -- 10.20.193.26:0/1579927784 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x558af3ed4b50 con 0x558af3de59a0 2026-02-24T19:18:04.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.612+0000 7fc931c98300 1 librados: init done 2026-02-24T19:18:04.621 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.612+0000 7fc931c98300 10 librados: wait_for_osdmap waiting 2026-02-24T19:18:04.622 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.620+0000 7fc91bfff640 1 -- 10.20.193.26:0/1579927784 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc920001ca0 con 0x558af3de59a0 2026-02-24T19:18:04.622 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.620+0000 7fc91bfff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:04.622 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.620+0000 7fc91bfff640 1 -- 10.20.193.26:0/1579927784 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc920002350 con 0x558af3de59a0 2026-02-24T19:18:04.622 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.620+0000 7fc91bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:04.622 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.620+0000 7fc91bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:04.622 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.620+0000 7fc91bfff640 10 monclient: dump: 2026-02-24T19:18:04.622 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:04.622 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:04.622 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:04.622 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:04.623 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:04.623 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:04.623 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:04.623 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:04.623 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:04.623 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:04.623 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.620+0000 7fc92a7fc640 4 set_mon_vals no callback set 2026-02-24T19:18:04.624 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.621+0000 7fc91bfff640 1 -- 10.20.193.26:0/1579927784 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fc920002530 con 0x558af3de59a0 2026-02-24T19:18:04.624 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.622+0000 7fc92bfff640 10 monclient: get_auth_request con 0x7fc910076540 auth_method 0 2026-02-24T19:18:04.624 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.622+0000 7fc91bfff640 10 client.4359.objecter ms_handle_connect 0x7fc910076540 2026-02-24T19:18:04.625 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.623+0000 7fc91bfff640 1 -- 10.20.193.26:0/1579927784 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(26..26 src has 1..26) ==== 8102+0+0 (unknown 3947388393 0 0) 0x7fc920091b70 con 0x558af3de59a0 2026-02-24T19:18:04.625 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.623+0000 7fc91bfff640 10 client.4359.objecter ms_dispatch2 0x558af3cfad50 osd_map(26..26 src has 1..26) 2026-02-24T19:18:04.625 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.623+0000 7fc91bfff640 3 client.4359.objecter handle_osd_map got epochs [26,26] > 0 2026-02-24T19:18:04.625 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.623+0000 7fc91bfff640 3 client.4359.objecter handle_osd_map decoding full epoch 26 2026-02-24T19:18:04.625 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.623+0000 7fc91bfff640 20 client.4359.objecter dump_active .. 0 homeless 2026-02-24T19:18:04.625 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.623+0000 7fc931c98300 10 librados: wait_for_osdmap done waiting 2026-02-24T19:18:04.625 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.624+0000 7fc931c98300 10 start_mon_command cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-24T19:18:04.625 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.624+0000 7fc931c98300 10 monclient: _send_command 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-24T19:18:04.626 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.624+0000 7fc931c98300 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:04.626 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:04.624+0000 7fc931c98300 1 -- 10.20.193.26:0/1579927784 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x558af3eea860 con 0x558af3de59a0 2026-02-24T19:18:05.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.575+0000 7fc91bfff640 1 -- 10.20.193.26:0/1579927784 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v27) ==== 141+0+0 (unknown 3716993650 0 0) 0x7fc92005c5a0 con 0x558af3de59a0 2026-02-24T19:18:05.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.575+0000 7fc91bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-24T19:18:05.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.575+0000 7fc91bfff640 10 monclient: _finish_command 1 = system:0 enabled application 'rbd' on pool 'rbd' 2026-02-24T19:18:05.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.575+0000 7fc931c98300 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:05.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.575+0000 7fc931c98300 1 -- 10.20.193.26:0/1579927784 --> v1:10.20.193.26:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x558af3cd6fb0 con 0x558af3de59a0 2026-02-24T19:18:05.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.608+0000 7fc91bfff640 1 -- 10.20.193.26:0/1579927784 <== mon.0 v1:10.20.193.26:6789/0 10 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (unknown 2135480514 0 0) 0x7fc92005b5a0 con 0x558af3de59a0 2026-02-24T19:18:05.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.608+0000 7fc91bfff640 10 monclient: handle_get_version_reply finishing 1 version 27 2026-02-24T19:18:05.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.608+0000 7fc92a7fc640 10 client.4359.objecter _get_latest_version latest 27, waiting 2026-02-24T19:18:05.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.608+0000 7fc92a7fc640 10 client.4359.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:05.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.608+0000 7fc92a7fc640 10 monclient: _renew_subs 2026-02-24T19:18:05.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.608+0000 7fc92a7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:05.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.608+0000 7fc92a7fc640 1 -- 10.20.193.26:0/1579927784 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=27}) -- 0x7fc908002ae0 con 0x558af3de59a0 2026-02-24T19:18:05.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.610+0000 7fc91bfff640 1 -- 10.20.193.26:0/1579927784 <== mon.0 v1:10.20.193.26:6789/0 11 ==== osd_map(27..27 src has 1..27) ==== 669+0+0 (unknown 1119663747 0 0) 0x7fc92005b760 con 0x558af3de59a0 2026-02-24T19:18:05.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.610+0000 7fc91bfff640 10 client.4359.objecter ms_dispatch2 0x558af3cfad50 osd_map(27..27 src has 1..27) 2026-02-24T19:18:05.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.610+0000 7fc91bfff640 3 client.4359.objecter handle_osd_map got epochs [27,27] > 26 2026-02-24T19:18:05.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.610+0000 7fc91bfff640 3 client.4359.objecter handle_osd_map decoding incremental epoch 27 2026-02-24T19:18:05.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.610+0000 7fc91bfff640 20 client.4359.objecter dump_active .. 0 homeless 2026-02-24T19:18:05.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.610+0000 7fc931c98300 10 librados: create oid=rbd_trash nspace= 2026-02-24T19:18:05.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.610+0000 7fc931c98300 10 client.4359.objecter _op_submit op 0x558af3ec1470 2026-02-24T19:18:05.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.610+0000 7fc931c98300 20 client.4359.objecter _calc_target epoch 27 base rbd_trash @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:05.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.610+0000 7fc931c98300 20 client.4359.objecter _calc_target target rbd_trash @2 -> pgid 2.5a749323 2026-02-24T19:18:05.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.610+0000 7fc931c98300 10 client.4359.objecter _calc_target raw pgid 2.5a749323 -> actual 2.3 acting [3,0] primary 3 2026-02-24T19:18:05.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.610+0000 7fc931c98300 20 client.4359.objecter _get_session s=0x558af3c57280 osd=3 3 2026-02-24T19:18:05.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.610+0000 7fc931c98300 10 client.4359.objecter _op_submit oid rbd_trash '@2' '@2' [create] tid 1 osd.3 2026-02-24T19:18:05.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.610+0000 7fc931c98300 20 client.4359.objecter get_session s=0x558af3c57280 osd=3 3 2026-02-24T19:18:05.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.610+0000 7fc931c98300 15 client.4359.objecter _session_op_assign 3 1 2026-02-24T19:18:05.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.610+0000 7fc931c98300 15 client.4359.objecter _send_op 1 to 2.3 on osd.3 2026-02-24T19:18:05.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.610+0000 7fc931c98300 1 -- 10.20.193.26:0/1579927784 --> v1:10.20.193.162:6805/920272754 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558af3edc2c0 con 0x558af3edbed0 2026-02-24T19:18:05.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.610+0000 7fc931c98300 20 client.4359.objecter put_session s=0x558af3c57280 osd=3 4 2026-02-24T19:18:05.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.610+0000 7fc931c98300 5 client.4359.objecter 1 in flight 2026-02-24T19:18:05.616 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.615+0000 7fc9319d6640 10 monclient: get_auth_request con 0x558af3edbed0 auth_method 0 2026-02-24T19:18:05.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:05.617+0000 7fc91bfff640 10 client.4359.objecter ms_handle_connect 0x558af3edbed0 2026-02-24T19:18:06.226 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.225+0000 7fc9319d6640 1 -- 10.20.193.26:0/1579927784 <== osd.3 v1:10.20.193.162:6805/920272754 1 ==== osd_op_reply(1 rbd_trash [create] v27'1 uv1 ondisk = 0) ==== 153+0+0 (unknown 3684242346 0 0) 0x7fc9240038d0 con 0x558af3edbed0 2026-02-24T19:18:06.226 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.225+0000 7fc9319d6640 10 client.4359.objecter ms_dispatch2 0x558af3cfad50 osd_op_reply(1 rbd_trash [create] v27'1 uv1 ondisk = 0) 2026-02-24T19:18:06.226 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.225+0000 7fc9319d6640 10 client.4359.objecter in handle_osd_op_reply 2026-02-24T19:18:06.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.225+0000 7fc9319d6640 7 client.4359.objecter handle_osd_op_reply 1 ondisk uv 1 in 2.3 attempt 0 2026-02-24T19:18:06.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.225+0000 7fc9319d6640 10 client.4359.objecter op 0 rval 0 len 0 2026-02-24T19:18:06.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.225+0000 7fc9319d6640 15 client.4359.objecter handle_osd_op_reply completed tid 1 2026-02-24T19:18:06.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.225+0000 7fc9319d6640 15 client.4359.objecter _finish_op 1 2026-02-24T19:18:06.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.225+0000 7fc9319d6640 20 client.4359.objecter put_session s=0x558af3c57280 osd=3 4 2026-02-24T19:18:06.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.225+0000 7fc9319d6640 15 client.4359.objecter _session_op_remove 3 1 2026-02-24T19:18:06.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.225+0000 7fc9319d6640 5 client.4359.objecter 0 in flight 2026-02-24T19:18:06.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.225+0000 7fc931c98300 10 librados: Objecter returned from create r=0 2026-02-24T19:18:06.228 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.227+0000 7fc931c98300 10 client.4359.objecter _op_submit op 0x558af3faa8b0 2026-02-24T19:18:06.228 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.227+0000 7fc931c98300 20 client.4359.objecter _calc_target epoch 27 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:06.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.227+0000 7fc931c98300 20 client.4359.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-24T19:18:06.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.227+0000 7fc931c98300 10 client.4359.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [3,11] primary 3 2026-02-24T19:18:06.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.227+0000 7fc931c98300 10 client.4359.objecter chose random osd.11 of [3,11] 2026-02-24T19:18:06.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.227+0000 7fc931c98300 20 client.4359.objecter _get_session s=0x558af3faadc0 osd=11 3 2026-02-24T19:18:06.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.227+0000 7fc931c98300 10 client.4359.objecter _op_submit oid rbd_info '@2' '@2' [call rbd.metadata_list in=33b] tid 2 osd.11 2026-02-24T19:18:06.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.227+0000 7fc931c98300 20 client.4359.objecter get_session s=0x558af3faadc0 osd=11 3 2026-02-24T19:18:06.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.227+0000 7fc931c98300 15 client.4359.objecter _session_op_assign 11 2 2026-02-24T19:18:06.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.227+0000 7fc931c98300 15 client.4359.objecter _send_op 2 to 2.2 on osd.11 2026-02-24T19:18:06.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.227+0000 7fc931c98300 1 -- 10.20.193.26:0/1579927784 --> v1:10.20.193.162:6813/1717662802 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e27) -- 0x558af3fcd300 con 0x558af3fab800 2026-02-24T19:18:06.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.227+0000 7fc931c98300 20 client.4359.objecter put_session s=0x558af3faadc0 osd=11 4 2026-02-24T19:18:06.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.227+0000 7fc931c98300 5 client.4359.objecter 1 in flight 2026-02-24T19:18:06.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.227+0000 7fc92bfff640 10 monclient: get_auth_request con 0x558af3fab800 auth_method 0 2026-02-24T19:18:06.230 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.229+0000 7fc91bfff640 10 client.4359.objecter ms_handle_connect 0x558af3fab800 2026-02-24T19:18:06.288 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.286+0000 7fc92bfff640 1 -- 10.20.193.26:0/1579927784 <== osd.11 v1:10.20.193.162:6813/1717662802 1 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 1379133595 0 0) 0x7fc91c006440 con 0x558af3fab800 2026-02-24T19:18:06.288 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.286+0000 7fc92bfff640 10 client.4359.objecter ms_dispatch2 0x558af3cfad50 osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:06.288 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.286+0000 7fc92bfff640 10 client.4359.objecter in handle_osd_op_reply 2026-02-24T19:18:06.288 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.286+0000 7fc92bfff640 7 client.4359.objecter handle_osd_op_reply 2 ondisk uv 0 in 2.2 attempt 0 2026-02-24T19:18:06.288 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.286+0000 7fc92bfff640 10 client.4359.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:06.288 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.286+0000 7fc92bfff640 10 client.4359.objecter op 0 rval 0 len 0 2026-02-24T19:18:06.288 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.286+0000 7fc92bfff640 15 client.4359.objecter handle_osd_op_reply completed tid 2 2026-02-24T19:18:06.288 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.286+0000 7fc92bfff640 15 client.4359.objecter _finish_op 2 2026-02-24T19:18:06.289 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.286+0000 7fc92bfff640 20 client.4359.objecter put_session s=0x558af3faadc0 osd=11 4 2026-02-24T19:18:06.289 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.286+0000 7fc92bfff640 15 client.4359.objecter _session_op_remove 11 2 2026-02-24T19:18:06.289 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.286+0000 7fc92bfff640 5 client.4359.objecter 0 in flight 2026-02-24T19:18:06.289 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.286+0000 7fc931c98300 10 client.4359.objecter _op_submit op 0x558af3fa9a10 2026-02-24T19:18:06.289 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.286+0000 7fc931c98300 20 client.4359.objecter _calc_target epoch 27 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:06.289 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.286+0000 7fc931c98300 20 client.4359.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-24T19:18:06.289 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.286+0000 7fc931c98300 10 client.4359.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [3,11] primary 3 2026-02-24T19:18:06.289 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.286+0000 7fc931c98300 10 client.4359.objecter chose random osd.11 of [3,11] 2026-02-24T19:18:06.289 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.286+0000 7fc931c98300 20 client.4359.objecter _get_session s=0x558af3faadc0 osd=11 3 2026-02-24T19:18:06.289 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.286+0000 7fc931c98300 10 client.4359.objecter _op_submit oid rbd_info '@2' '@2' [read 0~0] tid 3 osd.11 2026-02-24T19:18:06.289 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.286+0000 7fc931c98300 20 client.4359.objecter get_session s=0x558af3faadc0 osd=11 3 2026-02-24T19:18:06.289 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.286+0000 7fc931c98300 15 client.4359.objecter _session_op_assign 11 3 2026-02-24T19:18:06.289 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.286+0000 7fc931c98300 15 client.4359.objecter _send_op 3 to 2.2 on osd.11 2026-02-24T19:18:06.290 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.286+0000 7fc931c98300 1 -- 10.20.193.26:0/1579927784 --> v1:10.20.193.162:6813/1717662802 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e27) -- 0x558af3fa9ec0 con 0x558af3fab800 2026-02-24T19:18:06.290 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.286+0000 7fc931c98300 20 client.4359.objecter put_session s=0x558af3faadc0 osd=11 4 2026-02-24T19:18:06.290 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.286+0000 7fc931c98300 5 client.4359.objecter 1 in flight 2026-02-24T19:18:06.293 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.291+0000 7fc92bfff640 1 -- 10.20.193.26:0/1579927784 <== osd.11 v1:10.20.193.162:6813/1717662802 2 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 1399001751 0 0) 0x7fc91c006440 con 0x558af3fab800 2026-02-24T19:18:06.293 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.291+0000 7fc92bfff640 10 client.4359.objecter ms_dispatch2 0x558af3cfad50 osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:06.293 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.291+0000 7fc92bfff640 10 client.4359.objecter in handle_osd_op_reply 2026-02-24T19:18:06.293 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.291+0000 7fc92bfff640 7 client.4359.objecter handle_osd_op_reply 3 ondisk uv 0 in 2.2 attempt 0 2026-02-24T19:18:06.293 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.291+0000 7fc92bfff640 10 client.4359.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:06.293 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.291+0000 7fc92bfff640 10 client.4359.objecter op 0 rval 0 len 0 2026-02-24T19:18:06.293 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.291+0000 7fc92bfff640 15 client.4359.objecter handle_osd_op_reply completed tid 3 2026-02-24T19:18:06.293 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.291+0000 7fc92bfff640 15 client.4359.objecter _finish_op 3 2026-02-24T19:18:06.293 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.291+0000 7fc92bfff640 20 client.4359.objecter put_session s=0x558af3faadc0 osd=11 4 2026-02-24T19:18:06.293 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.291+0000 7fc92bfff640 15 client.4359.objecter _session_op_remove 11 3 2026-02-24T19:18:06.293 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.291+0000 7fc92bfff640 5 client.4359.objecter 0 in flight 2026-02-24T19:18:06.293 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.291+0000 7fc929ffb640 10 client.4359.objecter allocate_selfmanaged_snap; pool: 2 2026-02-24T19:18:06.294 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.291+0000 7fc929ffb640 10 client.4359.objecter pool_op_submit 4 2026-02-24T19:18:06.294 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.291+0000 7fc929ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:06.294 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.291+0000 7fc929ffb640 1 -- 10.20.193.26:0/1579927784 --> v1:10.20.193.26:6789/0 -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7fc90c003110 con 0x558af3de59a0 2026-02-24T19:18:06.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.611+0000 7fc91bfff640 1 -- 10.20.193.26:0/1579927784 <== mon.0 v1:10.20.193.26:6789/0 12 ==== pool_op_reply(tid 4 (0) Success v28) ==== 55+0+0 (unknown 3569367280 0 0) 0x7fc92005bea0 con 0x558af3de59a0 2026-02-24T19:18:06.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.611+0000 7fc91bfff640 10 client.4359.objecter ms_dispatch2 0x558af3cfad50 pool_op_reply(tid 4 (0) Success v28) 2026-02-24T19:18:06.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.611+0000 7fc91bfff640 10 client.4359.objecter handle_pool_op_reply pool_op_reply(tid 4 (0) Success v28) 2026-02-24T19:18:06.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.611+0000 7fc91bfff640 10 client.4359.objecter have request 4 at 0x7fc90c0030a0 Op: create unmanaged snap 2026-02-24T19:18:06.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.611+0000 7fc91bfff640 20 client.4359.objecter waiting for client to reach epoch 28 before calling back 2026-02-24T19:18:06.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.611+0000 7fc91bfff640 10 client.4359.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:06.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.611+0000 7fc91bfff640 10 monclient: _renew_subs 2026-02-24T19:18:06.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.611+0000 7fc91bfff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:06.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.611+0000 7fc91bfff640 1 -- 10.20.193.26:0/1579927784 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=28}) -- 0x558af3ed4f80 con 0x558af3de59a0 2026-02-24T19:18:06.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.611+0000 7fc91bfff640 10 client.4359.objecter done 2026-02-24T19:18:06.619 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.617+0000 7fc91bfff640 1 -- 10.20.193.26:0/1579927784 <== mon.0 v1:10.20.193.26:6789/0 13 ==== osd_map(28..28 src has 1..28) ==== 629+0+0 (unknown 3073110835 0 0) 0x7fc92005b960 con 0x558af3de59a0 2026-02-24T19:18:06.619 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.617+0000 7fc91bfff640 10 client.4359.objecter ms_dispatch2 0x558af3cfad50 osd_map(28..28 src has 1..28) 2026-02-24T19:18:06.619 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.617+0000 7fc91bfff640 3 client.4359.objecter handle_osd_map got epochs [28,28] > 27 2026-02-24T19:18:06.619 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.617+0000 7fc91bfff640 3 client.4359.objecter handle_osd_map decoding incremental epoch 28 2026-02-24T19:18:06.619 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.617+0000 7fc91bfff640 20 client.4359.objecter dump_active .. 0 homeless 2026-02-24T19:18:06.619 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.617+0000 7fc92a7fc640 20 librados: queue_aio_write 0x558af3fa5e40 completion 0x558af3ed91f0 write_seq 1 2026-02-24T19:18:06.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.617+0000 7fc92a7fc640 10 client.4359.objecter _op_submit op 0x7fc908006400 2026-02-24T19:18:06.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.617+0000 7fc92a7fc640 20 client.4359.objecter _calc_target epoch 28 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:06.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.617+0000 7fc92a7fc640 20 client.4359.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-24T19:18:06.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.617+0000 7fc92a7fc640 10 client.4359.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [3,11] primary 3 2026-02-24T19:18:06.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.617+0000 7fc92a7fc640 20 client.4359.objecter _get_session s=0x558af3c57280 osd=3 3 2026-02-24T19:18:06.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.617+0000 7fc92a7fc640 10 client.4359.objecter _op_submit oid rbd_info '@2' '@2' [create,write 0~8 in=8b] tid 5 osd.3 2026-02-24T19:18:06.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.617+0000 7fc92a7fc640 20 client.4359.objecter get_session s=0x558af3c57280 osd=3 3 2026-02-24T19:18:06.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.617+0000 7fc92a7fc640 15 client.4359.objecter _session_op_assign 3 5 2026-02-24T19:18:06.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.617+0000 7fc92a7fc640 15 client.4359.objecter _send_op 5 to 2.2 on osd.3 2026-02-24T19:18:06.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.617+0000 7fc92a7fc640 1 -- 10.20.193.26:0/1579927784 --> v1:10.20.193.162:6805/920272754 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) -- 0x7fc908006910 con 0x558af3edbed0 2026-02-24T19:18:06.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.617+0000 7fc92a7fc640 20 client.4359.objecter put_session s=0x558af3c57280 osd=3 4 2026-02-24T19:18:06.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.617+0000 7fc92a7fc640 5 client.4359.objecter 1 in flight 2026-02-24T19:18:06.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.715+0000 7fc9319d6640 1 -- 10.20.193.26:0/1579927784 <== osd.3 v1:10.20.193.162:6805/920272754 2 ==== osd_op_reply(5 rbd_info [create,write 0~8] v28'1 uv1 ondisk = 0) ==== 194+0+0 (unknown 444517681 0 0) 0x7fc9240038d0 con 0x558af3edbed0 2026-02-24T19:18:06.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.715+0000 7fc9319d6640 10 client.4359.objecter ms_dispatch2 0x558af3cfad50 osd_op_reply(5 rbd_info [create,write 0~8] v28'1 uv1 ondisk = 0) 2026-02-24T19:18:06.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.715+0000 7fc9319d6640 10 client.4359.objecter in handle_osd_op_reply 2026-02-24T19:18:06.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.715+0000 7fc9319d6640 7 client.4359.objecter handle_osd_op_reply 5 ondisk uv 1 in 2.2 attempt 0 2026-02-24T19:18:06.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.715+0000 7fc9319d6640 10 client.4359.objecter op 0 rval 0 len 0 2026-02-24T19:18:06.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.715+0000 7fc9319d6640 10 client.4359.objecter op 1 rval 0 len 0 2026-02-24T19:18:06.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.715+0000 7fc9319d6640 15 client.4359.objecter handle_osd_op_reply completed tid 5 2026-02-24T19:18:06.718 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.715+0000 7fc9319d6640 15 client.4359.objecter _finish_op 5 2026-02-24T19:18:06.718 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.715+0000 7fc9319d6640 20 client.4359.objecter put_session s=0x558af3c57280 osd=3 4 2026-02-24T19:18:06.718 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.715+0000 7fc9319d6640 15 client.4359.objecter _session_op_remove 3 5 2026-02-24T19:18:06.718 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.715+0000 7fc9319d6640 5 client.4359.objecter 0 in flight 2026-02-24T19:18:06.718 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.715+0000 7fc9319d6640 20 librados: complete_aio_write 0x558af3ed91f0 2026-02-24T19:18:06.718 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.715+0000 7fc929ffb640 10 client.4359.objecter delete_selfmanaged_snap; pool: 2; snap: 2 2026-02-24T19:18:06.718 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.715+0000 7fc929ffb640 10 client.4359.objecter pool_op_submit 6 2026-02-24T19:18:06.718 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.715+0000 7fc929ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:06.718 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:06.715+0000 7fc929ffb640 1 -- 10.20.193.26:0/1579927784 --> v1:10.20.193.26:6789/0 -- pool_op(delete unmanaged snap pool 2 tid 6 name v28) -- 0x7fc90c0033b0 con 0x558af3de59a0 2026-02-24T19:18:07.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.605+0000 7fc91affd640 10 monclient: tick 2026-02-24T19:18:07.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.605+0000 7fc91affd640 10 monclient: _check_auth_tickets 2026-02-24T19:18:07.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.605+0000 7fc91affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:07.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.605+0000 7fc91affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:07.712 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.711+0000 7fc91bfff640 1 -- 10.20.193.26:0/1579927784 <== mon.0 v1:10.20.193.26:6789/0 14 ==== pool_op_reply(tid 6 (0) Success v29) ==== 43+0+0 (unknown 4294468252 0 0) 0x7fc920061580 con 0x558af3de59a0 2026-02-24T19:18:07.712 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.711+0000 7fc91bfff640 10 client.4359.objecter ms_dispatch2 0x558af3cfad50 pool_op_reply(tid 6 (0) Success v29) 2026-02-24T19:18:07.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.711+0000 7fc91bfff640 10 client.4359.objecter handle_pool_op_reply pool_op_reply(tid 6 (0) Success v29) 2026-02-24T19:18:07.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.711+0000 7fc91bfff640 10 client.4359.objecter have request 6 at 0x7fc90c0030a0 Op: delete unmanaged snap 2026-02-24T19:18:07.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.711+0000 7fc91bfff640 20 client.4359.objecter waiting for client to reach epoch 29 before calling back 2026-02-24T19:18:07.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.711+0000 7fc91bfff640 10 client.4359.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:07.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.711+0000 7fc91bfff640 10 monclient: _renew_subs 2026-02-24T19:18:07.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.711+0000 7fc91bfff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:07.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.711+0000 7fc91bfff640 1 -- 10.20.193.26:0/1579927784 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=29}) -- 0x558af3e29860 con 0x558af3de59a0 2026-02-24T19:18:07.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.711+0000 7fc91bfff640 10 client.4359.objecter done 2026-02-24T19:18:07.715 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.713+0000 7fc91bfff640 1 -- 10.20.193.26:0/1579927784 <== mon.0 v1:10.20.193.26:6789/0 15 ==== osd_map(29..29 src has 1..29) ==== 657+0+0 (unknown 387535907 0 0) 0x7fc920059ba0 con 0x558af3de59a0 2026-02-24T19:18:07.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.713+0000 7fc91bfff640 10 client.4359.objecter ms_dispatch2 0x558af3cfad50 osd_map(29..29 src has 1..29) 2026-02-24T19:18:07.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.713+0000 7fc91bfff640 3 client.4359.objecter handle_osd_map got epochs [29,29] > 28 2026-02-24T19:18:07.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.713+0000 7fc91bfff640 3 client.4359.objecter handle_osd_map decoding incremental epoch 29 2026-02-24T19:18:07.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.713+0000 7fc91bfff640 20 client.4359.objecter dump_active .. 0 homeless 2026-02-24T19:18:07.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.713+0000 7fc92a7fc640 20 librados: queue_aio_write 0x558af3fa5e40 completion 0x7fc90c001da0 write_seq 2 2026-02-24T19:18:07.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.713+0000 7fc92a7fc640 10 client.4359.objecter _op_submit op 0x7fc908006400 2026-02-24T19:18:07.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.713+0000 7fc92a7fc640 20 client.4359.objecter _calc_target epoch 29 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:07.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.713+0000 7fc92a7fc640 20 client.4359.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-24T19:18:07.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.713+0000 7fc92a7fc640 10 client.4359.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [3,11] primary 3 2026-02-24T19:18:07.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.713+0000 7fc92a7fc640 20 client.4359.objecter _get_session s=0x558af3c57280 osd=3 3 2026-02-24T19:18:07.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.713+0000 7fc92a7fc640 10 client.4359.objecter _op_submit oid rbd_info '@2' '@2' [write 0~19 in=19b] tid 7 osd.3 2026-02-24T19:18:07.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.713+0000 7fc92a7fc640 20 client.4359.objecter get_session s=0x558af3c57280 osd=3 3 2026-02-24T19:18:07.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.713+0000 7fc92a7fc640 15 client.4359.objecter _session_op_assign 3 7 2026-02-24T19:18:07.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.713+0000 7fc92a7fc640 15 client.4359.objecter _send_op 7 to 2.2 on osd.3 2026-02-24T19:18:07.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.713+0000 7fc92a7fc640 1 -- 10.20.193.26:0/1579927784 --> v1:10.20.193.162:6805/920272754 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x7fc908006e40 con 0x558af3edbed0 2026-02-24T19:18:07.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.713+0000 7fc92a7fc640 20 client.4359.objecter put_session s=0x558af3c57280 osd=3 4 2026-02-24T19:18:07.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.713+0000 7fc92a7fc640 5 client.4359.objecter 1 in flight 2026-02-24T19:18:07.842 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc9319d6640 1 -- 10.20.193.26:0/1579927784 <== osd.3 v1:10.20.193.162:6805/920272754 3 ==== osd_op_reply(7 rbd_info [write 0~19] v29'2 uv2 ondisk = 0) ==== 152+0+0 (unknown 2480773985 0 0) 0x7fc9240038d0 con 0x558af3edbed0 2026-02-24T19:18:07.842 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc9319d6640 10 client.4359.objecter ms_dispatch2 0x558af3cfad50 osd_op_reply(7 rbd_info [write 0~19] v29'2 uv2 ondisk = 0) 2026-02-24T19:18:07.842 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc9319d6640 10 client.4359.objecter in handle_osd_op_reply 2026-02-24T19:18:07.842 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc9319d6640 7 client.4359.objecter handle_osd_op_reply 7 ondisk uv 2 in 2.2 attempt 0 2026-02-24T19:18:07.842 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc9319d6640 10 client.4359.objecter op 0 rval 0 len 0 2026-02-24T19:18:07.842 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc9319d6640 15 client.4359.objecter handle_osd_op_reply completed tid 7 2026-02-24T19:18:07.842 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc9319d6640 15 client.4359.objecter _finish_op 7 2026-02-24T19:18:07.842 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc9319d6640 20 client.4359.objecter put_session s=0x558af3c57280 osd=3 4 2026-02-24T19:18:07.843 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc9319d6640 15 client.4359.objecter _session_op_remove 3 7 2026-02-24T19:18:07.843 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc9319d6640 5 client.4359.objecter 0 in flight 2026-02-24T19:18:07.843 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc9319d6640 20 librados: complete_aio_write 0x7fc90c001da0 2026-02-24T19:18:07.843 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc931c98300 10 librados: watch_flush enter 2026-02-24T19:18:07.843 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc931c98300 10 librados: watch_flush exit 2026-02-24T19:18:07.843 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc931c98300 10 client.4359.objecter close_session for osd.3 2026-02-24T19:18:07.843 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc931c98300 1 -- 10.20.193.26:0/1579927784 >> v1:10.20.193.162:6805/920272754 conn(0x558af3edbed0 legacy=0x558af3f6eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:07.843 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc931c98300 20 client.4359.objecter put_session s=0x558af3c57280 osd=3 1 2026-02-24T19:18:07.843 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc931c98300 10 client.4359.objecter close_session for osd.11 2026-02-24T19:18:07.843 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc931c98300 1 -- 10.20.193.26:0/1579927784 >> v1:10.20.193.162:6813/1717662802 conn(0x558af3fab800 legacy=0x558af3fcbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:07.843 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc931c98300 20 client.4359.objecter put_session s=0x558af3faadc0 osd=11 1 2026-02-24T19:18:07.843 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc931c98300 20 client.4359.objecter shutdown clearing up homeless session... 2026-02-24T19:18:07.843 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc931c98300 10 client.4359.objecter successfully canceled tick 2026-02-24T19:18:07.844 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc931c98300 1 -- 10.20.193.26:0/1579927784 >> v1:10.20.193.162:6800/3889602630 conn(0x7fc910076540 legacy=0x7fc9100969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:07.844 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc931c98300 10 monclient: shutdown 2026-02-24T19:18:07.844 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc931c98300 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:07.844 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc931c98300 1 -- 10.20.193.26:0/1579927784 >> v1:10.20.193.26:6789/0 conn(0x558af3de59a0 legacy=0x558af3ee9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:07.844 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc9319d6640 1 -- 10.20.193.26:0/1579927784 reap_dead start 2026-02-24T19:18:07.844 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc931c98300 1 -- 10.20.193.26:0/1579927784 shutdown_connections 2026-02-24T19:18:07.844 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.839+0000 7fc931c98300 1 -- 10.20.193.26:0/1579927784 >> 10.20.193.26:0/1579927784 conn(0x558af3e2fed0 msgr2=0x558af3e2add0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:07.844 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.840+0000 7fc931c98300 1 -- 10.20.193.26:0/1579927784 shutdown_connections 2026-02-24T19:18:07.844 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.840+0000 7fc931c98300 1 -- 10.20.193.26:0/1579927784 wait complete. 2026-02-24T19:18:07.844 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.840+0000 7fc931c98300 1 librados: shutdown 2026-02-24T19:18:07.845 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-24T19:18:07.846 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-24T19:18:07.847 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-24T19:18:07.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.952+0000 7f4293d4c640 10 monclient: get_monmap_and_config 2026-02-24T19:18:07.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.952+0000 7f4293d4c640 10 monclient: build_initial_monmap 2026-02-24T19:18:07.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.952+0000 7f4293d4c640 10 monclient: monmap: 2026-02-24T19:18:07.953 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:07.953 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:07.953 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:07.952902+0000 2026-02-24T19:18:07.954 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:07.952902+0000 2026-02-24T19:18:07.954 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:07.954 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:07.954 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:07.954 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:07.954 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:07.954 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:07.955 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.952+0000 7f4293d4c640 1 Processor -- start 2026-02-24T19:18:07.955 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.952+0000 7f4293d4c640 1 -- start start 2026-02-24T19:18:07.955 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.952+0000 7f4293d4c640 10 monclient: init 2026-02-24T19:18:07.956 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.953+0000 7f4293d4c640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:07.956 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.953+0000 7f4293d4c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:18:07.956 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.953+0000 7f4293d4c640 10 monclient(hunting): picked mon.noname-b con 0x7f428c157780 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:07.956 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.953+0000 7f4293d4c640 10 monclient(hunting): picked mon.noname-c con 0x7f428c157b50 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:07.956 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.953+0000 7f4293d4c640 10 monclient(hunting): picked mon.noname-a con 0x7f428c164d00 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:07.956 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.953+0000 7f4293d4c640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f428c05de70 con 0x7f428c164d00 2026-02-24T19:18:07.956 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.953+0000 7f4293d4c640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f428c055b20 con 0x7f428c157780 2026-02-24T19:18:07.956 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.953+0000 7f4293d4c640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f428c055e00 con 0x7f428c157b50 2026-02-24T19:18:07.956 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.953+0000 7f4293d4c640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:07.956 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.953+0000 7f4293d4c640 10 monclient(hunting): authenticate will time out at 3670.635132s 2026-02-24T19:18:07.956 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.953+0000 7f42922c2640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f428c164d00 0x7f428c1c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:46654/0 (socket says 10.20.193.26:46654) 2026-02-24T19:18:07.957 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.953+0000 7f42922c2640 1 -- 10.20.193.26:0/3839306067 learned_addr learned my addr 10.20.193.26:0/3839306067 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:07.962 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.954+0000 7f4290abf640 1 -- 10.20.193.26:0/3839306067 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1915818199 0 0) 0x7f428c05de70 con 0x7f428c164d00 2026-02-24T19:18:07.962 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.954+0000 7f4290abf640 10 monclient(hunting): _negotiate 2026-02-24T19:18:07.962 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.954+0000 7f4290abf640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:07.962 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.954+0000 7f4290abf640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:07.962 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.954+0000 7f4290abf640 10 monclient(hunting): my global_id is 4362 2026-02-24T19:18:07.962 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.955+0000 7f4290abf640 1 -- 10.20.193.26:0/3839306067 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4274003610 con 0x7f428c164d00 2026-02-24T19:18:07.963 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.955+0000 7f4290abf640 1 -- 10.20.193.26:0/3839306067 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2258117916 0 0) 0x7f428c055b20 con 0x7f428c157780 2026-02-24T19:18:07.963 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.955+0000 7f4290abf640 10 monclient(hunting): _negotiate 2026-02-24T19:18:07.963 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.955+0000 7f4290abf640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:07.963 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.955+0000 7f4290abf640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:07.963 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.955+0000 7f4290abf640 10 monclient(hunting): my global_id is 4354 2026-02-24T19:18:07.963 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.955+0000 7f4290abf640 1 -- 10.20.193.26:0/3839306067 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f428c05de70 con 0x7f428c157780 2026-02-24T19:18:07.963 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.955+0000 7f4290abf640 1 -- 10.20.193.26:0/3839306067 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 288966074 0 0) 0x7f428c055e00 con 0x7f428c157b50 2026-02-24T19:18:07.963 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.955+0000 7f4290abf640 10 monclient(hunting): _negotiate 2026-02-24T19:18:07.963 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.955+0000 7f4290abf640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:07.963 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.955+0000 7f4290abf640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:07.963 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.955+0000 7f4290abf640 10 monclient(hunting): my global_id is 4367 2026-02-24T19:18:07.964 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.955+0000 7f4290abf640 1 -- 10.20.193.26:0/3839306067 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f428c055b20 con 0x7f428c157b50 2026-02-24T19:18:07.964 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.956+0000 7f4290abf640 1 -- 10.20.193.26:0/3839306067 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1803667956 0 0) 0x7f428c05de70 con 0x7f428c157780 2026-02-24T19:18:07.964 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.956+0000 7f4290abf640 1 -- 10.20.193.26:0/3839306067 >> v1:10.20.193.103:6789/0 conn(0x7f428c157b50 legacy=0x7f428c1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:07.964 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.956+0000 7f4290abf640 1 -- 10.20.193.26:0/3839306067 >> v1:10.20.193.26:6789/0 conn(0x7f428c164d00 legacy=0x7f428c1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:07.964 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.956+0000 7f4290abf640 10 monclient: _finish_hunting 0 2026-02-24T19:18:07.964 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.956+0000 7f4290abf640 1 monclient: found mon.noname-b 2026-02-24T19:18:07.964 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.956+0000 7f4290abf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:07.964 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.956+0000 7f4290abf640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:18:07.964 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.956+0000 7f4290abf640 1 -- 10.20.193.26:0/3839306067 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f428c0560e0 con 0x7f428c157780 2026-02-24T19:18:07.964 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.956+0000 7f4290abf640 10 monclient: _finish_auth 0 2026-02-24T19:18:07.964 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.956+0000 7f4290abf640 10 monclient: _check_auth_tickets 2026-02-24T19:18:07.964 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.956+0000 7f4290abf640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:07.965 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.956+0000 7f4290abf640 1 -- 10.20.193.26:0/3839306067 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f427c002d20 con 0x7f428c157780 2026-02-24T19:18:07.965 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.956+0000 7f4290abf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:07.965 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.956+0000 7f4290abf640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:07.965 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.956+0000 7f4290abf640 10 monclient: dump: 2026-02-24T19:18:07.965 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:07.965 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:07.965 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:07.965 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:07.965 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:07.965 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:07.965 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:07.965 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:07.966 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:07.966 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:07.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.956+0000 7f4293d4c640 5 monclient: authenticate success, global_id 4354 2026-02-24T19:18:07.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.956+0000 7f4293d4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:07.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.957+0000 7f4290abf640 1 -- 10.20.193.26:0/3839306067 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f427c002ef0 con 0x7f428c157780 2026-02-24T19:18:07.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.957+0000 7f4290abf640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:07.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.957+0000 7f4290abf640 1 -- 10.20.193.26:0/3839306067 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f427c003330 con 0x7f428c157780 2026-02-24T19:18:07.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.957+0000 7f4290abf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:07.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.957+0000 7f4290abf640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:07.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.957+0000 7f4290abf640 10 monclient: dump: 2026-02-24T19:18:07.966 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:07.966 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:07.967 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:07.967 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:07.967 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:07.967 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:07.967 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:07.967 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:07.967 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:07.967 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:07.967 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.957+0000 7f4293d4c640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:07.967 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.957+0000 7f4293d4c640 4 set_mon_vals no callback set 2026-02-24T19:18:07.967 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.957+0000 7f4293d4c640 10 monclient: shutdown 2026-02-24T19:18:07.967 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.957+0000 7f4293d4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:07.968 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.957+0000 7f4293d4c640 1 -- 10.20.193.26:0/3839306067 >> v1:10.20.193.70:6789/0 conn(0x7f428c157780 legacy=0x7f428c056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:07.968 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.957+0000 7f4293d4c640 1 -- 10.20.193.26:0/3839306067 shutdown_connections 2026-02-24T19:18:07.968 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.957+0000 7f4293d4c640 1 -- 10.20.193.26:0/3839306067 >> 10.20.193.26:0/3839306067 conn(0x7f428c0b2ef0 msgr2=0x7f428c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:07.968 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.958+0000 7f4293d4c640 1 -- 10.20.193.26:0/3839306067 shutdown_connections 2026-02-24T19:18:07.968 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.958+0000 7f4293d4c640 1 -- 10.20.193.26:0/3839306067 wait complete. 2026-02-24T19:18:07.968 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.958+0000 7f4293d4c640 10 monclient: build_initial_monmap 2026-02-24T19:18:07.968 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.958+0000 7f4293d4c640 10 monclient: monmap: 2026-02-24T19:18:07.968 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:07.968 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:07.968 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:07.968 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:07.968 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:07.969 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:07.969 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:07.969 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:07.969 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:07.969 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:07.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.958+0000 7f4293d4c640 1 librados: starting msgr at 2026-02-24T19:18:07.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.958+0000 7f4293d4c640 1 librados: starting objecter 2026-02-24T19:18:07.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.958+0000 7f4293d4c640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:07.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.958+0000 7f4293d4c640 1 Processor -- start 2026-02-24T19:18:07.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.958+0000 7f4293d4c640 1 -- start start 2026-02-24T19:18:07.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.958+0000 7f4293d4c640 1 librados: setting wanted keys 2026-02-24T19:18:07.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.958+0000 7f4293d4c640 1 librados: calling monclient init 2026-02-24T19:18:07.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.958+0000 7f4293d4c640 10 monclient: init 2026-02-24T19:18:07.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.959+0000 7f4293d4c640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:07.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.959+0000 7f4293d4c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:18:07.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.959+0000 7f4293d4c640 10 monclient(hunting): picked mon.noname-b con 0x7f428c157780 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:07.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.959+0000 7f4293d4c640 10 monclient(hunting): picked mon.noname-a con 0x7f428c157b50 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:07.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.959+0000 7f4293d4c640 10 monclient(hunting): picked mon.noname-c con 0x7f428c164d00 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:07.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.959+0000 7f4293d4c640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f428c1392f0 con 0x7f428c157b50 2026-02-24T19:18:07.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.959+0000 7f4293d4c640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f428c1395d0 con 0x7f428c157780 2026-02-24T19:18:07.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.959+0000 7f4293d4c640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f428c1398b0 con 0x7f428c164d00 2026-02-24T19:18:07.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.959+0000 7f4293d4c640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:07.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.959+0000 7f4293d4c640 10 monclient(hunting): authenticate will time out at 3670.641116s 2026-02-24T19:18:07.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.959+0000 7f42912c0640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f428c157b50 0x7f428c0af530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:46668/0 (socket says 10.20.193.26:46668) 2026-02-24T19:18:07.971 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.959+0000 7f42912c0640 1 -- 10.20.193.26:0/3064031816 learned_addr learned my addr 10.20.193.26:0/3064031816 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:07.971 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.959+0000 7f4291ac1640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f428c157780 0x7f428c160730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:59360/0 (socket says 10.20.193.26:59360) 2026-02-24T19:18:07.971 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.959+0000 7f427a7fc640 10 client.?.objecter ms_handle_connect 0x7f428c157b50 2026-02-24T19:18:07.971 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.959+0000 7f427a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:07.971 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.959+0000 7f427a7fc640 10 client.?.objecter ms_handle_connect 0x7f428c157780 2026-02-24T19:18:07.971 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.959+0000 7f427a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:07.971 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.959+0000 7f427a7fc640 10 client.?.objecter ms_handle_connect 0x7f428c164d00 2026-02-24T19:18:07.971 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.959+0000 7f427a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:07.971 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.960+0000 7f427a7fc640 1 -- 10.20.193.26:0/3064031816 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2208806460 0 0) 0x7f428c1392f0 con 0x7f428c157b50 2026-02-24T19:18:07.971 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.960+0000 7f427a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:07.971 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.960+0000 7f427a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:07.971 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.960+0000 7f427a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:07.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.960+0000 7f427a7fc640 10 monclient(hunting): my global_id is 4365 2026-02-24T19:18:07.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.960+0000 7f427a7fc640 1 -- 10.20.193.26:0/3064031816 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f425c003610 con 0x7f428c157b50 2026-02-24T19:18:07.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.960+0000 7f427a7fc640 1 -- 10.20.193.26:0/3064031816 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2763763241 0 0) 0x7f428c1395d0 con 0x7f428c157780 2026-02-24T19:18:07.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.960+0000 7f427a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:07.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.960+0000 7f427a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:07.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.960+0000 7f427a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:07.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.960+0000 7f427a7fc640 10 monclient(hunting): my global_id is 4357 2026-02-24T19:18:07.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.960+0000 7f427a7fc640 1 -- 10.20.193.26:0/3064031816 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f428c1392f0 con 0x7f428c157780 2026-02-24T19:18:07.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.960+0000 7f427a7fc640 1 -- 10.20.193.26:0/3064031816 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2818388304 0 0) 0x7f428c1398b0 con 0x7f428c164d00 2026-02-24T19:18:07.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.960+0000 7f427a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:07.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.960+0000 7f427a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:07.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.960+0000 7f427a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:07.973 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.960+0000 7f427a7fc640 10 monclient(hunting): my global_id is 4370 2026-02-24T19:18:07.973 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.960+0000 7f427a7fc640 1 -- 10.20.193.26:0/3064031816 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f428c1395d0 con 0x7f428c164d00 2026-02-24T19:18:07.976 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.962+0000 7f427a7fc640 1 -- 10.20.193.26:0/3064031816 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 513943651 0 0) 0x7f428c1392f0 con 0x7f428c157780 2026-02-24T19:18:07.976 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.962+0000 7f427a7fc640 1 -- 10.20.193.26:0/3064031816 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f428c1398b0 con 0x7f428c157780 2026-02-24T19:18:07.976 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.962+0000 7f427a7fc640 1 -- 10.20.193.26:0/3064031816 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f427c003240 con 0x7f428c157780 2026-02-24T19:18:07.976 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.962+0000 7f427a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:07.976 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.962+0000 7f427a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:07.976 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.962+0000 7f427a7fc640 10 monclient(hunting): dump: 2026-02-24T19:18:07.977 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:07.977 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:07.977 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:07.977 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:07.977 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:07.977 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:07.977 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:07.977 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:07.977 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:07.977 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:07.977 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.962+0000 7f427a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:07.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.963+0000 7f427a7fc640 1 -- 10.20.193.26:0/3064031816 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1781400429 0 0) 0x7f425c003610 con 0x7f428c157b50 2026-02-24T19:18:07.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.963+0000 7f427a7fc640 1 -- 10.20.193.26:0/3064031816 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f428c1392f0 con 0x7f428c157b50 2026-02-24T19:18:07.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.963+0000 7f427a7fc640 1 -- 10.20.193.26:0/3064031816 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f4280003170 con 0x7f428c157b50 2026-02-24T19:18:07.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.963+0000 7f427a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:07.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.963+0000 7f427a7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:07.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.963+0000 7f427a7fc640 10 monclient(hunting): dump: 2026-02-24T19:18:07.978 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:07.978 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:07.978 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:07.978 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:07.978 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:07.978 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:07.979 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:07.979 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:07.979 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:07.979 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:07.979 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.963+0000 7f427a7fc640 1 -- 10.20.193.26:0/3064031816 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 466489109 0 0) 0x7f428c1395d0 con 0x7f428c164d00 2026-02-24T19:18:07.979 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.963+0000 7f427a7fc640 1 -- 10.20.193.26:0/3064031816 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f425c003610 con 0x7f428c164d00 2026-02-24T19:18:07.979 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.963+0000 7f427a7fc640 1 -- 10.20.193.26:0/3064031816 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f4288003250 con 0x7f428c164d00 2026-02-24T19:18:07.979 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.963+0000 7f427a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:07.979 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.963+0000 7f427a7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:07.979 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.963+0000 7f427a7fc640 10 monclient(hunting): dump: 2026-02-24T19:18:07.979 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:07.979 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:07.980 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:07.980 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:07.980 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:07.980 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:07.980 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:07.980 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:07.980 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:07.980 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:07.980 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.964+0000 7f427a7fc640 1 -- 10.20.193.26:0/3064031816 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1049206978 0 0) 0x7f428c1398b0 con 0x7f428c157780 2026-02-24T19:18:07.980 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.964+0000 7f427a7fc640 1 -- 10.20.193.26:0/3064031816 >> v1:10.20.193.103:6789/0 conn(0x7f428c164d00 legacy=0x7f428c137080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:07.980 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.964+0000 7f427a7fc640 1 -- 10.20.193.26:0/3064031816 >> v1:10.20.193.26:6789/0 conn(0x7f428c157b50 legacy=0x7f428c0af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:07.980 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.964+0000 7f427a7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:18:07.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.964+0000 7f427a7fc640 1 monclient: found mon.b 2026-02-24T19:18:07.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.964+0000 7f427a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:07.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.964+0000 7f427a7fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:07.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.964+0000 7f427a7fc640 1 -- 10.20.193.26:0/3064031816 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f428c139b90 con 0x7f428c157780 2026-02-24T19:18:07.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.964+0000 7f427a7fc640 10 monclient: _finish_auth 0 2026-02-24T19:18:07.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.964+0000 7f427a7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:18:07.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.964+0000 7f427a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:07.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.964+0000 7f4293d4c640 5 monclient: authenticate success, global_id 4357 2026-02-24T19:18:07.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.964+0000 7f4293d4c640 10 monclient: _renew_subs 2026-02-24T19:18:07.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.964+0000 7f4293d4c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:07.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.964+0000 7f4293d4c640 1 -- 10.20.193.26:0/3064031816 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f428c15ff30 con 0x7f428c157780 2026-02-24T19:18:07.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.964+0000 7f4293d4c640 10 client.4357.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:07.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.964+0000 7f4293d4c640 10 monclient: _renew_subs 2026-02-24T19:18:07.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.964+0000 7f4293d4c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:07.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.964+0000 7f4293d4c640 1 -- 10.20.193.26:0/3064031816 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f428c138e90 con 0x7f428c157780 2026-02-24T19:18:07.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.964+0000 7f4293d4c640 1 librados: init done 2026-02-24T19:18:07.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.965+0000 7f4293d4c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:07.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.965+0000 7f4293d4c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:07.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.965+0000 7f4293d4c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:07.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.965+0000 7f4293d4c640 1 -- 10.20.193.26:0/3064031816 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f428c0b43e0 con 0x7f428c157780 2026-02-24T19:18:07.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.973+0000 7f427a7fc640 1 -- 10.20.193.26:0/3064031816 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f427c002ef0 con 0x7f428c157780 2026-02-24T19:18:07.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.973+0000 7f427a7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:07.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.973+0000 7f427a7fc640 1 -- 10.20.193.26:0/3064031816 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f427c003890 con 0x7f428c157780 2026-02-24T19:18:07.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.973+0000 7f427a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:07.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.973+0000 7f427a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:07.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.973+0000 7f427a7fc640 10 monclient: dump: 2026-02-24T19:18:07.983 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:07.983 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:07.983 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:07.983 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:07.983 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:07.983 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:07.983 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:07.983 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:07.983 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:07.983 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:07.983 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.973+0000 7f427bfff640 4 set_mon_vals no callback set 2026-02-24T19:18:07.983 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.974+0000 7f427a7fc640 1 -- 10.20.193.26:0/3064031816 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f427c003a70 con 0x7f428c157780 2026-02-24T19:18:07.984 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.974+0000 7f42912c0640 10 monclient: get_auth_request con 0x7f425c077ed0 auth_method 0 2026-02-24T19:18:07.984 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:07.975+0000 7f427a7fc640 10 client.4357.objecter ms_handle_connect 0x7f425c077ed0 2026-02-24T19:18:08.060 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.059+0000 7f427a7fc640 1 -- 10.20.193.26:0/3064031816 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f427c093070 con 0x7f428c157780 2026-02-24T19:18:08.060 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.059+0000 7f427a7fc640 10 client.4357.objecter ms_dispatch2 0x7f428c000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:08.060 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.059+0000 7f427a7fc640 3 client.4357.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:08.060 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.059+0000 7f427a7fc640 3 client.4357.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:08.060 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.059+0000 7f427a7fc640 20 client.4357.objecter dump_active .. 0 homeless 2026-02-24T19:18:08.061 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.060+0000 7f427a7fc640 1 -- 10.20.193.26:0/3064031816 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f427c05daa0 con 0x7f428c157780 2026-02-24T19:18:08.061 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.060+0000 7f427a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:08.061 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.060+0000 7f427a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:08.166 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.164+0000 7f4293d4c640 10 start_mon_command cmd=[{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-24T19:18:08.166 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.164+0000 7f4293d4c640 10 monclient: _send_command 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-24T19:18:08.166 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.164+0000 7f4293d4c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:08.166 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.164+0000 7f4293d4c640 1 -- 10.20.193.26:0/3064031816 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f428c138750 con 0x7f428c157780 2026-02-24T19:18:08.172 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.172+0000 7f427a7fc640 1 -- 10.20.193.26:0/3064031816 <== mon.1 v1:10.20.193.70:6789/0 10 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v1) ==== 86+0+61 (unknown 4269106227 0 102270264) 0x7f427c003890 con 0x7f428c157780 2026-02-24T19:18:08.173 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.172+0000 7f427a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-24T19:18:08.173 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.172+0000 7f427a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:08.173 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:18:08.174 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.172+0000 7f4293d4c640 10 librados: watch_flush enter 2026-02-24T19:18:08.174 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.173+0000 7f4293d4c640 10 librados: watch_flush exit 2026-02-24T19:18:08.175 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.173+0000 7f4293d4c640 20 client.4357.objecter shutdown clearing up homeless session... 2026-02-24T19:18:08.175 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.173+0000 7f4293d4c640 10 client.4357.objecter successfully canceled tick 2026-02-24T19:18:08.175 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.173+0000 7f4293d4c640 1 -- 10.20.193.26:0/3064031816 >> v1:10.20.193.162:6800/3889602630 conn(0x7f425c077ed0 legacy=0x7f425c098380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:08.175 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.173+0000 7f4293d4c640 10 monclient: shutdown 2026-02-24T19:18:08.175 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.173+0000 7f4293d4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:08.175 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.173+0000 7f4293d4c640 1 -- 10.20.193.26:0/3064031816 >> v1:10.20.193.70:6789/0 conn(0x7f428c157780 legacy=0x7f428c160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:08.175 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.173+0000 7f4293d4c640 1 -- 10.20.193.26:0/3064031816 shutdown_connections 2026-02-24T19:18:08.175 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.173+0000 7f4293d4c640 1 -- 10.20.193.26:0/3064031816 >> 10.20.193.26:0/3064031816 conn(0x7f428c0b2ef0 msgr2=0x7f428c13b910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:08.175 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.173+0000 7f4293d4c640 1 -- 10.20.193.26:0/3064031816 shutdown_connections 2026-02-24T19:18:08.175 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.173+0000 7f4293d4c640 1 -- 10.20.193.26:0/3064031816 wait complete. 2026-02-24T19:18:08.175 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.173+0000 7f4293d4c640 1 librados: shutdown 2026-02-24T19:18:08.182 INFO:teuthology.orchestra.run.trial026.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-24T19:18:08.183 INFO:tasks.ceph_manager:config epoch is 1 2026-02-24T19:18:08.183 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-24T19:18:08.183 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-24T19:18:08.183 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-24T19:18:08.254 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.253+0000 7f013eba9640 10 monclient: get_monmap_and_config 2026-02-24T19:18:08.254 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.253+0000 7f013eba9640 10 monclient: build_initial_monmap 2026-02-24T19:18:08.255 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.253+0000 7f013eba9640 10 monclient: monmap: 2026-02-24T19:18:08.255 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:08.255 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:08.255 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:08.254367+0000 2026-02-24T19:18:08.255 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:08.254367+0000 2026-02-24T19:18:08.255 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:08.255 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:08.255 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:08.255 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:08.255 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:08.255 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:08.257 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.254+0000 7f013eba9640 1 Processor -- start 2026-02-24T19:18:08.257 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.254+0000 7f013eba9640 1 -- start start 2026-02-24T19:18:08.257 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.254+0000 7f013eba9640 10 monclient: init 2026-02-24T19:18:08.257 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.254+0000 7f013eba9640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:08.257 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.254+0000 7f013eba9640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:18:08.257 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.254+0000 7f013eba9640 10 monclient(hunting): picked mon.noname-b con 0x7f0138058da0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:08.257 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.254+0000 7f013eba9640 10 monclient(hunting): picked mon.noname-a con 0x7f01380b0410 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:08.257 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.254+0000 7f013eba9640 10 monclient(hunting): picked mon.noname-c con 0x7f01381626a0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:08.257 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.254+0000 7f013eba9640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01381655c0 con 0x7f01380b0410 2026-02-24T19:18:08.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.254+0000 7f013eba9640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01380b12b0 con 0x7f0138058da0 2026-02-24T19:18:08.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.254+0000 7f013eba9640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01380b1590 con 0x7f01381626a0 2026-02-24T19:18:08.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.254+0000 7f013eba9640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:08.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.254+0000 7f013eba9640 10 monclient(hunting): authenticate will time out at 3670.936671s 2026-02-24T19:18:08.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.255+0000 7f012ffff640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f01380b0410 0x7f0138164eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:46674/0 (socket says 10.20.193.26:46674) 2026-02-24T19:18:08.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.255+0000 7f012ffff640 1 -- 10.20.193.26:0/1861154314 learned_addr learned my addr 10.20.193.26:0/1861154314 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:08.262 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.256+0000 7f012f7fe640 1 -- 10.20.193.26:0/1861154314 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1256212663 0 0) 0x7f01381655c0 con 0x7f01380b0410 2026-02-24T19:18:08.262 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.256+0000 7f012f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:08.262 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.256+0000 7f012f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:08.262 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.256+0000 7f012f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:08.262 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.256+0000 7f012f7fe640 10 monclient(hunting): my global_id is 4368 2026-02-24T19:18:08.263 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.256+0000 7f012f7fe640 1 -- 10.20.193.26:0/1861154314 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0124003610 con 0x7f01380b0410 2026-02-24T19:18:08.263 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.256+0000 7f012f7fe640 1 -- 10.20.193.26:0/1861154314 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 965658174 0 0) 0x7f01380b12b0 con 0x7f0138058da0 2026-02-24T19:18:08.263 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.256+0000 7f012f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:08.263 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.256+0000 7f012f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:08.263 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.256+0000 7f012f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:08.263 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.256+0000 7f012f7fe640 10 monclient(hunting): my global_id is 4360 2026-02-24T19:18:08.263 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.256+0000 7f012f7fe640 1 -- 10.20.193.26:0/1861154314 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01381655c0 con 0x7f0138058da0 2026-02-24T19:18:08.263 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.256+0000 7f012f7fe640 1 -- 10.20.193.26:0/1861154314 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2921043959 0 0) 0x7f01380b1590 con 0x7f01381626a0 2026-02-24T19:18:08.263 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.256+0000 7f012f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:08.263 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.256+0000 7f012f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:08.263 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.256+0000 7f012f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:08.263 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.256+0000 7f012f7fe640 10 monclient(hunting): my global_id is 4373 2026-02-24T19:18:08.264 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.256+0000 7f012f7fe640 1 -- 10.20.193.26:0/1861154314 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01380b12b0 con 0x7f01381626a0 2026-02-24T19:18:08.264 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.258+0000 7f012f7fe640 1 -- 10.20.193.26:0/1861154314 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3177033967 0 0) 0x7f01380b12b0 con 0x7f01381626a0 2026-02-24T19:18:08.264 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.258+0000 7f012f7fe640 1 -- 10.20.193.26:0/1861154314 >> v1:10.20.193.70:6789/0 conn(0x7f0138058da0 legacy=0x7f01381647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:08.264 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.258+0000 7f012f7fe640 1 -- 10.20.193.26:0/1861154314 >> v1:10.20.193.26:6789/0 conn(0x7f01380b0410 legacy=0x7f0138164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:08.264 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.258+0000 7f012f7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:18:08.264 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.258+0000 7f012f7fe640 1 monclient: found mon.noname-c 2026-02-24T19:18:08.264 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.258+0000 7f012f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:08.264 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.258+0000 7f012f7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:08.264 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.258+0000 7f012f7fe640 1 -- 10.20.193.26:0/1861154314 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01380b1870 con 0x7f01381626a0 2026-02-24T19:18:08.264 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.258+0000 7f012f7fe640 10 monclient: _finish_auth 0 2026-02-24T19:18:08.264 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.258+0000 7f012f7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:18:08.264 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.258+0000 7f012f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:08.265 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.258+0000 7f012f7fe640 1 -- 10.20.193.26:0/1861154314 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f0134003150 con 0x7f01381626a0 2026-02-24T19:18:08.265 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.258+0000 7f012f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:08.265 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.258+0000 7f012f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:08.265 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.258+0000 7f012f7fe640 10 monclient: dump: 2026-02-24T19:18:08.265 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:08.265 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:08.265 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:08.265 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:08.265 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:08.265 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:08.265 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:08.265 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:08.265 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:08.266 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:08.266 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.258+0000 7f013eba9640 5 monclient: authenticate success, global_id 4373 2026-02-24T19:18:08.266 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.258+0000 7f013eba9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:08.266 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.259+0000 7f012f7fe640 1 -- 10.20.193.26:0/1861154314 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0134003320 con 0x7f01381626a0 2026-02-24T19:18:08.266 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.259+0000 7f012f7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:08.266 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.259+0000 7f012f7fe640 1 -- 10.20.193.26:0/1861154314 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f0134003760 con 0x7f01381626a0 2026-02-24T19:18:08.266 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.259+0000 7f013eba9640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:08.266 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.259+0000 7f013eba9640 4 set_mon_vals no callback set 2026-02-24T19:18:08.266 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.259+0000 7f012f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:08.266 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.259+0000 7f012f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:08.266 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.259+0000 7f012f7fe640 10 monclient: dump: 2026-02-24T19:18:08.266 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:08.266 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:08.267 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:08.267 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:08.267 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:08.267 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:08.267 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:08.267 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:08.267 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:08.267 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:08.267 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.259+0000 7f013eba9640 10 monclient: shutdown 2026-02-24T19:18:08.267 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.259+0000 7f013eba9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:08.267 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.259+0000 7f013eba9640 1 -- 10.20.193.26:0/1861154314 >> v1:10.20.193.103:6789/0 conn(0x7f01381626a0 legacy=0x7f01381c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:08.267 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.259+0000 7f013eba9640 1 -- 10.20.193.26:0/1861154314 shutdown_connections 2026-02-24T19:18:08.267 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.259+0000 7f013eba9640 1 -- 10.20.193.26:0/1861154314 >> 10.20.193.26:0/1861154314 conn(0x7f01380b65f0 msgr2=0x7f01380b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:08.268 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.259+0000 7f013eba9640 1 -- 10.20.193.26:0/1861154314 shutdown_connections 2026-02-24T19:18:08.268 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.259+0000 7f013eba9640 1 -- 10.20.193.26:0/1861154314 wait complete. 2026-02-24T19:18:08.268 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.260+0000 7f013eba9640 10 monclient: build_initial_monmap 2026-02-24T19:18:08.268 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.260+0000 7f013eba9640 10 monclient: monmap: 2026-02-24T19:18:08.268 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:08.268 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:08.268 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:08.268 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:08.268 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:08.268 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:08.268 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:08.268 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:08.268 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:08.269 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:08.269 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.260+0000 7f013eba9640 1 librados: starting msgr at 2026-02-24T19:18:08.269 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.260+0000 7f013eba9640 1 librados: starting objecter 2026-02-24T19:18:08.269 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.260+0000 7f013eba9640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:08.269 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.260+0000 7f013eba9640 1 Processor -- start 2026-02-24T19:18:08.269 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.260+0000 7f013eba9640 1 -- start start 2026-02-24T19:18:08.269 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.260+0000 7f013eba9640 1 librados: setting wanted keys 2026-02-24T19:18:08.269 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.260+0000 7f013eba9640 1 librados: calling monclient init 2026-02-24T19:18:08.269 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.260+0000 7f013eba9640 10 monclient: init 2026-02-24T19:18:08.269 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.260+0000 7f013eba9640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:08.269 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.260+0000 7f013eba9640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:18:08.269 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.260+0000 7f013eba9640 10 monclient(hunting): picked mon.noname-c con 0x7f0138058da0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:08.269 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.260+0000 7f013eba9640 10 monclient(hunting): picked mon.noname-a con 0x7f01380b0410 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:08.270 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.260+0000 7f013eba9640 10 monclient(hunting): picked mon.noname-b con 0x7f01381626a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:08.270 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.260+0000 7f013eba9640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f013813f520 con 0x7f01380b0410 2026-02-24T19:18:08.270 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.260+0000 7f013eba9640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f013814aca0 con 0x7f01381626a0 2026-02-24T19:18:08.270 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.260+0000 7f013eba9640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f013813e1a0 con 0x7f0138058da0 2026-02-24T19:18:08.270 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.260+0000 7f013eba9640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:08.270 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.260+0000 7f013eba9640 10 monclient(hunting): authenticate will time out at 3670.942669s 2026-02-24T19:18:08.270 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.260+0000 7f012ffff640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f01380b0410 0x7f0138115a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:46676/0 (socket says 10.20.193.26:46676) 2026-02-24T19:18:08.270 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.260+0000 7f012ffff640 1 -- 10.20.193.26:0/1736841009 learned_addr learned my addr 10.20.193.26:0/1736841009 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:08.270 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.261+0000 7f012d7fa640 10 client.?.objecter ms_handle_connect 0x7f01380b0410 2026-02-24T19:18:08.270 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.261+0000 7f012d7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:08.270 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.261+0000 7f012d7fa640 10 client.?.objecter ms_handle_connect 0x7f0138058da0 2026-02-24T19:18:08.270 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.261+0000 7f012d7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:08.271 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.261+0000 7f012d7fa640 10 client.?.objecter ms_handle_connect 0x7f01381626a0 2026-02-24T19:18:08.271 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.261+0000 7f012d7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:08.274 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.262+0000 7f012d7fa640 1 -- 10.20.193.26:0/1736841009 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3604429914 0 0) 0x7f013813f520 con 0x7f01380b0410 2026-02-24T19:18:08.274 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.262+0000 7f012d7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:18:08.274 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.262+0000 7f012d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:08.274 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.262+0000 7f012d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:08.274 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.262+0000 7f012d7fa640 10 monclient(hunting): my global_id is 4371 2026-02-24T19:18:08.274 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.262+0000 7f012d7fa640 1 -- 10.20.193.26:0/1736841009 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0108003610 con 0x7f01380b0410 2026-02-24T19:18:08.274 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.262+0000 7f012d7fa640 1 -- 10.20.193.26:0/1736841009 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1984400383 0 0) 0x7f013813e1a0 con 0x7f0138058da0 2026-02-24T19:18:08.274 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.262+0000 7f012d7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:18:08.274 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.262+0000 7f012d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:08.274 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.262+0000 7f012d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:08.275 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.262+0000 7f012d7fa640 10 monclient(hunting): my global_id is 4376 2026-02-24T19:18:08.275 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.262+0000 7f012d7fa640 1 -- 10.20.193.26:0/1736841009 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f013813f520 con 0x7f0138058da0 2026-02-24T19:18:08.275 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.262+0000 7f012d7fa640 1 -- 10.20.193.26:0/1736841009 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3205856026 0 0) 0x7f013814aca0 con 0x7f01381626a0 2026-02-24T19:18:08.275 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.262+0000 7f012d7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:18:08.275 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.262+0000 7f012d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:08.275 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.262+0000 7f012d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:08.275 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.262+0000 7f012d7fa640 10 monclient(hunting): my global_id is 4363 2026-02-24T19:18:08.275 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.262+0000 7f012d7fa640 1 -- 10.20.193.26:0/1736841009 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f013813e1a0 con 0x7f01381626a0 2026-02-24T19:18:08.275 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.264+0000 7f012d7fa640 1 -- 10.20.193.26:0/1736841009 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3770264241 0 0) 0x7f013813f520 con 0x7f0138058da0 2026-02-24T19:18:08.275 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.264+0000 7f012d7fa640 1 -- 10.20.193.26:0/1736841009 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f013814aca0 con 0x7f0138058da0 2026-02-24T19:18:08.275 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.264+0000 7f012d7fa640 1 -- 10.20.193.26:0/1736841009 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f01280030b0 con 0x7f0138058da0 2026-02-24T19:18:08.275 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.264+0000 7f012d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:08.276 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.264+0000 7f012d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:08.276 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.264+0000 7f012d7fa640 10 monclient(hunting): dump: 2026-02-24T19:18:08.276 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:08.276 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:08.276 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:08.276 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:08.276 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:08.276 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:08.276 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:08.276 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:08.276 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:08.276 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:08.277 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.264+0000 7f012d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:08.277 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.264+0000 7f012d7fa640 1 -- 10.20.193.26:0/1736841009 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2138950727 0 0) 0x7f0108003610 con 0x7f01380b0410 2026-02-24T19:18:08.277 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.264+0000 7f012d7fa640 1 -- 10.20.193.26:0/1736841009 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f013813f520 con 0x7f01380b0410 2026-02-24T19:18:08.277 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.264+0000 7f012d7fa640 1 -- 10.20.193.26:0/1736841009 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f01200030b0 con 0x7f01380b0410 2026-02-24T19:18:08.277 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.264+0000 7f012d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:08.277 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.264+0000 7f012d7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:08.277 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.264+0000 7f012d7fa640 10 monclient(hunting): dump: 2026-02-24T19:18:08.277 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:08.277 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:08.277 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:08.277 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:08.277 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:08.277 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:08.278 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:08.278 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:08.278 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:08.278 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:08.278 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.264+0000 7f012d7fa640 1 -- 10.20.193.26:0/1736841009 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4083484701 0 0) 0x7f013813e1a0 con 0x7f01381626a0 2026-02-24T19:18:08.278 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.264+0000 7f012d7fa640 1 -- 10.20.193.26:0/1736841009 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0108003610 con 0x7f01381626a0 2026-02-24T19:18:08.278 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.264+0000 7f012d7fa640 1 -- 10.20.193.26:0/1736841009 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f0134003670 con 0x7f01381626a0 2026-02-24T19:18:08.278 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.264+0000 7f012d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:08.278 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.264+0000 7f012d7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:08.278 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.264+0000 7f012d7fa640 10 monclient(hunting): dump: 2026-02-24T19:18:08.278 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:08.278 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:08.278 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:08.279 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:08.279 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:08.279 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:08.279 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:08.279 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:08.279 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:08.279 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:08.279 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.266+0000 7f012d7fa640 1 -- 10.20.193.26:0/1736841009 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1495644552 0 0) 0x7f013814aca0 con 0x7f0138058da0 2026-02-24T19:18:08.279 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.266+0000 7f012d7fa640 1 -- 10.20.193.26:0/1736841009 >> v1:10.20.193.70:6789/0 conn(0x7f01381626a0 legacy=0x7f013815dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:08.279 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.266+0000 7f012d7fa640 1 -- 10.20.193.26:0/1736841009 >> v1:10.20.193.26:6789/0 conn(0x7f01380b0410 legacy=0x7f0138115a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:08.279 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.266+0000 7f012d7fa640 10 monclient: _finish_hunting 0 2026-02-24T19:18:08.279 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.266+0000 7f012d7fa640 1 monclient: found mon.c 2026-02-24T19:18:08.279 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.266+0000 7f012d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:08.280 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.266+0000 7f012d7fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:08.280 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.266+0000 7f012d7fa640 1 -- 10.20.193.26:0/1736841009 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013813e480 con 0x7f0138058da0 2026-02-24T19:18:08.280 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.266+0000 7f012d7fa640 10 monclient: _finish_auth 0 2026-02-24T19:18:08.280 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.266+0000 7f012d7fa640 10 monclient: _check_auth_tickets 2026-02-24T19:18:08.280 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.266+0000 7f012d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:08.280 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.266+0000 7f013eba9640 5 monclient: authenticate success, global_id 4376 2026-02-24T19:18:08.280 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.266+0000 7f013eba9640 10 monclient: _renew_subs 2026-02-24T19:18:08.280 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.266+0000 7f013eba9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:08.280 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.266+0000 7f013eba9640 1 -- 10.20.193.26:0/1736841009 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f013813e760 con 0x7f0138058da0 2026-02-24T19:18:08.280 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.266+0000 7f013eba9640 10 client.4376.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:08.280 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.266+0000 7f013eba9640 10 monclient: _renew_subs 2026-02-24T19:18:08.280 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.266+0000 7f013eba9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:08.280 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.266+0000 7f013eba9640 1 -- 10.20.193.26:0/1736841009 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f013813ed20 con 0x7f0138058da0 2026-02-24T19:18:08.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.266+0000 7f013eba9640 1 librados: init done 2026-02-24T19:18:08.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.266+0000 7f013eba9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:08.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.266+0000 7f013eba9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:08.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.266+0000 7f013eba9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:08.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.266+0000 7f013eba9640 1 -- 10.20.193.26:0/1736841009 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01380b6a60 con 0x7f0138058da0 2026-02-24T19:18:08.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.274+0000 7f012d7fa640 1 -- 10.20.193.26:0/1736841009 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0128003700 con 0x7f0138058da0 2026-02-24T19:18:08.283 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.274+0000 7f012d7fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:08.283 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.274+0000 7f012d7fa640 1 -- 10.20.193.26:0/1736841009 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f0128003a50 con 0x7f0138058da0 2026-02-24T19:18:08.283 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.274+0000 7f012d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:08.283 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.274+0000 7f012d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:08.283 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.274+0000 7f012d7fa640 10 monclient: dump: 2026-02-24T19:18:08.283 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:08.283 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:08.283 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:08.283 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:08.283 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:08.284 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:08.284 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:08.284 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:08.284 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:08.284 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:08.284 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.274+0000 7f012effd640 4 set_mon_vals no callback set 2026-02-24T19:18:08.284 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.275+0000 7f012d7fa640 1 -- 10.20.193.26:0/1736841009 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f012801c8c0 con 0x7f0138058da0 2026-02-24T19:18:08.284 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.275+0000 7f012ffff640 10 monclient: get_auth_request con 0x7f0108077dd0 auth_method 0 2026-02-24T19:18:08.284 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.276+0000 7f012d7fa640 10 client.4376.objecter ms_handle_connect 0x7f0108077dd0 2026-02-24T19:18:08.284 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.276+0000 7f012d7fa640 1 -- 10.20.193.26:0/1736841009 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f0128091fe0 con 0x7f0138058da0 2026-02-24T19:18:08.284 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.276+0000 7f012d7fa640 10 client.4376.objecter ms_dispatch2 0x7f0138000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:08.284 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.276+0000 7f012d7fa640 3 client.4376.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:08.284 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.276+0000 7f012d7fa640 3 client.4376.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:08.285 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.276+0000 7f012d7fa640 20 client.4376.objecter dump_active .. 0 homeless 2026-02-24T19:18:08.367 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.365+0000 7f012d7fa640 1 -- 10.20.193.26:0/1736841009 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f012805ca10 con 0x7f0138058da0 2026-02-24T19:18:08.367 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.366+0000 7f012d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:08.367 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.366+0000 7f012d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:08.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.503+0000 7f013eba9640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2026-02-24T19:18:08.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.503+0000 7f013eba9640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-24T19:18:08.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.503+0000 7f013eba9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:08.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.503+0000 7f013eba9640 1 -- 10.20.193.26:0/1736841009 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f0138059e00 con 0x7f0138058da0 2026-02-24T19:18:08.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.548+0000 7f012d7fa640 1 -- 10.20.193.26:0/1736841009 <== mon.2 v1:10.20.193.103:6789/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+193217 (unknown 481731318 0 2293523506) 0x7f012805c310 con 0x7f0138058da0 2026-02-24T19:18:08.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.548+0000 7f012d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-24T19:18:08.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.548+0000 7f012d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:08.553 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:18:08.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.550+0000 7f013eba9640 10 librados: watch_flush enter 2026-02-24T19:18:08.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.550+0000 7f013eba9640 10 librados: watch_flush exit 2026-02-24T19:18:08.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.550+0000 7f013eba9640 20 client.4376.objecter shutdown clearing up homeless session... 2026-02-24T19:18:08.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.550+0000 7f013eba9640 10 client.4376.objecter successfully canceled tick 2026-02-24T19:18:08.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.550+0000 7f013eba9640 1 -- 10.20.193.26:0/1736841009 >> v1:10.20.193.162:6800/3889602630 conn(0x7f0108077dd0 legacy=0x7f0108098280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:08.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.550+0000 7f013eba9640 10 monclient: shutdown 2026-02-24T19:18:08.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.550+0000 7f013eba9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:08.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.550+0000 7f013eba9640 1 -- 10.20.193.26:0/1736841009 >> v1:10.20.193.103:6789/0 conn(0x7f0138058da0 legacy=0x7f013814a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:08.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.550+0000 7f013eba9640 1 -- 10.20.193.26:0/1736841009 shutdown_connections 2026-02-24T19:18:08.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.550+0000 7f013eba9640 1 -- 10.20.193.26:0/1736841009 >> 10.20.193.26:0/1736841009 conn(0x7f01380b65f0 msgr2=0x7f0138055980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:08.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.550+0000 7f013eba9640 1 -- 10.20.193.26:0/1736841009 shutdown_connections 2026-02-24T19:18:08.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.550+0000 7f013eba9640 1 -- 10.20.193.26:0/1736841009 wait complete. 2026-02-24T19:18:08.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.550+0000 7f013eba9640 1 librados: shutdown 2026-02-24T19:18:08.560 INFO:teuthology.orchestra.run.trial026.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6800","nonce":3889602630}]},"active_addr":"10.20.193.162:6800/3889602630","active_change":"2026-02-24T19:17:24.425556+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self certificates generated and signed by cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.5","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"how frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self certificates generated and signed by cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.5","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"how frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.162:0","nonce":874914784}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.162:0","nonce":233269569}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.162:0","nonce":1114235234}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.162:0","nonce":1161928614}]}]} 2026-02-24T19:18:08.570 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-24T19:18:08.570 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-24T19:18:08.571 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-24T19:18:08.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.666+0000 7fd25991a640 10 monclient: get_monmap_and_config 2026-02-24T19:18:08.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.666+0000 7fd25991a640 10 monclient: build_initial_monmap 2026-02-24T19:18:08.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.666+0000 7fd25991a640 10 monclient: monmap: 2026-02-24T19:18:08.668 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:08.668 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:08.668 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:08.667241+0000 2026-02-24T19:18:08.668 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:08.667241+0000 2026-02-24T19:18:08.668 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:08.668 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:08.668 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:08.668 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:08.668 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:08.669 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:08.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.666+0000 7fd25991a640 1 Processor -- start 2026-02-24T19:18:08.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.666+0000 7fd25991a640 1 -- start start 2026-02-24T19:18:08.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.666+0000 7fd25991a640 10 monclient: init 2026-02-24T19:18:08.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.667+0000 7fd25991a640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:08.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.667+0000 7fd25991a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:18:08.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.667+0000 7fd25991a640 10 monclient(hunting): picked mon.noname-c con 0x7fd25415df50 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:08.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.667+0000 7fd25991a640 10 monclient(hunting): picked mon.noname-a con 0x7fd25416b930 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:08.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.667+0000 7fd25991a640 10 monclient(hunting): picked mon.noname-b con 0x7fd254059240 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:08.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.667+0000 7fd25991a640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2541685c0 con 0x7fd25416b930 2026-02-24T19:18:08.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.667+0000 7fd25991a640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd25405cbe0 con 0x7fd254059240 2026-02-24T19:18:08.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.667+0000 7fd25991a640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd25405cec0 con 0x7fd25415df50 2026-02-24T19:18:08.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.667+0000 7fd25991a640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:08.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.667+0000 7fd25991a640 10 monclient(hunting): authenticate will time out at 3671.349552s 2026-02-24T19:18:08.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.667+0000 7fd2527fc640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fd25416b930 0x7fd254058b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:46684/0 (socket says 10.20.193.26:46684) 2026-02-24T19:18:08.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.667+0000 7fd2527fc640 1 -- 10.20.193.26:0/3222729575 learned_addr learned my addr 10.20.193.26:0/3222729575 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:08.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.669+0000 7fd251ffb640 1 -- 10.20.193.26:0/3222729575 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3694498885 0 0) 0x7fd2541685c0 con 0x7fd25416b930 2026-02-24T19:18:08.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.669+0000 7fd251ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:08.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.669+0000 7fd251ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:08.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.669+0000 7fd251ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:08.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.669+0000 7fd251ffb640 10 monclient(hunting): my global_id is 4374 2026-02-24T19:18:08.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.669+0000 7fd251ffb640 1 -- 10.20.193.26:0/3222729575 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd240003610 con 0x7fd25416b930 2026-02-24T19:18:08.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.669+0000 7fd251ffb640 1 -- 10.20.193.26:0/3222729575 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4054391470 0 0) 0x7fd25405cec0 con 0x7fd25415df50 2026-02-24T19:18:08.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.669+0000 7fd251ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:08.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.669+0000 7fd251ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:08.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.669+0000 7fd251ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:08.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.669+0000 7fd251ffb640 10 monclient(hunting): my global_id is 4379 2026-02-24T19:18:08.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.669+0000 7fd251ffb640 1 -- 10.20.193.26:0/3222729575 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2541685c0 con 0x7fd25415df50 2026-02-24T19:18:08.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.669+0000 7fd251ffb640 1 -- 10.20.193.26:0/3222729575 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1159063024 0 0) 0x7fd25405cbe0 con 0x7fd254059240 2026-02-24T19:18:08.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.669+0000 7fd251ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:08.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.669+0000 7fd251ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:08.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.669+0000 7fd251ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:08.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.669+0000 7fd251ffb640 10 monclient(hunting): my global_id is 4366 2026-02-24T19:18:08.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.669+0000 7fd251ffb640 1 -- 10.20.193.26:0/3222729575 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd25405cec0 con 0x7fd254059240 2026-02-24T19:18:08.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.671+0000 7fd251ffb640 1 -- 10.20.193.26:0/3222729575 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 858176113 0 0) 0x7fd25405cec0 con 0x7fd254059240 2026-02-24T19:18:08.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.671+0000 7fd251ffb640 1 -- 10.20.193.26:0/3222729575 >> v1:10.20.193.103:6789/0 conn(0x7fd25415df50 legacy=0x7fd254056dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:08.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.671+0000 7fd251ffb640 1 -- 10.20.193.26:0/3222729575 >> v1:10.20.193.26:6789/0 conn(0x7fd25416b930 legacy=0x7fd254058b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:08.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.671+0000 7fd251ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:18:08.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.671+0000 7fd251ffb640 1 monclient: found mon.noname-b 2026-02-24T19:18:08.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.671+0000 7fd251ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:08.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.671+0000 7fd251ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:18:08.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.671+0000 7fd251ffb640 1 -- 10.20.193.26:0/3222729575 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd25405d1a0 con 0x7fd254059240 2026-02-24T19:18:08.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.671+0000 7fd251ffb640 10 monclient: _finish_auth 0 2026-02-24T19:18:08.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.671+0000 7fd251ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:18:08.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.671+0000 7fd251ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:08.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.671+0000 7fd251ffb640 1 -- 10.20.193.26:0/3222729575 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd244003150 con 0x7fd254059240 2026-02-24T19:18:08.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.671+0000 7fd251ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:08.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.671+0000 7fd251ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:08.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.671+0000 7fd251ffb640 10 monclient: dump: 2026-02-24T19:18:08.680 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:08.680 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:08.680 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:08.680 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:08.680 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:08.680 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:08.681 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:08.681 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:08.681 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:08.681 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:08.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.671+0000 7fd25991a640 5 monclient: authenticate success, global_id 4366 2026-02-24T19:18:08.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.671+0000 7fd25991a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:08.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.672+0000 7fd251ffb640 1 -- 10.20.193.26:0/3222729575 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd2440032f0 con 0x7fd254059240 2026-02-24T19:18:08.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.672+0000 7fd251ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:08.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.672+0000 7fd251ffb640 1 -- 10.20.193.26:0/3222729575 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd2440036f0 con 0x7fd254059240 2026-02-24T19:18:08.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.672+0000 7fd251ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:08.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.672+0000 7fd251ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:08.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.672+0000 7fd251ffb640 10 monclient: dump: 2026-02-24T19:18:08.681 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:08.682 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:08.682 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:08.682 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:08.682 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:08.682 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:08.682 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:08.682 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:08.682 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:08.682 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:08.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.672+0000 7fd25991a640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:08.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.672+0000 7fd25991a640 4 set_mon_vals no callback set 2026-02-24T19:18:08.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.672+0000 7fd25991a640 10 monclient: shutdown 2026-02-24T19:18:08.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.672+0000 7fd25991a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:08.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.672+0000 7fd25991a640 1 -- 10.20.193.26:0/3222729575 >> v1:10.20.193.70:6789/0 conn(0x7fd254059240 legacy=0x7fd254167810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:08.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.672+0000 7fd25991a640 1 -- 10.20.193.26:0/3222729575 shutdown_connections 2026-02-24T19:18:08.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.672+0000 7fd25991a640 1 -- 10.20.193.26:0/3222729575 >> 10.20.193.26:0/3222729575 conn(0x7fd2540b65f0 msgr2=0x7fd2540b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:08.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.672+0000 7fd25991a640 1 -- 10.20.193.26:0/3222729575 shutdown_connections 2026-02-24T19:18:08.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.672+0000 7fd25991a640 1 -- 10.20.193.26:0/3222729575 wait complete. 2026-02-24T19:18:08.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.672+0000 7fd25991a640 10 monclient: build_initial_monmap 2026-02-24T19:18:08.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.672+0000 7fd25991a640 10 monclient: monmap: 2026-02-24T19:18:08.683 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:08.683 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:08.683 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:08.683 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:08.683 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:08.684 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:08.684 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:08.684 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:08.684 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:08.684 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:08.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.672+0000 7fd25991a640 1 librados: starting msgr at 2026-02-24T19:18:08.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.672+0000 7fd25991a640 1 librados: starting objecter 2026-02-24T19:18:08.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.673+0000 7fd25991a640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:08.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.673+0000 7fd25991a640 1 Processor -- start 2026-02-24T19:18:08.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.673+0000 7fd25991a640 1 -- start start 2026-02-24T19:18:08.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.673+0000 7fd25991a640 1 librados: setting wanted keys 2026-02-24T19:18:08.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.673+0000 7fd25991a640 1 librados: calling monclient init 2026-02-24T19:18:08.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.673+0000 7fd25991a640 10 monclient: init 2026-02-24T19:18:08.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.673+0000 7fd25991a640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:08.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.673+0000 7fd25991a640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:18:08.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.673+0000 7fd25991a640 10 monclient(hunting): picked mon.noname-b con 0x7fd254059240 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:08.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.673+0000 7fd25991a640 10 monclient(hunting): picked mon.noname-a con 0x7fd25415df50 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:08.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.673+0000 7fd25991a640 10 monclient(hunting): picked mon.noname-c con 0x7fd25416b930 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:08.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.673+0000 7fd25991a640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2540ac7a0 con 0x7fd25415df50 2026-02-24T19:18:08.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.673+0000 7fd25991a640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2540ad380 con 0x7fd254059240 2026-02-24T19:18:08.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.673+0000 7fd25991a640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2540ab1a0 con 0x7fd25416b930 2026-02-24T19:18:08.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.673+0000 7fd25991a640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:08.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.673+0000 7fd25991a640 10 monclient(hunting): authenticate will time out at 3671.355508s 2026-02-24T19:18:08.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.673+0000 7fd2527fc640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fd25415df50 0x7fd25411cbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:46700/0 (socket says 10.20.193.26:46700) 2026-02-24T19:18:08.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.673+0000 7fd2527fc640 1 -- 10.20.193.26:0/1761999433 learned_addr learned my addr 10.20.193.26:0/1761999433 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:08.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.673+0000 7fd22bfff640 10 client.?.objecter ms_handle_connect 0x7fd25415df50 2026-02-24T19:18:08.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.673+0000 7fd22bfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:08.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.674+0000 7fd22bfff640 10 client.?.objecter ms_handle_connect 0x7fd254059240 2026-02-24T19:18:08.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.674+0000 7fd22bfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:08.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.674+0000 7fd22bfff640 10 client.?.objecter ms_handle_connect 0x7fd25416b930 2026-02-24T19:18:08.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.674+0000 7fd22bfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:08.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.674+0000 7fd22bfff640 1 -- 10.20.193.26:0/1761999433 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 708437917 0 0) 0x7fd2540ac7a0 con 0x7fd25415df50 2026-02-24T19:18:08.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.674+0000 7fd22bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:08.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.674+0000 7fd22bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:08.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.674+0000 7fd22bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:08.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.674+0000 7fd22bfff640 10 monclient(hunting): my global_id is 4377 2026-02-24T19:18:08.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.674+0000 7fd22bfff640 1 -- 10.20.193.26:0/1761999433 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd224003610 con 0x7fd25415df50 2026-02-24T19:18:08.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.674+0000 7fd22bfff640 1 -- 10.20.193.26:0/1761999433 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2188527391 0 0) 0x7fd2540ad380 con 0x7fd254059240 2026-02-24T19:18:08.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.675+0000 7fd22bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:08.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.675+0000 7fd22bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:08.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.675+0000 7fd22bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:08.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.675+0000 7fd22bfff640 10 monclient(hunting): my global_id is 4369 2026-02-24T19:18:08.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.675+0000 7fd22bfff640 1 -- 10.20.193.26:0/1761999433 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2540ac7a0 con 0x7fd254059240 2026-02-24T19:18:08.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.675+0000 7fd22bfff640 1 -- 10.20.193.26:0/1761999433 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 870101692 0 0) 0x7fd2540ab1a0 con 0x7fd25416b930 2026-02-24T19:18:08.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.675+0000 7fd22bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:08.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.675+0000 7fd22bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:08.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.675+0000 7fd22bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:08.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.675+0000 7fd22bfff640 10 monclient(hunting): my global_id is 4382 2026-02-24T19:18:08.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.675+0000 7fd22bfff640 1 -- 10.20.193.26:0/1761999433 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2540ad380 con 0x7fd25416b930 2026-02-24T19:18:08.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.677+0000 7fd22bfff640 1 -- 10.20.193.26:0/1761999433 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4203000388 0 0) 0x7fd224003610 con 0x7fd25415df50 2026-02-24T19:18:08.688 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.677+0000 7fd22bfff640 1 -- 10.20.193.26:0/1761999433 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd2540ab1a0 con 0x7fd25415df50 2026-02-24T19:18:08.688 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.677+0000 7fd22bfff640 1 -- 10.20.193.26:0/1761999433 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd23c002fb0 con 0x7fd25415df50 2026-02-24T19:18:08.688 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.677+0000 7fd22bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:08.688 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.677+0000 7fd22bfff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:08.688 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.677+0000 7fd22bfff640 10 monclient(hunting): dump: 2026-02-24T19:18:08.688 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:08.688 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:08.688 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:08.688 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:08.688 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:08.688 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:08.688 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:08.688 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:08.689 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:08.689 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:08.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.677+0000 7fd22bfff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:08.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.677+0000 7fd22bfff640 1 -- 10.20.193.26:0/1761999433 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4083582030 0 0) 0x7fd2540ac7a0 con 0x7fd254059240 2026-02-24T19:18:08.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.677+0000 7fd22bfff640 1 -- 10.20.193.26:0/1761999433 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd224003610 con 0x7fd254059240 2026-02-24T19:18:08.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.677+0000 7fd22bfff640 1 -- 10.20.193.26:0/1761999433 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd2480030a0 con 0x7fd254059240 2026-02-24T19:18:08.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.677+0000 7fd22bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:08.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.677+0000 7fd22bfff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:08.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.677+0000 7fd22bfff640 10 monclient(hunting): dump: 2026-02-24T19:18:08.689 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:08.689 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:08.689 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:08.689 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:08.690 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:08.690 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:08.690 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:08.690 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:08.690 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:08.690 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:08.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.677+0000 7fd22bfff640 1 -- 10.20.193.26:0/1761999433 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3777961569 0 0) 0x7fd2540ad380 con 0x7fd25416b930 2026-02-24T19:18:08.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.677+0000 7fd22bfff640 1 -- 10.20.193.26:0/1761999433 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd2540ac7a0 con 0x7fd25416b930 2026-02-24T19:18:08.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.677+0000 7fd22bfff640 1 -- 10.20.193.26:0/1761999433 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd244003640 con 0x7fd25416b930 2026-02-24T19:18:08.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.677+0000 7fd22bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:08.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.677+0000 7fd22bfff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:08.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.677+0000 7fd22bfff640 10 monclient(hunting): dump: 2026-02-24T19:18:08.691 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:08.691 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:08.691 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:08.691 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:08.691 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:08.691 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:08.691 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:08.691 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:08.691 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:08.691 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:08.693 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.679+0000 7fd22bfff640 1 -- 10.20.193.26:0/1761999433 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 685649682 0 0) 0x7fd224003610 con 0x7fd254059240 2026-02-24T19:18:08.693 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.679+0000 7fd22bfff640 1 -- 10.20.193.26:0/1761999433 >> v1:10.20.193.103:6789/0 conn(0x7fd25416b930 legacy=0x7fd2540aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:08.693 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.679+0000 7fd22bfff640 1 -- 10.20.193.26:0/1761999433 >> v1:10.20.193.26:6789/0 conn(0x7fd25415df50 legacy=0x7fd25411cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:08.693 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.679+0000 7fd22bfff640 10 monclient: _finish_hunting 0 2026-02-24T19:18:08.693 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.679+0000 7fd22bfff640 1 monclient: found mon.b 2026-02-24T19:18:08.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.679+0000 7fd22bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:08.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.679+0000 7fd22bfff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:08.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.679+0000 7fd22bfff640 1 -- 10.20.193.26:0/1761999433 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2540ab480 con 0x7fd254059240 2026-02-24T19:18:08.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.679+0000 7fd22bfff640 10 monclient: _finish_auth 0 2026-02-24T19:18:08.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.679+0000 7fd22bfff640 10 monclient: _check_auth_tickets 2026-02-24T19:18:08.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.679+0000 7fd22bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:08.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.679+0000 7fd25991a640 5 monclient: authenticate success, global_id 4369 2026-02-24T19:18:08.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.679+0000 7fd25991a640 10 monclient: _renew_subs 2026-02-24T19:18:08.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.679+0000 7fd25991a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:08.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.679+0000 7fd25991a640 1 -- 10.20.193.26:0/1761999433 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd2540ab760 con 0x7fd254059240 2026-02-24T19:18:08.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.679+0000 7fd25991a640 10 client.4369.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:08.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.679+0000 7fd25991a640 10 monclient: _renew_subs 2026-02-24T19:18:08.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.679+0000 7fd25991a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:08.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.679+0000 7fd25991a640 1 -- 10.20.193.26:0/1761999433 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd2540abd20 con 0x7fd254059240 2026-02-24T19:18:08.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.679+0000 7fd25991a640 1 librados: init done 2026-02-24T19:18:08.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.679+0000 7fd25991a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:08.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.679+0000 7fd25991a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:08.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.679+0000 7fd25991a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:08.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.679+0000 7fd25991a640 1 -- 10.20.193.26:0/1761999433 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd254058ff0 con 0x7fd254059240 2026-02-24T19:18:08.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.773+0000 7fd22bfff640 1 -- 10.20.193.26:0/1761999433 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd2480034f0 con 0x7fd254059240 2026-02-24T19:18:08.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.773+0000 7fd22bfff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:08.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.773+0000 7fd22bfff640 1 -- 10.20.193.26:0/1761999433 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd2480038c0 con 0x7fd254059240 2026-02-24T19:18:08.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.773+0000 7fd22bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:08.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.773+0000 7fd22bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:08.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.773+0000 7fd22bfff640 10 monclient: dump: 2026-02-24T19:18:08.775 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:08.775 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:08.775 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:08.775 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:08.775 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:08.775 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:08.775 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:08.775 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:08.775 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:08.775 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:08.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.773+0000 7fd2517fa640 4 set_mon_vals no callback set 2026-02-24T19:18:08.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.773+0000 7fd22bfff640 1 -- 10.20.193.26:0/1761999433 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fd248003aa0 con 0x7fd254059240 2026-02-24T19:18:08.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.774+0000 7fd2527fc640 10 monclient: get_auth_request con 0x7fd224077fd0 auth_method 0 2026-02-24T19:18:08.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.774+0000 7fd22bfff640 10 client.4369.objecter ms_handle_connect 0x7fd224077fd0 2026-02-24T19:18:08.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.775+0000 7fd22bfff640 1 -- 10.20.193.26:0/1761999433 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7fd248091ed0 con 0x7fd254059240 2026-02-24T19:18:08.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.775+0000 7fd22bfff640 10 client.4369.objecter ms_dispatch2 0x7fd254000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:08.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.775+0000 7fd22bfff640 3 client.4369.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:08.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.775+0000 7fd22bfff640 3 client.4369.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:08.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.775+0000 7fd22bfff640 20 client.4369.objecter dump_active .. 0 homeless 2026-02-24T19:18:08.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.777+0000 7fd22bfff640 1 -- 10.20.193.26:0/1761999433 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fd2480038c0 con 0x7fd254059240 2026-02-24T19:18:08.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.777+0000 7fd22bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:08.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.777+0000 7fd22bfff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:08.886 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.885+0000 7fd25991a640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:18:08.886 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.885+0000 7fd25991a640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:18:08.886 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.885+0000 7fd25991a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:08.886 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.885+0000 7fd25991a640 1 -- 10.20.193.26:0/1761999433 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd25415c850 con 0x7fd254059240 2026-02-24T19:18:08.933 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.932+0000 7fd22bfff640 1 -- 10.20.193.26:0/1761999433 <== mon.1 v1:10.20.193.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+20952 (unknown 3676990683 0 2468073468) 0x7fd24805c900 con 0x7fd254059240 2026-02-24T19:18:08.933 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.932+0000 7fd22bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:18:08.933 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.932+0000 7fd22bfff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:08.933 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:18:08.933 INFO:teuthology.orchestra.run.trial026.stdout:{"epoch":29,"fsid":"33b2b598-dbc5-4d7a-8df7-657f0501fe9e","created":"2026-02-24T19:17:21.810535+0000","modified":"2026-02-24T19:18:07.641612+0000","last_up_change":"2026-02-24T19:17:54.877686+0000","last_in_change":"2026-02-24T19:17:28.575109+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T19:17:56.803348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-24T19:18:02.876352+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":29,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5.9899997711181641,"score_stable":5.9899997711181641,"optimal_score":0.68999999761581421,"raw_score_acting":4.130000114440918,"raw_score_stable":4.130000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e08ffdb8-0db6-4356-88b5-54397e40be58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6808","nonce":4098203721}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6809","nonce":4098203721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6811","nonce":4098203721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6810","nonce":4098203721}]},"public_addr":"10.20.193.26:6808/4098203721","cluster_addr":"10.20.193.26:6809/4098203721","heartbeat_back_addr":"10.20.193.26:6811/4098203721","heartbeat_front_addr":"10.20.193.26:6810/4098203721","state":["exists","up"]},{"osd":1,"uuid":"08b117f7-0152-42bb-8a51-220b41a964ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6800","nonce":268803542}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6801","nonce":268803542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6803","nonce":268803542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6802","nonce":268803542}]},"public_addr":"10.20.193.70:6800/268803542","cluster_addr":"10.20.193.70:6801/268803542","heartbeat_back_addr":"10.20.193.70:6803/268803542","heartbeat_front_addr":"10.20.193.70:6802/268803542","state":["exists","up"]},{"osd":2,"uuid":"3c37f6aa-25cb-43be-a75a-86a246086a85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6800","nonce":3800806982}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6802","nonce":3800806982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6806","nonce":3800806982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6804","nonce":3800806982}]},"public_addr":"10.20.193.103:6800/3800806982","cluster_addr":"10.20.193.103:6802/3800806982","heartbeat_back_addr":"10.20.193.103:6806/3800806982","heartbeat_front_addr":"10.20.193.103:6804/3800806982","state":["exists","up"]},{"osd":3,"uuid":"a7e3939e-f8f5-4216-9700-27e229d1c4d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6805","nonce":920272754}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6806","nonce":920272754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6808","nonce":920272754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6807","nonce":920272754}]},"public_addr":"10.20.193.162:6805/920272754","cluster_addr":"10.20.193.162:6806/920272754","heartbeat_back_addr":"10.20.193.162:6808/920272754","heartbeat_front_addr":"10.20.193.162:6807/920272754","state":["exists","up"]},{"osd":4,"uuid":"445d43ab-a28c-4afa-90ff-e451602e494f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6800","nonce":3717327686}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6801","nonce":3717327686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6803","nonce":3717327686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6802","nonce":3717327686}]},"public_addr":"10.20.193.26:6800/3717327686","cluster_addr":"10.20.193.26:6801/3717327686","heartbeat_back_addr":"10.20.193.26:6803/3717327686","heartbeat_front_addr":"10.20.193.26:6802/3717327686","state":["exists","up"]},{"osd":5,"uuid":"37303b3f-6b88-4c73-aaff-10055ec5cc85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6812","nonce":1419227842}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6813","nonce":1419227842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6815","nonce":1419227842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6814","nonce":1419227842}]},"public_addr":"10.20.193.70:6812/1419227842","cluster_addr":"10.20.193.70:6813/1419227842","heartbeat_back_addr":"10.20.193.70:6815/1419227842","heartbeat_front_addr":"10.20.193.70:6814/1419227842","state":["exists","up"]},{"osd":6,"uuid":"ef2c9883-f17f-41ec-96b7-dbbe936b77d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6808","nonce":3149418268}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6809","nonce":3149418268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6811","nonce":3149418268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6810","nonce":3149418268}]},"public_addr":"10.20.193.103:6808/3149418268","cluster_addr":"10.20.193.103:6809/3149418268","heartbeat_back_addr":"10.20.193.103:6811/3149418268","heartbeat_front_addr":"10.20.193.103:6810/3149418268","state":["exists","up"]},{"osd":7,"uuid":"3e4a495e-c742-43fc-991a-371a47ff87bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6809","nonce":2963240067}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6810","nonce":2963240067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6812","nonce":2963240067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6811","nonce":2963240067}]},"public_addr":"10.20.193.162:6809/2963240067","cluster_addr":"10.20.193.162:6810/2963240067","heartbeat_back_addr":"10.20.193.162:6812/2963240067","heartbeat_front_addr":"10.20.193.162:6811/2963240067","state":["exists","up"]},{"osd":8,"uuid":"fb377a45-1ce5-4e07-92cd-7f546cfad57f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6812","nonce":1933830164}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6813","nonce":1933830164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6815","nonce":1933830164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6814","nonce":1933830164}]},"public_addr":"10.20.193.26:6812/1933830164","cluster_addr":"10.20.193.26:6813/1933830164","heartbeat_back_addr":"10.20.193.26:6815/1933830164","heartbeat_front_addr":"10.20.193.26:6814/1933830164","state":["exists","up"]},{"osd":9,"uuid":"8079b2ca-96c3-4321-9f24-a87e8ea1e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6804","nonce":3709696191}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6805","nonce":3709696191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6807","nonce":3709696191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6806","nonce":3709696191}]},"public_addr":"10.20.193.70:6804/3709696191","cluster_addr":"10.20.193.70:6805/3709696191","heartbeat_back_addr":"10.20.193.70:6807/3709696191","heartbeat_front_addr":"10.20.193.70:6806/3709696191","state":["exists","up"]},{"osd":10,"uuid":"8df004a9-88e3-43f5-833d-dfc73a658ec3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6801","nonce":3185480373}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6803","nonce":3185480373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6807","nonce":3185480373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6805","nonce":3185480373}]},"public_addr":"10.20.193.103:6801/3185480373","cluster_addr":"10.20.193.103:6803/3185480373","heartbeat_back_addr":"10.20.193.103:6807/3185480373","heartbeat_front_addr":"10.20.193.103:6805/3185480373","state":["exists","up"]},{"osd":11,"uuid":"f3cf3a4b-1c26-480c-ba10-178f8542c1e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6813","nonce":1717662802}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6814","nonce":1717662802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6816","nonce":1717662802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6815","nonce":1717662802}]},"public_addr":"10.20.193.162:6813/1717662802","cluster_addr":"10.20.193.162:6814/1717662802","heartbeat_back_addr":"10.20.193.162:6816/1717662802","heartbeat_front_addr":"10.20.193.162:6815/1717662802","state":["exists","up"]},{"osd":12,"uuid":"0e06b2e9-9b29-4c6e-ab44-77fd24d945af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6804","nonce":2128192173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6805","nonce":2128192173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6807","nonce":2128192173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6806","nonce":2128192173}]},"public_addr":"10.20.193.26:6804/2128192173","cluster_addr":"10.20.193.26:6805/2128192173","heartbeat_back_addr":"10.20.193.26:6807/2128192173","heartbeat_front_addr":"10.20.193.26:6806/2128192173","state":["exists","up"]},{"osd":13,"uuid":"b1cbaf8b-36e9-4196-a08d-e6e72c2229e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6808","nonce":2949423039}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6809","nonce":2949423039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6811","nonce":2949423039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6810","nonce":2949423039}]},"public_addr":"10.20.193.70:6808/2949423039","cluster_addr":"10.20.193.70:6809/2949423039","heartbeat_back_addr":"10.20.193.70:6811/2949423039","heartbeat_front_addr":"10.20.193.70:6810/2949423039","state":["exists","up"]},{"osd":14,"uuid":"214e8bfc-c78d-45ac-9ec3-7685dd5684cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6812","nonce":1276189911}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6813","nonce":1276189911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6815","nonce":1276189911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6814","nonce":1276189911}]},"public_addr":"10.20.193.103:6812/1276189911","cluster_addr":"10.20.193.103:6813/1276189911","heartbeat_back_addr":"10.20.193.103:6815/1276189911","heartbeat_front_addr":"10.20.193.103:6814/1276189911","state":["exists","up"]},{"osd":15,"uuid":"8c2eb0c6-abf0-42a7-bcab-83d0c9cf797b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6801","nonce":3445416924}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6802","nonce":3445416924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6804","nonce":3445416924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6803","nonce":3445416924}]},"public_addr":"10.20.193.162:6801/3445416924","cluster_addr":"10.20.193.162:6802/3445416924","heartbeat_back_addr":"10.20.193.162:6804/3445416924","heartbeat_front_addr":"10.20.193.162:6803/3445416924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.943088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.818374+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.712635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:53.063441+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.745019+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:53.046388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.670956+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:53.091882+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:53.000309+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.773039+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.840607+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:53.229086+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.734626+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.874415+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.926522+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.903220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T19:18:08.935 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.933+0000 7fd25991a640 10 librados: watch_flush enter 2026-02-24T19:18:08.935 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.933+0000 7fd25991a640 10 librados: watch_flush exit 2026-02-24T19:18:08.935 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.933+0000 7fd25991a640 20 client.4369.objecter shutdown clearing up homeless session... 2026-02-24T19:18:08.935 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.933+0000 7fd25991a640 10 client.4369.objecter successfully canceled tick 2026-02-24T19:18:08.935 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.933+0000 7fd25991a640 1 -- 10.20.193.26:0/1761999433 >> v1:10.20.193.162:6800/3889602630 conn(0x7fd224077fd0 legacy=0x7fd224098480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:08.935 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.933+0000 7fd25991a640 10 monclient: shutdown 2026-02-24T19:18:08.935 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.933+0000 7fd25991a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:08.936 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.933+0000 7fd25991a640 1 -- 10.20.193.26:0/1761999433 >> v1:10.20.193.70:6789/0 conn(0x7fd254059240 legacy=0x7fd2540acc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:08.936 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.933+0000 7fd25991a640 1 -- 10.20.193.26:0/1761999433 shutdown_connections 2026-02-24T19:18:08.936 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.933+0000 7fd25991a640 1 -- 10.20.193.26:0/1761999433 >> 10.20.193.26:0/1761999433 conn(0x7fd2540b65f0 msgr2=0x7fd25415cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:08.936 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.933+0000 7fd25991a640 1 -- 10.20.193.26:0/1761999433 shutdown_connections 2026-02-24T19:18:08.936 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.933+0000 7fd25991a640 1 -- 10.20.193.26:0/1761999433 wait complete. 2026-02-24T19:18:08.936 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:08.933+0000 7fd25991a640 1 librados: shutdown 2026-02-24T19:18:08.944 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-24T19:18:08.944 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-24T19:18:09.013 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.011+0000 7f7de1a13640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.013 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.011+0000 7f7de1a13640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.013 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.011+0000 7f7de1a13640 10 monclient: monmap: 2026-02-24T19:18:09.013 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.013 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.013 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.012111+0000 2026-02-24T19:18:09.013 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.012111+0000 2026-02-24T19:18:09.013 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.014 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.014 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.014 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.014 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.014 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.014 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.011+0000 7f7de1a13640 1 Processor -- start 2026-02-24T19:18:09.014 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.011+0000 7f7de1a13640 1 -- start start 2026-02-24T19:18:09.014 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.011+0000 7f7de1a13640 10 monclient: init 2026-02-24T19:18:09.016 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.012+0000 7f7de1a13640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.016 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.012+0000 7f7de1a13640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:18:09.016 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.012+0000 7f7de1a13640 10 monclient(hunting): picked mon.noname-c con 0x7f7ddc058da0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.016 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.012+0000 7f7de1a13640 10 monclient(hunting): picked mon.noname-b con 0x7f7ddc0b0410 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.016 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.012+0000 7f7de1a13640 10 monclient(hunting): picked mon.noname-a con 0x7f7ddc1626a0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.016 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.012+0000 7f7de1a13640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ddc1655c0 con 0x7f7ddc1626a0 2026-02-24T19:18:09.017 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.012+0000 7f7de1a13640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ddc0b12b0 con 0x7f7ddc0b0410 2026-02-24T19:18:09.017 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.012+0000 7f7de1a13640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ddc0b1590 con 0x7f7ddc058da0 2026-02-24T19:18:09.017 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.012+0000 7f7de1a13640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.017 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.012+0000 7f7de1a13640 10 monclient(hunting): authenticate will time out at 3671.694305s 2026-02-24T19:18:09.017 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.012+0000 7f7ddb7fe640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f7ddc1626a0 0x7f7ddc1c6d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:46704/0 (socket says 10.20.193.26:46704) 2026-02-24T19:18:09.017 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.012+0000 7f7ddb7fe640 1 -- 10.20.193.26:0/1477987677 learned_addr learned my addr 10.20.193.26:0/1477987677 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.017 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.013+0000 7f7dd9ffb640 1 -- 10.20.193.26:0/1477987677 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2749614959 0 0) 0x7f7ddc1655c0 con 0x7f7ddc1626a0 2026-02-24T19:18:09.017 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.013+0000 7f7dd9ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.017 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.013+0000 7f7dd9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.017 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.013+0000 7f7dd9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.017 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.013+0000 7f7dd9ffb640 10 monclient(hunting): my global_id is 4380 2026-02-24T19:18:09.017 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.013+0000 7f7dd9ffb640 1 -- 10.20.193.26:0/1477987677 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7dc8003610 con 0x7f7ddc1626a0 2026-02-24T19:18:09.017 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.014+0000 7f7dd9ffb640 1 -- 10.20.193.26:0/1477987677 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3118824340 0 0) 0x7f7ddc0b1590 con 0x7f7ddc058da0 2026-02-24T19:18:09.018 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.014+0000 7f7dd9ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.018 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.014+0000 7f7dd9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.018 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.014+0000 7f7dd9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.018 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.014+0000 7f7dd9ffb640 10 monclient(hunting): my global_id is 4385 2026-02-24T19:18:09.018 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.014+0000 7f7dd9ffb640 1 -- 10.20.193.26:0/1477987677 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ddc1655c0 con 0x7f7ddc058da0 2026-02-24T19:18:09.018 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.014+0000 7f7dd9ffb640 1 -- 10.20.193.26:0/1477987677 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3255744079 0 0) 0x7f7ddc0b12b0 con 0x7f7ddc0b0410 2026-02-24T19:18:09.018 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.014+0000 7f7dd9ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.018 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.014+0000 7f7dd9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.018 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.014+0000 7f7dd9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.018 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.014+0000 7f7dd9ffb640 10 monclient(hunting): my global_id is 4372 2026-02-24T19:18:09.018 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.014+0000 7f7dd9ffb640 1 -- 10.20.193.26:0/1477987677 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ddc0b1590 con 0x7f7ddc0b0410 2026-02-24T19:18:09.023 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.015+0000 7f7dd9ffb640 1 -- 10.20.193.26:0/1477987677 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4041819171 0 0) 0x7f7dc8003610 con 0x7f7ddc1626a0 2026-02-24T19:18:09.024 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.015+0000 7f7dd9ffb640 1 -- 10.20.193.26:0/1477987677 >> v1:10.20.193.103:6789/0 conn(0x7f7ddc058da0 legacy=0x7f7ddc1647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.024 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.015+0000 7f7dd9ffb640 1 -- 10.20.193.26:0/1477987677 >> v1:10.20.193.70:6789/0 conn(0x7f7ddc0b0410 legacy=0x7f7ddc164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.024 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.015+0000 7f7dd9ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.024 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.015+0000 7f7dd9ffb640 1 monclient: found mon.noname-a 2026-02-24T19:18:09.024 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.015+0000 7f7dd9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.024 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.015+0000 7f7dd9ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.024 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.015+0000 7f7dd9ffb640 1 -- 10.20.193.26:0/1477987677 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ddc0b1870 con 0x7f7ddc1626a0 2026-02-24T19:18:09.024 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.015+0000 7f7dd9ffb640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.024 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.015+0000 7f7dd9ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.024 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.015+0000 7f7dd9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.025 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.015+0000 7f7dd9ffb640 1 -- 10.20.193.26:0/1477987677 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7dcc003170 con 0x7f7ddc1626a0 2026-02-24T19:18:09.025 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.015+0000 7f7dd9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.025 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.015+0000 7f7dd9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:09.025 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.015+0000 7f7dd9ffb640 10 monclient: dump: 2026-02-24T19:18:09.025 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.025 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.025 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.025 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.025 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.025 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.025 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.025 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.025 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.026 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.026 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.015+0000 7f7de1a13640 5 monclient: authenticate success, global_id 4380 2026-02-24T19:18:09.026 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.015+0000 7f7de1a13640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.026 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.016+0000 7f7dd9ffb640 1 -- 10.20.193.26:0/1477987677 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7dcc003340 con 0x7f7ddc1626a0 2026-02-24T19:18:09.026 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.016+0000 7f7dd9ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.026 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.016+0000 7f7dd9ffb640 1 -- 10.20.193.26:0/1477987677 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7dcc003780 con 0x7f7ddc1626a0 2026-02-24T19:18:09.026 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.016+0000 7f7de1a13640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.026 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.016+0000 7f7de1a13640 4 set_mon_vals no callback set 2026-02-24T19:18:09.026 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.016+0000 7f7dd9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.026 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.016+0000 7f7dd9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:09.026 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.016+0000 7f7dd9ffb640 10 monclient: dump: 2026-02-24T19:18:09.026 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.027 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.027 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.027 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.027 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.027 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.027 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.027 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.027 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.027 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.027 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.016+0000 7f7de1a13640 10 monclient: shutdown 2026-02-24T19:18:09.027 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.016+0000 7f7de1a13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.027 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.016+0000 7f7de1a13640 1 -- 10.20.193.26:0/1477987677 >> v1:10.20.193.26:6789/0 conn(0x7f7ddc1626a0 legacy=0x7f7ddc1c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.028 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.016+0000 7f7de1a13640 1 -- 10.20.193.26:0/1477987677 shutdown_connections 2026-02-24T19:18:09.028 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.016+0000 7f7de1a13640 1 -- 10.20.193.26:0/1477987677 >> 10.20.193.26:0/1477987677 conn(0x7f7ddc0b65f0 msgr2=0x7f7ddc0b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.028 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.016+0000 7f7de1a13640 1 -- 10.20.193.26:0/1477987677 shutdown_connections 2026-02-24T19:18:09.028 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.016+0000 7f7de1a13640 1 -- 10.20.193.26:0/1477987677 wait complete. 2026-02-24T19:18:09.028 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.017+0000 7f7de1a13640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.028 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.017+0000 7f7de1a13640 10 monclient: monmap: 2026-02-24T19:18:09.028 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.028 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.028 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.028 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.028 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.028 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.028 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.029 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.029 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.029 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.029 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.017+0000 7f7de1a13640 1 librados: starting msgr at 2026-02-24T19:18:09.029 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.017+0000 7f7de1a13640 1 librados: starting objecter 2026-02-24T19:18:09.029 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.017+0000 7f7de1a13640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.029 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.017+0000 7f7de1a13640 1 Processor -- start 2026-02-24T19:18:09.029 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.017+0000 7f7de1a13640 1 -- start start 2026-02-24T19:18:09.029 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.017+0000 7f7de1a13640 1 librados: setting wanted keys 2026-02-24T19:18:09.029 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.017+0000 7f7de1a13640 1 librados: calling monclient init 2026-02-24T19:18:09.029 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.017+0000 7f7de1a13640 10 monclient: init 2026-02-24T19:18:09.029 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.017+0000 7f7de1a13640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.029 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.017+0000 7f7de1a13640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:18:09.030 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.018+0000 7f7de1a13640 10 monclient(hunting): picked mon.noname-a con 0x7f7ddc058da0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.030 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.018+0000 7f7de1a13640 10 monclient(hunting): picked mon.noname-c con 0x7f7ddc0b0410 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.030 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.018+0000 7f7de1a13640 10 monclient(hunting): picked mon.noname-b con 0x7f7ddc1626a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.030 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.018+0000 7f7de1a13640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ddc160890 con 0x7f7ddc058da0 2026-02-24T19:18:09.030 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.018+0000 7f7de1a13640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ddc1166c0 con 0x7f7ddc1626a0 2026-02-24T19:18:09.030 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.018+0000 7f7de1a13640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ddc1169a0 con 0x7f7ddc0b0410 2026-02-24T19:18:09.030 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.018+0000 7f7de1a13640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.030 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.018+0000 7f7de1a13640 10 monclient(hunting): authenticate will time out at 3671.700044s 2026-02-24T19:18:09.030 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.018+0000 7f7ddaffd640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f7ddc058da0 0x7f7ddc132900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:46712/0 (socket says 10.20.193.26:46712) 2026-02-24T19:18:09.030 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.018+0000 7f7ddaffd640 1 -- 10.20.193.26:0/2939181535 learned_addr learned my addr 10.20.193.26:0/2939181535 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.030 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.018+0000 7f7db3fff640 10 client.?.objecter ms_handle_connect 0x7f7ddc058da0 2026-02-24T19:18:09.030 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.018+0000 7f7db3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.031 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.018+0000 7f7db3fff640 10 client.?.objecter ms_handle_connect 0x7f7ddc1626a0 2026-02-24T19:18:09.031 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.018+0000 7f7db3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.031 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.018+0000 7f7db3fff640 10 client.?.objecter ms_handle_connect 0x7f7ddc0b0410 2026-02-24T19:18:09.031 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.018+0000 7f7db3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.031 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.019+0000 7f7db3fff640 1 -- 10.20.193.26:0/2939181535 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 334187810 0 0) 0x7f7ddc1166c0 con 0x7f7ddc1626a0 2026-02-24T19:18:09.031 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.019+0000 7f7db3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.031 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.019+0000 7f7db3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.031 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.019+0000 7f7db3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.031 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.019+0000 7f7db3fff640 10 monclient(hunting): my global_id is 4375 2026-02-24T19:18:09.031 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.019+0000 7f7db3fff640 1 -- 10.20.193.26:0/2939181535 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7dac003610 con 0x7f7ddc1626a0 2026-02-24T19:18:09.031 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.019+0000 7f7db3fff640 1 -- 10.20.193.26:0/2939181535 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1047070561 0 0) 0x7f7ddc160890 con 0x7f7ddc058da0 2026-02-24T19:18:09.031 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.019+0000 7f7db3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.031 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.019+0000 7f7db3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.032 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.019+0000 7f7db3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.032 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.019+0000 7f7db3fff640 10 monclient(hunting): my global_id is 4383 2026-02-24T19:18:09.032 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.019+0000 7f7db3fff640 1 -- 10.20.193.26:0/2939181535 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ddc1166c0 con 0x7f7ddc058da0 2026-02-24T19:18:09.032 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.019+0000 7f7db3fff640 1 -- 10.20.193.26:0/2939181535 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1707737116 0 0) 0x7f7ddc1169a0 con 0x7f7ddc0b0410 2026-02-24T19:18:09.032 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.019+0000 7f7db3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.032 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.019+0000 7f7db3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.032 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.019+0000 7f7db3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.032 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.019+0000 7f7db3fff640 10 monclient(hunting): my global_id is 4388 2026-02-24T19:18:09.032 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.019+0000 7f7db3fff640 1 -- 10.20.193.26:0/2939181535 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ddc160890 con 0x7f7ddc0b0410 2026-02-24T19:18:09.032 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.022+0000 7f7db3fff640 1 -- 10.20.193.26:0/2939181535 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1571618174 0 0) 0x7f7ddc160890 con 0x7f7ddc0b0410 2026-02-24T19:18:09.032 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.022+0000 7f7db3fff640 1 -- 10.20.193.26:0/2939181535 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7ddc1169a0 con 0x7f7ddc0b0410 2026-02-24T19:18:09.032 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.022+0000 7f7db3fff640 1 -- 10.20.193.26:0/2939181535 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7dc4003060 con 0x7f7ddc0b0410 2026-02-24T19:18:09.032 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.022+0000 7f7db3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.033 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.022+0000 7f7db3fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.033 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.022+0000 7f7db3fff640 10 monclient(hunting): dump: 2026-02-24T19:18:09.033 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.033 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.033 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.033 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.033 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.033 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.033 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.033 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.033 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.033 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.034 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.022+0000 7f7db3fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:09.034 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.022+0000 7f7db3fff640 1 -- 10.20.193.26:0/2939181535 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3788829448 0 0) 0x7f7dac003610 con 0x7f7ddc1626a0 2026-02-24T19:18:09.034 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.022+0000 7f7db3fff640 1 -- 10.20.193.26:0/2939181535 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7ddc160890 con 0x7f7ddc1626a0 2026-02-24T19:18:09.034 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.022+0000 7f7db3fff640 1 -- 10.20.193.26:0/2939181535 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7dcc003690 con 0x7f7ddc1626a0 2026-02-24T19:18:09.034 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.022+0000 7f7db3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.034 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.022+0000 7f7db3fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.034 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.022+0000 7f7db3fff640 10 monclient(hunting): dump: 2026-02-24T19:18:09.034 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.034 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.034 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.034 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.034 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.034 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.035 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.035 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.035 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.035 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.035 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.022+0000 7f7db3fff640 1 -- 10.20.193.26:0/2939181535 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2377215862 0 0) 0x7f7ddc1166c0 con 0x7f7ddc058da0 2026-02-24T19:18:09.035 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.022+0000 7f7db3fff640 1 -- 10.20.193.26:0/2939181535 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7dac003610 con 0x7f7ddc058da0 2026-02-24T19:18:09.035 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.022+0000 7f7db3fff640 1 -- 10.20.193.26:0/2939181535 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7dd0003190 con 0x7f7ddc058da0 2026-02-24T19:18:09.035 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.022+0000 7f7db3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.035 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.022+0000 7f7db3fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:09.035 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.022+0000 7f7db3fff640 10 monclient(hunting): dump: 2026-02-24T19:18:09.035 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.035 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.035 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.036 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.036 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.036 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.036 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.036 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.036 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.036 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.038 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.023+0000 7f7db3fff640 1 -- 10.20.193.26:0/2939181535 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3310582040 0 0) 0x7f7ddc1169a0 con 0x7f7ddc0b0410 2026-02-24T19:18:09.038 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.023+0000 7f7db3fff640 1 -- 10.20.193.26:0/2939181535 >> v1:10.20.193.70:6789/0 conn(0x7f7ddc1626a0 legacy=0x7f7ddc1fe200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.023+0000 7f7db3fff640 1 -- 10.20.193.26:0/2939181535 >> v1:10.20.193.26:6789/0 conn(0x7f7ddc058da0 legacy=0x7f7ddc132900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.023+0000 7f7db3fff640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.023+0000 7f7db3fff640 1 monclient: found mon.c 2026-02-24T19:18:09.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.023+0000 7f7db3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.023+0000 7f7db3fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.023+0000 7f7db3fff640 1 -- 10.20.193.26:0/2939181535 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ddc116c80 con 0x7f7ddc0b0410 2026-02-24T19:18:09.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.023+0000 7f7db3fff640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.023+0000 7f7db3fff640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.023+0000 7f7db3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.023+0000 7f7de1a13640 5 monclient: authenticate success, global_id 4388 2026-02-24T19:18:09.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.023+0000 7f7de1a13640 10 monclient: _renew_subs 2026-02-24T19:18:09.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.023+0000 7f7de1a13640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.040 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.023+0000 7f7de1a13640 1 -- 10.20.193.26:0/2939181535 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7ddc160b50 con 0x7f7ddc0b0410 2026-02-24T19:18:09.040 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.023+0000 7f7de1a13640 10 client.4388.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.040 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.023+0000 7f7de1a13640 10 monclient: _renew_subs 2026-02-24T19:18:09.040 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.023+0000 7f7de1a13640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.040 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.023+0000 7f7de1a13640 1 -- 10.20.193.26:0/2939181535 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7ddc1ff090 con 0x7f7ddc0b0410 2026-02-24T19:18:09.040 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.023+0000 7f7de1a13640 1 librados: init done 2026-02-24T19:18:09.040 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.024+0000 7f7de1a13640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.040 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.024+0000 7f7de1a13640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.040 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.024+0000 7f7de1a13640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.040 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.024+0000 7f7de1a13640 1 -- 10.20.193.26:0/2939181535 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ddc0b6e00 con 0x7f7ddc0b0410 2026-02-24T19:18:09.040 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.028+0000 7f7db3fff640 1 -- 10.20.193.26:0/2939181535 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7dc4003200 con 0x7f7ddc0b0410 2026-02-24T19:18:09.040 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.028+0000 7f7db3fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.040 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.028+0000 7f7db3fff640 1 -- 10.20.193.26:0/2939181535 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7dc4003920 con 0x7f7ddc0b0410 2026-02-24T19:18:09.041 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.028+0000 7f7db3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.041 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.028+0000 7f7db3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.041 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.028+0000 7f7db3fff640 10 monclient: dump: 2026-02-24T19:18:09.041 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.041 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.041 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.041 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.041 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.041 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.041 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.041 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.041 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.041 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.042 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.028+0000 7f7dd97fa640 4 set_mon_vals no callback set 2026-02-24T19:18:09.042 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.032+0000 7f7db3fff640 1 -- 10.20.193.26:0/2939181535 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f7dc401c5f0 con 0x7f7ddc0b0410 2026-02-24T19:18:09.042 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.032+0000 7f7db3fff640 1 -- 10.20.193.26:0/2939181535 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f7dc4058290 con 0x7f7ddc0b0410 2026-02-24T19:18:09.042 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.032+0000 7f7db3fff640 10 client.4388.objecter ms_dispatch2 0x7f7ddc000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:09.042 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.032+0000 7f7db3fff640 3 client.4388.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:09.042 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.032+0000 7f7db3fff640 3 client.4388.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:09.042 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.032+0000 7f7ddaffd640 10 monclient: get_auth_request con 0x7f7dac077e20 auth_method 0 2026-02-24T19:18:09.042 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.032+0000 7f7db3fff640 20 client.4388.objecter dump_active .. 0 homeless 2026-02-24T19:18:09.042 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.033+0000 7f7db3fff640 10 client.4388.objecter ms_handle_connect 0x7f7dac077e20 2026-02-24T19:18:09.118 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.117+0000 7f7db3fff640 1 -- 10.20.193.26:0/2939181535 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f7dc405ca00 con 0x7f7ddc0b0410 2026-02-24T19:18:09.118 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.117+0000 7f7db3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.118 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.117+0000 7f7db3fff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:09.224 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.223+0000 7f7de1a13640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:18:09.225 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.223+0000 7f7de1a13640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:18:09.225 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.223+0000 7f7de1a13640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.225 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.223+0000 7f7de1a13640 1 -- 10.20.193.26:0/2939181535 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ddc0b27f0 con 0x7f7ddc0b0410 2026-02-24T19:18:09.270 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.269+0000 7f7db3fff640 1 -- 10.20.193.26:0/2939181535 <== mon.2 v1:10.20.193.103:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+20952 (unknown 3676990683 0 2468073468) 0x7f7dc405c300 con 0x7f7ddc0b0410 2026-02-24T19:18:09.270 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.269+0000 7f7db3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:18:09.270 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.269+0000 7f7db3fff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:09.270 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:18:09.271 INFO:teuthology.orchestra.run.trial026.stdout:{"epoch":29,"fsid":"33b2b598-dbc5-4d7a-8df7-657f0501fe9e","created":"2026-02-24T19:17:21.810535+0000","modified":"2026-02-24T19:18:07.641612+0000","last_up_change":"2026-02-24T19:17:54.877686+0000","last_in_change":"2026-02-24T19:17:28.575109+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T19:17:56.803348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-24T19:18:02.876352+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":29,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5.9899997711181641,"score_stable":5.9899997711181641,"optimal_score":0.68999999761581421,"raw_score_acting":4.130000114440918,"raw_score_stable":4.130000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e08ffdb8-0db6-4356-88b5-54397e40be58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6808","nonce":4098203721}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6809","nonce":4098203721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6811","nonce":4098203721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6810","nonce":4098203721}]},"public_addr":"10.20.193.26:6808/4098203721","cluster_addr":"10.20.193.26:6809/4098203721","heartbeat_back_addr":"10.20.193.26:6811/4098203721","heartbeat_front_addr":"10.20.193.26:6810/4098203721","state":["exists","up"]},{"osd":1,"uuid":"08b117f7-0152-42bb-8a51-220b41a964ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6800","nonce":268803542}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6801","nonce":268803542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6803","nonce":268803542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6802","nonce":268803542}]},"public_addr":"10.20.193.70:6800/268803542","cluster_addr":"10.20.193.70:6801/268803542","heartbeat_back_addr":"10.20.193.70:6803/268803542","heartbeat_front_addr":"10.20.193.70:6802/268803542","state":["exists","up"]},{"osd":2,"uuid":"3c37f6aa-25cb-43be-a75a-86a246086a85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6800","nonce":3800806982}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6802","nonce":3800806982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6806","nonce":3800806982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6804","nonce":3800806982}]},"public_addr":"10.20.193.103:6800/3800806982","cluster_addr":"10.20.193.103:6802/3800806982","heartbeat_back_addr":"10.20.193.103:6806/3800806982","heartbeat_front_addr":"10.20.193.103:6804/3800806982","state":["exists","up"]},{"osd":3,"uuid":"a7e3939e-f8f5-4216-9700-27e229d1c4d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6805","nonce":920272754}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6806","nonce":920272754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6808","nonce":920272754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6807","nonce":920272754}]},"public_addr":"10.20.193.162:6805/920272754","cluster_addr":"10.20.193.162:6806/920272754","heartbeat_back_addr":"10.20.193.162:6808/920272754","heartbeat_front_addr":"10.20.193.162:6807/920272754","state":["exists","up"]},{"osd":4,"uuid":"445d43ab-a28c-4afa-90ff-e451602e494f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6800","nonce":3717327686}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6801","nonce":3717327686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6803","nonce":3717327686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6802","nonce":3717327686}]},"public_addr":"10.20.193.26:6800/3717327686","cluster_addr":"10.20.193.26:6801/3717327686","heartbeat_back_addr":"10.20.193.26:6803/3717327686","heartbeat_front_addr":"10.20.193.26:6802/3717327686","state":["exists","up"]},{"osd":5,"uuid":"37303b3f-6b88-4c73-aaff-10055ec5cc85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6812","nonce":1419227842}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6813","nonce":1419227842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6815","nonce":1419227842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6814","nonce":1419227842}]},"public_addr":"10.20.193.70:6812/1419227842","cluster_addr":"10.20.193.70:6813/1419227842","heartbeat_back_addr":"10.20.193.70:6815/1419227842","heartbeat_front_addr":"10.20.193.70:6814/1419227842","state":["exists","up"]},{"osd":6,"uuid":"ef2c9883-f17f-41ec-96b7-dbbe936b77d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6808","nonce":3149418268}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6809","nonce":3149418268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6811","nonce":3149418268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6810","nonce":3149418268}]},"public_addr":"10.20.193.103:6808/3149418268","cluster_addr":"10.20.193.103:6809/3149418268","heartbeat_back_addr":"10.20.193.103:6811/3149418268","heartbeat_front_addr":"10.20.193.103:6810/3149418268","state":["exists","up"]},{"osd":7,"uuid":"3e4a495e-c742-43fc-991a-371a47ff87bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6809","nonce":2963240067}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6810","nonce":2963240067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6812","nonce":2963240067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6811","nonce":2963240067}]},"public_addr":"10.20.193.162:6809/2963240067","cluster_addr":"10.20.193.162:6810/2963240067","heartbeat_back_addr":"10.20.193.162:6812/2963240067","heartbeat_front_addr":"10.20.193.162:6811/2963240067","state":["exists","up"]},{"osd":8,"uuid":"fb377a45-1ce5-4e07-92cd-7f546cfad57f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6812","nonce":1933830164}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6813","nonce":1933830164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6815","nonce":1933830164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6814","nonce":1933830164}]},"public_addr":"10.20.193.26:6812/1933830164","cluster_addr":"10.20.193.26:6813/1933830164","heartbeat_back_addr":"10.20.193.26:6815/1933830164","heartbeat_front_addr":"10.20.193.26:6814/1933830164","state":["exists","up"]},{"osd":9,"uuid":"8079b2ca-96c3-4321-9f24-a87e8ea1e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6804","nonce":3709696191}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6805","nonce":3709696191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6807","nonce":3709696191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6806","nonce":3709696191}]},"public_addr":"10.20.193.70:6804/3709696191","cluster_addr":"10.20.193.70:6805/3709696191","heartbeat_back_addr":"10.20.193.70:6807/3709696191","heartbeat_front_addr":"10.20.193.70:6806/3709696191","state":["exists","up"]},{"osd":10,"uuid":"8df004a9-88e3-43f5-833d-dfc73a658ec3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6801","nonce":3185480373}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6803","nonce":3185480373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6807","nonce":3185480373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6805","nonce":3185480373}]},"public_addr":"10.20.193.103:6801/3185480373","cluster_addr":"10.20.193.103:6803/3185480373","heartbeat_back_addr":"10.20.193.103:6807/3185480373","heartbeat_front_addr":"10.20.193.103:6805/3185480373","state":["exists","up"]},{"osd":11,"uuid":"f3cf3a4b-1c26-480c-ba10-178f8542c1e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6813","nonce":1717662802}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6814","nonce":1717662802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6816","nonce":1717662802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6815","nonce":1717662802}]},"public_addr":"10.20.193.162:6813/1717662802","cluster_addr":"10.20.193.162:6814/1717662802","heartbeat_back_addr":"10.20.193.162:6816/1717662802","heartbeat_front_addr":"10.20.193.162:6815/1717662802","state":["exists","up"]},{"osd":12,"uuid":"0e06b2e9-9b29-4c6e-ab44-77fd24d945af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6804","nonce":2128192173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6805","nonce":2128192173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6807","nonce":2128192173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6806","nonce":2128192173}]},"public_addr":"10.20.193.26:6804/2128192173","cluster_addr":"10.20.193.26:6805/2128192173","heartbeat_back_addr":"10.20.193.26:6807/2128192173","heartbeat_front_addr":"10.20.193.26:6806/2128192173","state":["exists","up"]},{"osd":13,"uuid":"b1cbaf8b-36e9-4196-a08d-e6e72c2229e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6808","nonce":2949423039}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6809","nonce":2949423039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6811","nonce":2949423039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6810","nonce":2949423039}]},"public_addr":"10.20.193.70:6808/2949423039","cluster_addr":"10.20.193.70:6809/2949423039","heartbeat_back_addr":"10.20.193.70:6811/2949423039","heartbeat_front_addr":"10.20.193.70:6810/2949423039","state":["exists","up"]},{"osd":14,"uuid":"214e8bfc-c78d-45ac-9ec3-7685dd5684cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6812","nonce":1276189911}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6813","nonce":1276189911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6815","nonce":1276189911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6814","nonce":1276189911}]},"public_addr":"10.20.193.103:6812/1276189911","cluster_addr":"10.20.193.103:6813/1276189911","heartbeat_back_addr":"10.20.193.103:6815/1276189911","heartbeat_front_addr":"10.20.193.103:6814/1276189911","state":["exists","up"]},{"osd":15,"uuid":"8c2eb0c6-abf0-42a7-bcab-83d0c9cf797b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6801","nonce":3445416924}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6802","nonce":3445416924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6804","nonce":3445416924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6803","nonce":3445416924}]},"public_addr":"10.20.193.162:6801/3445416924","cluster_addr":"10.20.193.162:6802/3445416924","heartbeat_back_addr":"10.20.193.162:6804/3445416924","heartbeat_front_addr":"10.20.193.162:6803/3445416924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.943088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.818374+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.712635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:53.063441+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.745019+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:53.046388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.670956+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:53.091882+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:53.000309+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.773039+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.840607+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:53.229086+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.734626+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.874415+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.926522+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.903220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T19:18:09.272 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.270+0000 7f7de1a13640 10 librados: watch_flush enter 2026-02-24T19:18:09.272 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.270+0000 7f7de1a13640 10 librados: watch_flush exit 2026-02-24T19:18:09.272 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.270+0000 7f7de1a13640 20 client.4388.objecter shutdown clearing up homeless session... 2026-02-24T19:18:09.272 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.270+0000 7f7de1a13640 10 client.4388.objecter successfully canceled tick 2026-02-24T19:18:09.272 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.270+0000 7f7de1a13640 1 -- 10.20.193.26:0/2939181535 >> v1:10.20.193.162:6800/3889602630 conn(0x7f7dac077e20 legacy=0x7f7dac0982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.272 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.270+0000 7f7de1a13640 10 monclient: shutdown 2026-02-24T19:18:09.273 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.270+0000 7f7de1a13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.273 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.270+0000 7f7de1a13640 1 -- 10.20.193.26:0/2939181535 >> v1:10.20.193.103:6789/0 conn(0x7f7ddc0b0410 legacy=0x7f7ddc161350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.273 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.270+0000 7f7de1a13640 1 -- 10.20.193.26:0/2939181535 shutdown_connections 2026-02-24T19:18:09.273 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.270+0000 7f7de1a13640 1 -- 10.20.193.26:0/2939181535 >> 10.20.193.26:0/2939181535 conn(0x7f7ddc0b65f0 msgr2=0x7f7ddc055a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.273 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.270+0000 7f7de1a13640 1 -- 10.20.193.26:0/2939181535 shutdown_connections 2026-02-24T19:18:09.273 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.270+0000 7f7de1a13640 1 -- 10.20.193.26:0/2939181535 wait complete. 2026-02-24T19:18:09.273 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.270+0000 7f7de1a13640 1 librados: shutdown 2026-02-24T19:18:09.281 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-24T19:18:09.282 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-24T19:18:09.283 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-24T19:18:09.283 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-24T19:18:09.283 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-24T19:18:09.284 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-24T19:18:09.284 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2026-02-24T19:18:09.285 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2026-02-24T19:18:09.285 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2026-02-24T19:18:09.286 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2026-02-24T19:18:09.286 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2026-02-24T19:18:09.287 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2026-02-24T19:18:09.287 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 flush_pg_stats 2026-02-24T19:18:09.287 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 flush_pg_stats 2026-02-24T19:18:09.288 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 flush_pg_stats 2026-02-24T19:18:09.288 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 flush_pg_stats 2026-02-24T19:18:09.370 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.368+0000 7f6be3b83640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.370 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.368+0000 7f6be3b83640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.370 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.368+0000 7f6be3b83640 10 monclient: monmap: 2026-02-24T19:18:09.370 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.370 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.370 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.369579+0000 2026-02-24T19:18:09.370 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.369579+0000 2026-02-24T19:18:09.370 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.371 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.371 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.371 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.371 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.371 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.369+0000 7f6be3b83640 1 Processor -- start 2026-02-24T19:18:09.373 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.369+0000 7f6be3b83640 1 -- start start 2026-02-24T19:18:09.373 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.369+0000 7f6be3b83640 10 monclient: init 2026-02-24T19:18:09.373 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.369+0000 7f6be3b83640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.373 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.370+0000 7f6be3b83640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:18:09.373 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.370+0000 7f6be3b83640 10 monclient(hunting): picked mon.noname-b con 0x7f6bdc15d070 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.373 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.370+0000 7f6be3b83640 10 monclient(hunting): picked mon.noname-a con 0x7f6bdc15d440 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.373 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.370+0000 7f6be3b83640 10 monclient(hunting): picked mon.noname-c con 0x7f6bdc166f60 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.373 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.370+0000 7f6be3b83640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bdc164e60 con 0x7f6bdc15d440 2026-02-24T19:18:09.373 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.370+0000 7f6be3b83640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bdc0b1790 con 0x7f6bdc15d070 2026-02-24T19:18:09.373 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.370+0000 7f6be3b83640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bdc0b1a70 con 0x7f6bdc166f60 2026-02-24T19:18:09.373 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.370+0000 7f6be3b83640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.374 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.370+0000 7f6be3b83640 10 monclient(hunting): authenticate will time out at 3672.052294s 2026-02-24T19:18:09.374 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.370+0000 7f6be18f8640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f6bdc15d070 0x7f6bdc164750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:59420/0 (socket says 10.20.193.26:59420) 2026-02-24T19:18:09.374 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.370+0000 7f6be18f8640 1 -- 10.20.193.26:0/3806141630 learned_addr learned my addr 10.20.193.26:0/3806141630 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.375 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.370+0000 7f7619b7f640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.375 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.370+0000 7f7619b7f640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.375 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.371+0000 7f7619b7f640 10 monclient: monmap: 2026-02-24T19:18:09.375 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.375 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.375 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.371799+0000 2026-02-24T19:18:09.375 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.371799+0000 2026-02-24T19:18:09.375 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.375 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.376 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.376 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.376 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.376 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.376 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.371+0000 7f7619b7f640 1 Processor -- start 2026-02-24T19:18:09.376 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.371+0000 7f7619b7f640 1 -- start start 2026-02-24T19:18:09.376 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.371+0000 7f7619b7f640 10 monclient: init 2026-02-24T19:18:09.376 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f7619b7f640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.376 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f7619b7f640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:18:09.376 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f7619b7f640 10 monclient(hunting): picked mon.noname-c con 0x7f761415d410 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.377 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f6be08f6640 1 -- 10.20.193.26:0/3806141630 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2995832288 0 0) 0x7f6bdc0b1790 con 0x7f6bdc15d070 2026-02-24T19:18:09.377 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f6be08f6640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.377 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f6be08f6640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.377 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f6be08f6640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.377 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f6be08f6640 10 monclient(hunting): my global_id is 4378 2026-02-24T19:18:09.377 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f6be08f6640 1 -- 10.20.193.26:0/3806141630 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bc4003610 con 0x7f6bdc15d070 2026-02-24T19:18:09.378 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f7619b7f640 10 monclient(hunting): picked mon.noname-a con 0x7f76140b0fa0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.378 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f7619b7f640 10 monclient(hunting): picked mon.noname-b con 0x7f76140b2920 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.378 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f7619b7f640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76140526e0 con 0x7f76140b0fa0 2026-02-24T19:18:09.378 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f7619b7f640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7614163cf0 con 0x7f76140b2920 2026-02-24T19:18:09.378 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f7619b7f640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7614163fd0 con 0x7f761415d410 2026-02-24T19:18:09.378 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f7619b7f640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.379 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f7619b7f640 10 monclient(hunting): authenticate will time out at 3672.054298s 2026-02-24T19:18:09.379 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f0cdd83c640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.379 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f6be08f6640 1 -- 10.20.193.26:0/3806141630 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3392870810 0 0) 0x7f6bdc0b1a70 con 0x7f6bdc166f60 2026-02-24T19:18:09.380 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f6be08f6640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.380 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f6be08f6640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.380 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f6be08f6640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.380 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f6be08f6640 10 monclient(hunting): my global_id is 4391 2026-02-24T19:18:09.380 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f6be08f6640 1 -- 10.20.193.26:0/3806141630 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bdc0b1790 con 0x7f6bdc166f60 2026-02-24T19:18:09.380 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f0cdd83c640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.380 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f0cdd83c640 10 monclient: monmap: 2026-02-24T19:18:09.381 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.381 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.381 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.373105+0000 2026-02-24T19:18:09.381 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.373105+0000 2026-02-24T19:18:09.381 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.381 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.381 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.381 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.381 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.381 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.382 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f76137fe640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f761415d410 0x7f76140b0890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:55446/0 (socket says 10.20.193.26:55446) 2026-02-24T19:18:09.382 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f76137fe640 1 -- 10.20.193.26:0/1698743334 learned_addr learned my addr 10.20.193.26:0/1698743334 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.382 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.372+0000 7f0cdd83c640 1 Processor -- start 2026-02-24T19:18:09.382 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.373+0000 7f0cdd83c640 1 -- start start 2026-02-24T19:18:09.383 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.373+0000 7f0cdd83c640 10 monclient: init 2026-02-24T19:18:09.383 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.373+0000 7f50ac24d640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.383 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.373+0000 7f50ac24d640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.383 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.373+0000 7f50ac24d640 10 monclient: monmap: 2026-02-24T19:18:09.383 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.383 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.383 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.374473+0000 2026-02-24T19:18:09.383 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.374473+0000 2026-02-24T19:18:09.384 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.384 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.384 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.384 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.384 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.384 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.385 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.373+0000 7f0cdd83c640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.385 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.373+0000 7f0cdd83c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:18:09.385 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.373+0000 7f0cdd83c640 10 monclient(hunting): picked mon.noname-b con 0x7f0cd80b9f80 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.385 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.373+0000 7f0cdd83c640 10 monclient(hunting): picked mon.noname-a con 0x7f0cd80ba350 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.385 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.373+0000 7f0cdd83c640 10 monclient(hunting): picked mon.noname-c con 0x7f0cd80585e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.385 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.373+0000 7f0cdd83c640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cd8163930 con 0x7f0cd80ba350 2026-02-24T19:18:09.385 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.373+0000 7f0cdd83c640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cd8163bb0 con 0x7f0cd80b9f80 2026-02-24T19:18:09.385 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.373+0000 7f0cdd83c640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cd8163e90 con 0x7f0cd80585e0 2026-02-24T19:18:09.385 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.373+0000 7f0cdd83c640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.385 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.373+0000 7f0cdd83c640 10 monclient(hunting): authenticate will time out at 3672.055990s 2026-02-24T19:18:09.387 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f6be08f6640 1 -- 10.20.193.26:0/3806141630 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4086965825 0 0) 0x7f6bdc164e60 con 0x7f6bdc15d440 2026-02-24T19:18:09.387 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f6be08f6640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.387 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f6be08f6640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.387 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f6be08f6640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.387 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f6be08f6640 10 monclient(hunting): my global_id is 4386 2026-02-24T19:18:09.387 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f6be08f6640 1 -- 10.20.193.26:0/3806141630 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bdc0b1a70 con 0x7f6bdc15d440 2026-02-24T19:18:09.387 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f6be08f6640 1 -- 10.20.193.26:0/3806141630 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2086536419 0 0) 0x7f6bc4003610 con 0x7f6bdc15d070 2026-02-24T19:18:09.387 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f6be08f6640 1 -- 10.20.193.26:0/3806141630 >> v1:10.20.193.103:6789/0 conn(0x7f6bdc166f60 legacy=0x7f6bdc0b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.387 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f6be08f6640 1 -- 10.20.193.26:0/3806141630 >> v1:10.20.193.26:6789/0 conn(0x7f6bdc15d440 legacy=0x7f6bdc166850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.388 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f6be08f6640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.388 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f6be08f6640 1 monclient: found mon.noname-b 2026-02-24T19:18:09.388 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f6be08f6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.388 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f6be08f6640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.388 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f6be08f6640 1 -- 10.20.193.26:0/3806141630 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bdc0b1d50 con 0x7f6bdc15d070 2026-02-24T19:18:09.388 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f6be08f6640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.388 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f6be08f6640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.388 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f6be08f6640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.388 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f6be08f6640 1 -- 10.20.193.26:0/3806141630 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6bcc002df0 con 0x7f6bdc15d070 2026-02-24T19:18:09.388 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f6be08f6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.388 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f6be08f6640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:09.388 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f6be08f6640 10 monclient: dump: 2026-02-24T19:18:09.388 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.389 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.389 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.389 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.389 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.389 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.389 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.389 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.389 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.389 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.389 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f6be3b83640 5 monclient: authenticate success, global_id 4378 2026-02-24T19:18:09.389 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f6be3b83640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.390 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f0e3898a640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.390 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f0e3898a640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.390 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f0e3898a640 10 monclient: monmap: 2026-02-24T19:18:09.390 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.390 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.390 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.375198+0000 2026-02-24T19:18:09.390 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.375198+0000 2026-02-24T19:18:09.390 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.390 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.391 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.391 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.391 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.391 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.391 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f0cd67fc640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f0cd80ba350 0x7f0cd8057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:46738/0 (socket says 10.20.193.26:46738) 2026-02-24T19:18:09.391 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f0cd67fc640 1 -- 10.20.193.26:0/1889309226 learned_addr learned my addr 10.20.193.26:0/1889309226 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.392 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f50ac24d640 1 Processor -- start 2026-02-24T19:18:09.392 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f50ac24d640 1 -- start start 2026-02-24T19:18:09.392 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f50ac24d640 10 monclient: init 2026-02-24T19:18:09.392 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f0e3898a640 1 Processor -- start 2026-02-24T19:18:09.393 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f0e3898a640 1 -- start start 2026-02-24T19:18:09.393 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.374+0000 7f0e3898a640 10 monclient: init 2026-02-24T19:18:09.393 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f50ac24d640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.393 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f50ac24d640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:18:09.393 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f50ac24d640 10 monclient(hunting): picked mon.noname-b con 0x7f50a40b9f80 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.393 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f50ac24d640 10 monclient(hunting): picked mon.noname-c con 0x7f50a40ba350 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.394 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f50ac24d640 10 monclient(hunting): picked mon.noname-a con 0x7f50a40585e0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.394 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f50ac24d640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50a4163930 con 0x7f50a40585e0 2026-02-24T19:18:09.394 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f50ac24d640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50a4163bb0 con 0x7f50a40b9f80 2026-02-24T19:18:09.394 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f50ac24d640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50a4163e90 con 0x7f50a40ba350 2026-02-24T19:18:09.394 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f50ac24d640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.394 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f50ac24d640 10 monclient(hunting): authenticate will time out at 3672.057484s 2026-02-24T19:18:09.394 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f0e3898a640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.395 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f0e3898a640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:18:09.395 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f2ac6213640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.395 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f2ac6213640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.395 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f2ac6213640 10 monclient: monmap: 2026-02-24T19:18:09.395 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.395 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.395 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.376322+0000 2026-02-24T19:18:09.395 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.376322+0000 2026-02-24T19:18:09.396 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.396 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.396 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.396 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.396 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.396 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.396 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f0e3898a640 10 monclient(hunting): picked mon.noname-b con 0x7f0e30161640 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f0e3898a640 10 monclient(hunting): picked mon.noname-a con 0x7f0e30161a10 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f0e3898a640 10 monclient(hunting): picked mon.noname-c con 0x7f0e300b5da0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f0e3898a640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e300b8540 con 0x7f0e30161a10 2026-02-24T19:18:09.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f0e3898a640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e300afd90 con 0x7f0e30161640 2026-02-24T19:18:09.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f0e3898a640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e300b0050 con 0x7f0e300b5da0 2026-02-24T19:18:09.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f0e3898a640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f0e3898a640 10 monclient(hunting): authenticate will time out at 3672.057724s 2026-02-24T19:18:09.398 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f0cd5ffb640 1 -- 10.20.193.26:0/1889309226 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1401280141 0 0) 0x7f0cc0002910 con 0x7f0cd80ba350 2026-02-24T19:18:09.398 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f0cd5ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.398 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f0cd5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.398 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f0cd5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.398 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f0cd5ffb640 10 monclient(hunting): my global_id is 4389 2026-02-24T19:18:09.398 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f0cd5ffb640 1 -- 10.20.193.26:0/1889309226 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cc4003610 con 0x7f0cd80ba350 2026-02-24T19:18:09.399 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f6be08f6640 1 -- 10.20.193.26:0/3806141630 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6bcc002fc0 con 0x7f6bdc15d070 2026-02-24T19:18:09.399 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f6be08f6640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.399 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f6be3b83640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.399 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.375+0000 7f6be3b83640 4 set_mon_vals no callback set 2026-02-24T19:18:09.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.376+0000 7f2ac6213640 1 Processor -- start 2026-02-24T19:18:09.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.376+0000 7f2ac6213640 1 -- start start 2026-02-24T19:18:09.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.376+0000 7f2ac6213640 10 monclient: init 2026-02-24T19:18:09.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.376+0000 7f76127fc640 1 -- 10.20.193.26:0/1698743334 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1597289526 0 0) 0x7f7614163fd0 con 0x7f761415d410 2026-02-24T19:18:09.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.376+0000 7f76127fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.376+0000 7f76127fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.401 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.376+0000 7f76127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.401 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.376+0000 7f76127fc640 10 monclient(hunting): my global_id is 4394 2026-02-24T19:18:09.401 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.376+0000 7f76127fc640 1 -- 10.20.193.26:0/1698743334 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75f8003610 con 0x7f761415d410 2026-02-24T19:18:09.401 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.376+0000 7f6be3b83640 10 monclient: shutdown 2026-02-24T19:18:09.401 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.376+0000 7f6be3b83640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.401 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.376+0000 7f6be3b83640 1 -- 10.20.193.26:0/3806141630 >> v1:10.20.193.70:6789/0 conn(0x7f6bdc15d070 legacy=0x7f6bdc164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.401 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.376+0000 7f2ac6213640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.376+0000 7f2ac6213640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:18:09.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.376+0000 7f2ac6213640 10 monclient(hunting): picked mon.noname-a con 0x7f2ac0161430 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.376+0000 7f2ac6213640 10 monclient(hunting): picked mon.noname-b con 0x7f2ac0161800 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.376+0000 7f2ac6213640 10 monclient(hunting): picked mon.noname-c con 0x7f2ac016ad30 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.376+0000 7f2ac6213640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ac00b1800 con 0x7f2ac0161430 2026-02-24T19:18:09.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.376+0000 7f2ac6213640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ac00b1ae0 con 0x7f2ac0161800 2026-02-24T19:18:09.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.376+0000 7f2ac6213640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ac00b1dc0 con 0x7f2ac016ad30 2026-02-24T19:18:09.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.376+0000 7f2ac6213640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.376+0000 7f2ac6213640 10 monclient(hunting): authenticate will time out at 3672.058683s 2026-02-24T19:18:09.403 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.376+0000 7f6be3b83640 1 -- 10.20.193.26:0/3806141630 shutdown_connections 2026-02-24T19:18:09.403 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.376+0000 7f6be3b83640 1 -- 10.20.193.26:0/3806141630 >> 10.20.193.26:0/3806141630 conn(0x7f6bdc0b2ef0 msgr2=0x7f6bdc0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.403 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.376+0000 7f6be3b83640 1 -- 10.20.193.26:0/3806141630 shutdown_connections 2026-02-24T19:18:09.403 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.376+0000 7f6be3b83640 1 -- 10.20.193.26:0/3806141630 wait complete. 2026-02-24T19:18:09.403 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.377+0000 7f6be3b83640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.403 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.377+0000 7f6be3b83640 10 monclient: monmap: 2026-02-24T19:18:09.404 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.404 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.404 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.404 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.404 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.404 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.404 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.404 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.404 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.404 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.404 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.377+0000 7f50a97c1640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f50a40ba350 0x7f50a4057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:55454/0 (socket says 10.20.193.26:55454) 2026-02-24T19:18:09.404 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.377+0000 7f50a97c1640 1 -- 10.20.193.26:0/2423784747 learned_addr learned my addr 10.20.193.26:0/2423784747 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.405 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.377+0000 7f6be3b83640 1 librados: starting msgr at 2026-02-24T19:18:09.405 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.377+0000 7f6be3b83640 1 librados: starting objecter 2026-02-24T19:18:09.405 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.377+0000 7f82eda32640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.405 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.377+0000 7f82eda32640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.405 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.377+0000 7f82eda32640 10 monclient: monmap: 2026-02-24T19:18:09.405 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.406 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.406 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.378658+0000 2026-02-24T19:18:09.406 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.378658+0000 2026-02-24T19:18:09.406 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.406 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.406 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.406 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.406 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.406 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.377+0000 7f6be3b83640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.407 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.377+0000 7f6be3b83640 1 Processor -- start 2026-02-24T19:18:09.407 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f76127fc640 1 -- 10.20.193.26:0/1698743334 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2686069323 0 0) 0x7f7614163cf0 con 0x7f76140b2920 2026-02-24T19:18:09.407 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f76127fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.407 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f76127fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.407 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f76127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.407 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f76127fc640 10 monclient(hunting): my global_id is 4381 2026-02-24T19:18:09.407 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f76127fc640 1 -- 10.20.193.26:0/1698743334 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7614163fd0 con 0x7f76140b2920 2026-02-24T19:18:09.408 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f6be3b83640 1 -- start start 2026-02-24T19:18:09.408 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f6be3b83640 1 librados: setting wanted keys 2026-02-24T19:18:09.408 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f6be3b83640 1 librados: calling monclient init 2026-02-24T19:18:09.408 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f6be3b83640 10 monclient: init 2026-02-24T19:18:09.408 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f89ae1c0640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.408 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f89ae1c0640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.408 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f89ae1c0640 10 monclient: monmap: 2026-02-24T19:18:09.409 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.409 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.409 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.378872+0000 2026-02-24T19:18:09.409 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.378872+0000 2026-02-24T19:18:09.409 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.409 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.409 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.409 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.409 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.409 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.409 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f2abeffd640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f2ac0161800 0x7f2ac0168c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:59462/0 (socket says 10.20.193.26:59462) 2026-02-24T19:18:09.410 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f2abeffd640 1 -- 10.20.193.26:0/1067385190 learned_addr learned my addr 10.20.193.26:0/1067385190 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.410 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f0e366ff640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f0e30161640 0x7f0e300b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:59450/0 (socket says 10.20.193.26:59450) 2026-02-24T19:18:09.410 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f0e366ff640 1 -- 10.20.193.26:0/3818847684 learned_addr learned my addr 10.20.193.26:0/3818847684 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.410 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f82eda32640 1 Processor -- start 2026-02-24T19:18:09.410 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f82eda32640 1 -- start start 2026-02-24T19:18:09.410 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f82eda32640 10 monclient: init 2026-02-24T19:18:09.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f89ae1c0640 1 Processor -- start 2026-02-24T19:18:09.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f6be3b83640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f6be3b83640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:18:09.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f6be3b83640 10 monclient(hunting): picked mon.noname-a con 0x7f6bdc15d070 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f6be3b83640 10 monclient(hunting): picked mon.noname-b con 0x7f6bdc15d440 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f89ae1c0640 1 -- start start 2026-02-24T19:18:09.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f89ae1c0640 10 monclient: init 2026-02-24T19:18:09.412 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.378+0000 7f6be3b83640 10 monclient(hunting): picked mon.noname-c con 0x7f6bdc166f60 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.412 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f6be3b83640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bdc160170 con 0x7f6bdc15d070 2026-02-24T19:18:09.412 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f6be3b83640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bdc160450 con 0x7f6bdc15d440 2026-02-24T19:18:09.412 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f6be3b83640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bdc160730 con 0x7f6bdc166f60 2026-02-24T19:18:09.412 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f6be3b83640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.412 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f6be3b83640 10 monclient(hunting): authenticate will time out at 3672.061103s 2026-02-24T19:18:09.412 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f0cd5ffb640 1 -- 10.20.193.26:0/1889309226 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2589775583 0 0) 0x7f0cd8163e90 con 0x7f0cd80585e0 2026-02-24T19:18:09.413 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f0cd5ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.413 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f0cd5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.413 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f0cd5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.413 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f0cd5ffb640 10 monclient(hunting): my global_id is 4397 2026-02-24T19:18:09.413 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f0cd5ffb640 1 -- 10.20.193.26:0/1889309226 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cc0002910 con 0x7f0cd80585e0 2026-02-24T19:18:09.413 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f82eda32640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.413 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f82eda32640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:18:09.413 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f89ae1c0640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.414 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f89ae1c0640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:18:09.414 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f82eda32640 10 monclient(hunting): picked mon.noname-b con 0x7f82e80b9f80 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.414 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f82eda32640 10 monclient(hunting): picked mon.noname-c con 0x7f82e80ba350 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.414 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f89ae1c0640 10 monclient(hunting): picked mon.noname-a con 0x7f89a80b9f80 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.414 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f89ae1c0640 10 monclient(hunting): picked mon.noname-b con 0x7f89a80ba350 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.414 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f89ae1c0640 10 monclient(hunting): picked mon.noname-c con 0x7f89a80585e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.415 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f82eda32640 10 monclient(hunting): picked mon.noname-a con 0x7f82e80585e0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.415 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f89ae1c0640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a8163930 con 0x7f89a80b9f80 2026-02-24T19:18:09.415 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f82eda32640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82e8163930 con 0x7f82e80585e0 2026-02-24T19:18:09.415 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f89ae1c0640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a8163bb0 con 0x7f89a80ba350 2026-02-24T19:18:09.415 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f89ae1c0640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a8163e90 con 0x7f89a80585e0 2026-02-24T19:18:09.415 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f89ae1c0640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.415 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f89ae1c0640 10 monclient(hunting): authenticate will time out at 3672.061537s 2026-02-24T19:18:09.416 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f82eda32640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82e8163bb0 con 0x7f82e80b9f80 2026-02-24T19:18:09.416 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f82eda32640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82e8163e90 con 0x7f82e80ba350 2026-02-24T19:18:09.416 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f82eda32640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.416 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.379+0000 7f82eda32640 10 monclient(hunting): authenticate will time out at 3672.061603s 2026-02-24T19:18:09.416 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.380+0000 7f0cd5ffb640 1 -- 10.20.193.26:0/1889309226 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3774775083 0 0) 0x7f0cc4003610 con 0x7f0cd80ba350 2026-02-24T19:18:09.416 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.380+0000 7f0cd5ffb640 1 -- 10.20.193.26:0/1889309226 >> v1:10.20.193.103:6789/0 conn(0x7f0cd80585e0 legacy=0x7f0cd8166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.416 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.380+0000 7f0cd5ffb640 1 -- 10.20.193.26:0/1889309226 >> v1:10.20.193.70:6789/0 conn(0x7f0cd80b9f80 legacy=0x7f0cd8163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.416 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.380+0000 7f0cd5ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.417 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.380+0000 7f0cd5ffb640 1 monclient: found mon.noname-a 2026-02-24T19:18:09.417 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.380+0000 7f0cd5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.417 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.380+0000 7f0cd5ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.417 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.380+0000 7f0cd5ffb640 1 -- 10.20.193.26:0/1889309226 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd80573f0 con 0x7f0cd80ba350 2026-02-24T19:18:09.417 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.380+0000 7f0cd5ffb640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.417 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.380+0000 7f0cd5ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.417 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.380+0000 7f0cd5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.417 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.380+0000 7f0cd5ffb640 1 -- 10.20.193.26:0/1889309226 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f0cc0002fc0 con 0x7f0cd80ba350 2026-02-24T19:18:09.417 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.380+0000 7f0cd5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.417 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.380+0000 7f0cd5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:09.417 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.380+0000 7f0cd5ffb640 10 monclient: dump: 2026-02-24T19:18:09.417 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.417 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.417 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.417 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.417 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.417 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.417 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.417 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.417 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.417 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.418 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.380+0000 7f0cdd83c640 5 monclient: authenticate success, global_id 4389 2026-02-24T19:18:09.418 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.380+0000 7f0cdd83c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.418 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.381+0000 7f86262e1640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.418 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.381+0000 7f86262e1640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.418 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.381+0000 7f86262e1640 10 monclient: monmap: 2026-02-24T19:18:09.418 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.418 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.418 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.382051+0000 2026-02-24T19:18:09.418 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.382051+0000 2026-02-24T19:18:09.418 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.418 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.418 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.418 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.418 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.418 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.419 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.381+0000 7f76127fc640 1 -- 10.20.193.26:0/1698743334 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1942337832 0 0) 0x7f76140526e0 con 0x7f76140b0fa0 2026-02-24T19:18:09.419 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.381+0000 7f76127fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.419 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.381+0000 7f76127fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.419 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.381+0000 7f76127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.419 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.381+0000 7f76127fc640 10 monclient(hunting): my global_id is 4392 2026-02-24T19:18:09.419 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.381+0000 7f76127fc640 1 -- 10.20.193.26:0/1698743334 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7614163cf0 con 0x7f76140b0fa0 2026-02-24T19:18:09.419 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.381+0000 7fb6ae10a640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.419 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.381+0000 7fb6ae10a640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.419 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.381+0000 7fb6ae10a640 10 monclient: monmap: 2026-02-24T19:18:09.419 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.419 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.419 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.382158+0000 2026-02-24T19:18:09.420 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.382158+0000 2026-02-24T19:18:09.420 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.420 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.420 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.420 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.420 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.420 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.420 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.381+0000 7f28e7fff640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.420 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.381+0000 7f28e7fff640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.420 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.381+0000 7f28e7fff640 10 monclient: monmap: 2026-02-24T19:18:09.420 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.420 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.420 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.382487+0000 2026-02-24T19:18:09.420 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.382487+0000 2026-02-24T19:18:09.420 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.420 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.420 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.421 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.421 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.421 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.421 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.381+0000 7fb6ae10a640 1 Processor -- start 2026-02-24T19:18:09.421 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.381+0000 7f86262e1640 1 Processor -- start 2026-02-24T19:18:09.421 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.381+0000 7fb6ae10a640 1 -- start start 2026-02-24T19:18:09.421 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.381+0000 7fb6ae10a640 10 monclient: init 2026-02-24T19:18:09.421 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.381+0000 7f86262e1640 1 -- start start 2026-02-24T19:18:09.421 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.381+0000 7f86262e1640 10 monclient: init 2026-02-24T19:18:09.422 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.381+0000 7f2abe7fc640 1 -- 10.20.193.26:0/1067385190 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1338737740 0 0) 0x7f2ac00b1ae0 con 0x7f2ac0161800 2026-02-24T19:18:09.422 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f2abe7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.422 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f2abe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.422 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f2abe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.422 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f2abe7fc640 10 monclient(hunting): my global_id is 4387 2026-02-24T19:18:09.422 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f2abe7fc640 1 -- 10.20.193.26:0/1067385190 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2aa4003610 con 0x7f2ac0161800 2026-02-24T19:18:09.422 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f28e7fff640 1 Processor -- start 2026-02-24T19:18:09.422 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f28e7fff640 1 -- start start 2026-02-24T19:18:09.422 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f28e7fff640 10 monclient: init 2026-02-24T19:18:09.422 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f35ed767640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.423 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f35ed767640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.423 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f35ed767640 10 monclient: monmap: 2026-02-24T19:18:09.423 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.423 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.423 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.383104+0000 2026-02-24T19:18:09.423 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.383104+0000 2026-02-24T19:18:09.423 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.423 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.423 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.423 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.423 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.423 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.423 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7fb6ae10a640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.423 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7fb6ae10a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:18:09.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7fb6ae10a640 10 monclient(hunting): picked mon.noname-b con 0x7fb6a80b9f80 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7fb6ae10a640 10 monclient(hunting): picked mon.noname-c con 0x7fb6a80ba350 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7fb6ae10a640 10 monclient(hunting): picked mon.noname-a con 0x7fb6a80585e0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7fb6ae10a640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a8163930 con 0x7fb6a80585e0 2026-02-24T19:18:09.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7fb6ae10a640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a8163bb0 con 0x7fb6a80b9f80 2026-02-24T19:18:09.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f86262e1640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7fb6ae10a640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a8163e90 con 0x7fb6a80ba350 2026-02-24T19:18:09.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7fb6ae10a640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7fb6ae10a640 10 monclient(hunting): authenticate will time out at 3672.064517s 2026-02-24T19:18:09.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f86262e1640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:18:09.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f86262e1640 10 monclient(hunting): picked mon.noname-b con 0x7f86200b9f80 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f86262e1640 10 monclient(hunting): picked mon.noname-c con 0x7f86200ba350 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f86262e1640 10 monclient(hunting): picked mon.noname-a con 0x7f86200585e0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f86262e1640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8620163930 con 0x7f86200585e0 2026-02-24T19:18:09.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f86262e1640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8620163bb0 con 0x7f86200b9f80 2026-02-24T19:18:09.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f86262e1640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8620163e90 con 0x7f86200ba350 2026-02-24T19:18:09.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f86262e1640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f86262e1640 10 monclient(hunting): authenticate will time out at 3672.064587s 2026-02-24T19:18:09.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f35ed767640 1 Processor -- start 2026-02-24T19:18:09.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f28e7fff640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f35ed767640 1 -- start start 2026-02-24T19:18:09.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f35ed767640 10 monclient: init 2026-02-24T19:18:09.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f28e7fff640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:18:09.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f28e7fff640 10 monclient(hunting): picked mon.noname-a con 0x7f28e8057500 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f28e7fff640 10 monclient(hunting): picked mon.noname-b con 0x7f28e80b91f0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f28e7fff640 10 monclient(hunting): picked mon.noname-c con 0x7f28e8159b40 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f28e7fff640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28e80b4d10 con 0x7f28e8057500 2026-02-24T19:18:09.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f28e7fff640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28e80b3eb0 con 0x7f28e80b91f0 2026-02-24T19:18:09.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f28e7fff640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28e80b4190 con 0x7f28e8159b40 2026-02-24T19:18:09.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f28e7fff640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.382+0000 7f28e7fff640 10 monclient(hunting): authenticate will time out at 3672.064861s 2026-02-24T19:18:09.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.383+0000 7f646fc3c640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.383+0000 7f646fc3c640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.427 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.383+0000 7f646fc3c640 10 monclient: monmap: 2026-02-24T19:18:09.427 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.427 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.427 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.383828+0000 2026-02-24T19:18:09.427 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.383828+0000 2026-02-24T19:18:09.427 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.427 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.427 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.427 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.427 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.427 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.427 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.383+0000 7f6be20f9640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f6bdc166f60 0x7f6bdc0ac450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:55480/0 (socket says 10.20.193.26:55480) 2026-02-24T19:18:09.427 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.383+0000 7f6be20f9640 1 -- 10.20.193.26:0/835935887 learned_addr learned my addr 10.20.193.26:0/835935887 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.427 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.383+0000 7f646fc3c640 1 Processor -- start 2026-02-24T19:18:09.428 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.383+0000 7f646fc3c640 1 -- start start 2026-02-24T19:18:09.428 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.383+0000 7f646fc3c640 10 monclient: init 2026-02-24T19:18:09.428 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.383+0000 7f35ed767640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.428 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.383+0000 7f35ed767640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:18:09.428 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.383+0000 7f35ed767640 10 monclient(hunting): picked mon.noname-a con 0x7f35e80b9f80 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.428 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.383+0000 7f35ed767640 10 monclient(hunting): picked mon.noname-b con 0x7f35e80ba350 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.428 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.383+0000 7f35ed767640 10 monclient(hunting): picked mon.noname-c con 0x7f35e80585e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.428 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.383+0000 7f6bca7fc640 10 client.?.objecter ms_handle_connect 0x7f6bdc166f60 2026-02-24T19:18:09.428 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f6bca7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.428 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f35ed767640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e8163930 con 0x7f35e80b9f80 2026-02-24T19:18:09.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f76127fc640 1 -- 10.20.193.26:0/1698743334 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4056953699 0 0) 0x7f75f8003610 con 0x7f761415d410 2026-02-24T19:18:09.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f76127fc640 1 -- 10.20.193.26:0/1698743334 >> v1:10.20.193.70:6789/0 conn(0x7f76140b2920 legacy=0x7f76140b7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f76127fc640 1 -- 10.20.193.26:0/1698743334 >> v1:10.20.193.26:6789/0 conn(0x7f76140b0fa0 legacy=0x7f76140b76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f76127fc640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f76127fc640 1 monclient: found mon.noname-c 2026-02-24T19:18:09.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f76127fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f76127fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f76127fc640 1 -- 10.20.193.26:0/1698743334 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76140afdb0 con 0x7f761415d410 2026-02-24T19:18:09.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f76127fc640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f76127fc640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f76127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f76127fc640 1 -- 10.20.193.26:0/1698743334 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7600002df0 con 0x7f761415d410 2026-02-24T19:18:09.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f76127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f76127fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f76127fc640 10 monclient: dump: 2026-02-24T19:18:09.429 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.429 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.429 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.429 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.429 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.429 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.429 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.430 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.430 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.430 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.430 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f35ed767640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e8163bb0 con 0x7f35e80ba350 2026-02-24T19:18:09.430 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f35ed767640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e8163e90 con 0x7f35e80585e0 2026-02-24T19:18:09.430 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f35ed767640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.430 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f35ed767640 10 monclient(hunting): authenticate will time out at 3672.066208s 2026-02-24T19:18:09.430 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f7619b7f640 5 monclient: authenticate success, global_id 4394 2026-02-24T19:18:09.430 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f7619b7f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.430 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f0e356fd640 1 -- 10.20.193.26:0/3818847684 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1068325299 0 0) 0x7f0e300afd90 con 0x7f0e30161640 2026-02-24T19:18:09.430 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f0e356fd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f0e356fd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f0e356fd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f0e356fd640 10 monclient(hunting): my global_id is 4390 2026-02-24T19:18:09.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f0e356fd640 1 -- 10.20.193.26:0/3818847684 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e20003610 con 0x7f0e30161640 2026-02-24T19:18:09.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f646fc3c640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f646fc3c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:18:09.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f646fc3c640 10 monclient(hunting): picked mon.noname-b con 0x7f64680b9f80 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f646fc3c640 10 monclient(hunting): picked mon.noname-c con 0x7f64680ba350 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f646fc3c640 10 monclient(hunting): picked mon.noname-a con 0x7f64680585e0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f646fc3c640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6468163930 con 0x7f64680585e0 2026-02-24T19:18:09.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f646fc3c640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6468163bb0 con 0x7f64680b9f80 2026-02-24T19:18:09.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f646fc3c640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6468163e90 con 0x7f64680ba350 2026-02-24T19:18:09.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f646fc3c640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.384+0000 7f646fc3c640 10 monclient(hunting): authenticate will time out at 3672.066393s 2026-02-24T19:18:09.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.385+0000 7f89a7fff640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f89a80585e0 0x7f89a8166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:55504/0 (socket says 10.20.193.26:55504) 2026-02-24T19:18:09.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.385+0000 7f89a7fff640 1 -- 10.20.193.26:0/2820215762 learned_addr learned my addr 10.20.193.26:0/2820215762 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.385+0000 7f82e6ffd640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f82e80b9f80 0x7f82e8163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:59468/0 (socket says 10.20.193.26:59468) 2026-02-24T19:18:09.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.385+0000 7f82e6ffd640 1 -- 10.20.193.26:0/1472319506 learned_addr learned my addr 10.20.193.26:0/1472319506 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.385+0000 7f6bca7fc640 10 client.?.objecter ms_handle_connect 0x7f6bdc15d070 2026-02-24T19:18:09.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.385+0000 7f6bca7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.386+0000 7f7af0001640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.386+0000 7f7af0001640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.386+0000 7f7af0001640 10 monclient: monmap: 2026-02-24T19:18:09.432 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.432 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.433 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.387023+0000 2026-02-24T19:18:09.433 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.387023+0000 2026-02-24T19:18:09.433 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.433 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.433 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.433 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.433 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.433 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.386+0000 7f7af0001640 1 Processor -- start 2026-02-24T19:18:09.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.386+0000 7f7af0001640 1 -- start start 2026-02-24T19:18:09.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.386+0000 7f7af0001640 10 monclient: init 2026-02-24T19:18:09.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.386+0000 7f0cd5ffb640 1 -- 10.20.193.26:0/1889309226 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0cc00031d0 con 0x7f0cd80ba350 2026-02-24T19:18:09.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.386+0000 7f0cd5ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.386+0000 7f0cd5ffb640 1 -- 10.20.193.26:0/1889309226 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f0cc0004990 con 0x7f0cd80ba350 2026-02-24T19:18:09.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.386+0000 7f0cd5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.386+0000 7f0cd5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:09.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.386+0000 7f0cd5ffb640 10 monclient: dump: 2026-02-24T19:18:09.433 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.433 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.433 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.433 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.433 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.433 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.433 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.434 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.434 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.434 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.434 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f0cdd83c640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.434 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.386+0000 7f2abe7fc640 1 -- 10.20.193.26:0/1067385190 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2272126899 0 0) 0x7f2ac00b1dc0 con 0x7f2ac016ad30 2026-02-24T19:18:09.434 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f2abe7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.434 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f2abe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.434 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f2abe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.434 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f2abe7fc640 10 monclient(hunting): my global_id is 4403 2026-02-24T19:18:09.434 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f2abe7fc640 1 -- 10.20.193.26:0/1067385190 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ac00b1ae0 con 0x7f2ac016ad30 2026-02-24T19:18:09.434 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f0cdd83c640 4 set_mon_vals no callback set 2026-02-24T19:18:09.435 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f7af0001640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.435 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f7af0001640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:18:09.435 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f7af0001640 10 monclient(hunting): picked mon.noname-c con 0x7f7ae8159a70 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.435 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f7af0001640 10 monclient(hunting): picked mon.noname-b con 0x7f7ae8159e40 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.435 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f7af0001640 10 monclient(hunting): picked mon.noname-a con 0x7f7ae8058070 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.435 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f7af0001640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ae8163930 con 0x7f7ae8058070 2026-02-24T19:18:09.435 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f7af0001640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ae8163bf0 con 0x7f7ae8159e40 2026-02-24T19:18:09.435 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f7af0001640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ae8163ed0 con 0x7f7ae8159a70 2026-02-24T19:18:09.435 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f7af0001640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.435 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f7af0001640 10 monclient(hunting): authenticate will time out at 3672.069426s 2026-02-24T19:18:09.435 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f861ffff640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f86200b9f80 0x7f8620163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:59484/0 (socket says 10.20.193.26:59484) 2026-02-24T19:18:09.435 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f861ffff640 1 -- 10.20.193.26:0/4066647443 learned_addr learned my addr 10.20.193.26:0/4066647443 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.436 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f0cdd83c640 10 monclient: shutdown 2026-02-24T19:18:09.436 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f0cdd83c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.436 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f0cdd83c640 1 -- 10.20.193.26:0/1889309226 >> v1:10.20.193.26:6789/0 conn(0x7f0cd80ba350 legacy=0x7f0cd8057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.436 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f0cdd83c640 1 -- 10.20.193.26:0/1889309226 shutdown_connections 2026-02-24T19:18:09.436 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f0cdd83c640 1 -- 10.20.193.26:0/1889309226 >> 10.20.193.26:0/1889309226 conn(0x7f0cd80b7990 msgr2=0x7f0cd80b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.436 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f0cdd83c640 1 -- 10.20.193.26:0/1889309226 shutdown_connections 2026-02-24T19:18:09.436 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f0cdd83c640 1 -- 10.20.193.26:0/1889309226 wait complete. 2026-02-24T19:18:09.436 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f70dcd33640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.436 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f70dcd33640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.436 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.387+0000 7f70dcd33640 10 monclient: monmap: 2026-02-24T19:18:09.436 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.436 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.436 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.388680+0000 2026-02-24T19:18:09.436 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.388680+0000 2026-02-24T19:18:09.436 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.436 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.436 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.436 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.436 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.436 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.437 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.388+0000 7f6bca7fc640 1 -- 10.20.193.26:0/835935887 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 741304486 0 0) 0x7f6bdc160730 con 0x7f6bdc166f60 2026-02-24T19:18:09.437 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.388+0000 7f6bca7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.437 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.388+0000 7f6bca7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.437 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.388+0000 7f6bca7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.437 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.388+0000 7f6bca7fc640 10 monclient(hunting): my global_id is 4409 2026-02-24T19:18:09.437 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.388+0000 7f0cdd83c640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.437 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.388+0000 7f6bca7fc640 1 -- 10.20.193.26:0/835935887 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bac003610 con 0x7f6bdc166f60 2026-02-24T19:18:09.437 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.388+0000 7f0cdd83c640 10 monclient: monmap: 2026-02-24T19:18:09.437 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.437 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.437 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.437 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.437 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.437 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.438 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.438 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.438 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.438 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.438 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.388+0000 7f70dcd33640 1 Processor -- start 2026-02-24T19:18:09.438 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.388+0000 7f70dcd33640 1 -- start start 2026-02-24T19:18:09.438 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.388+0000 7f70dcd33640 10 monclient: init 2026-02-24T19:18:09.438 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.388+0000 7f0cdd83c640 1 librados: starting msgr at 2026-02-24T19:18:09.438 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.388+0000 7f0cdd83c640 1 librados: starting objecter 2026-02-24T19:18:09.438 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.388+0000 7f0cdd83c640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.438 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.388+0000 7f0cdd83c640 1 Processor -- start 2026-02-24T19:18:09.438 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.388+0000 7f0cdd83c640 1 -- start start 2026-02-24T19:18:09.438 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.388+0000 7f0cdd83c640 1 librados: setting wanted keys 2026-02-24T19:18:09.438 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.388+0000 7f0cdd83c640 1 librados: calling monclient init 2026-02-24T19:18:09.438 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.388+0000 7f0cdd83c640 10 monclient: init 2026-02-24T19:18:09.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.388+0000 7f70dcd33640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f70dcd33640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:18:09.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f70dcd33640 10 monclient(hunting): picked mon.noname-c con 0x7f70d80b9f80 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f70dcd33640 10 monclient(hunting): picked mon.noname-a con 0x7f70d80ba350 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f70dcd33640 10 monclient(hunting): picked mon.noname-b con 0x7f70d80585e0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f70dcd33640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70d8163930 con 0x7f70d80ba350 2026-02-24T19:18:09.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f70dcd33640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70d8163bb0 con 0x7f70d80585e0 2026-02-24T19:18:09.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f70dcd33640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70d8163e90 con 0x7f70d80b9f80 2026-02-24T19:18:09.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f0cdd83c640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f70dcd33640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f70dcd33640 10 monclient(hunting): authenticate will time out at 3672.071147s 2026-02-24T19:18:09.440 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f0cdd83c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:18:09.440 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f0cdd83c640 10 monclient(hunting): picked mon.noname-b con 0x7f0cd80585e0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.440 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f0cdd83c640 10 monclient(hunting): picked mon.noname-c con 0x7f0cd80b9f80 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.440 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f50a8fc0640 1 -- 10.20.193.26:0/2423784747 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 67345939 0 0) 0x7f50a4163e90 con 0x7f50a40ba350 2026-02-24T19:18:09.440 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f50a8fc0640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.440 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f50a8fc0640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.440 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f50a8fc0640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.440 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f50a8fc0640 10 monclient(hunting): my global_id is 4400 2026-02-24T19:18:09.440 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f50a8fc0640 1 -- 10.20.193.26:0/2423784747 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f508c003610 con 0x7f50a40ba350 2026-02-24T19:18:09.440 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f0cdd83c640 10 monclient(hunting): picked mon.noname-a con 0x7f0cd80ba350 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.440 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f0cdd83c640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cd8156bc0 con 0x7f0cd80ba350 2026-02-24T19:18:09.440 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f0cdd83c640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cd81ff450 con 0x7f0cd80585e0 2026-02-24T19:18:09.440 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f0cdd83c640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cd81fb140 con 0x7f0cd80b9f80 2026-02-24T19:18:09.440 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f0cdd83c640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.440 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f0cdd83c640 10 monclient(hunting): authenticate will time out at 3672.071307s 2026-02-24T19:18:09.440 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7fb6a6ffd640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fb6a80ba350 0x7fb6a8057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:55518/0 (socket says 10.20.193.26:55518) 2026-02-24T19:18:09.440 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7fb6a6ffd640 1 -- 10.20.193.26:0/975393179 learned_addr learned my addr 10.20.193.26:0/975393179 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f50a8fc0640 1 -- 10.20.193.26:0/2423784747 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2237641026 0 0) 0x7f50a4163bb0 con 0x7f50a40b9f80 2026-02-24T19:18:09.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f50a8fc0640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f50a8fc0640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f50a8fc0640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f50a8fc0640 10 monclient(hunting): my global_id is 4393 2026-02-24T19:18:09.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.389+0000 7f50a8fc0640 1 -- 10.20.193.26:0/2423784747 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50a4163e90 con 0x7f50a40b9f80 2026-02-24T19:18:09.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.390+0000 7f2abe7fc640 1 -- 10.20.193.26:0/1067385190 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1881158452 0 0) 0x7f2ac00b1800 con 0x7f2ac0161430 2026-02-24T19:18:09.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.390+0000 7f2abe7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.390+0000 7f2abe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.390+0000 7f2abe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.390+0000 7f2abe7fc640 10 monclient(hunting): my global_id is 4398 2026-02-24T19:18:09.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.390+0000 7f2abe7fc640 1 -- 10.20.193.26:0/1067385190 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ac00b1dc0 con 0x7f2ac0161430 2026-02-24T19:18:09.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.390+0000 7f0e356fd640 1 -- 10.20.193.26:0/3818847684 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3545561127 0 0) 0x7f0e300b0050 con 0x7f0e300b5da0 2026-02-24T19:18:09.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.390+0000 7f0e356fd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.442 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.390+0000 7f0e356fd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.442 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.390+0000 7f0e356fd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.442 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.390+0000 7f0e356fd640 10 monclient(hunting): my global_id is 4406 2026-02-24T19:18:09.442 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.390+0000 7f0e356fd640 1 -- 10.20.193.26:0/3818847684 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e300afd90 con 0x7f0e300b5da0 2026-02-24T19:18:09.442 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f2abe7fc640 1 -- 10.20.193.26:0/1067385190 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 301453868 0 0) 0x7f2ac00b1ae0 con 0x7f2ac016ad30 2026-02-24T19:18:09.442 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f2abe7fc640 1 -- 10.20.193.26:0/1067385190 >> v1:10.20.193.70:6789/0 conn(0x7f2ac0161800 legacy=0x7f2ac0168c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.442 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f2abe7fc640 1 -- 10.20.193.26:0/1067385190 >> v1:10.20.193.26:6789/0 conn(0x7f2ac0161430 legacy=0x7f2ac00b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.442 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f2abe7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.442 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f2abe7fc640 1 monclient: found mon.noname-c 2026-02-24T19:18:09.442 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f2abe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.442 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f2abe7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.442 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f2abe7fc640 1 -- 10.20.193.26:0/1067385190 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac00b20a0 con 0x7f2ac016ad30 2026-02-24T19:18:09.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f2abe7fc640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f2abe7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f2abe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f2abe7fc640 1 -- 10.20.193.26:0/1067385190 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2ab4003170 con 0x7f2ac016ad30 2026-02-24T19:18:09.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f2abe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f2abe7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f2abe7fc640 10 monclient: dump: 2026-02-24T19:18:09.443 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.443 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.443 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.443 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.443 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.443 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.443 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.443 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.443 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.443 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f2ac6213640 5 monclient: authenticate success, global_id 4403 2026-02-24T19:18:09.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f2ac6213640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f89a67fc640 1 -- 10.20.193.26:0/2820215762 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4117520670 0 0) 0x7f89a8163e90 con 0x7f89a80585e0 2026-02-24T19:18:09.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f89a67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f89a67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f89a67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f89a67fc640 10 monclient(hunting): my global_id is 4412 2026-02-24T19:18:09.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f89a67fc640 1 -- 10.20.193.26:0/2820215762 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f898c003610 con 0x7f89a80585e0 2026-02-24T19:18:09.444 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f35e77fe640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f35e80585e0 0x7f35e8166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:55540/0 (socket says 10.20.193.26:55540) 2026-02-24T19:18:09.444 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f35e77fe640 1 -- 10.20.193.26:0/1250925434 learned_addr learned my addr 10.20.193.26:0/1250925434 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.444 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f50a8fc0640 1 -- 10.20.193.26:0/2423784747 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3873498319 0 0) 0x7f50a0002c90 con 0x7f50a40585e0 2026-02-24T19:18:09.444 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f50a8fc0640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.444 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f50a8fc0640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.444 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f50a8fc0640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.444 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f50a8fc0640 10 monclient(hunting): my global_id is 4395 2026-02-24T19:18:09.444 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.391+0000 7f50a8fc0640 1 -- 10.20.193.26:0/2423784747 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50a4163bb0 con 0x7f50a40585e0 2026-02-24T19:18:09.444 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.392+0000 7f0e356fd640 1 -- 10.20.193.26:0/3818847684 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3835872678 0 0) 0x7f0e20003610 con 0x7f0e30161640 2026-02-24T19:18:09.444 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.392+0000 7f0e356fd640 1 -- 10.20.193.26:0/3818847684 >> v1:10.20.193.103:6789/0 conn(0x7f0e300b5da0 legacy=0x7f0e301ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.444 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.392+0000 7f0e356fd640 1 -- 10.20.193.26:0/3818847684 >> v1:10.20.193.26:6789/0 conn(0x7f0e30161a10 legacy=0x7f0e300b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.444 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.392+0000 7f0e356fd640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.444 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.392+0000 7f0e356fd640 1 monclient: found mon.noname-b 2026-02-24T19:18:09.444 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.392+0000 7f0e356fd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.444 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.392+0000 7f0e356fd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.444 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.392+0000 7f0e356fd640 1 -- 10.20.193.26:0/3818847684 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e300b0330 con 0x7f0e30161640 2026-02-24T19:18:09.444 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.392+0000 7f0e356fd640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.444 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.392+0000 7f0e356fd640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.445 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.392+0000 7f0e356fd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.445 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.392+0000 7f0e356fd640 1 -- 10.20.193.26:0/3818847684 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f0e28002df0 con 0x7f0e30161640 2026-02-24T19:18:09.445 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.392+0000 7f0e356fd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.445 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.392+0000 7f0e356fd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:09.445 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.392+0000 7f0e356fd640 10 monclient: dump: 2026-02-24T19:18:09.445 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.445 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.445 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.445 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.445 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.445 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.445 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.445 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.445 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.445 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.445 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.392+0000 7f0e3898a640 5 monclient: authenticate success, global_id 4390 2026-02-24T19:18:09.445 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.392+0000 7f0e3898a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.445 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.392+0000 7f28e67fc640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f28e80b91f0 0x7f28e8159430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:59504/0 (socket says 10.20.193.26:59504) 2026-02-24T19:18:09.445 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.392+0000 7f28e67fc640 1 -- 10.20.193.26:0/3557509455 learned_addr learned my addr 10.20.193.26:0/3557509455 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.445 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.392+0000 7f6bca7fc640 10 client.?.objecter ms_handle_connect 0x7f6bdc15d440 2026-02-24T19:18:09.445 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.392+0000 7f6bca7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.394+0000 7f76127fc640 1 -- 10.20.193.26:0/1698743334 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7600003040 con 0x7f761415d410 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.394+0000 7f76127fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.394+0000 7f76127fc640 1 -- 10.20.193.26:0/1698743334 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7600003480 con 0x7f761415d410 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.394+0000 7f76127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.394+0000 7f76127fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.394+0000 7f76127fc640 10 monclient: dump: 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.394+0000 7f7619b7f640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.394+0000 7f7619b7f640 4 set_mon_vals no callback set 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.394+0000 7f613507b640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.394+0000 7f613507b640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.395+0000 7f613507b640 10 monclient: monmap: 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.395778+0000 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.395778+0000 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.446 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.447 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.447 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.395+0000 7f70d5d74640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f70d80ba350 0x7f70d8057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:46852/0 (socket says 10.20.193.26:46852) 2026-02-24T19:18:09.447 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.395+0000 7f70d5d74640 1 -- 10.20.193.26:0/2388437027 learned_addr learned my addr 10.20.193.26:0/2388437027 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.447 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.395+0000 7f7619b7f640 10 monclient: shutdown 2026-02-24T19:18:09.447 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.395+0000 7f7619b7f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.447 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.395+0000 7f7619b7f640 1 -- 10.20.193.26:0/1698743334 >> v1:10.20.193.103:6789/0 conn(0x7f761415d410 legacy=0x7f76140b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.447 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.395+0000 7f7619b7f640 1 -- 10.20.193.26:0/1698743334 shutdown_connections 2026-02-24T19:18:09.447 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.395+0000 7f7619b7f640 1 -- 10.20.193.26:0/1698743334 >> 10.20.193.26:0/1698743334 conn(0x7f76140b5250 msgr2=0x7f76140b5650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.447 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.395+0000 7f613507b640 1 Processor -- start 2026-02-24T19:18:09.447 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.395+0000 7f7619b7f640 1 -- 10.20.193.26:0/1698743334 shutdown_connections 2026-02-24T19:18:09.447 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.395+0000 7f613507b640 1 -- start start 2026-02-24T19:18:09.447 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.395+0000 7f613507b640 10 monclient: init 2026-02-24T19:18:09.447 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.395+0000 7f7619b7f640 1 -- 10.20.193.26:0/1698743334 wait complete. 2026-02-24T19:18:09.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.395+0000 7f82e5ffb640 1 -- 10.20.193.26:0/1472319506 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3773307016 0 0) 0x7f82e8163bb0 con 0x7f82e80b9f80 2026-02-24T19:18:09.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.395+0000 7f82e5ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.395+0000 7f82e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.395+0000 7f82e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.395+0000 7f82e5ffb640 10 monclient(hunting): my global_id is 4396 2026-02-24T19:18:09.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.395+0000 7f82e5ffb640 1 -- 10.20.193.26:0/1472319506 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82d4003610 con 0x7f82e80b9f80 2026-02-24T19:18:09.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.395+0000 7f646e1b2640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f64680585e0 0x7f6468166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:46832/0 (socket says 10.20.193.26:46832) 2026-02-24T19:18:09.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.395+0000 7f646e1b2640 1 -- 10.20.193.26:0/1132198546 learned_addr learned my addr 10.20.193.26:0/1132198546 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.396+0000 7f613507b640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.396+0000 7f613507b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:18:09.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.396+0000 7f613507b640 10 monclient(hunting): picked mon.noname-b con 0x7f61300b9f80 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.396+0000 7f613507b640 10 monclient(hunting): picked mon.noname-c con 0x7f61300ba350 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.396+0000 7f613507b640 10 monclient(hunting): picked mon.noname-a con 0x7f61300585e0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.396+0000 7f613507b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6130163930 con 0x7f61300585e0 2026-02-24T19:18:09.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.396+0000 7f613507b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6130163bb0 con 0x7f61300b9f80 2026-02-24T19:18:09.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.396+0000 7f613507b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6130163e90 con 0x7f61300ba350 2026-02-24T19:18:09.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.396+0000 7f613507b640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.396+0000 7f613507b640 10 monclient(hunting): authenticate will time out at 3672.078112s 2026-02-24T19:18:09.449 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.396+0000 7f7619b7f640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.449 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.396+0000 7f7619b7f640 10 monclient: monmap: 2026-02-24T19:18:09.449 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.449 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.449 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.449 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.449 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.449 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.449 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.449 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.449 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.449 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.449 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.396+0000 7f7aed575640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f7ae8159e40 0x7f7ae8163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:59534/0 (socket says 10.20.193.26:59534) 2026-02-24T19:18:09.449 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.396+0000 7f7aed575640 1 -- 10.20.193.26:0/3080506142 learned_addr learned my addr 10.20.193.26:0/3080506142 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.449 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.396+0000 7f7619b7f640 1 librados: starting msgr at 2026-02-24T19:18:09.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.396+0000 7f7619b7f640 1 librados: starting objecter 2026-02-24T19:18:09.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.396+0000 7f7619b7f640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.396+0000 7f7619b7f640 1 Processor -- start 2026-02-24T19:18:09.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.396+0000 7f7619b7f640 1 -- start start 2026-02-24T19:18:09.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.396+0000 7f7619b7f640 1 librados: setting wanted keys 2026-02-24T19:18:09.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.396+0000 7f7619b7f640 1 librados: calling monclient init 2026-02-24T19:18:09.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.396+0000 7f7619b7f640 10 monclient: init 2026-02-24T19:18:09.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.396+0000 7f7619b7f640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.396+0000 7f7619b7f640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:18:09.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.397+0000 7f7619b7f640 10 monclient(hunting): picked mon.noname-b con 0x7f76140b0fa0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.397+0000 7f7619b7f640 10 monclient(hunting): picked mon.noname-c con 0x7f76140b2920 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.397+0000 7f7619b7f640 10 monclient(hunting): picked mon.noname-a con 0x7f761415d410 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.397+0000 7f7619b7f640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f761412fc10 con 0x7f761415d410 2026-02-24T19:18:09.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.397+0000 7f7619b7f640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7614132080 con 0x7f76140b0fa0 2026-02-24T19:18:09.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.397+0000 7f7619b7f640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7614132890 con 0x7f76140b2920 2026-02-24T19:18:09.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.397+0000 7f7619b7f640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.397+0000 7f7619b7f640 10 monclient(hunting): authenticate will time out at 3672.079110s 2026-02-24T19:18:09.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.399+0000 7f35e5ffb640 1 -- 10.20.193.26:0/1250925434 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2769474373 0 0) 0x7f35e8163e90 con 0x7f35e80585e0 2026-02-24T19:18:09.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.399+0000 7f35e5ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.399+0000 7f35e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.399+0000 7f35e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.399+0000 7f35e5ffb640 10 monclient(hunting): my global_id is 4421 2026-02-24T19:18:09.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.399+0000 7f35e5ffb640 1 -- 10.20.193.26:0/1250925434 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35d4003610 con 0x7f35e80585e0 2026-02-24T19:18:09.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.400+0000 7f0cd77fe640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f0cd80ba350 0x7f0cd8158640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:46860/0 (socket says 10.20.193.26:46860) 2026-02-24T19:18:09.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.400+0000 7f0cd77fe640 1 -- 10.20.193.26:0/2370175587 learned_addr learned my addr 10.20.193.26:0/2370175587 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.451 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.400+0000 7f2abe7fc640 1 -- 10.20.193.26:0/1067385190 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2ab4003380 con 0x7f2ac016ad30 2026-02-24T19:18:09.451 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.400+0000 7f2abe7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.451 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.400+0000 7f2abe7fc640 1 -- 10.20.193.26:0/1067385190 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2ab4003780 con 0x7f2ac016ad30 2026-02-24T19:18:09.451 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.400+0000 7f2abe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.451 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.400+0000 7f2abe7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.451 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.400+0000 7f2abe7fc640 10 monclient: dump: 2026-02-24T19:18:09.451 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.451 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.451 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.451 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.451 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.451 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.451 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.451 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.451 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.451 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.451 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.400+0000 7f2ac6213640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.451 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.400+0000 7f2ac6213640 4 set_mon_vals no callback set 2026-02-24T19:18:09.451 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.400+0000 7f861effd640 1 -- 10.20.193.26:0/4066647443 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3351290615 0 0) 0x7f8620163bb0 con 0x7f86200b9f80 2026-02-24T19:18:09.451 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.400+0000 7f861effd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.451 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.400+0000 7f861effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.451 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.400+0000 7f861effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.451 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.400+0000 7f861effd640 10 monclient(hunting): my global_id is 4399 2026-02-24T19:18:09.451 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.400+0000 7f861effd640 1 -- 10.20.193.26:0/4066647443 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8604003610 con 0x7f86200b9f80 2026-02-24T19:18:09.452 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.400+0000 7f2ac6213640 10 monclient: shutdown 2026-02-24T19:18:09.452 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.400+0000 7f2ac6213640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.452 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.400+0000 7f2ac6213640 1 -- 10.20.193.26:0/1067385190 >> v1:10.20.193.103:6789/0 conn(0x7f2ac016ad30 legacy=0x7f2ac016b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.452 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.401+0000 7fb6a67fc640 1 -- 10.20.193.26:0/975393179 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2955513428 0 0) 0x7fb6a8163bb0 con 0x7fb6a80b9f80 2026-02-24T19:18:09.452 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.401+0000 7fb6a67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.452 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.401+0000 7fb6a67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.452 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.401+0000 7fb6a67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.452 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.401+0000 7fb6a67fc640 10 monclient(hunting): my global_id is 4402 2026-02-24T19:18:09.452 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.401+0000 7fb6a67fc640 1 -- 10.20.193.26:0/975393179 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb68c003610 con 0x7fb6a80b9f80 2026-02-24T19:18:09.452 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.401+0000 7f28e5ffb640 1 -- 10.20.193.26:0/3557509455 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 44506432 0 0) 0x7f28e80b3eb0 con 0x7f28e80b91f0 2026-02-24T19:18:09.452 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.401+0000 7f28e5ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.452 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.401+0000 7f28e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.452 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.401+0000 7f28e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.452 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.401+0000 7f28e5ffb640 10 monclient(hunting): my global_id is 4408 2026-02-24T19:18:09.452 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.401+0000 7f28e5ffb640 1 -- 10.20.193.26:0/3557509455 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28d4003610 con 0x7f28e80b91f0 2026-02-24T19:18:09.452 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.401+0000 7f2ac6213640 1 -- 10.20.193.26:0/1067385190 shutdown_connections 2026-02-24T19:18:09.452 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.401+0000 7f2ac6213640 1 -- 10.20.193.26:0/1067385190 >> 10.20.193.26:0/1067385190 conn(0x7f2ac00b2ef0 msgr2=0x7f2ac00b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.452 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.401+0000 7f2ac6213640 1 -- 10.20.193.26:0/1067385190 shutdown_connections 2026-02-24T19:18:09.452 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.401+0000 7f2ac6213640 1 -- 10.20.193.26:0/1067385190 wait complete. 2026-02-24T19:18:09.453 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.401+0000 7f0caffff640 10 client.?.objecter ms_handle_connect 0x7f0cd80ba350 2026-02-24T19:18:09.453 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.401+0000 7f0caffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.453 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.401+0000 7f82e5ffb640 1 -- 10.20.193.26:0/1472319506 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2861287480 0 0) 0x7f82e8163e90 con 0x7f82e80ba350 2026-02-24T19:18:09.453 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.401+0000 7f82e5ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.453 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.401+0000 7f82e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.453 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.401+0000 7f82e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.453 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.401+0000 7f82e5ffb640 10 monclient(hunting): my global_id is 4415 2026-02-24T19:18:09.453 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f82e5ffb640 1 -- 10.20.193.26:0/1472319506 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82e8163bb0 con 0x7f82e80ba350 2026-02-24T19:18:09.453 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f2ac6213640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.453 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f2ac6213640 10 monclient: monmap: 2026-02-24T19:18:09.453 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.453 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.453 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.453 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.453 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.453 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.453 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.453 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.453 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.453 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.453 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f2ac6213640 1 librados: starting msgr at 2026-02-24T19:18:09.453 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f2ac6213640 1 librados: starting objecter 2026-02-24T19:18:09.453 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f2ac6213640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.453 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f2ac6213640 1 Processor -- start 2026-02-24T19:18:09.453 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f2ac6213640 1 -- start start 2026-02-24T19:18:09.454 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f2ac6213640 1 librados: setting wanted keys 2026-02-24T19:18:09.454 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f2ac6213640 1 librados: calling monclient init 2026-02-24T19:18:09.454 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f2ac6213640 10 monclient: init 2026-02-24T19:18:09.454 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f7aecd74640 1 -- 10.20.193.26:0/3080506142 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2649127713 0 0) 0x7f7ae8163bf0 con 0x7f7ae8159e40 2026-02-24T19:18:09.454 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f7aecd74640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.454 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f7aecd74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.454 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f7aecd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.454 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f7aecd74640 10 monclient(hunting): my global_id is 4417 2026-02-24T19:18:09.454 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f7aecd74640 1 -- 10.20.193.26:0/3080506142 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ad0003610 con 0x7f7ae8159e40 2026-02-24T19:18:09.454 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f2ac6213640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.454 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f35e5ffb640 1 -- 10.20.193.26:0/1250925434 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 429581240 0 0) 0x7f35dc002910 con 0x7f35e80b9f80 2026-02-24T19:18:09.454 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f35e5ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.454 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f35e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.454 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f35e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.454 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f35e5ffb640 10 monclient(hunting): my global_id is 4416 2026-02-24T19:18:09.454 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f35e5ffb640 1 -- 10.20.193.26:0/1250925434 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35e8163e90 con 0x7f35e80b9f80 2026-02-24T19:18:09.454 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f2ac6213640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:18:09.454 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f2ac6213640 10 monclient(hunting): picked mon.noname-b con 0x7f2ac0161430 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.454 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f2ac6213640 10 monclient(hunting): picked mon.noname-c con 0x7f2ac0161800 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.454 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f2ac6213640 10 monclient(hunting): picked mon.noname-a con 0x7f2ac016ad30 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.454 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f2ac6213640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ac015d6e0 con 0x7f2ac016ad30 2026-02-24T19:18:09.454 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f2ac6213640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ac015d9c0 con 0x7f2ac0161430 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f2ac6213640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ac015dca0 con 0x7f2ac0161800 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f2ac6213640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.402+0000 7f2ac6213640 10 monclient(hunting): authenticate will time out at 3672.084755s 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f89a67fc640 1 -- 10.20.193.26:0/2820215762 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1774349002 0 0) 0x7f898c003610 con 0x7f89a80585e0 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f89a67fc640 1 -- 10.20.193.26:0/2820215762 >> v1:10.20.193.70:6789/0 conn(0x7f89a80ba350 legacy=0x7f89a8057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f89a67fc640 1 -- 10.20.193.26:0/2820215762 >> v1:10.20.193.26:6789/0 conn(0x7f89a80b9f80 legacy=0x7f89a8163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f89a67fc640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f89a67fc640 1 monclient: found mon.noname-c 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f89a67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f89a67fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f89a67fc640 1 -- 10.20.193.26:0/2820215762 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a80573f0 con 0x7f89a80585e0 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f89a67fc640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f89a67fc640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f89a67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f89a67fc640 1 -- 10.20.193.26:0/2820215762 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f899c003170 con 0x7f89a80585e0 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f89a67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f89a67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f89a67fc640 10 monclient: dump: 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f89ae1c0640 5 monclient: authenticate success, global_id 4412 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f89ae1c0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f50a8fc0640 1 -- 10.20.193.26:0/2423784747 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3848754717 0 0) 0x7f508c003610 con 0x7f50a40ba350 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f50a8fc0640 1 -- 10.20.193.26:0/2423784747 >> v1:10.20.193.70:6789/0 conn(0x7f50a40b9f80 legacy=0x7f50a4163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f50a8fc0640 1 -- 10.20.193.26:0/2423784747 >> v1:10.20.193.26:6789/0 conn(0x7f50a40585e0 legacy=0x7f50a4166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f50a8fc0640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f50a8fc0640 1 monclient: found mon.noname-c 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f50a8fc0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f50a8fc0640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f50a8fc0640 1 -- 10.20.193.26:0/2423784747 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a40573f0 con 0x7f50a40ba350 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f50a8fc0640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f50a8fc0640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f50a8fc0640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f50a8fc0640 1 -- 10.20.193.26:0/2423784747 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f5098002df0 con 0x7f50a40ba350 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f50a8fc0640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f50a8fc0640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f50a8fc0640 10 monclient: dump: 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f50ac24d640 5 monclient: authenticate success, global_id 4400 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f50ac24d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7fb6a67fc640 1 -- 10.20.193.26:0/975393179 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1426705507 0 0) 0x7fb6a8163e90 con 0x7fb6a80ba350 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7fb6a67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7fb6a67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7fb6a67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7fb6a67fc640 10 monclient(hunting): my global_id is 4418 2026-02-24T19:18:09.456 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7fb6a67fc640 1 -- 10.20.193.26:0/975393179 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6a8163bb0 con 0x7fb6a80ba350 2026-02-24T19:18:09.457 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f6bca7fc640 1 -- 10.20.193.26:0/835935887 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1916175833 0 0) 0x7f6bdc160450 con 0x7f6bdc15d440 2026-02-24T19:18:09.457 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f6bca7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.457 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f6bca7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.457 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f6bca7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.457 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f6bca7fc640 10 monclient(hunting): my global_id is 4405 2026-02-24T19:18:09.457 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.403+0000 7f6bca7fc640 1 -- 10.20.193.26:0/835935887 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bdc160730 con 0x7f6bdc15d440 2026-02-24T19:18:09.457 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.404+0000 7f70d5573640 1 -- 10.20.193.26:0/2388437027 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4068491088 0 0) 0x7f70c0002910 con 0x7f70d80ba350 2026-02-24T19:18:09.457 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.404+0000 7f70d5573640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.457 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.404+0000 7f70d5573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.457 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.404+0000 7f70d5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.457 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.404+0000 7f70d5573640 10 monclient(hunting): my global_id is 4422 2026-02-24T19:18:09.457 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.404+0000 7f70d5573640 1 -- 10.20.193.26:0/2388437027 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70c4003610 con 0x7f70d80ba350 2026-02-24T19:18:09.457 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.406+0000 7f861effd640 1 -- 10.20.193.26:0/4066647443 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1397513830 0 0) 0x7f8620163e90 con 0x7f86200ba350 2026-02-24T19:18:09.457 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.406+0000 7f861effd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.457 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.406+0000 7f861effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.457 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.406+0000 7f82e5ffb640 1 -- 10.20.193.26:0/1472319506 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 716723161 0 0) 0x7f82d8002c90 con 0x7f82e80585e0 2026-02-24T19:18:09.457 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.406+0000 7f82e5ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.457 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.406+0000 7f82e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.457 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.406+0000 7f82e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.457 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.406+0000 7f82e5ffb640 10 monclient(hunting): my global_id is 4404 2026-02-24T19:18:09.458 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.406+0000 7f861effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.458 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.406+0000 7f861effd640 10 monclient(hunting): my global_id is 4427 2026-02-24T19:18:09.458 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.406+0000 7f82e5ffb640 1 -- 10.20.193.26:0/1472319506 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82e8163e90 con 0x7f82e80585e0 2026-02-24T19:18:09.458 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.406+0000 7f861effd640 1 -- 10.20.193.26:0/4066647443 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8620163bb0 con 0x7f86200ba350 2026-02-24T19:18:09.458 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.407+0000 7f861effd640 1 -- 10.20.193.26:0/4066647443 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3759571066 0 0) 0x7f8614002c90 con 0x7f86200585e0 2026-02-24T19:18:09.458 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.407+0000 7f861effd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.458 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.407+0000 7f861effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.458 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.407+0000 7f861effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.458 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.407+0000 7f861effd640 10 monclient(hunting): my global_id is 4413 2026-02-24T19:18:09.458 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.407+0000 7f861effd640 1 -- 10.20.193.26:0/4066647443 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8620163e90 con 0x7f86200585e0 2026-02-24T19:18:09.458 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.407+0000 7f6bca7fc640 1 -- 10.20.193.26:0/835935887 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2811503535 0 0) 0x7f6bdc160170 con 0x7f6bdc15d070 2026-02-24T19:18:09.458 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.407+0000 7f6bca7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.458 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.407+0000 7f6bca7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.458 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.407+0000 7f6bca7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.458 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.407+0000 7f6bca7fc640 10 monclient(hunting): my global_id is 4401 2026-02-24T19:18:09.458 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.407+0000 7f6bca7fc640 1 -- 10.20.193.26:0/835935887 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bdc160450 con 0x7f6bdc15d070 2026-02-24T19:18:09.459 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.407+0000 7f28e5ffb640 1 -- 10.20.193.26:0/3557509455 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1824889570 0 0) 0x7f28e80b4190 con 0x7f28e8159b40 2026-02-24T19:18:09.459 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.407+0000 7f28e5ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.459 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.407+0000 7f28e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.459 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.407+0000 7f28e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.459 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.407+0000 7f28e5ffb640 10 monclient(hunting): my global_id is 4424 2026-02-24T19:18:09.459 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.407+0000 7f28e5ffb640 1 -- 10.20.193.26:0/3557509455 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28e80b3eb0 con 0x7f28e8159b40 2026-02-24T19:18:09.459 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.407+0000 7f0caffff640 10 client.?.objecter ms_handle_connect 0x7f0cd80b9f80 2026-02-24T19:18:09.459 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.407+0000 7f0caffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.459 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f646c9af640 1 -- 10.20.193.26:0/1132198546 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1877925768 0 0) 0x7f6464002c90 con 0x7f64680585e0 2026-02-24T19:18:09.459 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7fb6a67fc640 1 -- 10.20.193.26:0/975393179 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3887258635 0 0) 0x7fb69c002c90 con 0x7fb6a80585e0 2026-02-24T19:18:09.459 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7fb6a67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.459 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7fb6a67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.459 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7fb6a67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.459 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7fb6a67fc640 10 monclient(hunting): my global_id is 4410 2026-02-24T19:18:09.459 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7fb6a67fc640 1 -- 10.20.193.26:0/975393179 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6a8163e90 con 0x7fb6a80585e0 2026-02-24T19:18:09.459 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f646c9af640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.459 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f646c9af640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.459 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f646c9af640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.459 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f646c9af640 10 monclient(hunting): my global_id is 4419 2026-02-24T19:18:09.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f7aecd74640 1 -- 10.20.193.26:0/3080506142 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 365141800 0 0) 0x7f7ae8163ed0 con 0x7f7ae8159a70 2026-02-24T19:18:09.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f7aecd74640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f7aecd74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f7aecd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f7aecd74640 10 monclient(hunting): my global_id is 4433 2026-02-24T19:18:09.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f646c9af640 1 -- 10.20.193.26:0/1132198546 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6450003610 con 0x7f64680585e0 2026-02-24T19:18:09.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f646c9af640 1 -- 10.20.193.26:0/1132198546 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1101195435 0 0) 0x7f6468163e90 con 0x7f64680ba350 2026-02-24T19:18:09.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f646c9af640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f7aecd74640 1 -- 10.20.193.26:0/3080506142 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ae8163bf0 con 0x7f7ae8159a70 2026-02-24T19:18:09.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f646c9af640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f646c9af640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f646c9af640 10 monclient(hunting): my global_id is 4430 2026-02-24T19:18:09.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f646c9af640 1 -- 10.20.193.26:0/1132198546 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6464002c90 con 0x7f64680ba350 2026-02-24T19:18:09.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f0caffff640 1 -- 10.20.193.26:0/2370175587 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3361053645 0 0) 0x7f0cd8156bc0 con 0x7f0cd80ba350 2026-02-24T19:18:09.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f0caffff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f0caffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f0caffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f0caffff640 10 monclient(hunting): my global_id is 4431 2026-02-24T19:18:09.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f0caffff640 1 -- 10.20.193.26:0/2370175587 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ca8003610 con 0x7f0cd80ba350 2026-02-24T19:18:09.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f28e5ffb640 1 -- 10.20.193.26:0/3557509455 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2147198548 0 0) 0x7f28e80b4d10 con 0x7f28e8057500 2026-02-24T19:18:09.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f28e5ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f28e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f28e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f28e5ffb640 10 monclient(hunting): my global_id is 4428 2026-02-24T19:18:09.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f28e5ffb640 1 -- 10.20.193.26:0/3557509455 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28e80b4190 con 0x7f28e8057500 2026-02-24T19:18:09.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f612e575640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f61300ba350 0x7f6130057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:55578/0 (socket says 10.20.193.26:55578) 2026-02-24T19:18:09.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f612e575640 1 -- 10.20.193.26:0/1751168399 learned_addr learned my addr 10.20.193.26:0/1751168399 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f7612ffd640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f76140b2920 0x7f7614133650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:55594/0 (socket says 10.20.193.26:55594) 2026-02-24T19:18:09.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.408+0000 7f7612ffd640 1 -- 10.20.193.26:0/4132827319 learned_addr learned my addr 10.20.193.26:0/4132827319 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.409+0000 7f35e5ffb640 1 -- 10.20.193.26:0/1250925434 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3336084909 0 0) 0x7f35e8163bb0 con 0x7f35e80ba350 2026-02-24T19:18:09.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.409+0000 7f35e5ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.409+0000 7f35e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.409+0000 7f35e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.409+0000 7f35e5ffb640 10 monclient(hunting): my global_id is 4414 2026-02-24T19:18:09.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.409+0000 7f35e5ffb640 1 -- 10.20.193.26:0/1250925434 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35dc002910 con 0x7f35e80ba350 2026-02-24T19:18:09.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.409+0000 7f0e356fd640 1 -- 10.20.193.26:0/3818847684 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0e28003000 con 0x7f0e30161640 2026-02-24T19:18:09.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.409+0000 7f0e356fd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.409+0000 7f0e356fd640 1 -- 10.20.193.26:0/3818847684 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f0e28003440 con 0x7f0e30161640 2026-02-24T19:18:09.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.409+0000 7f0e356fd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.409+0000 7f0e356fd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.409+0000 7f0e356fd640 10 monclient: dump: 2026-02-24T19:18:09.461 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.461 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.461 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.461 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.461 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.461 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.461 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.462 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.462 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.462 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.409+0000 7f0e3898a640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.409+0000 7f0e3898a640 4 set_mon_vals no callback set 2026-02-24T19:18:09.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.409+0000 7f75effff640 10 client.?.objecter ms_handle_connect 0x7f76140b2920 2026-02-24T19:18:09.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.409+0000 7f75effff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.409+0000 7f0e3898a640 10 monclient: shutdown 2026-02-24T19:18:09.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.409+0000 7f0e3898a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.409+0000 7f0e3898a640 1 -- 10.20.193.26:0/3818847684 >> v1:10.20.193.70:6789/0 conn(0x7f0e30161640 legacy=0x7f0e300b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.409+0000 7f0e3898a640 1 -- 10.20.193.26:0/3818847684 shutdown_connections 2026-02-24T19:18:09.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.409+0000 7f0e3898a640 1 -- 10.20.193.26:0/3818847684 >> 10.20.193.26:0/3818847684 conn(0x7f0e300b5290 msgr2=0x7f0e300b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.410+0000 7f0e3898a640 1 -- 10.20.193.26:0/3818847684 shutdown_connections 2026-02-24T19:18:09.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.410+0000 7f0e3898a640 1 -- 10.20.193.26:0/3818847684 wait complete. 2026-02-24T19:18:09.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.410+0000 7f646c9af640 1 -- 10.20.193.26:0/1132198546 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1468757408 0 0) 0x7f6468163bb0 con 0x7f64680b9f80 2026-02-24T19:18:09.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.410+0000 7f646c9af640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.410+0000 7f646c9af640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.410+0000 7f646c9af640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.410+0000 7f646c9af640 10 monclient(hunting): my global_id is 4420 2026-02-24T19:18:09.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.410+0000 7f646c9af640 1 -- 10.20.193.26:0/1132198546 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6468163e90 con 0x7f64680b9f80 2026-02-24T19:18:09.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.410+0000 7f0caffff640 10 client.?.objecter ms_handle_connect 0x7f0cd80585e0 2026-02-24T19:18:09.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.410+0000 7f0caffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.410+0000 7f0e3898a640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.410+0000 7f0e3898a640 10 monclient: monmap: 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.410+0000 7f0e3898a640 1 librados: starting msgr at 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.410+0000 7f0e3898a640 1 librados: starting objecter 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.410+0000 7f0e3898a640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.410+0000 7f0e3898a640 1 Processor -- start 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.410+0000 7f0e3898a640 1 -- start start 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.410+0000 7f0e3898a640 1 librados: setting wanted keys 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.410+0000 7f0e3898a640 1 librados: calling monclient init 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.410+0000 7f0e3898a640 10 monclient: init 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.411+0000 7f0e3898a640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.411+0000 7f0e3898a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.411+0000 7f0e3898a640 10 monclient(hunting): picked mon.noname-a con 0x7f0e300b5da0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.411+0000 7f0e3898a640 10 monclient(hunting): picked mon.noname-c con 0x7f0e30161640 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.411+0000 7f0e3898a640 10 monclient(hunting): picked mon.noname-b con 0x7f0e30161a10 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.411+0000 7f0e3898a640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e3013a820 con 0x7f0e300b5da0 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.411+0000 7f0e3898a640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e3013ab00 con 0x7f0e30161a10 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.411+0000 7f0e3898a640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e3013ade0 con 0x7f0e30161640 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.411+0000 7f0e3898a640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.411+0000 7f0e3898a640 10 monclient(hunting): authenticate will time out at 3672.093367s 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.413+0000 7f861effd640 1 -- 10.20.193.26:0/4066647443 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1677513310 0 0) 0x7f8604003610 con 0x7f86200b9f80 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.413+0000 7f861effd640 1 -- 10.20.193.26:0/4066647443 >> v1:10.20.193.103:6789/0 conn(0x7f86200ba350 legacy=0x7f8620057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.413+0000 7f861effd640 1 -- 10.20.193.26:0/4066647443 >> v1:10.20.193.26:6789/0 conn(0x7f86200585e0 legacy=0x7f8620166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.413+0000 7f861effd640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.413+0000 7f861effd640 1 monclient: found mon.noname-b 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.413+0000 7f861effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.413+0000 7f861effd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.413+0000 7f861effd640 1 -- 10.20.193.26:0/4066647443 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86200573f0 con 0x7f86200b9f80 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.413+0000 7f861effd640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.413+0000 7f861effd640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.413+0000 7f861effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.413+0000 7f861effd640 1 -- 10.20.193.26:0/4066647443 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f860c002df0 con 0x7f86200b9f80 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.413+0000 7f861effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.413+0000 7f861effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.413+0000 7f861effd640 10 monclient: dump: 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.413+0000 7f86262e1640 5 monclient: authenticate success, global_id 4399 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.413+0000 7f86262e1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.415+0000 7f75effff640 10 client.?.objecter ms_handle_connect 0x7f76140b0fa0 2026-02-24T19:18:09.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.415+0000 7f75effff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.418+0000 7f35e5ffb640 1 -- 10.20.193.26:0/1250925434 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1580351296 0 0) 0x7f35d4003610 con 0x7f35e80585e0 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.418+0000 7f35e5ffb640 1 -- 10.20.193.26:0/1250925434 >> v1:10.20.193.70:6789/0 conn(0x7f35e80ba350 legacy=0x7f35e8057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.418+0000 7f35e5ffb640 1 -- 10.20.193.26:0/1250925434 >> v1:10.20.193.26:6789/0 conn(0x7f35e80b9f80 legacy=0x7f35e8163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.418+0000 7f35e5ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.418+0000 7f35e5ffb640 1 monclient: found mon.noname-c 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.418+0000 7f35e5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.418+0000 7f35e5ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.418+0000 7f35e5ffb640 1 -- 10.20.193.26:0/1250925434 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e80573f0 con 0x7f35e80585e0 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.418+0000 7f35e5ffb640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.418+0000 7f35e5ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.418+0000 7f35e5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.418+0000 7f35e5ffb640 1 -- 10.20.193.26:0/1250925434 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f35d8003170 con 0x7f35e80585e0 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.418+0000 7f35e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.418+0000 7f35e5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.418+0000 7f35e5ffb640 10 monclient: dump: 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.418+0000 7f35ed767640 5 monclient: authenticate success, global_id 4421 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.418+0000 7f35ed767640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.418+0000 7f0caffff640 1 -- 10.20.193.26:0/2370175587 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2008166466 0 0) 0x7f0cd81fb140 con 0x7f0cd80b9f80 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.418+0000 7f0caffff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.418+0000 7f0caffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.418+0000 7f0caffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.418+0000 7f0caffff640 10 monclient(hunting): my global_id is 4436 2026-02-24T19:18:09.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.418+0000 7f0caffff640 1 -- 10.20.193.26:0/2370175587 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cd8156bc0 con 0x7f0cd80b9f80 2026-02-24T19:18:09.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f82e5ffb640 1 -- 10.20.193.26:0/1472319506 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1132513312 0 0) 0x7f82d4003610 con 0x7f82e80b9f80 2026-02-24T19:18:09.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f82e5ffb640 1 -- 10.20.193.26:0/1472319506 >> v1:10.20.193.103:6789/0 conn(0x7f82e80ba350 legacy=0x7f82e8057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f82e5ffb640 1 -- 10.20.193.26:0/1472319506 >> v1:10.20.193.26:6789/0 conn(0x7f82e80585e0 legacy=0x7f82e8166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f82e5ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f82e5ffb640 1 monclient: found mon.noname-b 2026-02-24T19:18:09.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f82e5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f82e5ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f82e5ffb640 1 -- 10.20.193.26:0/1472319506 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e80573f0 con 0x7f82e80b9f80 2026-02-24T19:18:09.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f82e5ffb640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f82e5ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f82e5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f82e5ffb640 1 -- 10.20.193.26:0/1472319506 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f82dc002df0 con 0x7f82e80b9f80 2026-02-24T19:18:09.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f82e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f82e5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:09.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f82e5ffb640 10 monclient: dump: 2026-02-24T19:18:09.466 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.466 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.466 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.466 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.466 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.466 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.466 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.466 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.466 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.466 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f82eda32640 5 monclient: authenticate success, global_id 4396 2026-02-24T19:18:09.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f82eda32640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f70d5573640 1 -- 10.20.193.26:0/2388437027 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 752163773 0 0) 0x7f70d8163bb0 con 0x7f70d80585e0 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f70d5573640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f70d5573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f70d5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f70d5573640 10 monclient(hunting): my global_id is 4423 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f70d5573640 1 -- 10.20.193.26:0/2388437027 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70c0002910 con 0x7f70d80585e0 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f28e5ffb640 1 -- 10.20.193.26:0/3557509455 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2636468018 0 0) 0x7f28d4003610 con 0x7f28e80b91f0 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f28e5ffb640 1 -- 10.20.193.26:0/3557509455 >> v1:10.20.193.103:6789/0 conn(0x7f28e8159b40 legacy=0x7f28e8163270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f28e5ffb640 1 -- 10.20.193.26:0/3557509455 >> v1:10.20.193.26:6789/0 conn(0x7f28e8057500 legacy=0x7f28e80b8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f28e5ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f28e5ffb640 1 monclient: found mon.noname-b 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f28e5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f28e5ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f28e5ffb640 1 -- 10.20.193.26:0/3557509455 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e80b4470 con 0x7f28e80b91f0 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f28e5ffb640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f28e5ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f28e5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f28e5ffb640 1 -- 10.20.193.26:0/3557509455 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f28d0002df0 con 0x7f28e80b91f0 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f28e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f28e5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f28e5ffb640 10 monclient: dump: 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.467 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f28e7fff640 5 monclient: authenticate success, global_id 4408 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.419+0000 7f28e7fff640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.420+0000 7f612dd74640 1 -- 10.20.193.26:0/1751168399 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3414092880 0 0) 0x7f6130163e90 con 0x7f61300ba350 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.420+0000 7f612dd74640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.420+0000 7f612dd74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.420+0000 7f612dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.420+0000 7f612dd74640 10 monclient(hunting): my global_id is 4442 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.420+0000 7f612dd74640 1 -- 10.20.193.26:0/1751168399 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f611c003610 con 0x7f61300ba350 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.421+0000 7f6bca7fc640 1 -- 10.20.193.26:0/835935887 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1918736233 0 0) 0x7f6bac003610 con 0x7f6bdc166f60 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.421+0000 7f6bca7fc640 1 -- 10.20.193.26:0/835935887 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6bdc160170 con 0x7f6bdc166f60 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.421+0000 7f6bca7fc640 1 -- 10.20.193.26:0/835935887 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6bd8003420 con 0x7f6bdc166f60 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.421+0000 7f6bca7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.421+0000 7f6bca7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.421+0000 7f6bca7fc640 10 monclient(hunting): dump: 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.421+0000 7f6bca7fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.421+0000 7f89a67fc640 1 -- 10.20.193.26:0/2820215762 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f899c003380 con 0x7f89a80585e0 2026-02-24T19:18:09.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.421+0000 7f2abeffd640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f2ac0161800 0x7f2ac00afcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:55608/0 (socket says 10.20.193.26:55608) 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.421+0000 7f2abeffd640 1 -- 10.20.193.26:0/1231125686 learned_addr learned my addr 10.20.193.26:0/1231125686 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.421+0000 7f89a67fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.421+0000 7f89a67fc640 1 -- 10.20.193.26:0/2820215762 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f899c0037c0 con 0x7f89a80585e0 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.421+0000 7f89a67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.421+0000 7f89a67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.421+0000 7f89a67fc640 10 monclient: dump: 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.421+0000 7f89ae1c0640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.421+0000 7f89ae1c0640 4 set_mon_vals no callback set 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.421+0000 7f75effff640 1 -- 10.20.193.26:0/4132827319 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3878805813 0 0) 0x7f7614132890 con 0x7f76140b2920 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.421+0000 7f75effff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.421+0000 7f75effff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.421+0000 7f75effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.421+0000 7f75effff640 10 monclient(hunting): my global_id is 4439 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.421+0000 7f75effff640 1 -- 10.20.193.26:0/4132827319 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75e4003610 con 0x7f76140b2920 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7fb6a67fc640 1 -- 10.20.193.26:0/975393179 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1625482489 0 0) 0x7fb6a8163bb0 con 0x7fb6a80ba350 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7fb6a67fc640 1 -- 10.20.193.26:0/975393179 >> v1:10.20.193.70:6789/0 conn(0x7fb6a80b9f80 legacy=0x7fb6a8163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7fb6a67fc640 1 -- 10.20.193.26:0/975393179 >> v1:10.20.193.26:6789/0 conn(0x7fb6a80585e0 legacy=0x7fb6a8166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7fb6a67fc640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7fb6a67fc640 1 monclient: found mon.noname-c 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7fb6a67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7fb6a67fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7fb6a67fc640 1 -- 10.20.193.26:0/975393179 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a80573f0 con 0x7fb6a80ba350 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7fb6a67fc640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7fb6a67fc640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7fb6a67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7fb6a67fc640 1 -- 10.20.193.26:0/975393179 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fb698002df0 con 0x7fb6a80ba350 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7fb6a67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7fb6a67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7fb6a67fc640 10 monclient: dump: 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7fb6ae10a640 5 monclient: authenticate success, global_id 4418 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7f89ae1c0640 10 monclient: shutdown 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7fb6ae10a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7f89ae1c0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7f89ae1c0640 1 -- 10.20.193.26:0/2820215762 >> v1:10.20.193.103:6789/0 conn(0x7f89a80585e0 legacy=0x7f89a8166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7f89ae1c0640 1 -- 10.20.193.26:0/2820215762 shutdown_connections 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7f89ae1c0640 1 -- 10.20.193.26:0/2820215762 >> 10.20.193.26:0/2820215762 conn(0x7f89a80b7990 msgr2=0x7f89a80b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7f89ae1c0640 1 -- 10.20.193.26:0/2820215762 shutdown_connections 2026-02-24T19:18:09.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7f89ae1c0640 1 -- 10.20.193.26:0/2820215762 wait complete. 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7f2a9bfff640 10 client.?.objecter ms_handle_connect 0x7f2ac0161800 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7f2a9bfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7f89ae1c0640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7f89ae1c0640 10 monclient: monmap: 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7f89ae1c0640 1 librados: starting msgr at 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7f89ae1c0640 1 librados: starting objecter 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7f89ae1c0640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7f89ae1c0640 1 Processor -- start 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7f89ae1c0640 1 -- start start 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7f89ae1c0640 1 librados: setting wanted keys 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7f89ae1c0640 1 librados: calling monclient init 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.422+0000 7f89ae1c0640 10 monclient: init 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f646c9af640 1 -- 10.20.193.26:0/1132198546 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1349768497 0 0) 0x7f6464002c90 con 0x7f64680ba350 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f646c9af640 1 -- 10.20.193.26:0/1132198546 >> v1:10.20.193.70:6789/0 conn(0x7f64680b9f80 legacy=0x7f6468163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f646c9af640 1 -- 10.20.193.26:0/1132198546 >> v1:10.20.193.26:6789/0 conn(0x7f64680585e0 legacy=0x7f6468166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f646c9af640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f646c9af640 1 monclient: found mon.noname-c 2026-02-24T19:18:09.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f646c9af640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f646c9af640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f646c9af640 1 -- 10.20.193.26:0/1132198546 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64680573f0 con 0x7f64680ba350 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f646c9af640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f646c9af640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f646c9af640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f646c9af640 1 -- 10.20.193.26:0/1132198546 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f645c002df0 con 0x7f64680ba350 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f646c9af640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f646c9af640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f646c9af640 10 monclient: dump: 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f646fc3c640 5 monclient: authenticate success, global_id 4430 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f646fc3c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f89ae1c0640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f89ae1c0640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f89ae1c0640 10 monclient(hunting): picked mon.noname-b con 0x7f89a80585e0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f89ae1c0640 10 monclient(hunting): picked mon.noname-c con 0x7f89a80b9f80 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f89ae1c0640 10 monclient(hunting): picked mon.noname-a con 0x7f89a80ba350 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f89ae1c0640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a81fee00 con 0x7f89a80ba350 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f89ae1c0640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a8160320 con 0x7f89a80585e0 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f50a8fc0640 1 -- 10.20.193.26:0/2423784747 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5098002fc0 con 0x7f50a40ba350 2026-02-24T19:18:09.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f50a8fc0640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f89ae1c0640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a8160600 con 0x7f89a80b9f80 2026-02-24T19:18:09.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f89ae1c0640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f89ae1c0640 10 monclient(hunting): authenticate will time out at 3672.105588s 2026-02-24T19:18:09.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f50a8fc0640 1 -- 10.20.193.26:0/2423784747 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f5098003400 con 0x7f50a40ba350 2026-02-24T19:18:09.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f50a8fc0640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f50a8fc0640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f50a8fc0640 10 monclient: dump: 2026-02-24T19:18:09.473 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.473 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.473 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.473 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.473 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.473 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.473 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.473 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.473 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.473 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f50ac24d640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f50ac24d640 4 set_mon_vals no callback set 2026-02-24T19:18:09.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f612dd74640 1 -- 10.20.193.26:0/1751168399 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 457089063 0 0) 0x7f6130163bb0 con 0x7f61300b9f80 2026-02-24T19:18:09.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f612dd74640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f612dd74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f612dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f612dd74640 10 monclient(hunting): my global_id is 4429 2026-02-24T19:18:09.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f612dd74640 1 -- 10.20.193.26:0/1751168399 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6130163e90 con 0x7f61300b9f80 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f0caffff640 1 -- 10.20.193.26:0/2370175587 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1253474602 0 0) 0x7f0cd81ff450 con 0x7f0cd80585e0 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f0caffff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f0caffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f0caffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f0caffff640 10 monclient(hunting): my global_id is 4426 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f0caffff640 1 -- 10.20.193.26:0/2370175587 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cd81fb140 con 0x7f0cd80585e0 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f7aecd74640 1 -- 10.20.193.26:0/3080506142 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3796551846 0 0) 0x7f7ae8163930 con 0x7f7ae8058070 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f7aecd74640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f7aecd74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f7aecd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f7aecd74640 10 monclient(hunting): my global_id is 4434 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.423+0000 7f7aecd74640 1 -- 10.20.193.26:0/3080506142 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ae8163ed0 con 0x7f7ae8058070 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.424+0000 7f50ac24d640 10 monclient: shutdown 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.424+0000 7f50ac24d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.424+0000 7f50ac24d640 1 -- 10.20.193.26:0/2423784747 >> v1:10.20.193.103:6789/0 conn(0x7f50a40ba350 legacy=0x7f50a4057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.424+0000 7f6bca7fc640 1 -- 10.20.193.26:0/835935887 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 476734096 0 0) 0x7f6bdc160450 con 0x7f6bdc15d070 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.424+0000 7f6bca7fc640 1 -- 10.20.193.26:0/835935887 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6bac003610 con 0x7f6bdc15d070 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.424+0000 7f6bca7fc640 1 -- 10.20.193.26:0/835935887 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6bcc002d00 con 0x7f6bdc15d070 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.424+0000 7f6bca7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.424+0000 7f6bca7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.424+0000 7f6bca7fc640 10 monclient(hunting): dump: 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.474 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.475 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.424+0000 7f50ac24d640 1 -- 10.20.193.26:0/2423784747 shutdown_connections 2026-02-24T19:18:09.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.424+0000 7f50ac24d640 1 -- 10.20.193.26:0/2423784747 >> 10.20.193.26:0/2423784747 conn(0x7f50a40b7990 msgr2=0x7f50a40b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.424+0000 7f50ac24d640 1 -- 10.20.193.26:0/2423784747 shutdown_connections 2026-02-24T19:18:09.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.424+0000 7f50ac24d640 1 -- 10.20.193.26:0/2423784747 wait complete. 2026-02-24T19:18:09.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.424+0000 7f2a9bfff640 10 client.?.objecter ms_handle_connect 0x7f2ac0161430 2026-02-24T19:18:09.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.424+0000 7f2a9bfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.424+0000 7f2a9bfff640 10 client.?.objecter ms_handle_connect 0x7f2ac016ad30 2026-02-24T19:18:09.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.424+0000 7f2a9bfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.424+0000 7f50ac24d640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.424+0000 7f50ac24d640 10 monclient: monmap: 2026-02-24T19:18:09.475 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.475 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.475 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.475 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.475 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.475 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.475 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.475 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.475 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.475 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f50ac24d640 1 librados: starting msgr at 2026-02-24T19:18:09.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f50ac24d640 1 librados: starting objecter 2026-02-24T19:18:09.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f50ac24d640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f50ac24d640 1 Processor -- start 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f50ac24d640 1 -- start start 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f50ac24d640 1 librados: setting wanted keys 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f50ac24d640 1 librados: calling monclient init 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f50ac24d640 10 monclient: init 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f7aecd74640 1 -- 10.20.193.26:0/3080506142 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2043110838 0 0) 0x7f7ad0003610 con 0x7f7ae8159e40 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f7aecd74640 1 -- 10.20.193.26:0/3080506142 >> v1:10.20.193.103:6789/0 conn(0x7f7ae8159a70 legacy=0x7f7ae80b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f7aecd74640 1 -- 10.20.193.26:0/3080506142 >> v1:10.20.193.26:6789/0 conn(0x7f7ae8058070 legacy=0x7f7ae8058460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f7aecd74640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f7aecd74640 1 monclient: found mon.noname-b 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f7aecd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f7aecd74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f7aecd74640 1 -- 10.20.193.26:0/3080506142 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae8057590 con 0x7f7ae8159e40 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f7aecd74640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f7aecd74640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f7aecd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f7aecd74640 1 -- 10.20.193.26:0/3080506142 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7adc002df0 con 0x7f7ae8159e40 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f7aecd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f7aecd74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f7aecd74640 10 monclient: dump: 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f7af0001640 5 monclient: authenticate success, global_id 4417 2026-02-24T19:18:09.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f7af0001640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f50ac24d640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f50ac24d640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:18:09.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f50ac24d640 10 monclient(hunting): picked mon.noname-b con 0x7f50a40585e0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f50ac24d640 10 monclient(hunting): picked mon.noname-c con 0x7f50a40b9f80 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f50ac24d640 10 monclient(hunting): picked mon.noname-a con 0x7f50a40ba350 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f50ac24d640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50a4161500 con 0x7f50a40ba350 2026-02-24T19:18:09.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f50ac24d640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50a415f760 con 0x7f50a40585e0 2026-02-24T19:18:09.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f50ac24d640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50a415fa40 con 0x7f50a40b9f80 2026-02-24T19:18:09.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f50ac24d640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.425+0000 7f50ac24d640 10 monclient(hunting): authenticate will time out at 3672.107943s 2026-02-24T19:18:09.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.426+0000 7f35e5ffb640 1 -- 10.20.193.26:0/1250925434 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f35d8003340 con 0x7f35e80585e0 2026-02-24T19:18:09.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.426+0000 7f35e5ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.426+0000 7f35e5ffb640 1 -- 10.20.193.26:0/1250925434 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f35d8003780 con 0x7f35e80585e0 2026-02-24T19:18:09.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.426+0000 7f35e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.426+0000 7f35e5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.426+0000 7f35e5ffb640 10 monclient: dump: 2026-02-24T19:18:09.477 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.477 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.477 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.477 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.477 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.477 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.477 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.478 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.478 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.478 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.478 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.426+0000 7f35ed767640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.478 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.426+0000 7f35ed767640 4 set_mon_vals no callback set 2026-02-24T19:18:09.478 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.426+0000 7f35ed767640 10 monclient: shutdown 2026-02-24T19:18:09.478 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.426+0000 7f35ed767640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.478 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.426+0000 7f35ed767640 1 -- 10.20.193.26:0/1250925434 >> v1:10.20.193.103:6789/0 conn(0x7f35e80585e0 legacy=0x7f35e8166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.478 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.426+0000 7f35ed767640 1 -- 10.20.193.26:0/1250925434 shutdown_connections 2026-02-24T19:18:09.478 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.426+0000 7f35ed767640 1 -- 10.20.193.26:0/1250925434 >> 10.20.193.26:0/1250925434 conn(0x7f35e80b7990 msgr2=0x7f35e80b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.478 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f35ed767640 1 -- 10.20.193.26:0/1250925434 shutdown_connections 2026-02-24T19:18:09.478 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f35ed767640 1 -- 10.20.193.26:0/1250925434 wait complete. 2026-02-24T19:18:09.478 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f0e36f00640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f0e30161a10 0x7f0e3014bb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:59596/0 (socket says 10.20.193.26:59596) 2026-02-24T19:18:09.478 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f0e36f00640 1 -- 10.20.193.26:0/664289147 learned_addr learned my addr 10.20.193.26:0/664289147 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.478 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f75effff640 1 -- 10.20.193.26:0/4132827319 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 514622534 0 0) 0x7f7614132080 con 0x7f76140b0fa0 2026-02-24T19:18:09.478 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f75effff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.478 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f75effff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.478 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f75effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.478 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f75effff640 10 monclient(hunting): my global_id is 4432 2026-02-24T19:18:09.478 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f75effff640 1 -- 10.20.193.26:0/4132827319 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7614132890 con 0x7f76140b0fa0 2026-02-24T19:18:09.478 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f75effff640 10 client.?.objecter ms_handle_connect 0x7f761415d410 2026-02-24T19:18:09.478 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f75effff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.478 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f0e1affd640 10 client.?.objecter ms_handle_connect 0x7f0e30161a10 2026-02-24T19:18:09.478 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f0e1affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f82e5ffb640 1 -- 10.20.193.26:0/1472319506 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f82dc002fc0 con 0x7f82e80b9f80 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f82e5ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f82e5ffb640 1 -- 10.20.193.26:0/1472319506 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f82dc003400 con 0x7f82e80b9f80 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f82e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f82e5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f82e5ffb640 10 monclient: dump: 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f82eda32640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f82eda32640 4 set_mon_vals no callback set 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f35ed767640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f35ed767640 10 monclient: monmap: 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f0caffff640 1 -- 10.20.193.26:0/2370175587 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2560450278 0 0) 0x7f0cd8156bc0 con 0x7f0cd80b9f80 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f0caffff640 1 -- 10.20.193.26:0/2370175587 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0cd81ff450 con 0x7f0cd80b9f80 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f0caffff640 1 -- 10.20.193.26:0/2370175587 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f0cc0002ed0 con 0x7f0cd80b9f80 2026-02-24T19:18:09.479 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f0caffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.480 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f0caffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.480 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f0caffff640 10 monclient(hunting): dump: 2026-02-24T19:18:09.480 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.480 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.480 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.480 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.480 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.480 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.480 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.480 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.480 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.480 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.480 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f0caffff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:09.480 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f70d5573640 1 -- 10.20.193.26:0/2388437027 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 698862936 0 0) 0x7f70d8163e90 con 0x7f70d80b9f80 2026-02-24T19:18:09.480 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f70d5573640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.480 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f70d5573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.480 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f70d5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.480 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f70d5573640 10 monclient(hunting): my global_id is 4445 2026-02-24T19:18:09.480 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f70d5573640 1 -- 10.20.193.26:0/2388437027 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70d8163bb0 con 0x7f70d80b9f80 2026-02-24T19:18:09.480 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f35ed767640 1 librados: starting msgr at 2026-02-24T19:18:09.480 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f35ed767640 1 librados: starting objecter 2026-02-24T19:18:09.480 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.427+0000 7f35ed767640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.480 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.428+0000 7f35ed767640 1 Processor -- start 2026-02-24T19:18:09.480 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.428+0000 7f35ed767640 1 -- start start 2026-02-24T19:18:09.480 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.428+0000 7f35ed767640 1 librados: setting wanted keys 2026-02-24T19:18:09.480 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.428+0000 7f35ed767640 1 librados: calling monclient init 2026-02-24T19:18:09.480 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.428+0000 7f35ed767640 10 monclient: init 2026-02-24T19:18:09.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.428+0000 7f82eda32640 10 monclient: shutdown 2026-02-24T19:18:09.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.428+0000 7f82eda32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.428+0000 7f82eda32640 1 -- 10.20.193.26:0/1472319506 >> v1:10.20.193.70:6789/0 conn(0x7f82e80b9f80 legacy=0x7f82e8163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.428+0000 7f82eda32640 1 -- 10.20.193.26:0/1472319506 shutdown_connections 2026-02-24T19:18:09.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.428+0000 7f82eda32640 1 -- 10.20.193.26:0/1472319506 >> 10.20.193.26:0/1472319506 conn(0x7f82e80b7990 msgr2=0x7f82e80b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.428+0000 7f82eda32640 1 -- 10.20.193.26:0/1472319506 shutdown_connections 2026-02-24T19:18:09.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.428+0000 7f82eda32640 1 -- 10.20.193.26:0/1472319506 wait complete. 2026-02-24T19:18:09.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.428+0000 7f35ed767640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.428+0000 7f35ed767640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:18:09.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.428+0000 7f35ed767640 10 monclient(hunting): picked mon.noname-c con 0x7f35e80585e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.428+0000 7f35ed767640 10 monclient(hunting): picked mon.noname-a con 0x7f35e80b9f80 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.428+0000 7f35ed767640 10 monclient(hunting): picked mon.noname-b con 0x7f35e80ba350 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.428+0000 7f35ed767640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e81fef50 con 0x7f35e80b9f80 2026-02-24T19:18:09.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.428+0000 7f35ed767640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e81605d0 con 0x7f35e80ba350 2026-02-24T19:18:09.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.428+0000 7f35ed767640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e81608b0 con 0x7f35e80585e0 2026-02-24T19:18:09.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.428+0000 7f35ed767640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.428+0000 7f35ed767640 10 monclient(hunting): authenticate will time out at 3672.110655s 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.428+0000 7f82eda32640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.428+0000 7f82eda32640 10 monclient: monmap: 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.429+0000 7f82eda32640 1 librados: starting msgr at 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.429+0000 7f82eda32640 1 librados: starting objecter 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.429+0000 7f82eda32640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.429+0000 7f0caffff640 1 -- 10.20.193.26:0/2370175587 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3237617637 0 0) 0x7f0ca8003610 con 0x7f0cd80ba350 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.429+0000 7f0caffff640 1 -- 10.20.193.26:0/2370175587 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0cd8156bc0 con 0x7f0cd80ba350 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.429+0000 7f0caffff640 1 -- 10.20.193.26:0/2370175587 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f0cc8003420 con 0x7f0cd80ba350 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.429+0000 7f0caffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.429+0000 7f0caffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.429+0000 7f82eda32640 1 Processor -- start 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.429+0000 7f0caffff640 10 monclient(hunting): dump: 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.482 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.429+0000 7f82eda32640 1 -- start start 2026-02-24T19:18:09.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.429+0000 7f82eda32640 1 librados: setting wanted keys 2026-02-24T19:18:09.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.429+0000 7f82eda32640 1 librados: calling monclient init 2026-02-24T19:18:09.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.429+0000 7f82eda32640 10 monclient: init 2026-02-24T19:18:09.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.429+0000 7f0e1affd640 10 client.?.objecter ms_handle_connect 0x7f0e30161640 2026-02-24T19:18:09.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.429+0000 7f0e1affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.429+0000 7f82eda32640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.429+0000 7f82eda32640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:18:09.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.429+0000 7f82eda32640 10 monclient(hunting): picked mon.noname-a con 0x7f82e80585e0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.429+0000 7f82eda32640 10 monclient(hunting): picked mon.noname-b con 0x7f82e80b9f80 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.429+0000 7f82eda32640 10 monclient(hunting): picked mon.noname-c con 0x7f82e80ba350 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.429+0000 7f82eda32640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82e8161500 con 0x7f82e80585e0 2026-02-24T19:18:09.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.429+0000 7f82eda32640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82e815f760 con 0x7f82e80b9f80 2026-02-24T19:18:09.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.429+0000 7f82eda32640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82e815fa40 con 0x7f82e80ba350 2026-02-24T19:18:09.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.429+0000 7f82eda32640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.429+0000 7f82eda32640 10 monclient(hunting): authenticate will time out at 3672.111830s 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.430+0000 7f861effd640 1 -- 10.20.193.26:0/4066647443 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f860c002fc0 con 0x7f86200b9f80 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.430+0000 7f861effd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.430+0000 7f861effd640 1 -- 10.20.193.26:0/4066647443 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f860c003400 con 0x7f86200b9f80 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.430+0000 7f86262e1640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.430+0000 7f86262e1640 4 set_mon_vals no callback set 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.430+0000 7f861effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.430+0000 7f861effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.430+0000 7f861effd640 10 monclient: dump: 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.431+0000 7f86262e1640 10 monclient: shutdown 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.431+0000 7f86262e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.431+0000 7f86262e1640 1 -- 10.20.193.26:0/4066647443 >> v1:10.20.193.70:6789/0 conn(0x7f86200b9f80 legacy=0x7f8620163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.431+0000 7f86262e1640 1 -- 10.20.193.26:0/4066647443 shutdown_connections 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.431+0000 7f86262e1640 1 -- 10.20.193.26:0/4066647443 >> 10.20.193.26:0/4066647443 conn(0x7f86200b7990 msgr2=0x7f86200b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.431+0000 7f86262e1640 1 -- 10.20.193.26:0/4066647443 shutdown_connections 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.431+0000 7f86262e1640 1 -- 10.20.193.26:0/4066647443 wait complete. 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.431+0000 7f86262e1640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.431+0000 7f86262e1640 10 monclient: monmap: 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.484 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.485 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.485 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.431+0000 7f6bca7fc640 1 -- 10.20.193.26:0/835935887 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2250675446 0 0) 0x7f6bac003610 con 0x7f6bdc15d070 2026-02-24T19:18:09.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.431+0000 7f6bca7fc640 1 -- 10.20.193.26:0/835935887 >> v1:10.20.193.103:6789/0 conn(0x7f6bdc166f60 legacy=0x7f6bdc0ac450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.431+0000 7f6bca7fc640 1 -- 10.20.193.26:0/835935887 >> v1:10.20.193.70:6789/0 conn(0x7f6bdc15d440 legacy=0x7f6bdc0aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.431+0000 7f6bca7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.431+0000 7f6bca7fc640 1 monclient: found mon.a 2026-02-24T19:18:09.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.431+0000 7f6bca7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.431+0000 7f6bca7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.431+0000 7f6bca7fc640 1 -- 10.20.193.26:0/835935887 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bdc160a10 con 0x7f6bdc15d070 2026-02-24T19:18:09.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.431+0000 7f6bca7fc640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.431+0000 7f6bca7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.431+0000 7f6bca7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.431+0000 7f6be3b83640 5 monclient: authenticate success, global_id 4401 2026-02-24T19:18:09.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.431+0000 7f6be3b83640 10 monclient: _renew_subs 2026-02-24T19:18:09.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.431+0000 7f86262e1640 1 librados: starting msgr at 2026-02-24T19:18:09.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f86262e1640 1 librados: starting objecter 2026-02-24T19:18:09.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f6be3b83640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f6be3b83640 1 -- 10.20.193.26:0/835935887 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6bdc0aafe0 con 0x7f6bdc15d070 2026-02-24T19:18:09.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f86262e1640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f86262e1640 1 Processor -- start 2026-02-24T19:18:09.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f6be3b83640 10 client.4401.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f6be3b83640 10 monclient: _renew_subs 2026-02-24T19:18:09.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f6be3b83640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f6be3b83640 1 -- 10.20.193.26:0/835935887 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6bdc0acd40 con 0x7f6bdc15d070 2026-02-24T19:18:09.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f6be3b83640 1 librados: init done 2026-02-24T19:18:09.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f86262e1640 1 -- start start 2026-02-24T19:18:09.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f86262e1640 1 librados: setting wanted keys 2026-02-24T19:18:09.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f86262e1640 1 librados: calling monclient init 2026-02-24T19:18:09.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f86262e1640 10 monclient: init 2026-02-24T19:18:09.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f28e5ffb640 1 -- 10.20.193.26:0/3557509455 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f28d0002fc0 con 0x7f28e80b91f0 2026-02-24T19:18:09.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f28e5ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f28e5ffb640 1 -- 10.20.193.26:0/3557509455 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f28d0003400 con 0x7f28e80b91f0 2026-02-24T19:18:09.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f28e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f28e5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f28e5ffb640 10 monclient: dump: 2026-02-24T19:18:09.486 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.486 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.486 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.486 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.486 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.486 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.486 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.486 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.486 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.486 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f28e7fff640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f28e7fff640 4 set_mon_vals no callback set 2026-02-24T19:18:09.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f86262e1640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f86262e1640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:18:09.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f86262e1640 10 monclient(hunting): picked mon.noname-c con 0x7f86200585e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f86262e1640 10 monclient(hunting): picked mon.noname-a con 0x7f86200b9f80 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f86262e1640 10 monclient(hunting): picked mon.noname-b con 0x7f86200ba350 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f86262e1640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f862015eff0 con 0x7f86200b9f80 2026-02-24T19:18:09.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f86262e1640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f862015f2d0 con 0x7f86200ba350 2026-02-24T19:18:09.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f86262e1640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f862015f5b0 con 0x7f86200585e0 2026-02-24T19:18:09.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f6be3b83640 10 client.4401.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f86262e1640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f86262e1640 10 monclient(hunting): authenticate will time out at 3672.114703s 2026-02-24T19:18:09.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f6be3b83640 15 client.4401.objecter _session_command_op_assign -1 1 2026-02-24T19:18:09.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f6be3b83640 20 client.4401.objecter _get_session osd=-1 returning homeless 2026-02-24T19:18:09.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f6be3b83640 10 client.4401.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f6be3b83640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f6be3b83640 1 -- 10.20.193.26:0/835935887 --> v1:10.20.193.26:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f6bdc160c50 con 0x7f6bdc15d070 2026-02-24T19:18:09.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f28e7fff640 10 monclient: shutdown 2026-02-24T19:18:09.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f28e7fff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f28e7fff640 1 -- 10.20.193.26:0/3557509455 >> v1:10.20.193.70:6789/0 conn(0x7f28e80b91f0 legacy=0x7f28e8159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f28e7fff640 1 -- 10.20.193.26:0/3557509455 shutdown_connections 2026-02-24T19:18:09.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f28e7fff640 1 -- 10.20.193.26:0/3557509455 >> 10.20.193.26:0/3557509455 conn(0x7f28e80b7730 msgr2=0x7f28e80b7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.432+0000 7f28e7fff640 1 -- 10.20.193.26:0/3557509455 shutdown_connections 2026-02-24T19:18:09.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.433+0000 7f28e7fff640 1 -- 10.20.193.26:0/3557509455 wait complete. 2026-02-24T19:18:09.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.433+0000 7f28e7fff640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.433+0000 7f28e7fff640 10 monclient: monmap: 2026-02-24T19:18:09.488 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.488 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.488 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.488 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.488 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.488 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.488 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.488 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.488 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.488 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.433+0000 7f28e7fff640 1 librados: starting msgr at 2026-02-24T19:18:09.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.433+0000 7f28e7fff640 1 librados: starting objecter 2026-02-24T19:18:09.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.433+0000 7f28e7fff640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.433+0000 7f28e7fff640 1 Processor -- start 2026-02-24T19:18:09.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.433+0000 7f28e7fff640 1 -- start start 2026-02-24T19:18:09.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.433+0000 7f28e7fff640 1 librados: setting wanted keys 2026-02-24T19:18:09.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.433+0000 7f28e7fff640 1 librados: calling monclient init 2026-02-24T19:18:09.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.433+0000 7f28e7fff640 10 monclient: init 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f612dd74640 1 -- 10.20.193.26:0/1751168399 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 587733781 0 0) 0x7f6130163e90 con 0x7f61300b9f80 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f612dd74640 1 -- 10.20.193.26:0/1751168399 >> v1:10.20.193.103:6789/0 conn(0x7f61300ba350 legacy=0x7f6130057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f612dd74640 1 -- 10.20.193.26:0/1751168399 >> v1:10.20.193.26:6789/0 conn(0x7f61300585e0 legacy=0x7f6130166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f612dd74640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f612dd74640 1 monclient: found mon.noname-b 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f612dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f612dd74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f612dd74640 1 -- 10.20.193.26:0/1751168399 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61300573f0 con 0x7f61300b9f80 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f612dd74640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f612dd74640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f612dd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f612dd74640 1 -- 10.20.193.26:0/1751168399 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6124002df0 con 0x7f61300b9f80 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f612dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f612dd74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f612dd74640 10 monclient: dump: 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f613507b640 5 monclient: authenticate success, global_id 4429 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f613507b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f28e7fff640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f28e7fff640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:18:09.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f28e7fff640 10 monclient(hunting): picked mon.noname-a con 0x7f28e8057500 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f28e7fff640 10 monclient(hunting): picked mon.noname-b con 0x7f28e80b91f0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f28e7fff640 10 monclient(hunting): picked mon.noname-c con 0x7f28e8159b40 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f28e7fff640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28e8167180 con 0x7f28e8057500 2026-02-24T19:18:09.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f28e7fff640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28e8155f20 con 0x7f28e80b91f0 2026-02-24T19:18:09.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f28e7fff640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28e8164490 con 0x7f28e8159b40 2026-02-24T19:18:09.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f28e7fff640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f28e7fff640 10 monclient(hunting): authenticate will time out at 3672.116316s 2026-02-24T19:18:09.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f70d5573640 1 -- 10.20.193.26:0/2388437027 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2113787804 0 0) 0x7f70c0002910 con 0x7f70d80585e0 2026-02-24T19:18:09.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f70d5573640 1 -- 10.20.193.26:0/2388437027 >> v1:10.20.193.103:6789/0 conn(0x7f70d80b9f80 legacy=0x7f70d8163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f70d5573640 1 -- 10.20.193.26:0/2388437027 >> v1:10.20.193.26:6789/0 conn(0x7f70d80ba350 legacy=0x7f70d8057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f70d5573640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f70d5573640 1 monclient: found mon.noname-b 2026-02-24T19:18:09.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f70d5573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f70d5573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f70d5573640 1 -- 10.20.193.26:0/2388437027 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d80573f0 con 0x7f70d80585e0 2026-02-24T19:18:09.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f70d5573640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f70d5573640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f70d5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f70d5573640 1 -- 10.20.193.26:0/2388437027 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f70c8003170 con 0x7f70d80585e0 2026-02-24T19:18:09.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f70dcd33640 5 monclient: authenticate success, global_id 4423 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f70dcd33640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f70d5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f70d5573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f70d5573640 10 monclient: dump: 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.434+0000 7f70dcd33640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.436+0000 7f89a6ffd640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f89a80b9f80 0x7f89a81fe6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:55630/0 (socket says 10.20.193.26:55630) 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.436+0000 7f89a6ffd640 1 -- 10.20.193.26:0/989299693 learned_addr learned my addr 10.20.193.26:0/989299693 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.436+0000 7f2a9bfff640 1 -- 10.20.193.26:0/1231125686 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2583595207 0 0) 0x7f2ac015dca0 con 0x7f2ac0161800 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.436+0000 7f2a9bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.436+0000 7f2a9bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.436+0000 7f2a9bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.436+0000 7f2a9bfff640 10 monclient(hunting): my global_id is 4448 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.436+0000 7f2a9bfff640 1 -- 10.20.193.26:0/1231125686 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a90003610 con 0x7f2ac0161800 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.437+0000 7f50a97c1640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f50a40b9f80 0x7f50a41564b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:55644/0 (socket says 10.20.193.26:55644) 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.437+0000 7f50a97c1640 1 -- 10.20.193.26:0/2908256076 learned_addr learned my addr 10.20.193.26:0/2908256076 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.437+0000 7f8983fff640 10 client.?.objecter ms_handle_connect 0x7f89a80b9f80 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.437+0000 7f8983fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.439+0000 7f2a9bfff640 1 -- 10.20.193.26:0/1231125686 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2860461896 0 0) 0x7f2ac015d6e0 con 0x7f2ac016ad30 2026-02-24T19:18:09.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.439+0000 7f2a9bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.439+0000 7f2a9bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.439+0000 7f2a9bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.439+0000 7f2a9bfff640 10 monclient(hunting): my global_id is 4440 2026-02-24T19:18:09.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.439+0000 7f2a9bfff640 1 -- 10.20.193.26:0/1231125686 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ac015dca0 con 0x7f2ac016ad30 2026-02-24T19:18:09.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.439+0000 7f50927fc640 10 client.?.objecter ms_handle_connect 0x7f50a40b9f80 2026-02-24T19:18:09.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.439+0000 7f50927fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.439+0000 7f8983fff640 10 client.?.objecter ms_handle_connect 0x7f89a80ba350 2026-02-24T19:18:09.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.439+0000 7f8983fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.439+0000 7f7aecd74640 1 -- 10.20.193.26:0/3080506142 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7adc003000 con 0x7f7ae8159e40 2026-02-24T19:18:09.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.439+0000 7f7aecd74640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.439+0000 7f7aecd74640 1 -- 10.20.193.26:0/3080506142 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7adc003400 con 0x7f7ae8159e40 2026-02-24T19:18:09.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.439+0000 7f7aecd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.439+0000 7f7aecd74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.439+0000 7f7aecd74640 10 monclient: dump: 2026-02-24T19:18:09.492 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.492 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.492 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.492 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.492 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.492 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.492 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.492 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.492 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.492 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.439+0000 7f7af0001640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.439+0000 7f7af0001640 4 set_mon_vals no callback set 2026-02-24T19:18:09.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.439+0000 7f35e67fc640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f35e80b9f80 0x7f35e81fe840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:46928/0 (socket says 10.20.193.26:46928) 2026-02-24T19:18:09.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.439+0000 7f35e67fc640 1 -- 10.20.193.26:0/2813836055 learned_addr learned my addr 10.20.193.26:0/2813836055 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.439+0000 7f35c77fe640 10 client.?.objecter ms_handle_connect 0x7f35e80b9f80 2026-02-24T19:18:09.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.440+0000 7f35c77fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.440+0000 7f7af0001640 10 monclient: shutdown 2026-02-24T19:18:09.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.440+0000 7f7af0001640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.440+0000 7f7af0001640 1 -- 10.20.193.26:0/3080506142 >> v1:10.20.193.70:6789/0 conn(0x7f7ae8159e40 legacy=0x7f7ae8163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.440+0000 7f7af0001640 1 -- 10.20.193.26:0/3080506142 shutdown_connections 2026-02-24T19:18:09.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.440+0000 7f7af0001640 1 -- 10.20.193.26:0/3080506142 >> 10.20.193.26:0/3080506142 conn(0x7f7ae80b7780 msgr2=0x7f7ae80b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.440+0000 7f7af0001640 1 -- 10.20.193.26:0/3080506142 shutdown_connections 2026-02-24T19:18:09.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.440+0000 7f7af0001640 1 -- 10.20.193.26:0/3080506142 wait complete. 2026-02-24T19:18:09.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.440+0000 7f7af0001640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.440+0000 7f7af0001640 10 monclient: monmap: 2026-02-24T19:18:09.493 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.493 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.493 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.493 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.493 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.493 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.493 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.493 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.493 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.493 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.441+0000 7f75effff640 1 -- 10.20.193.26:0/4132827319 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2646878302 0 0) 0x7f75e4003610 con 0x7f76140b2920 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.441+0000 7f75effff640 1 -- 10.20.193.26:0/4132827319 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7614132080 con 0x7f76140b2920 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.441+0000 7f75effff640 1 -- 10.20.193.26:0/4132827319 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7604003090 con 0x7f76140b2920 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.441+0000 7f75effff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.441+0000 7f75effff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.441+0000 7f75effff640 10 monclient(hunting): dump: 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.441+0000 7f75effff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.441+0000 7f7af0001640 1 librados: starting msgr at 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.441+0000 7f7af0001640 1 librados: starting objecter 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.441+0000 7fb6a67fc640 1 -- 10.20.193.26:0/975393179 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb698002fc0 con 0x7fb6a80ba350 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.441+0000 7fb6a67fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.441+0000 7fb6a67fc640 1 -- 10.20.193.26:0/975393179 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fb698003400 con 0x7fb6a80ba350 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.441+0000 7fb6a67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.441+0000 7fb6a67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.441+0000 7fb6a67fc640 10 monclient: dump: 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.494 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.495 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.495 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.495 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.441+0000 7fb6ae10a640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.441+0000 7fb6ae10a640 4 set_mon_vals no callback set 2026-02-24T19:18:09.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.441+0000 7f7af0001640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.441+0000 7f7af0001640 1 Processor -- start 2026-02-24T19:18:09.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.441+0000 7f7af0001640 1 -- start start 2026-02-24T19:18:09.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.441+0000 7f7af0001640 1 librados: setting wanted keys 2026-02-24T19:18:09.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.441+0000 7f7af0001640 1 librados: calling monclient init 2026-02-24T19:18:09.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.441+0000 7f7af0001640 10 monclient: init 2026-02-24T19:18:09.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.441+0000 7fb6ae10a640 10 monclient: shutdown 2026-02-24T19:18:09.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.441+0000 7fb6ae10a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.441+0000 7fb6ae10a640 1 -- 10.20.193.26:0/975393179 >> v1:10.20.193.103:6789/0 conn(0x7fb6a80ba350 legacy=0x7fb6a8057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.441+0000 7fb6ae10a640 1 -- 10.20.193.26:0/975393179 shutdown_connections 2026-02-24T19:18:09.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7fb6ae10a640 1 -- 10.20.193.26:0/975393179 >> 10.20.193.26:0/975393179 conn(0x7fb6a80b7990 msgr2=0x7fb6a80b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7fb6ae10a640 1 -- 10.20.193.26:0/975393179 shutdown_connections 2026-02-24T19:18:09.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f646c9af640 1 -- 10.20.193.26:0/1132198546 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f645c002fc0 con 0x7f64680ba350 2026-02-24T19:18:09.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7fb6ae10a640 1 -- 10.20.193.26:0/975393179 wait complete. 2026-02-24T19:18:09.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f646c9af640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f646c9af640 1 -- 10.20.193.26:0/1132198546 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f645c003400 con 0x7f64680ba350 2026-02-24T19:18:09.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f646fc3c640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f646fc3c640 4 set_mon_vals no callback set 2026-02-24T19:18:09.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f646c9af640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f7af0001640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f7af0001640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:18:09.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f7af0001640 10 monclient(hunting): picked mon.noname-b con 0x7f7ae8058070 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f7af0001640 10 monclient(hunting): picked mon.noname-a con 0x7f7ae8159a70 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f7af0001640 10 monclient(hunting): picked mon.noname-c con 0x7f7ae8159e40 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f7af0001640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ae81603f0 con 0x7f7ae8159a70 2026-02-24T19:18:09.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f7af0001640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ae81fdde0 con 0x7f7ae8058070 2026-02-24T19:18:09.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f7af0001640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ae815e920 con 0x7f7ae8159e40 2026-02-24T19:18:09.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f7af0001640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f7af0001640 10 monclient(hunting): authenticate will time out at 3672.124562s 2026-02-24T19:18:09.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f646c9af640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f646c9af640 10 monclient: dump: 2026-02-24T19:18:09.496 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.496 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.496 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.497 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.497 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.497 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.497 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.497 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.497 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.497 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.497 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f0e1affd640 1 -- 10.20.193.26:0/664289147 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4154906024 0 0) 0x7f0e3013ade0 con 0x7f0e30161640 2026-02-24T19:18:09.497 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f0e1affd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.497 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f0e1affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.497 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f0e1affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.497 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f0e1affd640 10 monclient(hunting): my global_id is 4451 2026-02-24T19:18:09.497 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f0e1affd640 1 -- 10.20.193.26:0/664289147 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e00003610 con 0x7f0e30161640 2026-02-24T19:18:09.497 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7fb6ae10a640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.497 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7fb6ae10a640 10 monclient: monmap: 2026-02-24T19:18:09.497 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.497 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.497 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.497 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.497 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.497 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.497 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.497 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.497 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.497 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.497 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f646fc3c640 10 monclient: shutdown 2026-02-24T19:18:09.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f646fc3c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f646fc3c640 1 -- 10.20.193.26:0/1132198546 >> v1:10.20.193.103:6789/0 conn(0x7f64680ba350 legacy=0x7f6468057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f646fc3c640 1 -- 10.20.193.26:0/1132198546 shutdown_connections 2026-02-24T19:18:09.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f646fc3c640 1 -- 10.20.193.26:0/1132198546 >> 10.20.193.26:0/1132198546 conn(0x7f64680b7990 msgr2=0x7f64680b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f646fc3c640 1 -- 10.20.193.26:0/1132198546 shutdown_connections 2026-02-24T19:18:09.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7f646fc3c640 1 -- 10.20.193.26:0/1132198546 wait complete. 2026-02-24T19:18:09.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7fb6ae10a640 1 librados: starting msgr at 2026-02-24T19:18:09.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7fb6ae10a640 1 librados: starting objecter 2026-02-24T19:18:09.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7fb6ae10a640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.442+0000 7fb6ae10a640 1 Processor -- start 2026-02-24T19:18:09.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7fb6ae10a640 1 -- start start 2026-02-24T19:18:09.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7fb6ae10a640 1 librados: setting wanted keys 2026-02-24T19:18:09.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7fb6ae10a640 1 librados: calling monclient init 2026-02-24T19:18:09.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7fb6ae10a640 10 monclient: init 2026-02-24T19:18:09.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7f646fc3c640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7f646fc3c640 10 monclient: monmap: 2026-02-24T19:18:09.498 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.498 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.498 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.498 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.498 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.498 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.498 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.498 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.498 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.499 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7f646fc3c640 1 librados: starting msgr at 2026-02-24T19:18:09.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7f646fc3c640 1 librados: starting objecter 2026-02-24T19:18:09.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7fb6ae10a640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7f646fc3c640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7f646fc3c640 1 Processor -- start 2026-02-24T19:18:09.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7fb6ae10a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:18:09.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7fb6ae10a640 10 monclient(hunting): picked mon.noname-c con 0x7fb6a80585e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7fb6ae10a640 10 monclient(hunting): picked mon.noname-b con 0x7fb6a80b9f80 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7fb6ae10a640 10 monclient(hunting): picked mon.noname-a con 0x7fb6a80ba350 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7fb6ae10a640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a80b4ea0 con 0x7fb6a80ba350 2026-02-24T19:18:09.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7fb6ae10a640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a80b23b0 con 0x7fb6a80b9f80 2026-02-24T19:18:09.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7fb6ae10a640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a80b2690 con 0x7fb6a80585e0 2026-02-24T19:18:09.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7fb6ae10a640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7fb6ae10a640 10 monclient(hunting): authenticate will time out at 3672.125791s 2026-02-24T19:18:09.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7f646fc3c640 1 -- start start 2026-02-24T19:18:09.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7f646fc3c640 1 librados: setting wanted keys 2026-02-24T19:18:09.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7f646fc3c640 1 librados: calling monclient init 2026-02-24T19:18:09.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7f646fc3c640 10 monclient: init 2026-02-24T19:18:09.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7f2a9bfff640 1 -- 10.20.193.26:0/1231125686 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2570133695 0 0) 0x7f2ac015d9c0 con 0x7f2ac0161430 2026-02-24T19:18:09.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7f2a9bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7f2a9bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7f2a9bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7f2a9bfff640 10 monclient(hunting): my global_id is 4435 2026-02-24T19:18:09.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.443+0000 7f2a9bfff640 1 -- 10.20.193.26:0/1231125686 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ac015d6e0 con 0x7f2ac0161430 2026-02-24T19:18:09.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.444+0000 7f28e6ffd640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f28e8057500 0x7f28e8155810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:46946/0 (socket says 10.20.193.26:46946) 2026-02-24T19:18:09.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.444+0000 7f28e6ffd640 1 -- 10.20.193.26:0/4010354651 learned_addr learned my addr 10.20.193.26:0/4010354651 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.444+0000 7f646fc3c640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.444+0000 7f646fc3c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:18:09.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.444+0000 7f646fc3c640 10 monclient(hunting): picked mon.noname-b con 0x7f64680585e0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.444+0000 7f646fc3c640 10 monclient(hunting): picked mon.noname-c con 0x7f64680b9f80 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.444+0000 7f646fc3c640 10 monclient(hunting): picked mon.noname-a con 0x7f64680ba350 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.444+0000 7f646fc3c640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6468165ee0 con 0x7f64680ba350 2026-02-24T19:18:09.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.444+0000 7f646fc3c640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6468156d30 con 0x7f64680585e0 2026-02-24T19:18:09.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.444+0000 7f646fc3c640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6468166170 con 0x7f64680b9f80 2026-02-24T19:18:09.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.444+0000 7f646fc3c640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.444+0000 7f646fc3c640 10 monclient(hunting): authenticate will time out at 3672.126418s 2026-02-24T19:18:09.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.444+0000 7f0e1affd640 1 -- 10.20.193.26:0/664289147 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 900317005 0 0) 0x7f0e3013ab00 con 0x7f0e30161a10 2026-02-24T19:18:09.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.444+0000 7f0e1affd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.444+0000 7f0e1affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.444+0000 7f0e1affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.444+0000 7f0e1affd640 10 monclient(hunting): my global_id is 4438 2026-02-24T19:18:09.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.444+0000 7f0e1affd640 1 -- 10.20.193.26:0/664289147 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e3013ade0 con 0x7f0e30161a10 2026-02-24T19:18:09.501 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.444+0000 7f2a9bfff640 1 -- 10.20.193.26:0/1231125686 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2447942582 0 0) 0x7f2a90003610 con 0x7f2ac0161800 2026-02-24T19:18:09.501 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.444+0000 7f2a9bfff640 1 -- 10.20.193.26:0/1231125686 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ac015d9c0 con 0x7f2ac0161800 2026-02-24T19:18:09.501 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.444+0000 7f8983fff640 10 client.?.objecter ms_handle_connect 0x7f89a80585e0 2026-02-24T19:18:09.501 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.444+0000 7f8983fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.501 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.444+0000 7f2a9bfff640 1 -- 10.20.193.26:0/1231125686 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2ab0002f90 con 0x7f2ac0161800 2026-02-24T19:18:09.501 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.444+0000 7f2a9bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.501 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.444+0000 7f2a9bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.501 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.444+0000 7f2a9bfff640 10 monclient(hunting): dump: 2026-02-24T19:18:09.501 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.501 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.501 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.501 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.501 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.501 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.501 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.501 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.501 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.501 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.501 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.444+0000 7f2a9bfff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:09.501 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.445+0000 7f75effff640 1 -- 10.20.193.26:0/4132827319 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1321830544 0 0) 0x7f7614132890 con 0x7f76140b0fa0 2026-02-24T19:18:09.501 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.445+0000 7f75effff640 1 -- 10.20.193.26:0/4132827319 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f75e4003610 con 0x7f76140b0fa0 2026-02-24T19:18:09.501 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.445+0000 7f75effff640 1 -- 10.20.193.26:0/4132827319 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f76000031f0 con 0x7f76140b0fa0 2026-02-24T19:18:09.501 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.445+0000 7f75effff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.501 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.445+0000 7f75effff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.501 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.445+0000 7f75effff640 10 monclient(hunting): dump: 2026-02-24T19:18:09.501 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.501 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.502 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.502 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.502 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.502 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.502 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.502 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.502 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.502 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.445+0000 7f28c77fe640 10 client.?.objecter ms_handle_connect 0x7f28e8057500 2026-02-24T19:18:09.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.445+0000 7f28c77fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.445+0000 7f82e67fc640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f82e80b9f80 0x7f82e81564b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:59632/0 (socket says 10.20.193.26:59632) 2026-02-24T19:18:09.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.445+0000 7f82e67fc640 1 -- 10.20.193.26:0/368358355 learned_addr learned my addr 10.20.193.26:0/368358355 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.445+0000 7f35c77fe640 10 client.?.objecter ms_handle_connect 0x7f35e80585e0 2026-02-24T19:18:09.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.445+0000 7f35c77fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.445+0000 7f50927fc640 10 client.?.objecter ms_handle_connect 0x7f50a40585e0 2026-02-24T19:18:09.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.445+0000 7f50927fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.446+0000 7f0e1affd640 10 client.?.objecter ms_handle_connect 0x7f0e300b5da0 2026-02-24T19:18:09.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.446+0000 7f0e1affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.446+0000 7f82bffff640 10 client.?.objecter ms_handle_connect 0x7f82e80b9f80 2026-02-24T19:18:09.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.446+0000 7f82bffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.446+0000 7f0caffff640 1 -- 10.20.193.26:0/2370175587 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2731389114 0 0) 0x7f0cd81ff450 con 0x7f0cd80b9f80 2026-02-24T19:18:09.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.446+0000 7f0caffff640 1 -- 10.20.193.26:0/2370175587 >> v1:10.20.193.70:6789/0 conn(0x7f0cd80585e0 legacy=0x7f0cd80b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.446+0000 7f0caffff640 1 -- 10.20.193.26:0/2370175587 >> v1:10.20.193.26:6789/0 conn(0x7f0cd80ba350 legacy=0x7f0cd8158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.446+0000 7f0caffff640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.446+0000 7f0caffff640 1 monclient: found mon.c 2026-02-24T19:18:09.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.446+0000 7f0caffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.446+0000 7f0caffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.446+0000 7f0caffff640 1 -- 10.20.193.26:0/2370175587 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd81fb420 con 0x7f0cd80b9f80 2026-02-24T19:18:09.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.446+0000 7f0caffff640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.446+0000 7f0caffff640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.446+0000 7f0caffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.446+0000 7f0cdd83c640 5 monclient: authenticate success, global_id 4436 2026-02-24T19:18:09.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.446+0000 7f0cdd83c640 10 monclient: _renew_subs 2026-02-24T19:18:09.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.446+0000 7f0cdd83c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.446+0000 7f0cdd83c640 1 -- 10.20.193.26:0/2370175587 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd81fb700 con 0x7f0cd80b9f80 2026-02-24T19:18:09.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.446+0000 7f0cdd83c640 10 client.4436.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.446+0000 7f0cdd83c640 10 monclient: _renew_subs 2026-02-24T19:18:09.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.446+0000 7f0cdd83c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.446+0000 7f0cdd83c640 1 -- 10.20.193.26:0/2370175587 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0cd81fbcc0 con 0x7f0cd80b9f80 2026-02-24T19:18:09.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.446+0000 7f0cdd83c640 1 librados: init done 2026-02-24T19:18:09.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.447+0000 7f0cdd83c640 10 client.4436.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.447+0000 7f0cdd83c640 15 client.4436.objecter _session_command_op_assign -1 1 2026-02-24T19:18:09.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.447+0000 7f0cdd83c640 20 client.4436.objecter _get_session osd=-1 returning homeless 2026-02-24T19:18:09.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.447+0000 7f0cdd83c640 10 client.4436.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.447+0000 7f0cdd83c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.447+0000 7f0cdd83c640 1 -- 10.20.193.26:0/2370175587 --> v1:10.20.193.103:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f0cd80b9170 con 0x7f0cd80b9f80 2026-02-24T19:18:09.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.447+0000 7f75effff640 1 -- 10.20.193.26:0/4132827319 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3767733754 0 0) 0x7f761412fc10 con 0x7f761415d410 2026-02-24T19:18:09.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.447+0000 7f75effff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.447+0000 7f75effff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.447+0000 7f75effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.447+0000 7f75effff640 10 monclient(hunting): my global_id is 4443 2026-02-24T19:18:09.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.447+0000 7f75effff640 1 -- 10.20.193.26:0/4132827319 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7614132890 con 0x7f761415d410 2026-02-24T19:18:09.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.448+0000 7f861f7fe640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f86200b9f80 0x7f8620157b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:46942/0 (socket says 10.20.193.26:46942) 2026-02-24T19:18:09.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.448+0000 7f861f7fe640 1 -- 10.20.193.26:0/1159143980 learned_addr learned my addr 10.20.193.26:0/1159143980 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.448+0000 7f50927fc640 1 -- 10.20.193.26:0/2908256076 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3208997758 0 0) 0x7f50a415fa40 con 0x7f50a40b9f80 2026-02-24T19:18:09.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.448+0000 7f50927fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.448+0000 7f50927fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.448+0000 7f50927fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.448+0000 7f50927fc640 10 monclient(hunting): my global_id is 4457 2026-02-24T19:18:09.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.448+0000 7f50927fc640 1 -- 10.20.193.26:0/2908256076 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5074003610 con 0x7f50a40b9f80 2026-02-24T19:18:09.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.449+0000 7f35c77fe640 10 client.?.objecter ms_handle_connect 0x7f35e80ba350 2026-02-24T19:18:09.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.449+0000 7f35c77fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.449+0000 7f28c77fe640 10 client.?.objecter ms_handle_connect 0x7f28e80b91f0 2026-02-24T19:18:09.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.449+0000 7f28c77fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.449+0000 7f70d5573640 1 -- 10.20.193.26:0/2388437027 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f70c8003380 con 0x7f70d80585e0 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.449+0000 7f70d5573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.449+0000 7f70d5573640 1 -- 10.20.193.26:0/2388437027 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f70c8003780 con 0x7f70d80585e0 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.449+0000 7f70dcd33640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.449+0000 7f70dcd33640 4 set_mon_vals no callback set 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.449+0000 7f70d5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.449+0000 7f70d5573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.449+0000 7f70d5573640 10 monclient: dump: 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.450+0000 7f70dcd33640 10 monclient: shutdown 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.450+0000 7f70dcd33640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.450+0000 7f70dcd33640 1 -- 10.20.193.26:0/2388437027 >> v1:10.20.193.70:6789/0 conn(0x7f70d80585e0 legacy=0x7f70d8166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.450+0000 7f70dcd33640 1 -- 10.20.193.26:0/2388437027 shutdown_connections 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.450+0000 7f70dcd33640 1 -- 10.20.193.26:0/2388437027 >> 10.20.193.26:0/2388437027 conn(0x7f70d80b7990 msgr2=0x7f70d80b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.450+0000 7f70dcd33640 1 -- 10.20.193.26:0/2388437027 shutdown_connections 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.450+0000 7f70dcd33640 1 -- 10.20.193.26:0/2388437027 wait complete. 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.450+0000 7f8983fff640 1 -- 10.20.193.26:0/989299693 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1648094090 0 0) 0x7f89a8160600 con 0x7f89a80b9f80 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.450+0000 7f8983fff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.450+0000 7f8983fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.450+0000 7f8983fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.506 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.450+0000 7f8983fff640 10 monclient(hunting): my global_id is 4454 2026-02-24T19:18:09.506 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.450+0000 7f8983fff640 1 -- 10.20.193.26:0/989299693 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8978003610 con 0x7f89a80b9f80 2026-02-24T19:18:09.506 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.450+0000 7f7aee577640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f7ae8159e40 0x7f7ae81582a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:55710/0 (socket says 10.20.193.26:55710) 2026-02-24T19:18:09.506 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.450+0000 7f7aee577640 1 -- 10.20.193.26:0/3517643153 learned_addr learned my addr 10.20.193.26:0/3517643153 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.506 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.451+0000 7f70dcd33640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.506 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.451+0000 7f70dcd33640 10 monclient: monmap: 2026-02-24T19:18:09.506 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.506 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.506 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.506 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.506 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.506 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.506 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.506 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.506 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.506 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.506 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.451+0000 7f70dcd33640 1 librados: starting msgr at 2026-02-24T19:18:09.506 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.451+0000 7f70dcd33640 1 librados: starting objecter 2026-02-24T19:18:09.506 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.451+0000 7f70dcd33640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.506 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.451+0000 7f70dcd33640 1 Processor -- start 2026-02-24T19:18:09.506 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.451+0000 7f70dcd33640 1 -- start start 2026-02-24T19:18:09.506 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.451+0000 7f70dcd33640 1 librados: setting wanted keys 2026-02-24T19:18:09.506 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.451+0000 7f70dcd33640 1 librados: calling monclient init 2026-02-24T19:18:09.506 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.451+0000 7f70dcd33640 10 monclient: init 2026-02-24T19:18:09.507 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.451+0000 7f6bca7fc640 1 -- 10.20.193.26:0/835935887 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6bcc002f00 con 0x7f6bdc15d070 2026-02-24T19:18:09.507 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.451+0000 7f6bca7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.507 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.451+0000 7f6bca7fc640 1 -- 10.20.193.26:0/835935887 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6bcc004d20 con 0x7f6bdc15d070 2026-02-24T19:18:09.507 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.451+0000 7f6bca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.507 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.451+0000 7f6bca7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:09.507 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.451+0000 7f6bcbfff640 4 set_mon_vals no callback set 2026-02-24T19:18:09.507 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.451+0000 7f6bca7fc640 10 monclient: dump: 2026-02-24T19:18:09.507 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.507 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.507 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.507 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.507 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.507 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.507 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.507 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.507 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.507 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.507 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.451+0000 7f7ad67fc640 10 client.?.objecter ms_handle_connect 0x7f7ae8159e40 2026-02-24T19:18:09.507 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.451+0000 7f7ad67fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.507 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.451+0000 7f70dcd33640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.507 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.451+0000 7f70dcd33640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:18:09.507 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.451+0000 7f70dcd33640 10 monclient(hunting): picked mon.noname-b con 0x7f70d80585e0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.507 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.452+0000 7f70dcd33640 10 monclient(hunting): picked mon.noname-a con 0x7f70d80b9f80 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.508 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.452+0000 7f70dcd33640 10 monclient(hunting): picked mon.noname-c con 0x7f70d80ba350 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.508 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.452+0000 7f70dcd33640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70d8159ea0 con 0x7f70d80b9f80 2026-02-24T19:18:09.508 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.452+0000 7f70dcd33640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70d81fb450 con 0x7f70d80585e0 2026-02-24T19:18:09.508 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.452+0000 7f70dcd33640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70d81fb730 con 0x7f70d80ba350 2026-02-24T19:18:09.508 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.452+0000 7f70dcd33640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.508 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.452+0000 7f70dcd33640 10 monclient(hunting): authenticate will time out at 3672.134151s 2026-02-24T19:18:09.508 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.452+0000 7f6bca7fc640 1 -- 10.20.193.26:0/835935887 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f6bcc01db90 con 0x7f6bdc15d070 2026-02-24T19:18:09.508 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.453+0000 7f6be10f7640 10 monclient: get_auth_request con 0x7f6bac077d30 auth_method 0 2026-02-24T19:18:09.508 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.453+0000 7f6bca7fc640 10 client.4401.objecter ms_handle_connect 0x7f6bac077d30 2026-02-24T19:18:09.508 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.453+0000 7f82bffff640 1 -- 10.20.193.26:0/368358355 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 57107844 0 0) 0x7f82e815f760 con 0x7f82e80b9f80 2026-02-24T19:18:09.508 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.453+0000 7f82bffff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.508 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.453+0000 7f82bffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.508 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.453+0000 7f82bffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.508 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.453+0000 7f82bffff640 10 monclient(hunting): my global_id is 4447 2026-02-24T19:18:09.508 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.453+0000 7f82bffff640 1 -- 10.20.193.26:0/368358355 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82b8003610 con 0x7f82e80b9f80 2026-02-24T19:18:09.508 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.453+0000 7f861cff9640 10 client.?.objecter ms_handle_connect 0x7f86200ba350 2026-02-24T19:18:09.508 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.453+0000 7f861cff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.508 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.454+0000 7f8983fff640 1 -- 10.20.193.26:0/989299693 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 355912525 0 0) 0x7f89a81fee00 con 0x7f89a80ba350 2026-02-24T19:18:09.508 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.454+0000 7f8983fff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.509 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.454+0000 7f8983fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.509 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.454+0000 7f8983fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.509 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.454+0000 7f8983fff640 10 monclient(hunting): my global_id is 4446 2026-02-24T19:18:09.509 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.454+0000 7f8983fff640 1 -- 10.20.193.26:0/989299693 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89a8160600 con 0x7f89a80ba350 2026-02-24T19:18:09.509 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.454+0000 7f646d1b0640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f64680b9f80 0x7f6468156620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:55724/0 (socket says 10.20.193.26:55724) 2026-02-24T19:18:09.509 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.454+0000 7f646d1b0640 1 -- 10.20.193.26:0/2922835923 learned_addr learned my addr 10.20.193.26:0/2922835923 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.509 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.454+0000 7f82bffff640 10 client.?.objecter ms_handle_connect 0x7f82e80ba350 2026-02-24T19:18:09.509 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.454+0000 7f82bffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.509 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.455+0000 7f6bca7fc640 1 -- 10.20.193.26:0/835935887 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f6bcc093240 con 0x7f6bdc15d070 2026-02-24T19:18:09.509 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.455+0000 7f6bca7fc640 10 client.4401.objecter ms_dispatch2 0x7f6bdc000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:09.509 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.455+0000 7f6bca7fc640 3 client.4401.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:09.509 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.455+0000 7f6bca7fc640 3 client.4401.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:09.509 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.455+0000 7f861cff9640 10 client.?.objecter ms_handle_connect 0x7f86200b9f80 2026-02-24T19:18:09.509 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.455+0000 7f861cff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.455+0000 7f6bca7fc640 10 client.4401.objecter checking command 1 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.455+0000 7f6bca7fc640 20 client.4401.objecter _get_session s=0x7f6bac0a0bb0 osd=1 3 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.455+0000 7f6bca7fc640 20 client.4401.objecter put_session s=0x7f6bac0a0bb0 osd=1 3 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.455+0000 7f6bca7fc640 15 client.4401.objecter _session_command_op_remove -1 1 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.455+0000 7f6bca7fc640 20 client.4401.objecter _get_session s=0x7f6bac0a0bb0 osd=1 3 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.455+0000 7f6bca7fc640 20 client.4401.objecter get_session s=0x7f6bac0a0bb0 osd=1 3 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.455+0000 7f6bca7fc640 15 client.4401.objecter _session_command_op_assign 1 1 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.455+0000 7f6bca7fc640 20 client.4401.objecter put_session s=0x7f6bac0a0bb0 osd=1 4 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.455+0000 7f6bca7fc640 10 client.4401.objecter _send_command 1 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.455+0000 7f6bca7fc640 1 -- 10.20.193.26:0/835935887 --> v1:10.20.193.70:6800/268803542 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6bac0c2e60 con 0x7f6bac0a1260 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.455+0000 7f6bca7fc640 20 client.4401.objecter dump_active .. 0 homeless 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.455+0000 7f6bca7fc640 1 -- 10.20.193.26:0/835935887 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f6bcc0598e0 con 0x7f6bdc15d070 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.455+0000 7f6bca7fc640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.455+0000 7f6be20f9640 10 monclient: get_auth_request con 0x7f6bac0a1260 auth_method 0 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.455+0000 7f612dd74640 1 -- 10.20.193.26:0/1751168399 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6124003000 con 0x7f61300b9f80 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.455+0000 7f612dd74640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.455+0000 7f612dd74640 1 -- 10.20.193.26:0/1751168399 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6124003440 con 0x7f61300b9f80 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.455+0000 7f612dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.455+0000 7f612dd74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.455+0000 7f612dd74640 10 monclient: dump: 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.510 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.456+0000 7f613507b640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.456+0000 7f613507b640 4 set_mon_vals no callback set 2026-02-24T19:18:09.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.456+0000 7f35c77fe640 1 -- 10.20.193.26:0/2813836055 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1178357050 0 0) 0x7f35e81fef50 con 0x7f35e80b9f80 2026-02-24T19:18:09.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.456+0000 7f35c77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.456+0000 7f35c77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.456+0000 7f35c77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.456+0000 7f35c77fe640 10 monclient(hunting): my global_id is 4449 2026-02-24T19:18:09.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.456+0000 7f35c77fe640 1 -- 10.20.193.26:0/2813836055 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35b4003610 con 0x7f35e80b9f80 2026-02-24T19:18:09.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.456+0000 7f613507b640 10 monclient: shutdown 2026-02-24T19:18:09.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.456+0000 7f613507b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.456+0000 7f613507b640 1 -- 10.20.193.26:0/1751168399 >> v1:10.20.193.70:6789/0 conn(0x7f61300b9f80 legacy=0x7f6130163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.456+0000 7f613507b640 1 -- 10.20.193.26:0/1751168399 shutdown_connections 2026-02-24T19:18:09.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.456+0000 7f613507b640 1 -- 10.20.193.26:0/1751168399 >> 10.20.193.26:0/1751168399 conn(0x7f61300b7990 msgr2=0x7f61300b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.456+0000 7f2a9bfff640 1 -- 10.20.193.26:0/1231125686 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2704324672 0 0) 0x7f2ac015dca0 con 0x7f2ac016ad30 2026-02-24T19:18:09.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.456+0000 7f613507b640 1 -- 10.20.193.26:0/1751168399 shutdown_connections 2026-02-24T19:18:09.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.456+0000 7f613507b640 1 -- 10.20.193.26:0/1751168399 wait complete. 2026-02-24T19:18:09.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.456+0000 7f2a9bfff640 1 -- 10.20.193.26:0/1231125686 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2a90003610 con 0x7f2ac016ad30 2026-02-24T19:18:09.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.456+0000 7f2a9bfff640 1 -- 10.20.193.26:0/1231125686 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2ab4003080 con 0x7f2ac016ad30 2026-02-24T19:18:09.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.456+0000 7f2a9bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.456+0000 7f2a9bfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:09.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.456+0000 7f2a9bfff640 10 monclient(hunting): dump: 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.456+0000 7f64567fc640 10 client.?.objecter ms_handle_connect 0x7f64680b9f80 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.456+0000 7f64567fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f75effff640 1 -- 10.20.193.26:0/4132827319 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3078760323 0 0) 0x7f7614132080 con 0x7f76140b2920 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f75effff640 1 -- 10.20.193.26:0/4132827319 >> v1:10.20.193.70:6789/0 conn(0x7f76140b0fa0 legacy=0x7f761412f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f75effff640 1 -- 10.20.193.26:0/4132827319 >> v1:10.20.193.26:6789/0 conn(0x7f761415d410 legacy=0x7f7614131230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f75effff640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f75effff640 1 monclient: found mon.c 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f75effff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f75effff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f75effff640 1 -- 10.20.193.26:0/4132827319 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7614132b70 con 0x7f76140b2920 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f75effff640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f75effff640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f75effff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f7619b7f640 5 monclient: authenticate success, global_id 4439 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f7619b7f640 10 monclient: _renew_subs 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f7619b7f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f7619b7f640 1 -- 10.20.193.26:0/4132827319 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7614132e50 con 0x7f76140b2920 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f7619b7f640 10 client.4439.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f7619b7f640 10 monclient: _renew_subs 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f7619b7f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f7619b7f640 1 -- 10.20.193.26:0/4132827319 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7614133f40 con 0x7f76140b2920 2026-02-24T19:18:09.513 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f7619b7f640 1 librados: init done 2026-02-24T19:18:09.513 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f50927fc640 10 client.?.objecter ms_handle_connect 0x7f50a40ba350 2026-02-24T19:18:09.513 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f50927fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.513 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f613507b640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.513 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f613507b640 10 monclient: monmap: 2026-02-24T19:18:09.513 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.513 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.513 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.513 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.513 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.513 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.513 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.513 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.513 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.513 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.513 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f613507b640 1 librados: starting msgr at 2026-02-24T19:18:09.513 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f613507b640 1 librados: starting objecter 2026-02-24T19:18:09.513 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f613507b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.513 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f613507b640 1 Processor -- start 2026-02-24T19:18:09.513 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f613507b640 1 -- start start 2026-02-24T19:18:09.513 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f613507b640 1 librados: setting wanted keys 2026-02-24T19:18:09.513 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f613507b640 1 librados: calling monclient init 2026-02-24T19:18:09.513 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f613507b640 10 monclient: init 2026-02-24T19:18:09.513 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f6bca7fc640 10 client.4401.objecter ms_handle_connect 0x7f6bac0a1260 2026-02-24T19:18:09.513 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f8983fff640 1 -- 10.20.193.26:0/989299693 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3150895606 0 0) 0x7f8978003610 con 0x7f89a80b9f80 2026-02-24T19:18:09.514 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f8983fff640 1 -- 10.20.193.26:0/989299693 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89a81fee00 con 0x7f89a80b9f80 2026-02-24T19:18:09.514 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f8983fff640 1 -- 10.20.193.26:0/989299693 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f89980030f0 con 0x7f89a80b9f80 2026-02-24T19:18:09.514 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f7619b7f640 10 client.4439.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.514 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f7619b7f640 15 client.4439.objecter _session_command_op_assign -1 1 2026-02-24T19:18:09.514 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f7619b7f640 20 client.4439.objecter _get_session osd=-1 returning homeless 2026-02-24T19:18:09.514 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f7619b7f640 10 client.4439.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.514 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f7619b7f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.514 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f7619b7f640 1 -- 10.20.193.26:0/4132827319 --> v1:10.20.193.103:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f76140b4940 con 0x7f76140b2920 2026-02-24T19:18:09.514 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f8983fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.514 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f8983fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.514 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f8983fff640 10 monclient(hunting): dump: 2026-02-24T19:18:09.514 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.514 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.514 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.514 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.514 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.514 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.514 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.514 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.514 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.514 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.514 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.457+0000 7f8983fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:09.514 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.458+0000 7f613507b640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.514 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.458+0000 7f613507b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:18:09.514 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.458+0000 7f613507b640 10 monclient(hunting): picked mon.noname-c con 0x7f61300585e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.515 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.458+0000 7f613507b640 10 monclient(hunting): picked mon.noname-a con 0x7f61300b9f80 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.515 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.458+0000 7f613507b640 10 monclient(hunting): picked mon.noname-b con 0x7f61300ba350 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.515 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.458+0000 7f613507b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f613015c090 con 0x7f61300b9f80 2026-02-24T19:18:09.515 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.458+0000 7f613507b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61301ff700 con 0x7f61300ba350 2026-02-24T19:18:09.515 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.458+0000 7f613507b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61301ff9e0 con 0x7f61300585e0 2026-02-24T19:18:09.515 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.458+0000 7f613507b640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.515 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.458+0000 7f613507b640 10 monclient(hunting): authenticate will time out at 3672.140263s 2026-02-24T19:18:09.515 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.459+0000 7f861cff9640 10 client.?.objecter ms_handle_connect 0x7f86200585e0 2026-02-24T19:18:09.515 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.459+0000 7f861cff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.515 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.459+0000 7f82bffff640 10 client.?.objecter ms_handle_connect 0x7f82e80585e0 2026-02-24T19:18:09.515 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.459+0000 7f82bffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.515 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.461+0000 7f8983fff640 1 -- 10.20.193.26:0/989299693 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 260780767 0 0) 0x7f89a8160320 con 0x7f89a80585e0 2026-02-24T19:18:09.515 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.461+0000 7f8983fff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.515 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.461+0000 7f8983fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.515 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.461+0000 7f8983fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.515 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.461+0000 7f8983fff640 10 monclient(hunting): my global_id is 4441 2026-02-24T19:18:09.515 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.461+0000 7f8983fff640 1 -- 10.20.193.26:0/989299693 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8978003610 con 0x7f89a80585e0 2026-02-24T19:18:09.515 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.464+0000 7f7ad67fc640 10 client.?.objecter ms_handle_connect 0x7f7ae8058070 2026-02-24T19:18:09.515 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.464+0000 7f7ad67fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.515 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.464+0000 7f35c77fe640 1 -- 10.20.193.26:0/2813836055 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3298966253 0 0) 0x7f35e81605d0 con 0x7f35e80ba350 2026-02-24T19:18:09.515 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.464+0000 7f35c77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.515 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.464+0000 7f35c77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.515 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.464+0000 7f35c77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.515 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.464+0000 7f35c77fe640 10 monclient(hunting): my global_id is 4450 2026-02-24T19:18:09.516 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.464+0000 7f35c77fe640 1 -- 10.20.193.26:0/2813836055 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35e81fef50 con 0x7f35e80ba350 2026-02-24T19:18:09.516 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.464+0000 7f50927fc640 1 -- 10.20.193.26:0/2908256076 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4147283885 0 0) 0x7f50a415f760 con 0x7f50a40585e0 2026-02-24T19:18:09.516 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.464+0000 7f50927fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.516 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.464+0000 7f50927fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.516 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.464+0000 7f50927fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.516 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.464+0000 7f50927fc640 10 monclient(hunting): my global_id is 4444 2026-02-24T19:18:09.516 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.464+0000 7f50927fc640 1 -- 10.20.193.26:0/2908256076 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50a415fa40 con 0x7f50a40585e0 2026-02-24T19:18:09.516 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.464+0000 7f861cff9640 1 -- 10.20.193.26:0/1159143980 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1940626412 0 0) 0x7f862015f2d0 con 0x7f86200ba350 2026-02-24T19:18:09.516 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.464+0000 7f861cff9640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.516 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.464+0000 7f861cff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.516 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.464+0000 7f861cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.516 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.464+0000 7f861cff9640 10 monclient(hunting): my global_id is 4456 2026-02-24T19:18:09.516 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.464+0000 7f861cff9640 1 -- 10.20.193.26:0/1159143980 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85f0003610 con 0x7f86200ba350 2026-02-24T19:18:09.516 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.464+0000 7f28c77fe640 1 -- 10.20.193.26:0/4010354651 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 91973800 0 0) 0x7f28e8155f20 con 0x7f28e80b91f0 2026-02-24T19:18:09.516 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.464+0000 7f28c77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.516 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.464+0000 7f28c77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.516 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.464+0000 7f28c77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.516 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.464+0000 7f28c77fe640 10 monclient(hunting): my global_id is 4453 2026-02-24T19:18:09.516 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.464+0000 7f28c77fe640 1 -- 10.20.193.26:0/4010354651 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28b4003610 con 0x7f28e80b91f0 2026-02-24T19:18:09.516 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.465+0000 7f70d6575640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f70d80585e0 0x7f70d8159790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:59704/0 (socket says 10.20.193.26:59704) 2026-02-24T19:18:09.516 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.465+0000 7f70d6575640 1 -- 10.20.193.26:0/2159113441 learned_addr learned my addr 10.20.193.26:0/2159113441 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.516 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.465+0000 7fb6a6ffd640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7fb6a80b9f80 0x7fb6a81fc380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:59682/0 (socket says 10.20.193.26:59682) 2026-02-24T19:18:09.517 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.465+0000 7fb6a6ffd640 1 -- 10.20.193.26:0/4238003527 learned_addr learned my addr 10.20.193.26:0/4238003527 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.517 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.466+0000 7f70beffd640 10 client.?.objecter ms_handle_connect 0x7f70d80585e0 2026-02-24T19:18:09.517 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.466+0000 7f70beffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.517 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.466+0000 7fb683fff640 10 client.?.objecter ms_handle_connect 0x7fb6a80b9f80 2026-02-24T19:18:09.517 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.466+0000 7fb683fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.517 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.466+0000 7f64567fc640 10 client.?.objecter ms_handle_connect 0x7f64680585e0 2026-02-24T19:18:09.517 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.466+0000 7f64567fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.517 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.467+0000 7f2a9bfff640 1 -- 10.20.193.26:0/1231125686 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 279255315 0 0) 0x7f2ac015d6e0 con 0x7f2ac0161430 2026-02-24T19:18:09.517 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.467+0000 7f2a9bfff640 1 -- 10.20.193.26:0/1231125686 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ac015dca0 con 0x7f2ac0161430 2026-02-24T19:18:09.517 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.467+0000 7f2a9bfff640 1 -- 10.20.193.26:0/1231125686 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2aac002fb0 con 0x7f2ac0161430 2026-02-24T19:18:09.517 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.467+0000 7f2a9bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.517 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.467+0000 7f2a9bfff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.517 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.467+0000 7f2a9bfff640 10 monclient(hunting): dump: 2026-02-24T19:18:09.517 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.517 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.517 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.517 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.517 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.517 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.517 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.517 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.517 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.517 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.518 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.468+0000 7f0e1affd640 1 -- 10.20.193.26:0/664289147 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 722414873 0 0) 0x7f0e3013ade0 con 0x7f0e30161a10 2026-02-24T19:18:09.518 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.468+0000 7f0e1affd640 1 -- 10.20.193.26:0/664289147 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0e3013ab00 con 0x7f0e30161a10 2026-02-24T19:18:09.518 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.468+0000 7f0e1affd640 1 -- 10.20.193.26:0/664289147 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f0e240033d0 con 0x7f0e30161a10 2026-02-24T19:18:09.518 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.468+0000 7f0e1affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.518 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.468+0000 7f0e1affd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:09.518 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.468+0000 7f0e1affd640 10 monclient(hunting): dump: 2026-02-24T19:18:09.518 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.518 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.518 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.518 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.518 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.518 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.518 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.518 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.518 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.518 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.518 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.468+0000 7f0e1affd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:09.518 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.469+0000 7f28c77fe640 1 -- 10.20.193.26:0/4010354651 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2964729644 0 0) 0x7f28e8167180 con 0x7f28e8057500 2026-02-24T19:18:09.518 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.469+0000 7f28c77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.518 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.469+0000 7f28c77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.518 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.469+0000 7f28c77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.518 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.469+0000 7f28c77fe640 10 monclient(hunting): my global_id is 4455 2026-02-24T19:18:09.518 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.469+0000 7f28c77fe640 1 -- 10.20.193.26:0/4010354651 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28e8155f20 con 0x7f28e8057500 2026-02-24T19:18:09.518 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.469+0000 7f861cff9640 1 -- 10.20.193.26:0/1159143980 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3247636378 0 0) 0x7f862015eff0 con 0x7f86200b9f80 2026-02-24T19:18:09.518 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.469+0000 7f861cff9640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.518 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.469+0000 7f861cff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.519 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.469+0000 7f861cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.519 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.469+0000 7f861cff9640 10 monclient(hunting): my global_id is 4458 2026-02-24T19:18:09.519 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.469+0000 7f861cff9640 1 -- 10.20.193.26:0/1159143980 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f862015f2d0 con 0x7f86200b9f80 2026-02-24T19:18:09.519 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.469+0000 7f0e1affd640 1 -- 10.20.193.26:0/664289147 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3971833570 0 0) 0x7f0e3013a820 con 0x7f0e300b5da0 2026-02-24T19:18:09.519 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.469+0000 7f0e1affd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.519 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.469+0000 7f0e1affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.519 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.469+0000 7f0e1affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.519 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.469+0000 7f0e1affd640 10 monclient(hunting): my global_id is 4452 2026-02-24T19:18:09.519 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.469+0000 7f0e1affd640 1 -- 10.20.193.26:0/664289147 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e3013ade0 con 0x7f0e300b5da0 2026-02-24T19:18:09.519 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.469+0000 7f50927fc640 1 -- 10.20.193.26:0/2908256076 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3246430358 0 0) 0x7f50a4161500 con 0x7f50a40ba350 2026-02-24T19:18:09.519 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.469+0000 7f50927fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.519 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.469+0000 7f50927fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.519 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.469+0000 7f50927fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.519 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.469+0000 7f50927fc640 10 monclient(hunting): my global_id is 4461 2026-02-24T19:18:09.519 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.469+0000 7f50927fc640 1 -- 10.20.193.26:0/2908256076 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50a415f760 con 0x7f50a40ba350 2026-02-24T19:18:09.519 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.470+0000 7f82bffff640 1 -- 10.20.193.26:0/368358355 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 590917621 0 0) 0x7f82b8003610 con 0x7f82e80b9f80 2026-02-24T19:18:09.519 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.470+0000 7f82bffff640 1 -- 10.20.193.26:0/368358355 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82e815f760 con 0x7f82e80b9f80 2026-02-24T19:18:09.519 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.470+0000 7f82bffff640 1 -- 10.20.193.26:0/368358355 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f82d00030f0 con 0x7f82e80b9f80 2026-02-24T19:18:09.519 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.470+0000 7f82bffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.519 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.470+0000 7f82bffff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:09.519 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.470+0000 7f82bffff640 10 monclient(hunting): dump: 2026-02-24T19:18:09.519 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.519 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.519 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.519 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.519 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.519 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.520 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.520 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.520 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.520 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.520 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.470+0000 7f82bffff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:09.520 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.470+0000 7f612e575640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f61300b9f80 0x7f613015b980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:47006/0 (socket says 10.20.193.26:47006) 2026-02-24T19:18:09.520 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.470+0000 7f612e575640 1 -- 10.20.193.26:0/1994107782 learned_addr learned my addr 10.20.193.26:0/1994107782 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.520 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.471+0000 7f64567fc640 10 client.?.objecter ms_handle_connect 0x7f64680ba350 2026-02-24T19:18:09.520 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.471+0000 7f64567fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.520 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.471+0000 7f7ad67fc640 10 client.?.objecter ms_handle_connect 0x7f7ae8159a70 2026-02-24T19:18:09.520 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.471+0000 7f7ad67fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.520 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.471+0000 7f610f7fe640 10 client.?.objecter ms_handle_connect 0x7f61300b9f80 2026-02-24T19:18:09.520 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.471+0000 7f610f7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.520 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.472+0000 7f82bffff640 1 -- 10.20.193.26:0/368358355 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4080165288 0 0) 0x7f82e8161500 con 0x7f82e80585e0 2026-02-24T19:18:09.520 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.472+0000 7f82bffff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.520 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.472+0000 7f82bffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.520 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.472+0000 7f82bffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.520 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.472+0000 7f82bffff640 10 monclient(hunting): my global_id is 4464 2026-02-24T19:18:09.520 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.472+0000 7f82bffff640 1 -- 10.20.193.26:0/368358355 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82b8003610 con 0x7f82e80585e0 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.472+0000 7f28c77fe640 10 client.?.objecter ms_handle_connect 0x7f28e8159b40 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.472+0000 7f28c77fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.473+0000 7f0e1affd640 1 -- 10.20.193.26:0/664289147 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3989481093 0 0) 0x7f0e00003610 con 0x7f0e30161640 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.473+0000 7f0e1affd640 1 -- 10.20.193.26:0/664289147 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0e3013a820 con 0x7f0e30161640 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.473+0000 7f0e1affd640 1 -- 10.20.193.26:0/664289147 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f0e1c002ff0 con 0x7f0e30161640 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.473+0000 7f0e1affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.473+0000 7f0e1affd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.473+0000 7f0e1affd640 10 monclient(hunting): dump: 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f8983fff640 1 -- 10.20.193.26:0/989299693 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3689510631 0 0) 0x7f89a8160600 con 0x7f89a80ba350 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f8983fff640 1 -- 10.20.193.26:0/989299693 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89a8160320 con 0x7f89a80ba350 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f8983fff640 1 -- 10.20.193.26:0/989299693 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f899c003530 con 0x7f89a80ba350 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f8983fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f8983fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f8983fff640 10 monclient(hunting): dump: 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.521 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.522 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.522 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.522 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.522 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.522 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f35c77fe640 1 -- 10.20.193.26:0/2813836055 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2866890962 0 0) 0x7f35b4003610 con 0x7f35e80b9f80 2026-02-24T19:18:09.522 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f35c77fe640 1 -- 10.20.193.26:0/2813836055 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f35e81605d0 con 0x7f35e80b9f80 2026-02-24T19:18:09.522 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f35c77fe640 1 -- 10.20.193.26:0/2813836055 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f35d00030c0 con 0x7f35e80b9f80 2026-02-24T19:18:09.522 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f35c77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.522 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f35c77fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:09.522 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f35c77fe640 10 monclient(hunting): dump: 2026-02-24T19:18:09.522 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.522 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.522 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.522 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.522 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.522 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.522 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.522 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.522 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.522 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.522 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f35c77fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:09.522 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f2a9bfff640 1 -- 10.20.193.26:0/1231125686 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3053841956 0 0) 0x7f2a90003610 con 0x7f2ac016ad30 2026-02-24T19:18:09.522 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f2a9bfff640 1 -- 10.20.193.26:0/1231125686 >> v1:10.20.193.103:6789/0 conn(0x7f2ac0161800 legacy=0x7f2ac00afcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.522 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f2a9bfff640 1 -- 10.20.193.26:0/1231125686 >> v1:10.20.193.70:6789/0 conn(0x7f2ac0161430 legacy=0x7f2ac0163140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f2a9bfff640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f2a9bfff640 1 monclient: found mon.a 2026-02-24T19:18:09.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f2a9bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f2a9bfff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f2a9bfff640 1 -- 10.20.193.26:0/1231125686 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac015df80 con 0x7f2ac016ad30 2026-02-24T19:18:09.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f2a9bfff640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f2a9bfff640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f2a9bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f2ac6213640 5 monclient: authenticate success, global_id 4440 2026-02-24T19:18:09.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f2ac6213640 10 monclient: _renew_subs 2026-02-24T19:18:09.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f2ac6213640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f2ac6213640 1 -- 10.20.193.26:0/1231125686 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2ac015e260 con 0x7f2ac016ad30 2026-02-24T19:18:09.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f2ac6213640 10 client.4440.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f2ac6213640 10 monclient: _renew_subs 2026-02-24T19:18:09.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f2ac6213640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f2ac6213640 1 -- 10.20.193.26:0/1231125686 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2ac012abd0 con 0x7f2ac016ad30 2026-02-24T19:18:09.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f2ac6213640 1 librados: init done 2026-02-24T19:18:09.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f70beffd640 10 client.?.objecter ms_handle_connect 0x7f70d80ba350 2026-02-24T19:18:09.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f70beffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f7ad67fc640 1 -- 10.20.193.26:0/3517643153 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4169320213 0 0) 0x7f7ae815e920 con 0x7f7ae8159e40 2026-02-24T19:18:09.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f7ad67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f7ad67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f7ad67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f7ad67fc640 10 monclient(hunting): my global_id is 4463 2026-02-24T19:18:09.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.474+0000 7f7ad67fc640 1 -- 10.20.193.26:0/3517643153 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ab8003610 con 0x7f7ae8159e40 2026-02-24T19:18:09.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.475+0000 7f64567fc640 1 -- 10.20.193.26:0/2922835923 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1867834034 0 0) 0x7f6468166170 con 0x7f64680b9f80 2026-02-24T19:18:09.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.475+0000 7f64567fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.524 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.475+0000 7f64567fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.524 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.475+0000 7f64567fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.524 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.475+0000 7f64567fc640 10 monclient(hunting): my global_id is 4469 2026-02-24T19:18:09.524 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.475+0000 7f64567fc640 1 -- 10.20.193.26:0/2922835923 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6438003610 con 0x7f64680b9f80 2026-02-24T19:18:09.524 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.475+0000 7f2ac6213640 10 client.4440.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.524 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.475+0000 7f2ac6213640 15 client.4440.objecter _session_command_op_assign -1 1 2026-02-24T19:18:09.524 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.475+0000 7f2ac6213640 20 client.4440.objecter _get_session osd=-1 returning homeless 2026-02-24T19:18:09.524 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.475+0000 7f2ac6213640 10 client.4440.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.524 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.475+0000 7fb683fff640 10 client.?.objecter ms_handle_connect 0x7fb6a80ba350 2026-02-24T19:18:09.524 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.475+0000 7fb683fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.524 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.475+0000 7f2ac6213640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.524 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.475+0000 7f2ac6213640 1 -- 10.20.193.26:0/1231125686 --> v1:10.20.193.26:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f2ac0055d30 con 0x7f2ac016ad30 2026-02-24T19:18:09.524 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.478+0000 7f0caffff640 1 -- 10.20.193.26:0/2370175587 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0cd80b9170 con 0x7f0cd80b9f80 2026-02-24T19:18:09.524 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.478+0000 7f0caffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.524 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.478+0000 7f0caffff640 1 -- 10.20.193.26:0/2370175587 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f0cc0004b80 con 0x7f0cd80b9f80 2026-02-24T19:18:09.524 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.478+0000 7f0caffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.524 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.478+0000 7f0caffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.524 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.478+0000 7f0caffff640 10 monclient: dump: 2026-02-24T19:18:09.524 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.524 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.524 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.524 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.524 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.524 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.524 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.525 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.525 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.525 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.478+0000 7f0cd57fa640 4 set_mon_vals no callback set 2026-02-24T19:18:09.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.479+0000 7f0caffff640 1 -- 10.20.193.26:0/2370175587 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f0cc0004d90 con 0x7f0cd80b9f80 2026-02-24T19:18:09.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.480+0000 7fb683fff640 1 -- 10.20.193.26:0/4238003527 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2687732659 0 0) 0x7fb6a80b23b0 con 0x7fb6a80b9f80 2026-02-24T19:18:09.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.480+0000 7fb683fff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.480+0000 7fb683fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.480+0000 7fb683fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.480+0000 7fb683fff640 10 monclient(hunting): my global_id is 4465 2026-02-24T19:18:09.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.480+0000 7fb683fff640 1 -- 10.20.193.26:0/4238003527 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb678003610 con 0x7fb6a80b9f80 2026-02-24T19:18:09.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.480+0000 7f0cd6ffd640 10 monclient: get_auth_request con 0x7f0ca8077d60 auth_method 0 2026-02-24T19:18:09.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.480+0000 7f0caffff640 10 client.4436.objecter ms_handle_connect 0x7f0ca8077d60 2026-02-24T19:18:09.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.481+0000 7f6bca7fc640 1 -- 10.20.193.26:0/835935887 <== osd.1 v1:10.20.193.70:6800/268803542 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f6bac0c2e60 con 0x7f6bac0a1260 2026-02-24T19:18:09.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.481+0000 7f6bca7fc640 10 client.4401.objecter ms_dispatch2 0x7f6bdc000b90 command_reply(tid 1: 0 ) 2026-02-24T19:18:09.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.481+0000 7f6bca7fc640 10 client.4401.objecter _finish_command 1 = system:0 2026-02-24T19:18:09.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.481+0000 7f6bca7fc640 20 client.4401.objecter put_session s=0x7f6bac0a0bb0 osd=1 4 2026-02-24T19:18:09.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.481+0000 7f6bca7fc640 15 client.4401.objecter _session_command_op_remove 1 1 2026-02-24T19:18:09.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.481+0000 7f0caffff640 1 -- 10.20.193.26:0/2370175587 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f0cc00930f0 con 0x7f0cd80b9f80 2026-02-24T19:18:09.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.481+0000 7f0caffff640 10 client.4436.objecter ms_dispatch2 0x7f0cd8000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:09.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.481+0000 7f0caffff640 3 client.4436.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:09.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.481+0000 7f0caffff640 3 client.4436.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:09.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.481+0000 7f0caffff640 10 client.4436.objecter checking command 1 2026-02-24T19:18:09.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.481+0000 7f0caffff640 20 client.4436.objecter _get_session s=0x7f0ca80a0be0 osd=10 3 2026-02-24T19:18:09.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.481+0000 7f0caffff640 20 client.4436.objecter put_session s=0x7f0ca80a0be0 osd=10 3 2026-02-24T19:18:09.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.481+0000 7f0caffff640 15 client.4436.objecter _session_command_op_remove -1 1 2026-02-24T19:18:09.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.481+0000 7f0caffff640 20 client.4436.objecter _get_session s=0x7f0ca80a0be0 osd=10 3 2026-02-24T19:18:09.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.481+0000 7f0caffff640 20 client.4436.objecter get_session s=0x7f0ca80a0be0 osd=10 3 2026-02-24T19:18:09.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.481+0000 7f0caffff640 15 client.4436.objecter _session_command_op_assign 10 1 2026-02-24T19:18:09.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.481+0000 7f0caffff640 20 client.4436.objecter put_session s=0x7f0ca80a0be0 osd=10 4 2026-02-24T19:18:09.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.481+0000 7f0caffff640 10 client.4436.objecter _send_command 1 2026-02-24T19:18:09.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.481+0000 7f0caffff640 1 -- 10.20.193.26:0/2370175587 --> v1:10.20.193.103:6801/3185480373 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0ca80c2e90 con 0x7f0ca80a1290 2026-02-24T19:18:09.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.481+0000 7f0caffff640 20 client.4436.objecter dump_active .. 0 homeless 2026-02-24T19:18:09.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.481+0000 7f0cd77fe640 10 monclient: get_auth_request con 0x7f0ca80a1290 auth_method 0 2026-02-24T19:18:09.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.482+0000 7f0caffff640 1 -- 10.20.193.26:0/2370175587 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f0cc0059790 con 0x7f0cd80b9f80 2026-02-24T19:18:09.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.482+0000 7f0caffff640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:18:09.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.482+0000 7fb683fff640 10 client.?.objecter ms_handle_connect 0x7fb6a80585e0 2026-02-24T19:18:09.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.482+0000 7fb683fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.482+0000 7f610f7fe640 10 client.?.objecter ms_handle_connect 0x7f61300585e0 2026-02-24T19:18:09.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.482+0000 7f610f7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.483+0000 7f0caffff640 10 client.4436.objecter ms_handle_connect 0x7f0ca80a1290 2026-02-24T19:18:09.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.484+0000 7f70beffd640 10 client.?.objecter ms_handle_connect 0x7f70d80b9f80 2026-02-24T19:18:09.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.484+0000 7f70beffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.484+0000 7f35c77fe640 1 -- 10.20.193.26:0/2813836055 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1906026539 0 0) 0x7f35e81608b0 con 0x7f35e80585e0 2026-02-24T19:18:09.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.484+0000 7f35c77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.484+0000 7f35c77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.484+0000 7f35c77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.484+0000 7f35c77fe640 10 monclient(hunting): my global_id is 4460 2026-02-24T19:18:09.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.484+0000 7f35c77fe640 1 -- 10.20.193.26:0/2813836055 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35b4003610 con 0x7f35e80585e0 2026-02-24T19:18:09.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.485+0000 7f8983fff640 1 -- 10.20.193.26:0/989299693 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2572944449 0 0) 0x7f8978003610 con 0x7f89a80585e0 2026-02-24T19:18:09.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.485+0000 7f8983fff640 1 -- 10.20.193.26:0/989299693 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89a8160600 con 0x7f89a80585e0 2026-02-24T19:18:09.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.485+0000 7f8983fff640 1 -- 10.20.193.26:0/989299693 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f8994002f80 con 0x7f89a80585e0 2026-02-24T19:18:09.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.485+0000 7f8983fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.485+0000 7f8983fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.485+0000 7f8983fff640 10 monclient(hunting): dump: 2026-02-24T19:18:09.527 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.527 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.527 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.527 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.527 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.527 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.527 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.527 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.527 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.527 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.485+0000 7f7ad67fc640 1 -- 10.20.193.26:0/3517643153 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2352242360 0 0) 0x7f7ae81fdde0 con 0x7f7ae8058070 2026-02-24T19:18:09.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.485+0000 7f7ad67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.485+0000 7f7ad67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.485+0000 7f7ad67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.485+0000 7f7ad67fc640 10 monclient(hunting): my global_id is 4459 2026-02-24T19:18:09.528 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.485+0000 7f7ad67fc640 1 -- 10.20.193.26:0/3517643153 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ae815e920 con 0x7f7ae8058070 2026-02-24T19:18:09.528 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.486+0000 7f35c77fe640 1 -- 10.20.193.26:0/2813836055 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1276041288 0 0) 0x7f35e81fef50 con 0x7f35e80ba350 2026-02-24T19:18:09.528 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.486+0000 7f35c77fe640 1 -- 10.20.193.26:0/2813836055 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f35e81608b0 con 0x7f35e80ba350 2026-02-24T19:18:09.528 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.486+0000 7f35c77fe640 1 -- 10.20.193.26:0/2813836055 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f35d80034f0 con 0x7f35e80ba350 2026-02-24T19:18:09.528 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.486+0000 7f35c77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.528 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.486+0000 7f35c77fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.528 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.486+0000 7f35c77fe640 10 monclient(hunting): dump: 2026-02-24T19:18:09.528 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.528 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.528 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.528 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.528 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.528 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.528 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.528 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.528 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.528 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.528 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.486+0000 7f861cff9640 1 -- 10.20.193.26:0/1159143980 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2223814814 0 0) 0x7f85f0003610 con 0x7f86200ba350 2026-02-24T19:18:09.528 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.486+0000 7f861cff9640 1 -- 10.20.193.26:0/1159143980 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f862015eff0 con 0x7f86200ba350 2026-02-24T19:18:09.528 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.486+0000 7f861cff9640 1 -- 10.20.193.26:0/1159143980 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f86140035e0 con 0x7f86200ba350 2026-02-24T19:18:09.528 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.486+0000 7f861cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.528 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.486+0000 7f861cff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:09.528 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.486+0000 7f861cff9640 10 monclient(hunting): dump: 2026-02-24T19:18:09.528 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.528 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.528 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.529 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.529 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.529 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.529 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.529 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.529 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.529 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.529 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.486+0000 7f861cff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:09.529 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.486+0000 7f64567fc640 1 -- 10.20.193.26:0/2922835923 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1388254919 0 0) 0x7f6468156d30 con 0x7f64680585e0 2026-02-24T19:18:09.529 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.486+0000 7f64567fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.529 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.486+0000 7f64567fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.529 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.486+0000 7f64567fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.529 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.486+0000 7f64567fc640 10 monclient(hunting): my global_id is 4468 2026-02-24T19:18:09.529 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.486+0000 7f64567fc640 1 -- 10.20.193.26:0/2922835923 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6468166170 con 0x7f64680585e0 2026-02-24T19:18:09.529 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.487+0000 7f70beffd640 1 -- 10.20.193.26:0/2159113441 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2584326976 0 0) 0x7f70d81fb450 con 0x7f70d80585e0 2026-02-24T19:18:09.529 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.487+0000 7f70beffd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.529 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.487+0000 7f70beffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.529 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.487+0000 7f70beffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.529 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.487+0000 7f70beffd640 10 monclient(hunting): my global_id is 4462 2026-02-24T19:18:09.529 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.487+0000 7f70beffd640 1 -- 10.20.193.26:0/2159113441 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70a4003610 con 0x7f70d80585e0 2026-02-24T19:18:09.529 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.488+0000 7f64567fc640 1 -- 10.20.193.26:0/2922835923 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3240996226 0 0) 0x7f6468165ee0 con 0x7f64680ba350 2026-02-24T19:18:09.529 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.488+0000 7f64567fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.529 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.488+0000 7f64567fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.529 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.488+0000 7f64567fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.530 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.488+0000 7f64567fc640 10 monclient(hunting): my global_id is 4467 2026-02-24T19:18:09.530 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.488+0000 7f64567fc640 1 -- 10.20.193.26:0/2922835923 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6468156d30 con 0x7f64680ba350 2026-02-24T19:18:09.530 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.488+0000 7f6be3b83640 10 client.4401.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:18:09.530 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.488+0000 7f6be3b83640 15 client.4401.objecter _session_command_op_assign -1 2 2026-02-24T19:18:09.530 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.488+0000 7f6be3b83640 20 client.4401.objecter _get_session s=0x7f6bac0a0bb0 osd=1 3 2026-02-24T19:18:09.530 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.488+0000 7f6be3b83640 20 client.4401.objecter put_session s=0x7f6bac0a0bb0 osd=1 3 2026-02-24T19:18:09.530 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.488+0000 7f6be3b83640 20 client.4401.objecter _get_session s=0x7f6bac0a0bb0 osd=1 3 2026-02-24T19:18:09.530 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.488+0000 7f6be3b83640 15 client.4401.objecter _session_command_op_remove -1 2 2026-02-24T19:18:09.530 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.488+0000 7f6be3b83640 20 client.4401.objecter get_session s=0x7f6bac0a0bb0 osd=1 3 2026-02-24T19:18:09.530 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.488+0000 7f6be3b83640 15 client.4401.objecter _session_command_op_assign 1 2 2026-02-24T19:18:09.530 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.488+0000 7f50927fc640 1 -- 10.20.193.26:0/2908256076 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4074975331 0 0) 0x7f50a415fa40 con 0x7f50a40585e0 2026-02-24T19:18:09.530 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.488+0000 7f6be3b83640 20 client.4401.objecter put_session s=0x7f6bac0a0bb0 osd=1 4 2026-02-24T19:18:09.530 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.488+0000 7f6be3b83640 10 client.4401.objecter _send_command 2 2026-02-24T19:18:09.530 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.488+0000 7f6be3b83640 1 -- 10.20.193.26:0/835935887 --> v1:10.20.193.70:6800/268803542 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6bdc0aa1f0 con 0x7f6bac0a1260 2026-02-24T19:18:09.530 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.488+0000 7f50927fc640 1 -- 10.20.193.26:0/2908256076 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50a4161500 con 0x7f50a40585e0 2026-02-24T19:18:09.530 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.488+0000 7f50927fc640 1 -- 10.20.193.26:0/2908256076 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f50940030b0 con 0x7f50a40585e0 2026-02-24T19:18:09.530 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.488+0000 7f50927fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.530 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.488+0000 7f50927fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:09.530 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.488+0000 7f50927fc640 10 monclient(hunting): dump: 2026-02-24T19:18:09.530 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.530 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.530 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.530 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.531 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.531 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.531 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.531 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.531 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.531 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.531 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.488+0000 7f50927fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:09.531 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.489+0000 7f610f7fe640 10 client.?.objecter ms_handle_connect 0x7f61300ba350 2026-02-24T19:18:09.531 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.489+0000 7f610f7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.531 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.489+0000 7f28c77fe640 1 -- 10.20.193.26:0/4010354651 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1302662591 0 0) 0x7f28b4003610 con 0x7f28e80b91f0 2026-02-24T19:18:09.531 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.489+0000 7f28c77fe640 1 -- 10.20.193.26:0/4010354651 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f28e8167180 con 0x7f28e80b91f0 2026-02-24T19:18:09.531 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.489+0000 7f28c77fe640 1 -- 10.20.193.26:0/4010354651 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f28d0003310 con 0x7f28e80b91f0 2026-02-24T19:18:09.531 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.489+0000 7f28c77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.531 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.489+0000 7f28c77fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:09.531 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.489+0000 7f28c77fe640 10 monclient(hunting): dump: 2026-02-24T19:18:09.531 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.531 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.531 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.531 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.531 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.531 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.531 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.531 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.531 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.531 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.531 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.489+0000 7f28c77fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:09.531 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.489+0000 7f0e1affd640 1 -- 10.20.193.26:0/664289147 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3313528993 0 0) 0x7f0e3013ade0 con 0x7f0e300b5da0 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.489+0000 7f0e1affd640 1 -- 10.20.193.26:0/664289147 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0e00003610 con 0x7f0e300b5da0 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.489+0000 7f0e1affd640 1 -- 10.20.193.26:0/664289147 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f0e28003350 con 0x7f0e300b5da0 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.489+0000 7f0e1affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.490+0000 7f0e1affd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.490+0000 7f0e1affd640 10 monclient(hunting): dump: 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.490+0000 7f610f7fe640 1 -- 10.20.193.26:0/1994107782 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1786076483 0 0) 0x7f613015c090 con 0x7f61300b9f80 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.490+0000 7f610f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.490+0000 7f610f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.490+0000 7f610f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.490+0000 7f610f7fe640 10 monclient(hunting): my global_id is 4473 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.490+0000 7f610f7fe640 1 -- 10.20.193.26:0/1994107782 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60fc003610 con 0x7f61300b9f80 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.490+0000 7f7ad67fc640 1 -- 10.20.193.26:0/3517643153 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1763900950 0 0) 0x7f7ae81603f0 con 0x7f7ae8159a70 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.490+0000 7f7ad67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.490+0000 7f7ad67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.490+0000 7f7ad67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.490+0000 7f7ad67fc640 10 monclient(hunting): my global_id is 4470 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.490+0000 7f7ad67fc640 1 -- 10.20.193.26:0/3517643153 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ae81fdde0 con 0x7f7ae8159a70 2026-02-24T19:18:09.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.490+0000 7f50927fc640 1 -- 10.20.193.26:0/2908256076 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2097485102 0 0) 0x7f50a415f760 con 0x7f50a40ba350 2026-02-24T19:18:09.533 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.490+0000 7f50927fc640 1 -- 10.20.193.26:0/2908256076 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50a415fa40 con 0x7f50a40ba350 2026-02-24T19:18:09.533 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.490+0000 7f50927fc640 1 -- 10.20.193.26:0/2908256076 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f50a00035e0 con 0x7f50a40ba350 2026-02-24T19:18:09.533 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.490+0000 7f50927fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.533 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.490+0000 7f50927fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:09.533 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.490+0000 7f50927fc640 10 monclient(hunting): dump: 2026-02-24T19:18:09.533 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.533 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.533 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.533 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.533 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.533 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.533 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.533 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.533 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.533 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.533 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.491+0000 7f6bca7fc640 1 -- 10.20.193.26:0/835935887 <== osd.1 v1:10.20.193.70:6800/268803542 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f6bd8005ca0 con 0x7f6bac0a1260 2026-02-24T19:18:09.533 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.491+0000 7f6bca7fc640 10 client.4401.objecter ms_dispatch2 0x7f6bdc000b90 command_reply(tid 2: 0 ) 2026-02-24T19:18:09.533 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.491+0000 7f6bca7fc640 10 client.4401.objecter _finish_command 2 = system:0 2026-02-24T19:18:09.533 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.491+0000 7f6bca7fc640 20 client.4401.objecter put_session s=0x7f6bac0a0bb0 osd=1 4 2026-02-24T19:18:09.533 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.491+0000 7f6bca7fc640 15 client.4401.objecter _session_command_op_remove 1 2 2026-02-24T19:18:09.533 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.491+0000 7f6be3b83640 10 librados: watch_flush enter 2026-02-24T19:18:09.533 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.491+0000 7f6be3b83640 10 librados: watch_flush exit 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.491+0000 7f6be3b83640 10 client.4401.objecter close_session for osd.1 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.491+0000 7f6be3b83640 1 -- 10.20.193.26:0/835935887 >> v1:10.20.193.70:6800/268803542 conn(0x7f6bac0a1260 legacy=0x7f6bac0c1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.491+0000 7f6be3b83640 20 client.4401.objecter put_session s=0x7f6bac0a0bb0 osd=1 1 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.491+0000 7f6be3b83640 20 client.4401.objecter shutdown clearing up homeless session... 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.491+0000 7f6be3b83640 10 client.4401.objecter successfully canceled tick 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.491+0000 7f6be3b83640 1 -- 10.20.193.26:0/835935887 >> v1:10.20.193.162:6800/3889602630 conn(0x7f6bac077d30 legacy=0x7f6bac0981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.491+0000 7f6be3b83640 10 monclient: shutdown 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.491+0000 7f6be3b83640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.491+0000 7f6be3b83640 1 -- 10.20.193.26:0/835935887 >> v1:10.20.193.26:6789/0 conn(0x7f6bdc15d070 legacy=0x7f6bdc155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.491+0000 7f6be20f9640 1 -- 10.20.193.26:0/835935887 reap_dead start 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.491+0000 7f6be3b83640 1 -- 10.20.193.26:0/835935887 shutdown_connections 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.491+0000 7f6be3b83640 1 -- 10.20.193.26:0/835935887 >> 10.20.193.26:0/835935887 conn(0x7f6bdc0b2ef0 msgr2=0x7f6bdc0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.491+0000 7f6be3b83640 1 -- 10.20.193.26:0/835935887 shutdown_connections 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.492+0000 7f6be3b83640 1 -- 10.20.193.26:0/835935887 wait complete. 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.492+0000 7f6be3b83640 1 librados: shutdown 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.493+0000 7f82bffff640 1 -- 10.20.193.26:0/368358355 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1629110115 0 0) 0x7f82e815f760 con 0x7f82e80b9f80 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.493+0000 7f82bffff640 1 -- 10.20.193.26:0/368358355 >> v1:10.20.193.103:6789/0 conn(0x7f82e80ba350 legacy=0x7f82e8162ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.493+0000 7f82bffff640 1 -- 10.20.193.26:0/368358355 >> v1:10.20.193.26:6789/0 conn(0x7f82e80585e0 legacy=0x7f82e8160df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.493+0000 7f82bffff640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.493+0000 7f82bffff640 1 monclient: found mon.b 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.493+0000 7f82bffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.493+0000 7f82bffff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.493+0000 7f82bffff640 1 -- 10.20.193.26:0/368358355 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82e815fd20 con 0x7f82e80b9f80 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.493+0000 7f82bffff640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.493+0000 7f82bffff640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.493+0000 7f82bffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.493+0000 7f82eda32640 5 monclient: authenticate success, global_id 4447 2026-02-24T19:18:09.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.493+0000 7f82eda32640 10 monclient: _renew_subs 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.493+0000 7f82eda32640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.493+0000 7f82eda32640 1 -- 10.20.193.26:0/368358355 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f82e8160000 con 0x7f82e80b9f80 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.493+0000 7f82eda32640 10 client.4447.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.493+0000 7f82eda32640 10 monclient: _renew_subs 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.493+0000 7f82eda32640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.493+0000 7f82eda32640 1 -- 10.20.193.26:0/368358355 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f82e81605c0 con 0x7f82e80b9f80 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.493+0000 7f82eda32640 1 librados: init done 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.494+0000 7f82eda32640 10 client.4447.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.494+0000 7f82eda32640 15 client.4447.objecter _session_command_op_assign -1 1 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.494+0000 7f82eda32640 20 client.4447.objecter _get_session osd=-1 returning homeless 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.494+0000 7f82eda32640 10 client.4447.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.494+0000 7f82eda32640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.494+0000 7f82eda32640 1 -- 10.20.193.26:0/368358355 --> v1:10.20.193.70:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f82e8160ba0 con 0x7f82e80b9f80 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.495+0000 7f75effff640 1 -- 10.20.193.26:0/4132827319 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f76140b4940 con 0x7f76140b2920 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.495+0000 7f75effff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.495+0000 7f75effff640 1 -- 10.20.193.26:0/4132827319 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f76040039b0 con 0x7f76140b2920 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.495+0000 7f75effff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.495+0000 7f75effff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.495+0000 7f75effff640 10 monclient: dump: 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.495+0000 7f7611ffb640 4 set_mon_vals no callback set 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.496+0000 7f75effff640 1 -- 10.20.193.26:0/4132827319 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f7604003bc0 con 0x7f76140b2920 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.496+0000 7f28c77fe640 1 -- 10.20.193.26:0/4010354651 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1581158372 0 0) 0x7f28e8155f20 con 0x7f28e8057500 2026-02-24T19:18:09.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.496+0000 7f28c77fe640 1 -- 10.20.193.26:0/4010354651 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f28b4003610 con 0x7f28e8057500 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.496+0000 7f28c77fe640 1 -- 10.20.193.26:0/4010354651 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f28dc003170 con 0x7f28e8057500 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.496+0000 7f28c77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.496+0000 7f28c77fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.496+0000 7f28c77fe640 10 monclient(hunting): dump: 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.496+0000 7f76137fe640 10 monclient: get_auth_request con 0x7f75e4077d20 auth_method 0 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.496+0000 7f75effff640 10 client.4439.objecter ms_handle_connect 0x7f75e4077d20 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f75effff640 1 -- 10.20.193.26:0/4132827319 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f76040931c0 con 0x7f76140b2920 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f75effff640 10 client.4439.objecter ms_dispatch2 0x7f7614000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f75effff640 3 client.4439.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f75effff640 3 client.4439.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f75effff640 10 client.4439.objecter checking command 1 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f75effff640 20 client.4439.objecter _get_session s=0x7f75e40a0ba0 osd=8 3 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f75effff640 20 client.4439.objecter put_session s=0x7f75e40a0ba0 osd=8 3 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f75effff640 15 client.4439.objecter _session_command_op_remove -1 1 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f75effff640 20 client.4439.objecter _get_session s=0x7f75e40a0ba0 osd=8 3 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f75effff640 20 client.4439.objecter get_session s=0x7f75e40a0ba0 osd=8 3 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f75effff640 15 client.4439.objecter _session_command_op_assign 8 1 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f75effff640 20 client.4439.objecter put_session s=0x7f75e40a0ba0 osd=8 4 2026-02-24T19:18:09.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f50927fc640 1 -- 10.20.193.26:0/2908256076 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3030815449 0 0) 0x7f5074003610 con 0x7f50a40b9f80 2026-02-24T19:18:09.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f75effff640 10 client.4439.objecter _send_command 1 2026-02-24T19:18:09.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f75effff640 1 -- 10.20.193.26:0/4132827319 --> v1:10.20.193.26:6812/1933830164 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f75e40c2e50 con 0x7f75e40a1250 2026-02-24T19:18:09.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f75effff640 20 client.4439.objecter dump_active .. 0 homeless 2026-02-24T19:18:09.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f50927fc640 1 -- 10.20.193.26:0/2908256076 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50a415f760 con 0x7f50a40b9f80 2026-02-24T19:18:09.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f50927fc640 1 -- 10.20.193.26:0/2908256076 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f5098003310 con 0x7f50a40b9f80 2026-02-24T19:18:09.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f50927fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f50927fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f50927fc640 10 monclient(hunting): dump: 2026-02-24T19:18:09.537 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.537 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.537 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.537 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.537 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.537 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.537 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.537 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.537 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.537 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f75effff640 1 -- 10.20.193.26:0/4132827319 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f7604059860 con 0x7f76140b2920 2026-02-24T19:18:09.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f75effff640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:18:09.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7fb683fff640 1 -- 10.20.193.26:0/4238003527 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1013843076 0 0) 0x7fb6a80b4ea0 con 0x7fb6a80ba350 2026-02-24T19:18:09.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7fb683fff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7fb683fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7fb683fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7fb683fff640 10 monclient(hunting): my global_id is 4476 2026-02-24T19:18:09.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7fb683fff640 1 -- 10.20.193.26:0/4238003527 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6a80b23b0 con 0x7fb6a80ba350 2026-02-24T19:18:09.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f0e1affd640 1 -- 10.20.193.26:0/664289147 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1754437910 0 0) 0x7f0e3013a820 con 0x7f0e30161640 2026-02-24T19:18:09.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f0e1affd640 1 -- 10.20.193.26:0/664289147 >> v1:10.20.193.70:6789/0 conn(0x7f0e30161a10 legacy=0x7f0e3014bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f0e1affd640 1 -- 10.20.193.26:0/664289147 >> v1:10.20.193.26:6789/0 conn(0x7f0e300b5da0 legacy=0x7f0e3011c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f0e1affd640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f0e1affd640 1 monclient: found mon.c 2026-02-24T19:18:09.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f0e1affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f0e1affd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f0e1affd640 1 -- 10.20.193.26:0/664289147 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e3013b0c0 con 0x7f0e30161640 2026-02-24T19:18:09.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f0e1affd640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f0e1affd640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f0e1affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f0e3898a640 5 monclient: authenticate success, global_id 4451 2026-02-24T19:18:09.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f0e3898a640 10 monclient: _renew_subs 2026-02-24T19:18:09.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f0e3898a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.497+0000 7f0e3898a640 1 -- 10.20.193.26:0/664289147 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0e3013b3a0 con 0x7f0e30161640 2026-02-24T19:18:09.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f7613fff640 10 monclient: get_auth_request con 0x7f75e40a1250 auth_method 0 2026-02-24T19:18:09.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f0e3898a640 10 client.4451.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f0e3898a640 10 monclient: _renew_subs 2026-02-24T19:18:09.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f0e3898a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f0e3898a640 1 -- 10.20.193.26:0/664289147 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0e30130c10 con 0x7f0e30161640 2026-02-24T19:18:09.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f0e3898a640 1 librados: init done 2026-02-24T19:18:09.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f8983fff640 1 -- 10.20.193.26:0/989299693 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2660689953 0 0) 0x7f89a8160320 con 0x7f89a80ba350 2026-02-24T19:18:09.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f8983fff640 1 -- 10.20.193.26:0/989299693 >> v1:10.20.193.103:6789/0 conn(0x7f89a80b9f80 legacy=0x7f89a81fe6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f8983fff640 1 -- 10.20.193.26:0/989299693 >> v1:10.20.193.70:6789/0 conn(0x7f89a80585e0 legacy=0x7f89a815daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f8983fff640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f8983fff640 1 monclient: found mon.a 2026-02-24T19:18:09.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f8983fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f8983fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f8983fff640 1 -- 10.20.193.26:0/989299693 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a81608e0 con 0x7f89a80ba350 2026-02-24T19:18:09.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f8983fff640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f8983fff640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f8983fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f89ae1c0640 5 monclient: authenticate success, global_id 4446 2026-02-24T19:18:09.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f89ae1c0640 10 monclient: _renew_subs 2026-02-24T19:18:09.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f89ae1c0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f89ae1c0640 1 -- 10.20.193.26:0/989299693 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f89a8160bc0 con 0x7f89a80ba350 2026-02-24T19:18:09.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f89ae1c0640 10 client.4446.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f89ae1c0640 10 monclient: _renew_subs 2026-02-24T19:18:09.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f89ae1c0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f89ae1c0640 1 -- 10.20.193.26:0/989299693 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f89a81ff110 con 0x7f89a80ba350 2026-02-24T19:18:09.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f89ae1c0640 1 librados: init done 2026-02-24T19:18:09.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f35c77fe640 1 -- 10.20.193.26:0/2813836055 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4287765932 0 0) 0x7f35e81605d0 con 0x7f35e80b9f80 2026-02-24T19:18:09.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f35c77fe640 1 -- 10.20.193.26:0/2813836055 >> v1:10.20.193.103:6789/0 conn(0x7f35e80585e0 legacy=0x7f35e815daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f35c77fe640 1 -- 10.20.193.26:0/2813836055 >> v1:10.20.193.70:6789/0 conn(0x7f35e80ba350 legacy=0x7f35e81619c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f35c77fe640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f35c77fe640 1 monclient: found mon.a 2026-02-24T19:18:09.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f35c77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f35c77fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f35c77fe640 1 -- 10.20.193.26:0/2813836055 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e8160b90 con 0x7f35e80b9f80 2026-02-24T19:18:09.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f35c77fe640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f35c77fe640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f35c77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f35ed767640 5 monclient: authenticate success, global_id 4449 2026-02-24T19:18:09.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f35ed767640 10 monclient: _renew_subs 2026-02-24T19:18:09.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f35ed767640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f35ed767640 1 -- 10.20.193.26:0/2813836055 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f35e81611c0 con 0x7f35e80b9f80 2026-02-24T19:18:09.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f70beffd640 1 -- 10.20.193.26:0/2159113441 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4002701079 0 0) 0x7f70d8159ea0 con 0x7f70d80b9f80 2026-02-24T19:18:09.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f70beffd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f70beffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f70beffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f70beffd640 10 monclient(hunting): my global_id is 4479 2026-02-24T19:18:09.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f70beffd640 1 -- 10.20.193.26:0/2159113441 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70d81fb450 con 0x7f70d80b9f80 2026-02-24T19:18:09.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f0e3898a640 10 client.4451.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f0e3898a640 15 client.4451.objecter _session_command_op_assign -1 1 2026-02-24T19:18:09.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f0e3898a640 20 client.4451.objecter _get_session osd=-1 returning homeless 2026-02-24T19:18:09.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f0e3898a640 10 client.4451.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f0e3898a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f0e3898a640 1 -- 10.20.193.26:0/664289147 --> v1:10.20.193.103:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f0e30052d80 con 0x7f0e30161640 2026-02-24T19:18:09.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f35ed767640 10 client.4449.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f35ed767640 10 monclient: _renew_subs 2026-02-24T19:18:09.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f35ed767640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f35ed767640 1 -- 10.20.193.26:0/2813836055 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f35e81ff340 con 0x7f35e80b9f80 2026-02-24T19:18:09.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f35ed767640 1 librados: init done 2026-02-24T19:18:09.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f89ae1c0640 10 client.4446.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f89ae1c0640 15 client.4446.objecter _session_command_op_assign -1 1 2026-02-24T19:18:09.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f89ae1c0640 20 client.4446.objecter _get_session osd=-1 returning homeless 2026-02-24T19:18:09.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f89ae1c0640 10 client.4446.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f89ae1c0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.498+0000 7f89ae1c0640 1 -- 10.20.193.26:0/989299693 --> v1:10.20.193.26:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f89a81600d0 con 0x7f89a80ba350 2026-02-24T19:18:09.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.499+0000 7f35ed767640 10 client.4449.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.499+0000 7f35ed767640 15 client.4449.objecter _session_command_op_assign -1 1 2026-02-24T19:18:09.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.499+0000 7f35ed767640 20 client.4449.objecter _get_session osd=-1 returning homeless 2026-02-24T19:18:09.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.499+0000 7f35ed767640 10 client.4449.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.499+0000 7f35ed767640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.499+0000 7f35ed767640 1 -- 10.20.193.26:0/2813836055 --> v1:10.20.193.26:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f35e8160dd0 con 0x7f35e80b9f80 2026-02-24T19:18:09.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.499+0000 7f75effff640 10 client.4439.objecter ms_handle_connect 0x7f75e40a1250 2026-02-24T19:18:09.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.500+0000 7f861cff9640 1 -- 10.20.193.26:0/1159143980 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4051809547 0 0) 0x7f862015f5b0 con 0x7f86200585e0 2026-02-24T19:18:09.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.500+0000 7f861cff9640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.500+0000 7f861cff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.500+0000 7f861cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.500+0000 7f861cff9640 10 monclient(hunting): my global_id is 4472 2026-02-24T19:18:09.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.500+0000 7f861cff9640 1 -- 10.20.193.26:0/1159143980 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85f0003610 con 0x7f86200585e0 2026-02-24T19:18:09.542 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:09.542 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-24T19:18:09.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.500+0000 7f7ad67fc640 1 -- 10.20.193.26:0/3517643153 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3663977448 0 0) 0x7f7ab8003610 con 0x7f7ae8159e40 2026-02-24T19:18:09.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.500+0000 7f7ad67fc640 1 -- 10.20.193.26:0/3517643153 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7ae81603f0 con 0x7f7ae8159e40 2026-02-24T19:18:09.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.500+0000 7f7ad67fc640 1 -- 10.20.193.26:0/3517643153 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7ae40033c0 con 0x7f7ae8159e40 2026-02-24T19:18:09.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.500+0000 7f7ad67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.500+0000 7f7ad67fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.500+0000 7f7ad67fc640 10 monclient(hunting): dump: 2026-02-24T19:18:09.542 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.542 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.542 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.542 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.542 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.542 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.542 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.542 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.542 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.542 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.500+0000 7f7ad67fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:09.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.501+0000 7f64567fc640 1 -- 10.20.193.26:0/2922835923 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1089253293 0 0) 0x7f6438003610 con 0x7f64680b9f80 2026-02-24T19:18:09.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.501+0000 7f64567fc640 1 -- 10.20.193.26:0/2922835923 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6468165ee0 con 0x7f64680b9f80 2026-02-24T19:18:09.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.501+0000 7f64567fc640 1 -- 10.20.193.26:0/2922835923 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f645c0033d0 con 0x7f64680b9f80 2026-02-24T19:18:09.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.501+0000 7f64567fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.501+0000 7f64567fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.501+0000 7f64567fc640 10 monclient(hunting): dump: 2026-02-24T19:18:09.543 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.543 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.543 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.543 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.543 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.543 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.543 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.543 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.543 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.543 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.501+0000 7f64567fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:09.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.501+0000 7f28c77fe640 1 -- 10.20.193.26:0/4010354651 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 899811976 0 0) 0x7f28e8164490 con 0x7f28e8159b40 2026-02-24T19:18:09.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.501+0000 7f28c77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.501+0000 7f28c77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.501+0000 7f28c77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.501+0000 7f28c77fe640 10 monclient(hunting): my global_id is 4475 2026-02-24T19:18:09.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.501+0000 7f28c77fe640 1 -- 10.20.193.26:0/4010354651 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28e8155f20 con 0x7f28e8159b40 2026-02-24T19:18:09.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.501+0000 7fb683fff640 1 -- 10.20.193.26:0/4238003527 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 257545590 0 0) 0x7fb6a80b2690 con 0x7fb6a80585e0 2026-02-24T19:18:09.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.501+0000 7fb683fff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.501+0000 7fb683fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.501+0000 7fb683fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.501+0000 7fb683fff640 10 monclient(hunting): my global_id is 4481 2026-02-24T19:18:09.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.501+0000 7fb683fff640 1 -- 10.20.193.26:0/4238003527 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6a80b4ea0 con 0x7fb6a80585e0 2026-02-24T19:18:09.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.503+0000 7f70beffd640 1 -- 10.20.193.26:0/2159113441 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2975450400 0 0) 0x7f70d81fb730 con 0x7f70d80ba350 2026-02-24T19:18:09.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.503+0000 7f70beffd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.503+0000 7f70beffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.503+0000 7f70beffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.503+0000 7f70beffd640 10 monclient(hunting): my global_id is 4478 2026-02-24T19:18:09.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.503+0000 7f70beffd640 1 -- 10.20.193.26:0/2159113441 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70d8159ea0 con 0x7f70d80ba350 2026-02-24T19:18:09.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.504+0000 7f0caffff640 1 -- 10.20.193.26:0/2370175587 <== osd.10 v1:10.20.193.103:6801/3185480373 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f0ca80c2e90 con 0x7f0ca80a1290 2026-02-24T19:18:09.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.504+0000 7f0caffff640 10 client.4436.objecter ms_dispatch2 0x7f0cd8000b90 command_reply(tid 1: 0 ) 2026-02-24T19:18:09.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.504+0000 7f0caffff640 10 client.4436.objecter _finish_command 1 = system:0 2026-02-24T19:18:09.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.504+0000 7f0caffff640 20 client.4436.objecter put_session s=0x7f0ca80a0be0 osd=10 4 2026-02-24T19:18:09.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.504+0000 7f0caffff640 15 client.4436.objecter _session_command_op_remove 10 1 2026-02-24T19:18:09.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.504+0000 7f610f7fe640 1 -- 10.20.193.26:0/1994107782 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3793007331 0 0) 0x7f61301ff9e0 con 0x7f61300585e0 2026-02-24T19:18:09.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.504+0000 7f610f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.504+0000 7f610f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.504+0000 7f610f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.504+0000 7f610f7fe640 10 monclient(hunting): my global_id is 4484 2026-02-24T19:18:09.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.504+0000 7f610f7fe640 1 -- 10.20.193.26:0/1994107782 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f613015c090 con 0x7f61300585e0 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.507+0000 7fb683fff640 1 -- 10.20.193.26:0/4238003527 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2259561362 0 0) 0x7fb678003610 con 0x7fb6a80b9f80 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.507+0000 7fb683fff640 1 -- 10.20.193.26:0/4238003527 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb6a80b2690 con 0x7fb6a80b9f80 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.507+0000 7fb683fff640 1 -- 10.20.193.26:0/4238003527 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fb698003310 con 0x7fb6a80b9f80 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.507+0000 7fb683fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.507+0000 7fb683fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.507+0000 7fb683fff640 10 monclient(hunting): dump: 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.507+0000 7fb683fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.508+0000 7f610f7fe640 1 -- 10.20.193.26:0/1994107782 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3549468425 0 0) 0x7f61301ff700 con 0x7f61300ba350 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.508+0000 7f610f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.508+0000 7f610f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.508+0000 7f610f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.508+0000 7f610f7fe640 10 monclient(hunting): my global_id is 4471 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.508+0000 7f610f7fe640 1 -- 10.20.193.26:0/1994107782 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61301ff9e0 con 0x7f61300ba350 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.508+0000 7f70beffd640 1 -- 10.20.193.26:0/2159113441 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3660612335 0 0) 0x7f70a4003610 con 0x7f70d80585e0 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.508+0000 7f70beffd640 1 -- 10.20.193.26:0/2159113441 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f70d81fb730 con 0x7f70d80585e0 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.508+0000 7f70beffd640 1 -- 10.20.193.26:0/2159113441 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f70cc003170 con 0x7f70d80585e0 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.508+0000 7f70beffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.508+0000 7f70beffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.508+0000 7f70beffd640 10 monclient(hunting): dump: 2026-02-24T19:18:09.545 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.508+0000 7f70beffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.509+0000 7f50927fc640 1 -- 10.20.193.26:0/2908256076 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2800430003 0 0) 0x7f50a4161500 con 0x7f50a40585e0 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.509+0000 7f50927fc640 1 -- 10.20.193.26:0/2908256076 >> v1:10.20.193.103:6789/0 conn(0x7f50a40b9f80 legacy=0x7f50a41564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.509+0000 7f50927fc640 1 -- 10.20.193.26:0/2908256076 >> v1:10.20.193.26:6789/0 conn(0x7f50a40ba350 legacy=0x7f50a4162ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.509+0000 7f50927fc640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.509+0000 7f50927fc640 1 monclient: found mon.b 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.509+0000 7f50927fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.509+0000 7f50927fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.509+0000 7f50927fc640 1 -- 10.20.193.26:0/2908256076 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a415fd20 con 0x7f50a40585e0 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.509+0000 7f50927fc640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.509+0000 7f50927fc640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.509+0000 7f50927fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.509+0000 7f50ac24d640 5 monclient: authenticate success, global_id 4444 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.509+0000 7f50ac24d640 10 monclient: _renew_subs 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.509+0000 7f50ac24d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.509+0000 7f50ac24d640 1 -- 10.20.193.26:0/2908256076 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f50a4160000 con 0x7f50a40585e0 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.509+0000 7f50ac24d640 10 client.4444.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.509+0000 7f50ac24d640 10 monclient: _renew_subs 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.509+0000 7f50ac24d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.509+0000 7f50ac24d640 1 -- 10.20.193.26:0/2908256076 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f50a41605c0 con 0x7f50a40585e0 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.509+0000 7f50ac24d640 1 librados: init done 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.510+0000 7f50ac24d640 10 client.4444.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.510+0000 7f50ac24d640 15 client.4444.objecter _session_command_op_assign -1 1 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.510+0000 7f50ac24d640 20 client.4444.objecter _get_session osd=-1 returning homeless 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.510+0000 7f50ac24d640 10 client.4444.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.510+0000 7f50ac24d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.510+0000 7f50ac24d640 1 -- 10.20.193.26:0/2908256076 --> v1:10.20.193.70:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f50a4160ba0 con 0x7f50a40585e0 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.512+0000 7f0cdd83c640 10 client.4436.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.512+0000 7f0cdd83c640 15 client.4436.objecter _session_command_op_assign -1 2 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.512+0000 7f0cdd83c640 20 client.4436.objecter _get_session s=0x7f0ca80a0be0 osd=10 3 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.512+0000 7f0cdd83c640 20 client.4436.objecter put_session s=0x7f0ca80a0be0 osd=10 3 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.512+0000 7f0cdd83c640 20 client.4436.objecter _get_session s=0x7f0ca80a0be0 osd=10 3 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.512+0000 7f0cdd83c640 15 client.4436.objecter _session_command_op_remove -1 2 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.512+0000 7f0cdd83c640 20 client.4436.objecter get_session s=0x7f0ca80a0be0 osd=10 3 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.512+0000 7f0cdd83c640 15 client.4436.objecter _session_command_op_assign 10 2 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.512+0000 7f0cdd83c640 20 client.4436.objecter put_session s=0x7f0ca80a0be0 osd=10 4 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.512+0000 7f0cdd83c640 10 client.4436.objecter _send_command 2 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.512+0000 7f0cdd83c640 1 -- 10.20.193.26:0/2370175587 --> v1:10.20.193.103:6801/3185480373 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0cd80b8e90 con 0x7f0ca80a1290 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.513+0000 7f7ad67fc640 1 -- 10.20.193.26:0/3517643153 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1854648515 0 0) 0x7f7ae815e920 con 0x7f7ae8058070 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.513+0000 7f7ad67fc640 1 -- 10.20.193.26:0/3517643153 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7ab8003610 con 0x7f7ae8058070 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.513+0000 7f7ad67fc640 1 -- 10.20.193.26:0/3517643153 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7ad8002ff0 con 0x7f7ae8058070 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.513+0000 7f7ad67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.513+0000 7f7ad67fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.513+0000 7f7ad67fc640 10 monclient(hunting): dump: 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.547 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.513+0000 7f861cff9640 1 -- 10.20.193.26:0/1159143980 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3141158782 0 0) 0x7f862015eff0 con 0x7f86200ba350 2026-02-24T19:18:09.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.513+0000 7f861cff9640 1 -- 10.20.193.26:0/1159143980 >> v1:10.20.193.103:6789/0 conn(0x7f86200585e0 legacy=0x7f86201564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.513+0000 7f861cff9640 1 -- 10.20.193.26:0/1159143980 >> v1:10.20.193.26:6789/0 conn(0x7f86200b9f80 legacy=0x7f8620157b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.513+0000 7f861cff9640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.513+0000 7f861cff9640 1 monclient: found mon.b 2026-02-24T19:18:09.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.513+0000 7f861cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.513+0000 7f861cff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.513+0000 7f861cff9640 1 -- 10.20.193.26:0/1159143980 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f862015f890 con 0x7f86200ba350 2026-02-24T19:18:09.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.513+0000 7f861cff9640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.513+0000 7f861cff9640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.513+0000 7f861cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.513+0000 7f86262e1640 5 monclient: authenticate success, global_id 4456 2026-02-24T19:18:09.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.513+0000 7f86262e1640 10 monclient: _renew_subs 2026-02-24T19:18:09.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.513+0000 7f86262e1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.513+0000 7f86262e1640 1 -- 10.20.193.26:0/1159143980 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f862015fb70 con 0x7f86200ba350 2026-02-24T19:18:09.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.513+0000 7f86262e1640 10 client.4456.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.513+0000 7f86262e1640 10 monclient: _renew_subs 2026-02-24T19:18:09.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.513+0000 7f86262e1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.513+0000 7f86262e1640 1 -- 10.20.193.26:0/1159143980 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8620156bc0 con 0x7f86200ba350 2026-02-24T19:18:09.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.513+0000 7f86262e1640 1 librados: init done 2026-02-24T19:18:09.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.514+0000 7f64567fc640 1 -- 10.20.193.26:0/2922835923 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2813957732 0 0) 0x7f6468166170 con 0x7f64680585e0 2026-02-24T19:18:09.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.514+0000 7f64567fc640 1 -- 10.20.193.26:0/2922835923 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6438003610 con 0x7f64680585e0 2026-02-24T19:18:09.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.514+0000 7f64567fc640 1 -- 10.20.193.26:0/2922835923 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6458003060 con 0x7f64680585e0 2026-02-24T19:18:09.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.514+0000 7f64567fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.514+0000 7f64567fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.514+0000 7f64567fc640 10 monclient(hunting): dump: 2026-02-24T19:18:09.548 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.549 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.549 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.549 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.549 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.549 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.549 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.549 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.549 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.549 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.514+0000 7f86262e1640 10 client.4456.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.514+0000 7f86262e1640 15 client.4456.objecter _session_command_op_assign -1 1 2026-02-24T19:18:09.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.514+0000 7f86262e1640 20 client.4456.objecter _get_session osd=-1 returning homeless 2026-02-24T19:18:09.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.514+0000 7f86262e1640 10 client.4456.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.514+0000 7f86262e1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.514+0000 7f86262e1640 1 -- 10.20.193.26:0/1159143980 --> v1:10.20.193.70:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f8620163770 con 0x7f86200ba350 2026-02-24T19:18:09.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.514+0000 7f0caffff640 1 -- 10.20.193.26:0/2370175587 <== osd.10 v1:10.20.193.103:6801/3185480373 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1506399442) 0x7f0cd80b8e90 con 0x7f0ca80a1290 2026-02-24T19:18:09.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.514+0000 7f0caffff640 10 client.4436.objecter ms_dispatch2 0x7f0cd8000b90 command_reply(tid 2: 0 ) 2026-02-24T19:18:09.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.514+0000 7f0caffff640 10 client.4436.objecter _finish_command 2 = system:0 2026-02-24T19:18:09.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.514+0000 7f0caffff640 20 client.4436.objecter put_session s=0x7f0ca80a0be0 osd=10 4 2026-02-24T19:18:09.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.514+0000 7f0caffff640 15 client.4436.objecter _session_command_op_remove 10 2 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.515+0000 7f0cdd83c640 10 librados: watch_flush enter 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.515+0000 7f0cdd83c640 10 librados: watch_flush exit 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.515+0000 7f0cdd83c640 10 client.4436.objecter close_session for osd.10 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.515+0000 7f0cdd83c640 1 -- 10.20.193.26:0/2370175587 >> v1:10.20.193.103:6801/3185480373 conn(0x7f0ca80a1290 legacy=0x7f0ca80c16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.515+0000 7f0cdd83c640 20 client.4436.objecter put_session s=0x7f0ca80a0be0 osd=10 1 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.515+0000 7f0cdd83c640 20 client.4436.objecter shutdown clearing up homeless session... 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.515+0000 7f0cdd83c640 10 client.4436.objecter successfully canceled tick 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.515+0000 7f0cdd83c640 1 -- 10.20.193.26:0/2370175587 >> v1:10.20.193.162:6800/3889602630 conn(0x7f0ca8077d60 legacy=0x7f0ca8098210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.515+0000 7f0cdd83c640 10 monclient: shutdown 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.515+0000 7f0cdd83c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.515+0000 7f0cdd83c640 1 -- 10.20.193.26:0/2370175587 >> v1:10.20.193.103:6789/0 conn(0x7f0cd80b9f80 legacy=0x7f0cd81fc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.515+0000 7f0cd77fe640 1 -- 10.20.193.26:0/2370175587 reap_dead start 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.515+0000 7f0cdd83c640 1 -- 10.20.193.26:0/2370175587 shutdown_connections 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.515+0000 7f0cdd83c640 1 -- 10.20.193.26:0/2370175587 >> 10.20.193.26:0/2370175587 conn(0x7f0cd80b7990 msgr2=0x7f0cd815bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.515+0000 7f0cdd83c640 1 -- 10.20.193.26:0/2370175587 shutdown_connections 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.515+0000 7f0cdd83c640 1 -- 10.20.193.26:0/2370175587 wait complete. 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.515+0000 7f0cdd83c640 1 librados: shutdown 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f7ad67fc640 1 -- 10.20.193.26:0/3517643153 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1201542748 0 0) 0x7f7ae81fdde0 con 0x7f7ae8159a70 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f7ad67fc640 1 -- 10.20.193.26:0/3517643153 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7ae815e920 con 0x7f7ae8159a70 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f7ad67fc640 1 -- 10.20.193.26:0/3517643153 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7adc002b60 con 0x7f7ae8159a70 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f7ad67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f7ad67fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f7ad67fc640 10 monclient(hunting): dump: 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.550 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f75effff640 1 -- 10.20.193.26:0/4132827319 <== osd.8 v1:10.20.193.26:6812/1933830164 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f75e40c2e50 con 0x7f75e40a1250 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f75effff640 10 client.4439.objecter ms_dispatch2 0x7f7614000b90 command_reply(tid 1: 0 ) 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f75effff640 10 client.4439.objecter _finish_command 1 = system:0 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f75effff640 20 client.4439.objecter put_session s=0x7f75e40a0ba0 osd=8 4 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f75effff640 15 client.4439.objecter _session_command_op_remove 8 1 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f28c77fe640 1 -- 10.20.193.26:0/4010354651 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3592392593 0 0) 0x7f28e8167180 con 0x7f28e80b91f0 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f28c77fe640 1 -- 10.20.193.26:0/4010354651 >> v1:10.20.193.103:6789/0 conn(0x7f28e8159b40 legacy=0x7f28e825f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f28c77fe640 1 -- 10.20.193.26:0/4010354651 >> v1:10.20.193.26:6789/0 conn(0x7f28e8057500 legacy=0x7f28e8155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f28c77fe640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f28c77fe640 1 monclient: found mon.b 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f28c77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f28c77fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f28c77fe640 1 -- 10.20.193.26:0/4010354651 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e8164770 con 0x7f28e80b91f0 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f28c77fe640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f28c77fe640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f28c77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f28e7fff640 5 monclient: authenticate success, global_id 4453 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f28e7fff640 10 monclient: _renew_subs 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f28e7fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f28e7fff640 1 -- 10.20.193.26:0/4010354651 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f28e8164a50 con 0x7f28e80b91f0 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f28e7fff640 10 client.4453.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f28e7fff640 10 monclient: _renew_subs 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f28e7fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f28e7fff640 1 -- 10.20.193.26:0/4010354651 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f28e8165010 con 0x7f28e80b91f0 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.519+0000 7f28e7fff640 1 librados: init done 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.520+0000 7f28e7fff640 10 client.4453.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.520+0000 7f28e7fff640 15 client.4453.objecter _session_command_op_assign -1 1 2026-02-24T19:18:09.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.520+0000 7f28e7fff640 20 client.4453.objecter _get_session osd=-1 returning homeless 2026-02-24T19:18:09.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.520+0000 7f28e7fff640 10 client.4453.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.520+0000 7f28e7fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.520+0000 7f28e7fff640 1 -- 10.20.193.26:0/4010354651 --> v1:10.20.193.70:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f28e8167520 con 0x7f28e80b91f0 2026-02-24T19:18:09.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.521+0000 7f70beffd640 1 -- 10.20.193.26:0/2159113441 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1472692935 0 0) 0x7f70d8159ea0 con 0x7f70d80ba350 2026-02-24T19:18:09.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.521+0000 7f70beffd640 1 -- 10.20.193.26:0/2159113441 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f70a4003610 con 0x7f70d80ba350 2026-02-24T19:18:09.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.521+0000 7f70beffd640 1 -- 10.20.193.26:0/2159113441 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f70c8003080 con 0x7f70d80ba350 2026-02-24T19:18:09.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.521+0000 7f70beffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.521+0000 7f70beffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.521+0000 7f70beffd640 10 monclient(hunting): dump: 2026-02-24T19:18:09.552 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.552 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.552 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.552 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.552 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.552 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.552 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.552 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.552 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.552 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.552 INFO:teuthology.orchestra.run.trial026.stdout:90194313221 2026-02-24T19:18:09.552 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-24T19:18:09.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.524+0000 7fb683fff640 1 -- 10.20.193.26:0/4238003527 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3249525984 0 0) 0x7fb6a80b23b0 con 0x7fb6a80ba350 2026-02-24T19:18:09.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.524+0000 7fb683fff640 1 -- 10.20.193.26:0/4238003527 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb678003610 con 0x7fb6a80ba350 2026-02-24T19:18:09.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.524+0000 7fb683fff640 1 -- 10.20.193.26:0/4238003527 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fb69c0035e0 con 0x7fb6a80ba350 2026-02-24T19:18:09.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.524+0000 7fb683fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.524+0000 7fb683fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:09.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.524+0000 7fb683fff640 10 monclient(hunting): dump: 2026-02-24T19:18:09.553 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.553 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.553 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.553 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.553 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.553 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.553 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.553 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.553 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.553 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.524+0000 7f0e1affd640 1 -- 10.20.193.26:0/664289147 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0e30052d80 con 0x7f0e30161640 2026-02-24T19:18:09.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.524+0000 7f0e1affd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.524+0000 7f0e1affd640 1 -- 10.20.193.26:0/664289147 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f0e1c003330 con 0x7f0e30161640 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.524+0000 7f0e1affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.524+0000 7f0e1affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.524+0000 7f0e34efc640 4 set_mon_vals no callback set 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.524+0000 7f0e1affd640 10 monclient: dump: 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.525+0000 7f0e1affd640 1 -- 10.20.193.26:0/664289147 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f0e1c003540 con 0x7f0e30161640 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.525+0000 7f0e366ff640 10 monclient: get_auth_request con 0x7f0e00077f20 auth_method 0 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.526+0000 7f0e1affd640 10 client.4451.objecter ms_handle_connect 0x7f0e00077f20 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.526+0000 7f0e1affd640 1 -- 10.20.193.26:0/664289147 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f0e1c003330 con 0x7f0e30161640 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.526+0000 7f0e1affd640 10 client.4451.objecter ms_dispatch2 0x7f0e30000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.526+0000 7f0e1affd640 3 client.4451.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.526+0000 7f0e1affd640 3 client.4451.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.526+0000 7f0e1affd640 10 client.4451.objecter checking command 1 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.526+0000 7f0e1affd640 20 client.4451.objecter _get_session s=0x7f0e000a0da0 osd=12 3 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.526+0000 7f0e1affd640 20 client.4451.objecter put_session s=0x7f0e000a0da0 osd=12 3 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.526+0000 7f0e1affd640 15 client.4451.objecter _session_command_op_remove -1 1 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.526+0000 7f0e1affd640 20 client.4451.objecter _get_session s=0x7f0e000a0da0 osd=12 3 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.526+0000 7f0e1affd640 20 client.4451.objecter get_session s=0x7f0e000a0da0 osd=12 3 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.526+0000 7f0e1affd640 15 client.4451.objecter _session_command_op_assign 12 1 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.526+0000 7f0e1affd640 20 client.4451.objecter put_session s=0x7f0e000a0da0 osd=12 4 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.526+0000 7f0e1affd640 10 client.4451.objecter _send_command 1 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.526+0000 7f0e1affd640 1 -- 10.20.193.26:0/664289147 --> v1:10.20.193.26:6804/2128192173 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0e1c004130 con 0x7f0e000a1450 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.526+0000 7f0e1affd640 20 client.4451.objecter dump_active .. 0 homeless 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.526+0000 7f0e1affd640 1 -- 10.20.193.26:0/664289147 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f0e1c0583b0 con 0x7f0e30161640 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.526+0000 7f0e1affd640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.526+0000 7f610f7fe640 1 -- 10.20.193.26:0/1994107782 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3091327061 0 0) 0x7f613015c090 con 0x7f61300585e0 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.526+0000 7f610f7fe640 1 -- 10.20.193.26:0/1994107782 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f61301ff700 con 0x7f61300585e0 2026-02-24T19:18:09.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.526+0000 7f0e36f00640 10 monclient: get_auth_request con 0x7f0e000a1450 auth_method 0 2026-02-24T19:18:09.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.526+0000 7f610f7fe640 1 -- 10.20.193.26:0/1994107782 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6124003350 con 0x7f61300585e0 2026-02-24T19:18:09.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.526+0000 7f610f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.526+0000 7f610f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.526+0000 7f610f7fe640 10 monclient(hunting): dump: 2026-02-24T19:18:09.555 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.555 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.555 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.555 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.555 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.555 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.555 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.555 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.555 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.555 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.526+0000 7f610f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:09.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7ad67fc640 1 -- 10.20.193.26:0/3517643153 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 88338135 0 0) 0x7f7ae81603f0 con 0x7f7ae8159e40 2026-02-24T19:18:09.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7ad67fc640 1 -- 10.20.193.26:0/3517643153 >> v1:10.20.193.70:6789/0 conn(0x7f7ae8058070 legacy=0x7f7ae815fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7ad67fc640 1 -- 10.20.193.26:0/3517643153 >> v1:10.20.193.26:6789/0 conn(0x7f7ae8159a70 legacy=0x7f7ae81fd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7ad67fc640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7ad67fc640 1 monclient: found mon.c 2026-02-24T19:18:09.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7ad67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7ad67fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7ad67fc640 1 -- 10.20.193.26:0/3517643153 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae815ef20 con 0x7f7ae8159e40 2026-02-24T19:18:09.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7ad67fc640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7ad67fc640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7ad67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7af0001640 5 monclient: authenticate success, global_id 4463 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7af0001640 10 monclient: _renew_subs 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7af0001640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7af0001640 1 -- 10.20.193.26:0/3517643153 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae815f200 con 0x7f7ae8159e40 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7af0001640 10 client.4463.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7af0001640 10 monclient: _renew_subs 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7af0001640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7af0001640 1 -- 10.20.193.26:0/3517643153 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7ae815f7c0 con 0x7f7ae8159e40 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7af0001640 1 librados: init done 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7619b7f640 10 client.4439.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7619b7f640 15 client.4439.objecter _session_command_op_assign -1 2 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7619b7f640 20 client.4439.objecter _get_session s=0x7f75e40a0ba0 osd=8 3 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7619b7f640 20 client.4439.objecter put_session s=0x7f75e40a0ba0 osd=8 3 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7619b7f640 20 client.4439.objecter _get_session s=0x7f75e40a0ba0 osd=8 3 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7619b7f640 15 client.4439.objecter _session_command_op_remove -1 2 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7619b7f640 20 client.4439.objecter get_session s=0x7f75e40a0ba0 osd=8 3 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7619b7f640 15 client.4439.objecter _session_command_op_assign 8 2 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7619b7f640 20 client.4439.objecter put_session s=0x7f75e40a0ba0 osd=8 4 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7619b7f640 10 client.4439.objecter _send_command 2 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7619b7f640 1 -- 10.20.193.26:0/4132827319 --> v1:10.20.193.26:6812/1933830164 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f76140b6dc0 con 0x7f75e40a1250 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f64567fc640 1 -- 10.20.193.26:0/2922835923 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1182863674 0 0) 0x7f6468165ee0 con 0x7f64680b9f80 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f64567fc640 1 -- 10.20.193.26:0/2922835923 >> v1:10.20.193.70:6789/0 conn(0x7f64680585e0 legacy=0x7f64681657d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f64567fc640 1 -- 10.20.193.26:0/2922835923 >> v1:10.20.193.26:6789/0 conn(0x7f64680ba350 legacy=0x7f64681645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f64567fc640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f64567fc640 1 monclient: found mon.c 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f64567fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f64567fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f64567fc640 1 -- 10.20.193.26:0/2922835923 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6468166450 con 0x7f64680b9f80 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f64567fc640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f64567fc640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f64567fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f646fc3c640 5 monclient: authenticate success, global_id 4469 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f646fc3c640 10 monclient: _renew_subs 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f646fc3c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f646fc3c640 1 -- 10.20.193.26:0/2922835923 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f64681fb2e0 con 0x7f64680b9f80 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f646fc3c640 10 client.4469.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f646fc3c640 10 monclient: _renew_subs 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f646fc3c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f646fc3c640 1 -- 10.20.193.26:0/2922835923 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f64681fb8a0 con 0x7f64680b9f80 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f646fc3c640 1 librados: init done 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f70beffd640 1 -- 10.20.193.26:0/2159113441 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1976006402 0 0) 0x7f70d81fb730 con 0x7f70d80585e0 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f70beffd640 1 -- 10.20.193.26:0/2159113441 >> v1:10.20.193.103:6789/0 conn(0x7f70d80ba350 legacy=0x7f70d8160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f70beffd640 1 -- 10.20.193.26:0/2159113441 >> v1:10.20.193.26:6789/0 conn(0x7f70d80b9f80 legacy=0x7f70d815daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f70beffd640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f70beffd640 1 monclient: found mon.b 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f70beffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f70beffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f70beffd640 1 -- 10.20.193.26:0/2159113441 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d81fba10 con 0x7f70d80585e0 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f70beffd640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f70beffd640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f70beffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f70dcd33640 5 monclient: authenticate success, global_id 4462 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f70dcd33640 10 monclient: _renew_subs 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f70dcd33640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f70dcd33640 1 -- 10.20.193.26:0/2159113441 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f70d81fbcf0 con 0x7f70d80585e0 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f70dcd33640 10 client.4462.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f70dcd33640 10 monclient: _renew_subs 2026-02-24T19:18:09.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f70dcd33640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7af0001640 10 client.4463.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7af0001640 15 client.4463.objecter _session_command_op_assign -1 1 2026-02-24T19:18:09.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7af0001640 20 client.4463.objecter _get_session osd=-1 returning homeless 2026-02-24T19:18:09.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f70dcd33640 1 -- 10.20.193.26:0/2159113441 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f70d815faf0 con 0x7f70d80585e0 2026-02-24T19:18:09.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f70dcd33640 1 librados: init done 2026-02-24T19:18:09.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7af0001640 10 client.4463.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7af0001640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.527+0000 7f7af0001640 1 -- 10.20.193.26:0/3517643153 --> v1:10.20.193.103:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f7ae8161460 con 0x7f7ae8159e40 2026-02-24T19:18:09.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.528+0000 7fb683fff640 1 -- 10.20.193.26:0/4238003527 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1188657026 0 0) 0x7fb6a80b4ea0 con 0x7fb6a80585e0 2026-02-24T19:18:09.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.528+0000 7fb683fff640 1 -- 10.20.193.26:0/4238003527 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb6a80b23b0 con 0x7fb6a80585e0 2026-02-24T19:18:09.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.528+0000 7fb683fff640 1 -- 10.20.193.26:0/4238003527 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fb6940030b0 con 0x7fb6a80585e0 2026-02-24T19:18:09.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.528+0000 7fb683fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.528+0000 7fb683fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.528+0000 7fb683fff640 10 monclient(hunting): dump: 2026-02-24T19:18:09.558 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.558 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.558 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.558 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.558 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.558 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.558 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.558 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.558 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.558 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.528+0000 7f0e1affd640 10 client.4451.objecter ms_handle_connect 0x7f0e000a1450 2026-02-24T19:18:09.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.528+0000 7f646fc3c640 10 client.4469.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.528+0000 7f646fc3c640 15 client.4469.objecter _session_command_op_assign -1 1 2026-02-24T19:18:09.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.528+0000 7f646fc3c640 20 client.4469.objecter _get_session osd=-1 returning homeless 2026-02-24T19:18:09.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.528+0000 7f646fc3c640 10 client.4469.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.528+0000 7f646fc3c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.528+0000 7f646fc3c640 1 -- 10.20.193.26:0/2922835923 --> v1:10.20.193.103:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f64680b96a0 con 0x7f64680b9f80 2026-02-24T19:18:09.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.528+0000 7f70dcd33640 10 client.4462.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.528+0000 7f70dcd33640 15 client.4462.objecter _session_command_op_assign -1 1 2026-02-24T19:18:09.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.528+0000 7f70dcd33640 20 client.4462.objecter _get_session osd=-1 returning homeless 2026-02-24T19:18:09.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.528+0000 7f70dcd33640 10 client.4462.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.528+0000 7f70dcd33640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.528+0000 7f70dcd33640 1 -- 10.20.193.26:0/2159113441 --> v1:10.20.193.70:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f70d815e210 con 0x7f70d80585e0 2026-02-24T19:18:09.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f75effff640 1 -- 10.20.193.26:0/4132827319 <== osd.8 v1:10.20.193.26:6812/1933830164 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f76140b6dc0 con 0x7f75e40a1250 2026-02-24T19:18:09.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f75effff640 10 client.4439.objecter ms_dispatch2 0x7f7614000b90 command_reply(tid 2: 0 ) 2026-02-24T19:18:09.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f75effff640 10 client.4439.objecter _finish_command 2 = system:0 2026-02-24T19:18:09.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f75effff640 20 client.4439.objecter put_session s=0x7f75e40a0ba0 osd=8 4 2026-02-24T19:18:09.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f75effff640 15 client.4439.objecter _session_command_op_remove 8 2 2026-02-24T19:18:09.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f2a9bfff640 1 -- 10.20.193.26:0/1231125686 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2ac0055d30 con 0x7f2ac016ad30 2026-02-24T19:18:09.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f2a9bfff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f2a9bfff640 1 -- 10.20.193.26:0/1231125686 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2ab4003ce0 con 0x7f2ac016ad30 2026-02-24T19:18:09.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f7619b7f640 10 librados: watch_flush enter 2026-02-24T19:18:09.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f7619b7f640 10 librados: watch_flush exit 2026-02-24T19:18:09.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f2a9bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f2a9bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:09.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f2abdffb640 4 set_mon_vals no callback set 2026-02-24T19:18:09.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f2a9bfff640 10 monclient: dump: 2026-02-24T19:18:09.560 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.560 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.560 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.560 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.560 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.560 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.560 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.560 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.560 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.560 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f7619b7f640 10 client.4439.objecter close_session for osd.8 2026-02-24T19:18:09.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f7619b7f640 1 -- 10.20.193.26:0/4132827319 >> v1:10.20.193.26:6812/1933830164 conn(0x7f75e40a1250 legacy=0x7f75e40c1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f7619b7f640 20 client.4439.objecter put_session s=0x7f75e40a0ba0 osd=8 1 2026-02-24T19:18:09.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f7619b7f640 20 client.4439.objecter shutdown clearing up homeless session... 2026-02-24T19:18:09.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f7619b7f640 10 client.4439.objecter successfully canceled tick 2026-02-24T19:18:09.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f7619b7f640 1 -- 10.20.193.26:0/4132827319 >> v1:10.20.193.162:6800/3889602630 conn(0x7f75e4077d20 legacy=0x7f75e40981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f7619b7f640 10 monclient: shutdown 2026-02-24T19:18:09.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f7619b7f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f7619b7f640 1 -- 10.20.193.26:0/4132827319 >> v1:10.20.193.103:6789/0 conn(0x7f76140b2920 legacy=0x7f7614133650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f7613fff640 1 -- 10.20.193.26:0/4132827319 reap_dead start 2026-02-24T19:18:09.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f7619b7f640 1 -- 10.20.193.26:0/4132827319 shutdown_connections 2026-02-24T19:18:09.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f7619b7f640 1 -- 10.20.193.26:0/4132827319 >> 10.20.193.26:0/4132827319 conn(0x7f76140b5250 msgr2=0x7f76140b5620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f7619b7f640 1 -- 10.20.193.26:0/4132827319 shutdown_connections 2026-02-24T19:18:09.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f7619b7f640 1 -- 10.20.193.26:0/4132827319 wait complete. 2026-02-24T19:18:09.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f7619b7f640 1 librados: shutdown 2026-02-24T19:18:09.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f82bffff640 1 -- 10.20.193.26:0/368358355 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f82e8160ba0 con 0x7f82e80b9f80 2026-02-24T19:18:09.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f82bffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f82bffff640 1 -- 10.20.193.26:0/368358355 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f82d00039f0 con 0x7f82e80b9f80 2026-02-24T19:18:09.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f82bffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f82e57fa640 4 set_mon_vals no callback set 2026-02-24T19:18:09.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f82bffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.531+0000 7f82bffff640 10 monclient: dump: 2026-02-24T19:18:09.561 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.561 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.561 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.561 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.561 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.561 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.561 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.561 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.561 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.561 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.532+0000 7f2a9bfff640 1 -- 10.20.193.26:0/1231125686 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f2ab401cb50 con 0x7f2ac016ad30 2026-02-24T19:18:09.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.532+0000 7f82bffff640 1 -- 10.20.193.26:0/368358355 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f82d0003c00 con 0x7f82e80b9f80 2026-02-24T19:18:09.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.532+0000 7f2abf7fe640 10 monclient: get_auth_request con 0x7f2a90077ef0 auth_method 0 2026-02-24T19:18:09.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.533+0000 7f2a9bfff640 10 client.4440.objecter ms_handle_connect 0x7f2a90077ef0 2026-02-24T19:18:09.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.533+0000 7f82e6ffd640 10 monclient: get_auth_request con 0x7f82b8077d00 auth_method 0 2026-02-24T19:18:09.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.533+0000 7f82bffff640 10 client.4447.objecter ms_handle_connect 0x7f82b8077d00 2026-02-24T19:18:09.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.533+0000 7f82bffff640 1 -- 10.20.193.26:0/368358355 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f82d00931a0 con 0x7f82e80b9f80 2026-02-24T19:18:09.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.533+0000 7f82bffff640 10 client.4447.objecter ms_dispatch2 0x7f82e8000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:09.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.533+0000 7f82bffff640 3 client.4447.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:09.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.533+0000 7f82bffff640 3 client.4447.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:09.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f82bffff640 10 client.4447.objecter checking command 1 2026-02-24T19:18:09.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f82bffff640 20 client.4447.objecter _get_session s=0x7f82b80a0b80 osd=3 3 2026-02-24T19:18:09.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f82bffff640 20 client.4447.objecter put_session s=0x7f82b80a0b80 osd=3 3 2026-02-24T19:18:09.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f82bffff640 15 client.4447.objecter _session_command_op_remove -1 1 2026-02-24T19:18:09.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f82bffff640 20 client.4447.objecter _get_session s=0x7f82b80a0b80 osd=3 3 2026-02-24T19:18:09.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f82bffff640 20 client.4447.objecter get_session s=0x7f82b80a0b80 osd=3 3 2026-02-24T19:18:09.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f82bffff640 15 client.4447.objecter _session_command_op_assign 3 1 2026-02-24T19:18:09.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f82bffff640 20 client.4447.objecter put_session s=0x7f82b80a0b80 osd=3 4 2026-02-24T19:18:09.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f82bffff640 10 client.4447.objecter _send_command 1 2026-02-24T19:18:09.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f82bffff640 1 -- 10.20.193.26:0/368358355 --> v1:10.20.193.162:6805/920272754 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f82b80c2ed0 con 0x7f82b80a1230 2026-02-24T19:18:09.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f82bffff640 20 client.4447.objecter dump_active .. 0 homeless 2026-02-24T19:18:09.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f82bffff640 1 -- 10.20.193.26:0/368358355 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f82d0059840 con 0x7f82e80b9f80 2026-02-24T19:18:09.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f82bffff640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:18:09.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f610f7fe640 1 -- 10.20.193.26:0/1994107782 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 744021896 0 0) 0x7f61301ff9e0 con 0x7f61300ba350 2026-02-24T19:18:09.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f610f7fe640 1 -- 10.20.193.26:0/1994107782 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f613015c090 con 0x7f61300ba350 2026-02-24T19:18:09.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f610f7fe640 1 -- 10.20.193.26:0/1994107782 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6120003360 con 0x7f61300ba350 2026-02-24T19:18:09.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f610f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f610f7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f610f7fe640 10 monclient(hunting): dump: 2026-02-24T19:18:09.562 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.562 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.563 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.563 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.563 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.563 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.563 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.563 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.563 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.563 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f2a9bfff640 1 -- 10.20.193.26:0/1231125686 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f2ab4091fb0 con 0x7f2ac016ad30 2026-02-24T19:18:09.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f2a9bfff640 10 client.4440.objecter ms_dispatch2 0x7f2ac0000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:09.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f2a9bfff640 3 client.4440.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:09.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f2a9bfff640 3 client.4440.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:09.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7fb683fff640 1 -- 10.20.193.26:0/4238003527 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1216689229 0 0) 0x7fb6a80b2690 con 0x7fb6a80b9f80 2026-02-24T19:18:09.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7fb683fff640 1 -- 10.20.193.26:0/4238003527 >> v1:10.20.193.103:6789/0 conn(0x7fb6a80585e0 legacy=0x7fb6a80b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7fb683fff640 1 -- 10.20.193.26:0/4238003527 >> v1:10.20.193.26:6789/0 conn(0x7fb6a80ba350 legacy=0x7fb6a81fe480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7fb683fff640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7fb683fff640 1 monclient: found mon.b 2026-02-24T19:18:09.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7fb683fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7fb683fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7fb683fff640 1 -- 10.20.193.26:0/4238003527 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a80b2970 con 0x7fb6a80b9f80 2026-02-24T19:18:09.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7fb683fff640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7fb683fff640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7fb683fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7fb6ae10a640 5 monclient: authenticate success, global_id 4465 2026-02-24T19:18:09.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7fb6ae10a640 10 monclient: _renew_subs 2026-02-24T19:18:09.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7fb6ae10a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7fb6ae10a640 1 -- 10.20.193.26:0/4238003527 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb6a80b2c50 con 0x7fb6a80b9f80 2026-02-24T19:18:09.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f82e77fe640 10 monclient: get_auth_request con 0x7f82b80a1230 auth_method 0 2026-02-24T19:18:09.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f2a9bfff640 10 client.4440.objecter checking command 1 2026-02-24T19:18:09.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7fb6ae10a640 10 client.4465.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7fb6ae10a640 10 monclient: _renew_subs 2026-02-24T19:18:09.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7fb6ae10a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7fb6ae10a640 1 -- 10.20.193.26:0/4238003527 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb6a80b3210 con 0x7fb6a80b9f80 2026-02-24T19:18:09.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7fb6ae10a640 1 librados: init done 2026-02-24T19:18:09.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f2a9bfff640 20 client.4440.objecter _get_session s=0x7f2a900a0d70 osd=11 3 2026-02-24T19:18:09.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f2a9bfff640 20 client.4440.objecter put_session s=0x7f2a900a0d70 osd=11 3 2026-02-24T19:18:09.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f2a9bfff640 15 client.4440.objecter _session_command_op_remove -1 1 2026-02-24T19:18:09.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f2a9bfff640 20 client.4440.objecter _get_session s=0x7f2a900a0d70 osd=11 3 2026-02-24T19:18:09.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f2a9bfff640 20 client.4440.objecter get_session s=0x7f2a900a0d70 osd=11 3 2026-02-24T19:18:09.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f2a9bfff640 15 client.4440.objecter _session_command_op_assign 11 1 2026-02-24T19:18:09.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f2a9bfff640 20 client.4440.objecter put_session s=0x7f2a900a0d70 osd=11 4 2026-02-24T19:18:09.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f2a9bfff640 10 client.4440.objecter _send_command 1 2026-02-24T19:18:09.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f2a9bfff640 1 -- 10.20.193.26:0/1231125686 --> v1:10.20.193.162:6813/1717662802 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2a900c3020 con 0x7f2a900a1420 2026-02-24T19:18:09.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f2a9bfff640 20 client.4440.objecter dump_active .. 0 homeless 2026-02-24T19:18:09.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f2a9bfff640 1 -- 10.20.193.26:0/1231125686 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f2ab4058650 con 0x7f2ac016ad30 2026-02-24T19:18:09.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.534+0000 7f2a9bfff640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:18:09.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.535+0000 7fb6ae10a640 10 client.4465.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.535+0000 7fb6ae10a640 15 client.4465.objecter _session_command_op_assign -1 1 2026-02-24T19:18:09.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.535+0000 7fb6ae10a640 20 client.4465.objecter _get_session osd=-1 returning homeless 2026-02-24T19:18:09.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.535+0000 7fb6ae10a640 10 client.4465.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.535+0000 7fb6ae10a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.535+0000 7fb6ae10a640 1 -- 10.20.193.26:0/4238003527 --> v1:10.20.193.70:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fb6a80b64c0 con 0x7fb6a80b9f80 2026-02-24T19:18:09.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.535+0000 7f2abeffd640 10 monclient: get_auth_request con 0x7f2a900a1420 auth_method 0 2026-02-24T19:18:09.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.535+0000 7f610f7fe640 1 -- 10.20.193.26:0/1994107782 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3277621283 0 0) 0x7f60fc003610 con 0x7f61300b9f80 2026-02-24T19:18:09.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.535+0000 7f610f7fe640 1 -- 10.20.193.26:0/1994107782 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f61301ff9e0 con 0x7f61300b9f80 2026-02-24T19:18:09.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.535+0000 7f610f7fe640 1 -- 10.20.193.26:0/1994107782 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6118002f90 con 0x7f61300b9f80 2026-02-24T19:18:09.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.535+0000 7f610f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.535+0000 7f610f7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:09.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.535+0000 7f610f7fe640 10 monclient(hunting): dump: 2026-02-24T19:18:09.565 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.565 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.565 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.565 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.565 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.565 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.565 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.565 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.565 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.565 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.536+0000 7f82bffff640 10 client.4447.objecter ms_handle_connect 0x7f82b80a1230 2026-02-24T19:18:09.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.536+0000 7f2a9bfff640 10 client.4440.objecter ms_handle_connect 0x7f2a900a1420 2026-02-24T19:18:09.566 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:09.566 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-24T19:18:09.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.540+0000 7f610f7fe640 1 -- 10.20.193.26:0/1994107782 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 291891814 0 0) 0x7f61301ff700 con 0x7f61300585e0 2026-02-24T19:18:09.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.540+0000 7f610f7fe640 1 -- 10.20.193.26:0/1994107782 >> v1:10.20.193.70:6789/0 conn(0x7f61300ba350 legacy=0x7f61301650d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.540+0000 7f610f7fe640 1 -- 10.20.193.26:0/1994107782 >> v1:10.20.193.26:6789/0 conn(0x7f61300b9f80 legacy=0x7f613015b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.540+0000 7f610f7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.540+0000 7f610f7fe640 1 monclient: found mon.c 2026-02-24T19:18:09.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.540+0000 7f610f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.540+0000 7f610f7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.540+0000 7f610f7fe640 1 -- 10.20.193.26:0/1994107782 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61301ffcc0 con 0x7f61300585e0 2026-02-24T19:18:09.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.540+0000 7f610f7fe640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.540+0000 7f610f7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.540+0000 7f610f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.540+0000 7f613507b640 5 monclient: authenticate success, global_id 4484 2026-02-24T19:18:09.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.540+0000 7f613507b640 10 monclient: _renew_subs 2026-02-24T19:18:09.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.540+0000 7f613507b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.540+0000 7f613507b640 1 -- 10.20.193.26:0/1994107782 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f61301648d0 con 0x7f61300585e0 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.540+0000 7f613507b640 10 client.4484.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.540+0000 7f613507b640 10 monclient: _renew_subs 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.540+0000 7f613507b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.540+0000 7f613507b640 1 -- 10.20.193.26:0/1994107782 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f61301659c0 con 0x7f61300585e0 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.540+0000 7f613507b640 1 librados: init done 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.540+0000 7f8983fff640 1 -- 10.20.193.26:0/989299693 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f89a81600d0 con 0x7f89a80ba350 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.540+0000 7f8983fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.540+0000 7f8983fff640 1 -- 10.20.193.26:0/989299693 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f899c004db0 con 0x7f89a80ba350 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.540+0000 7f8983fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.540+0000 7f89a5ffb640 4 set_mon_vals no callback set 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.540+0000 7f8983fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.540+0000 7f8983fff640 10 monclient: dump: 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.541+0000 7f8983fff640 1 -- 10.20.193.26:0/989299693 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f899c01dc20 con 0x7f89a80ba350 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.541+0000 7f613507b640 10 client.4484.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.541+0000 7f613507b640 15 client.4484.objecter _session_command_op_assign -1 1 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.541+0000 7f613507b640 20 client.4484.objecter _get_session osd=-1 returning homeless 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.541+0000 7f613507b640 10 client.4484.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.541+0000 7f613507b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.541+0000 7f613507b640 1 -- 10.20.193.26:0/1994107782 --> v1:10.20.193.103:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f61300b64c0 con 0x7f61300585e0 2026-02-24T19:18:09.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.542+0000 7f89a77fe640 10 monclient: get_auth_request con 0x7f8978077f20 auth_method 0 2026-02-24T19:18:09.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.542+0000 7f8983fff640 10 client.4446.objecter ms_handle_connect 0x7f8978077f20 2026-02-24T19:18:09.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.544+0000 7f7ad67fc640 1 -- 10.20.193.26:0/3517643153 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7ae8161460 con 0x7f7ae8159e40 2026-02-24T19:18:09.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.544+0000 7f7ad67fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.544+0000 7f7ad67fc640 1 -- 10.20.193.26:0/3517643153 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7ae4003c20 con 0x7f7ae8159e40 2026-02-24T19:18:09.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.544+0000 7f7ad67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.544+0000 7f7ad67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.544+0000 7f7ad7fff640 4 set_mon_vals no callback set 2026-02-24T19:18:09.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.544+0000 7f7ad67fc640 10 monclient: dump: 2026-02-24T19:18:09.568 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.568 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.568 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.568 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.568 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.568 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.568 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.568 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.568 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.568 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.545+0000 7f7ad67fc640 1 -- 10.20.193.26:0/3517643153 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f7ae4003e30 con 0x7f7ae8159e40 2026-02-24T19:18:09.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.546+0000 7f7aedd76640 10 monclient: get_auth_request con 0x7f7ab8077f00 auth_method 0 2026-02-24T19:18:09.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.546+0000 7f8983fff640 1 -- 10.20.193.26:0/989299693 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f899c093170 con 0x7f89a80ba350 2026-02-24T19:18:09.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.546+0000 7f8983fff640 10 client.4446.objecter ms_dispatch2 0x7f89a8000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:09.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.546+0000 7f8983fff640 3 client.4446.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:09.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.546+0000 7f8983fff640 3 client.4446.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:09.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.546+0000 7f8983fff640 10 client.4446.objecter checking command 1 2026-02-24T19:18:09.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.546+0000 7f8983fff640 20 client.4446.objecter _get_session s=0x7f89780a0da0 osd=4 3 2026-02-24T19:18:09.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.546+0000 7f8983fff640 20 client.4446.objecter put_session s=0x7f89780a0da0 osd=4 3 2026-02-24T19:18:09.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.546+0000 7f8983fff640 15 client.4446.objecter _session_command_op_remove -1 1 2026-02-24T19:18:09.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.546+0000 7f8983fff640 20 client.4446.objecter _get_session s=0x7f89780a0da0 osd=4 3 2026-02-24T19:18:09.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.546+0000 7f8983fff640 20 client.4446.objecter get_session s=0x7f89780a0da0 osd=4 3 2026-02-24T19:18:09.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.546+0000 7f8983fff640 15 client.4446.objecter _session_command_op_assign 4 1 2026-02-24T19:18:09.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.546+0000 7f8983fff640 20 client.4446.objecter put_session s=0x7f89780a0da0 osd=4 4 2026-02-24T19:18:09.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.546+0000 7f8983fff640 10 client.4446.objecter _send_command 1 2026-02-24T19:18:09.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.546+0000 7f8983fff640 1 -- 10.20.193.26:0/989299693 --> v1:10.20.193.26:6800/3717327686 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f89780c3050 con 0x7f89780a1450 2026-02-24T19:18:09.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.546+0000 7f8983fff640 20 client.4446.objecter dump_active .. 0 homeless 2026-02-24T19:18:09.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.546+0000 7f8983fff640 1 -- 10.20.193.26:0/989299693 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f899c059810 con 0x7f89a80ba350 2026-02-24T19:18:09.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.546+0000 7f8983fff640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:18:09.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.546+0000 7f7ad67fc640 10 client.4463.objecter ms_handle_connect 0x7f7ab8077f00 2026-02-24T19:18:09.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.546+0000 7f89a6ffd640 10 monclient: get_auth_request con 0x7f89780a1450 auth_method 0 2026-02-24T19:18:09.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.547+0000 7f7ad67fc640 1 -- 10.20.193.26:0/3517643153 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f7ae4003c20 con 0x7f7ae8159e40 2026-02-24T19:18:09.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.547+0000 7f7ad67fc640 10 client.4463.objecter ms_dispatch2 0x7f7ae8000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:09.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.547+0000 7f7ad67fc640 3 client.4463.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:09.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.547+0000 7f7ad67fc640 3 client.4463.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:09.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.547+0000 7f7ad67fc640 10 client.4463.objecter checking command 1 2026-02-24T19:18:09.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.547+0000 7f7ad67fc640 20 client.4463.objecter _get_session s=0x7f7ab80a0d80 osd=6 3 2026-02-24T19:18:09.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.547+0000 7f7ad67fc640 20 client.4463.objecter put_session s=0x7f7ab80a0d80 osd=6 3 2026-02-24T19:18:09.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.547+0000 7f7ad67fc640 15 client.4463.objecter _session_command_op_remove -1 1 2026-02-24T19:18:09.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.547+0000 7f7ad67fc640 20 client.4463.objecter _get_session s=0x7f7ab80a0d80 osd=6 3 2026-02-24T19:18:09.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.547+0000 7f7ad67fc640 20 client.4463.objecter get_session s=0x7f7ab80a0d80 osd=6 3 2026-02-24T19:18:09.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.547+0000 7f7ad67fc640 15 client.4463.objecter _session_command_op_assign 6 1 2026-02-24T19:18:09.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.547+0000 7f7ad67fc640 20 client.4463.objecter put_session s=0x7f7ab80a0d80 osd=6 4 2026-02-24T19:18:09.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.547+0000 7f7ad67fc640 10 client.4463.objecter _send_command 1 2026-02-24T19:18:09.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.547+0000 7f7ad67fc640 1 -- 10.20.193.26:0/3517643153 --> v1:10.20.193.103:6808/3149418268 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ab80c3030 con 0x7f7ab80a1430 2026-02-24T19:18:09.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.547+0000 7f7ad67fc640 20 client.4463.objecter dump_active .. 0 homeless 2026-02-24T19:18:09.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.547+0000 7f7ad67fc640 1 -- 10.20.193.26:0/3517643153 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f7ae40599d0 con 0x7f7ae8159e40 2026-02-24T19:18:09.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.547+0000 7f7ad67fc640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:18:09.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.547+0000 7f0e1affd640 1 -- 10.20.193.26:0/664289147 <== osd.12 v1:10.20.193.26:6804/2128192173 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f0e1c004130 con 0x7f0e000a1450 2026-02-24T19:18:09.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.547+0000 7f0e1affd640 10 client.4451.objecter ms_dispatch2 0x7f0e30000b90 command_reply(tid 1: 0 ) 2026-02-24T19:18:09.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.547+0000 7f0e1affd640 10 client.4451.objecter _finish_command 1 = system:0 2026-02-24T19:18:09.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.547+0000 7f0e1affd640 20 client.4451.objecter put_session s=0x7f0e000a0da0 osd=12 4 2026-02-24T19:18:09.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.547+0000 7f0e1affd640 15 client.4451.objecter _session_command_op_remove 12 1 2026-02-24T19:18:09.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.547+0000 7f7aed575640 10 monclient: get_auth_request con 0x7f7ab80a1430 auth_method 0 2026-02-24T19:18:09.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.548+0000 7f8983fff640 10 client.4446.objecter ms_handle_connect 0x7f89780a1450 2026-02-24T19:18:09.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.549+0000 7f7ad67fc640 10 client.4463.objecter ms_handle_connect 0x7f7ab80a1430 2026-02-24T19:18:09.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.550+0000 7f64567fc640 1 -- 10.20.193.26:0/2922835923 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f64680b96a0 con 0x7f64680b9f80 2026-02-24T19:18:09.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.550+0000 7f64567fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.550+0000 7f64567fc640 1 -- 10.20.193.26:0/2922835923 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f645c003990 con 0x7f64680b9f80 2026-02-24T19:18:09.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.550+0000 7f64567fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.550+0000 7f6457fff640 4 set_mon_vals no callback set 2026-02-24T19:18:09.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.550+0000 7f64567fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.550+0000 7f64567fc640 10 monclient: dump: 2026-02-24T19:18:09.571 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.571 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.571 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.571 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.571 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.571 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.571 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.571 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.571 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.571 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.551+0000 7f64567fc640 1 -- 10.20.193.26:0/2922835923 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f645c003ba0 con 0x7f64680b9f80 2026-02-24T19:18:09.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.552+0000 7f646d9b1640 10 monclient: get_auth_request con 0x7f6438077d60 auth_method 0 2026-02-24T19:18:09.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.552+0000 7f64567fc640 10 client.4469.objecter ms_handle_connect 0x7f6438077d60 2026-02-24T19:18:09.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.553+0000 7f64567fc640 1 -- 10.20.193.26:0/2922835923 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f645c093000 con 0x7f64680b9f80 2026-02-24T19:18:09.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.553+0000 7f64567fc640 10 client.4469.objecter ms_dispatch2 0x7f6468000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:09.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.553+0000 7f64567fc640 3 client.4469.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:09.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.553+0000 7f64567fc640 3 client.4469.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:09.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.553+0000 7f64567fc640 10 client.4469.objecter checking command 1 2026-02-24T19:18:09.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.553+0000 7f64567fc640 20 client.4469.objecter _get_session s=0x7f64380a0be0 osd=9 3 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.553+0000 7f64567fc640 20 client.4469.objecter put_session s=0x7f64380a0be0 osd=9 3 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.553+0000 7f64567fc640 15 client.4469.objecter _session_command_op_remove -1 1 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.553+0000 7f64567fc640 20 client.4469.objecter _get_session s=0x7f64380a0be0 osd=9 3 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.553+0000 7f64567fc640 20 client.4469.objecter get_session s=0x7f64380a0be0 osd=9 3 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.553+0000 7f64567fc640 15 client.4469.objecter _session_command_op_assign 9 1 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.553+0000 7f64567fc640 20 client.4469.objecter put_session s=0x7f64380a0be0 osd=9 4 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.553+0000 7f64567fc640 10 client.4469.objecter _send_command 1 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.553+0000 7f64567fc640 1 -- 10.20.193.26:0/2922835923 --> v1:10.20.193.70:6804/3709696191 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f64380c2e90 con 0x7f64380a1290 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.553+0000 7f64567fc640 20 client.4469.objecter dump_active .. 0 homeless 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.553+0000 7f64567fc640 1 -- 10.20.193.26:0/2922835923 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f645c0596a0 con 0x7f64680b9f80 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.553+0000 7f64567fc640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.553+0000 7f646e1b2640 10 monclient: get_auth_request con 0x7f64380a1290 auth_method 0 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.554+0000 7f0e3898a640 10 client.4451.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.554+0000 7f0e3898a640 15 client.4451.objecter _session_command_op_assign -1 2 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.554+0000 7f0e3898a640 20 client.4451.objecter _get_session s=0x7f0e000a0da0 osd=12 3 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.554+0000 7f0e3898a640 20 client.4451.objecter put_session s=0x7f0e000a0da0 osd=12 3 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.554+0000 7f0e3898a640 20 client.4451.objecter _get_session s=0x7f0e000a0da0 osd=12 3 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.554+0000 7f0e3898a640 15 client.4451.objecter _session_command_op_remove -1 2 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.554+0000 7f0e3898a640 20 client.4451.objecter get_session s=0x7f0e000a0da0 osd=12 3 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.554+0000 7f0e3898a640 15 client.4451.objecter _session_command_op_assign 12 2 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.554+0000 7f0e3898a640 20 client.4451.objecter put_session s=0x7f0e000a0da0 osd=12 4 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.554+0000 7f0e3898a640 10 client.4451.objecter _send_command 2 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.554+0000 7f0e3898a640 1 -- 10.20.193.26:0/664289147 --> v1:10.20.193.26:6804/2128192173 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0e30131360 con 0x7f0e000a1450 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.555+0000 7f35c77fe640 1 -- 10.20.193.26:0/2813836055 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f35e8160dd0 con 0x7f35e80b9f80 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.555+0000 7f35c77fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.555+0000 7f35c77fe640 1 -- 10.20.193.26:0/2813836055 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f35d00039b0 con 0x7f35e80b9f80 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.555+0000 7f35c77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.555+0000 7f35c77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:09.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.555+0000 7f35c77fe640 10 monclient: dump: 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.555+0000 7f35e57fa640 4 set_mon_vals no callback set 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.555+0000 7f64567fc640 10 client.4469.objecter ms_handle_connect 0x7f64380a1290 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.555+0000 7f2a9bfff640 1 -- 10.20.193.26:0/1231125686 <== osd.11 v1:10.20.193.162:6813/1717662802 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f2a900c3020 con 0x7f2a900a1420 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.555+0000 7f2a9bfff640 10 client.4440.objecter ms_dispatch2 0x7f2ac0000b90 command_reply(tid 1: 0 ) 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.555+0000 7f2a9bfff640 10 client.4440.objecter _finish_command 1 = system:0 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.555+0000 7f2a9bfff640 20 client.4440.objecter put_session s=0x7f2a900a0d70 osd=11 4 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.555+0000 7f2a9bfff640 15 client.4440.objecter _session_command_op_remove 11 1 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.555+0000 7f50927fc640 1 -- 10.20.193.26:0/2908256076 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f50a4160ba0 con 0x7f50a40585e0 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.555+0000 7f50927fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.555+0000 7f50927fc640 1 -- 10.20.193.26:0/2908256076 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f5094003850 con 0x7f50a40585e0 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.555+0000 7f50927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.555+0000 7f50927fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.555+0000 7f50927fc640 10 monclient: dump: 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.573 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.574 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.574 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.555+0000 7f5093fff640 4 set_mon_vals no callback set 2026-02-24T19:18:09.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.555+0000 7f35c77fe640 1 -- 10.20.193.26:0/2813836055 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f35d0003bc0 con 0x7f35e80b9f80 2026-02-24T19:18:09.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.555+0000 7f82bffff640 1 -- 10.20.193.26:0/368358355 <== osd.3 v1:10.20.193.162:6805/920272754 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f82b80c2ed0 con 0x7f82b80a1230 2026-02-24T19:18:09.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.555+0000 7f82bffff640 10 client.4447.objecter ms_dispatch2 0x7f82e8000b90 command_reply(tid 1: 0 ) 2026-02-24T19:18:09.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.555+0000 7f82bffff640 10 client.4447.objecter _finish_command 1 = system:0 2026-02-24T19:18:09.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.555+0000 7f82bffff640 20 client.4447.objecter put_session s=0x7f82b80a0b80 osd=3 4 2026-02-24T19:18:09.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.555+0000 7f82bffff640 15 client.4447.objecter _session_command_op_remove 3 1 2026-02-24T19:18:09.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.556+0000 7f35e6ffd640 10 monclient: get_auth_request con 0x7f35b4077e00 auth_method 0 2026-02-24T19:18:09.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.556+0000 7f50927fc640 1 -- 10.20.193.26:0/2908256076 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f509401c6c0 con 0x7f50a40585e0 2026-02-24T19:18:09.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.556+0000 7f35c77fe640 10 client.4449.objecter ms_handle_connect 0x7f35b4077e00 2026-02-24T19:18:09.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.557+0000 7f50a97c1640 10 monclient: get_auth_request con 0x7f5074077dd0 auth_method 0 2026-02-24T19:18:09.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.557+0000 7f50927fc640 10 client.4444.objecter ms_handle_connect 0x7f5074077dd0 2026-02-24T19:18:09.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.557+0000 7f0e1affd640 1 -- 10.20.193.26:0/664289147 <== osd.12 v1:10.20.193.26:6804/2128192173 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f0e30131360 con 0x7f0e000a1450 2026-02-24T19:18:09.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.557+0000 7f0e1affd640 10 client.4451.objecter ms_dispatch2 0x7f0e30000b90 command_reply(tid 2: 0 ) 2026-02-24T19:18:09.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.557+0000 7f0e1affd640 10 client.4451.objecter _finish_command 2 = system:0 2026-02-24T19:18:09.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.557+0000 7f0e1affd640 20 client.4451.objecter put_session s=0x7f0e000a0da0 osd=12 4 2026-02-24T19:18:09.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.557+0000 7f0e1affd640 15 client.4451.objecter _session_command_op_remove 12 2 2026-02-24T19:18:09.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.557+0000 7f0e3898a640 10 librados: watch_flush enter 2026-02-24T19:18:09.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.557+0000 7f0e3898a640 10 librados: watch_flush exit 2026-02-24T19:18:09.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.557+0000 7f0e3898a640 10 client.4451.objecter close_session for osd.12 2026-02-24T19:18:09.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.557+0000 7f0e3898a640 1 -- 10.20.193.26:0/664289147 >> v1:10.20.193.26:6804/2128192173 conn(0x7f0e000a1450 legacy=0x7f0e000c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.557+0000 7f0e3898a640 20 client.4451.objecter put_session s=0x7f0e000a0da0 osd=12 1 2026-02-24T19:18:09.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.557+0000 7f0e3898a640 20 client.4451.objecter shutdown clearing up homeless session... 2026-02-24T19:18:09.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.557+0000 7f0e3898a640 10 client.4451.objecter successfully canceled tick 2026-02-24T19:18:09.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f50927fc640 1 -- 10.20.193.26:0/2908256076 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f5094091db0 con 0x7f50a40585e0 2026-02-24T19:18:09.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f50927fc640 10 client.4444.objecter ms_dispatch2 0x7f50a4000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:09.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f50927fc640 3 client.4444.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:09.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f50927fc640 3 client.4444.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:09.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f0e3898a640 1 -- 10.20.193.26:0/664289147 >> v1:10.20.193.162:6800/3889602630 conn(0x7f0e00077f20 legacy=0x7f0e000983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f0e3898a640 10 monclient: shutdown 2026-02-24T19:18:09.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f0e3898a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f0e3898a640 1 -- 10.20.193.26:0/664289147 >> v1:10.20.193.103:6789/0 conn(0x7f0e30161640 legacy=0x7f0e3011e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f0e36f00640 1 -- 10.20.193.26:0/664289147 reap_dead start 2026-02-24T19:18:09.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f0e3898a640 1 -- 10.20.193.26:0/664289147 shutdown_connections 2026-02-24T19:18:09.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f0e3898a640 1 -- 10.20.193.26:0/664289147 >> 10.20.193.26:0/664289147 conn(0x7f0e300b5290 msgr2=0x7f0e300b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f50927fc640 10 client.4444.objecter checking command 1 2026-02-24T19:18:09.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f50927fc640 20 client.4444.objecter _get_session s=0x7f50740a0c50 osd=7 3 2026-02-24T19:18:09.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f50927fc640 20 client.4444.objecter put_session s=0x7f50740a0c50 osd=7 3 2026-02-24T19:18:09.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f50927fc640 15 client.4444.objecter _session_command_op_remove -1 1 2026-02-24T19:18:09.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f50927fc640 20 client.4444.objecter _get_session s=0x7f50740a0c50 osd=7 3 2026-02-24T19:18:09.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f50927fc640 20 client.4444.objecter get_session s=0x7f50740a0c50 osd=7 3 2026-02-24T19:18:09.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f50927fc640 15 client.4444.objecter _session_command_op_assign 7 1 2026-02-24T19:18:09.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f50927fc640 20 client.4444.objecter put_session s=0x7f50740a0c50 osd=7 4 2026-02-24T19:18:09.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f50927fc640 10 client.4444.objecter _send_command 1 2026-02-24T19:18:09.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f50927fc640 1 -- 10.20.193.26:0/2908256076 --> v1:10.20.193.162:6809/2963240067 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f50740c2fa0 con 0x7f50740a1300 2026-02-24T19:18:09.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f0e3898a640 1 -- 10.20.193.26:0/664289147 shutdown_connections 2026-02-24T19:18:09.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f50927fc640 20 client.4444.objecter dump_active .. 0 homeless 2026-02-24T19:18:09.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f50927fc640 1 -- 10.20.193.26:0/2908256076 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f509405beb0 con 0x7f50a40585e0 2026-02-24T19:18:09.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f50927fc640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:18:09.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f0e3898a640 1 -- 10.20.193.26:0/664289147 wait complete. 2026-02-24T19:18:09.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f0e3898a640 1 librados: shutdown 2026-02-24T19:18:09.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.558+0000 7f50aa7c3640 10 monclient: get_auth_request con 0x7f50740a1300 auth_method 0 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.559+0000 7f35c77fe640 1 -- 10.20.193.26:0/2813836055 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f35d00931a0 con 0x7f35e80b9f80 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.559+0000 7f35c77fe640 10 client.4449.objecter ms_dispatch2 0x7f35e8000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.559+0000 7f35c77fe640 3 client.4449.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.559+0000 7f35c77fe640 3 client.4449.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.559+0000 7f35c77fe640 10 client.4449.objecter checking command 1 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.559+0000 7f35c77fe640 20 client.4449.objecter _get_session s=0x7f35b40a0c80 osd=0 3 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.559+0000 7f35c77fe640 20 client.4449.objecter put_session s=0x7f35b40a0c80 osd=0 3 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.559+0000 7f35c77fe640 15 client.4449.objecter _session_command_op_remove -1 1 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.559+0000 7f35c77fe640 20 client.4449.objecter _get_session s=0x7f35b40a0c80 osd=0 3 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.559+0000 7f35c77fe640 20 client.4449.objecter get_session s=0x7f35b40a0c80 osd=0 3 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.559+0000 7f35c77fe640 15 client.4449.objecter _session_command_op_assign 0 1 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.559+0000 7f35c77fe640 20 client.4449.objecter put_session s=0x7f35b40a0c80 osd=0 4 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.559+0000 7f35c77fe640 10 client.4449.objecter _send_command 1 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.559+0000 7f35c77fe640 1 -- 10.20.193.26:0/2813836055 --> v1:10.20.193.26:6808/4098203721 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f35b40c2f30 con 0x7f35b40a1330 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.559+0000 7f35c77fe640 20 client.4449.objecter dump_active .. 0 homeless 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.559+0000 7f35c77fe640 1 -- 10.20.193.26:0/2813836055 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f35d0059840 con 0x7f35e80b9f80 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.559+0000 7f35c77fe640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.559+0000 7f35e77fe640 10 monclient: get_auth_request con 0x7f35b40a1330 auth_method 0 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.560+0000 7f50927fc640 10 client.4444.objecter ms_handle_connect 0x7f50740a1300 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.560+0000 7f610f7fe640 1 -- 10.20.193.26:0/1994107782 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f61300b64c0 con 0x7f61300585e0 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.560+0000 7f610f7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.560+0000 7f610f7fe640 1 -- 10.20.193.26:0/1994107782 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6124003a50 con 0x7f61300585e0 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.560+0000 7f610f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.560+0000 7f610f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.560+0000 7f612d573640 4 set_mon_vals no callback set 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.560+0000 7f610f7fe640 10 monclient: dump: 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.577 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.578 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.578 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.578 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.578 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.578 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.578 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.578 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.561+0000 7f35c77fe640 10 client.4449.objecter ms_handle_connect 0x7f35b40a1330 2026-02-24T19:18:09.578 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.561+0000 7f610f7fe640 1 -- 10.20.193.26:0/1994107782 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f612401c8c0 con 0x7f61300585e0 2026-02-24T19:18:09.578 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.561+0000 7f861cff9640 1 -- 10.20.193.26:0/1159143980 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8614003a80 con 0x7f86200ba350 2026-02-24T19:18:09.578 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.561+0000 7f861cff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.578 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.561+0000 7f861cff9640 1 -- 10.20.193.26:0/1159143980 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f8614003cb0 con 0x7f86200ba350 2026-02-24T19:18:09.578 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.561+0000 7f861cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.578 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.561+0000 7f861cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.578 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.561+0000 7f861e7fc640 4 set_mon_vals no callback set 2026-02-24T19:18:09.578 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.561+0000 7f861cff9640 10 monclient: dump: 2026-02-24T19:18:09.578 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.578 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.578 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.578 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.578 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.578 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.578 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.578 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.578 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.578 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.562+0000 7f612e575640 10 monclient: get_auth_request con 0x7f60fc077ef0 auth_method 0 2026-02-24T19:18:09.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.562+0000 7f610f7fe640 1 -- 10.20.193.26:0/1994107782 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f6124091f10 con 0x7f61300585e0 2026-02-24T19:18:09.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.562+0000 7f610f7fe640 10 client.4484.objecter ms_dispatch2 0x7f6130000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:09.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.562+0000 7f610f7fe640 3 client.4484.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:09.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.562+0000 7f610f7fe640 3 client.4484.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:09.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.562+0000 7f610f7fe640 10 client.4484.objecter checking command 1 2026-02-24T19:18:09.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.562+0000 7f610f7fe640 20 client.4484.objecter _get_session s=0x7f60fc0a0d70 osd=15 3 2026-02-24T19:18:09.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.562+0000 7f610f7fe640 20 client.4484.objecter put_session s=0x7f60fc0a0d70 osd=15 3 2026-02-24T19:18:09.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.562+0000 7f610f7fe640 15 client.4484.objecter _session_command_op_remove -1 1 2026-02-24T19:18:09.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.562+0000 7f610f7fe640 20 client.4484.objecter _get_session s=0x7f60fc0a0d70 osd=15 3 2026-02-24T19:18:09.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.562+0000 7f610f7fe640 20 client.4484.objecter get_session s=0x7f60fc0a0d70 osd=15 3 2026-02-24T19:18:09.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.562+0000 7f610f7fe640 15 client.4484.objecter _session_command_op_assign 15 1 2026-02-24T19:18:09.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.562+0000 7f610f7fe640 20 client.4484.objecter put_session s=0x7f60fc0a0d70 osd=15 4 2026-02-24T19:18:09.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.562+0000 7f610f7fe640 10 client.4484.objecter _send_command 1 2026-02-24T19:18:09.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.562+0000 7f610f7fe640 1 -- 10.20.193.26:0/1994107782 --> v1:10.20.193.162:6801/3445416924 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6124003000 con 0x7f60fc0a1420 2026-02-24T19:18:09.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.562+0000 7f610f7fe640 20 client.4484.objecter dump_active .. 0 homeless 2026-02-24T19:18:09.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.562+0000 7f610f7fe640 1 -- 10.20.193.26:0/1994107782 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f61240585b0 con 0x7f61300585e0 2026-02-24T19:18:09.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.562+0000 7f610f7fe640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:18:09.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.562+0000 7f861cff9640 1 -- 10.20.193.26:0/1159143980 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f8614003ec0 con 0x7f86200ba350 2026-02-24T19:18:09.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.562+0000 7f610f7fe640 10 client.4484.objecter ms_handle_connect 0x7f60fc077ef0 2026-02-24T19:18:09.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.562+0000 7f612f577640 10 monclient: get_auth_request con 0x7f60fc0a1420 auth_method 0 2026-02-24T19:18:09.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.563+0000 7f861ffff640 10 monclient: get_auth_request con 0x7f85f0077d80 auth_method 0 2026-02-24T19:18:09.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.563+0000 7f2ac6213640 10 client.4440.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:18:09.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.563+0000 7f2ac6213640 15 client.4440.objecter _session_command_op_assign -1 2 2026-02-24T19:18:09.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.563+0000 7f2ac6213640 20 client.4440.objecter _get_session s=0x7f2a900a0d70 osd=11 3 2026-02-24T19:18:09.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.563+0000 7f2ac6213640 20 client.4440.objecter put_session s=0x7f2a900a0d70 osd=11 3 2026-02-24T19:18:09.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.563+0000 7f2ac6213640 20 client.4440.objecter _get_session s=0x7f2a900a0d70 osd=11 3 2026-02-24T19:18:09.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.563+0000 7f2ac6213640 15 client.4440.objecter _session_command_op_remove -1 2 2026-02-24T19:18:09.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.563+0000 7f2ac6213640 20 client.4440.objecter get_session s=0x7f2a900a0d70 osd=11 3 2026-02-24T19:18:09.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.563+0000 7f2ac6213640 15 client.4440.objecter _session_command_op_assign 11 2 2026-02-24T19:18:09.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.563+0000 7f2ac6213640 20 client.4440.objecter put_session s=0x7f2a900a0d70 osd=11 4 2026-02-24T19:18:09.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.563+0000 7f2ac6213640 10 client.4440.objecter _send_command 2 2026-02-24T19:18:09.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.563+0000 7f2ac6213640 1 -- 10.20.193.26:0/1231125686 --> v1:10.20.193.162:6813/1717662802 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2ac0161d60 con 0x7f2a900a1420 2026-02-24T19:18:09.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.563+0000 7f861cff9640 10 client.4456.objecter ms_handle_connect 0x7f85f0077d80 2026-02-24T19:18:09.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.563+0000 7f861cff9640 1 -- 10.20.193.26:0/1159143980 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f8614092450 con 0x7f86200ba350 2026-02-24T19:18:09.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.563+0000 7f861cff9640 10 client.4456.objecter ms_dispatch2 0x7f8620000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:09.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.563+0000 7f861cff9640 3 client.4456.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:09.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.563+0000 7f861cff9640 3 client.4456.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:09.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.564+0000 7f861cff9640 10 client.4456.objecter checking command 1 2026-02-24T19:18:09.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.564+0000 7f861cff9640 20 client.4456.objecter _get_session s=0x7f85f00a0c00 osd=14 3 2026-02-24T19:18:09.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.564+0000 7f861cff9640 20 client.4456.objecter put_session s=0x7f85f00a0c00 osd=14 3 2026-02-24T19:18:09.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.564+0000 7f861cff9640 15 client.4456.objecter _session_command_op_remove -1 1 2026-02-24T19:18:09.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.564+0000 7f861cff9640 20 client.4456.objecter _get_session s=0x7f85f00a0c00 osd=14 3 2026-02-24T19:18:09.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.564+0000 7f861cff9640 20 client.4456.objecter get_session s=0x7f85f00a0c00 osd=14 3 2026-02-24T19:18:09.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.564+0000 7f861cff9640 15 client.4456.objecter _session_command_op_assign 14 1 2026-02-24T19:18:09.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.564+0000 7f861cff9640 20 client.4456.objecter put_session s=0x7f85f00a0c00 osd=14 4 2026-02-24T19:18:09.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.564+0000 7f861cff9640 10 client.4456.objecter _send_command 1 2026-02-24T19:18:09.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.564+0000 7f861cff9640 1 -- 10.20.193.26:0/1159143980 --> v1:10.20.193.103:6812/1276189911 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f85f00c2eb0 con 0x7f85f00a12b0 2026-02-24T19:18:09.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.564+0000 7f861cff9640 20 client.4456.objecter dump_active .. 0 homeless 2026-02-24T19:18:09.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.564+0000 7f82eda32640 10 client.4447.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:18:09.581 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.564+0000 7f82eda32640 15 client.4447.objecter _session_command_op_assign -1 2 2026-02-24T19:18:09.581 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.564+0000 7f82eda32640 20 client.4447.objecter _get_session s=0x7f82b80a0b80 osd=3 3 2026-02-24T19:18:09.581 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.564+0000 7f82eda32640 20 client.4447.objecter put_session s=0x7f82b80a0b80 osd=3 3 2026-02-24T19:18:09.581 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.564+0000 7f82eda32640 20 client.4447.objecter _get_session s=0x7f82b80a0b80 osd=3 3 2026-02-24T19:18:09.581 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.564+0000 7f82eda32640 15 client.4447.objecter _session_command_op_remove -1 2 2026-02-24T19:18:09.581 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.564+0000 7f82eda32640 20 client.4447.objecter get_session s=0x7f82b80a0b80 osd=3 3 2026-02-24T19:18:09.581 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.564+0000 7f82eda32640 15 client.4447.objecter _session_command_op_assign 3 2 2026-02-24T19:18:09.581 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.564+0000 7f82eda32640 20 client.4447.objecter put_session s=0x7f82b80a0b80 osd=3 4 2026-02-24T19:18:09.581 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.564+0000 7f82eda32640 10 client.4447.objecter _send_command 2 2026-02-24T19:18:09.581 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.564+0000 7f82eda32640 1 -- 10.20.193.26:0/368358355 --> v1:10.20.193.162:6805/920272754 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f82e8056500 con 0x7f82b80a1230 2026-02-24T19:18:09.581 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.564+0000 7f610f7fe640 10 client.4484.objecter ms_handle_connect 0x7f60fc0a1420 2026-02-24T19:18:09.581 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.564+0000 7f861f7fe640 10 monclient: get_auth_request con 0x7f85f00a12b0 auth_method 0 2026-02-24T19:18:09.581 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.565+0000 7f2a9bfff640 1 -- 10.20.193.26:0/1231125686 <== osd.11 v1:10.20.193.162:6813/1717662802 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1506399442) 0x7f2ac0161d60 con 0x7f2a900a1420 2026-02-24T19:18:09.581 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.565+0000 7f2a9bfff640 10 client.4440.objecter ms_dispatch2 0x7f2ac0000b90 command_reply(tid 2: 0 ) 2026-02-24T19:18:09.581 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.565+0000 7f2a9bfff640 10 client.4440.objecter _finish_command 2 = system:0 2026-02-24T19:18:09.581 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.565+0000 7f2a9bfff640 20 client.4440.objecter put_session s=0x7f2a900a0d70 osd=11 4 2026-02-24T19:18:09.581 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.565+0000 7f2a9bfff640 15 client.4440.objecter _session_command_op_remove 11 2 2026-02-24T19:18:09.582 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.566+0000 7f2ac6213640 10 librados: watch_flush enter 2026-02-24T19:18:09.582 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.566+0000 7f2ac6213640 10 librados: watch_flush exit 2026-02-24T19:18:09.582 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.566+0000 7f2ac6213640 10 client.4440.objecter close_session for osd.11 2026-02-24T19:18:09.582 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.566+0000 7f2ac6213640 1 -- 10.20.193.26:0/1231125686 >> v1:10.20.193.162:6813/1717662802 conn(0x7f2a900a1420 legacy=0x7f2a900c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.582 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.566+0000 7f2ac6213640 20 client.4440.objecter put_session s=0x7f2a900a0d70 osd=11 1 2026-02-24T19:18:09.582 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.566+0000 7f2ac6213640 20 client.4440.objecter shutdown clearing up homeless session... 2026-02-24T19:18:09.582 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.566+0000 7f2ac6213640 10 client.4440.objecter successfully canceled tick 2026-02-24T19:18:09.582 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.566+0000 7f2ac6213640 1 -- 10.20.193.26:0/1231125686 >> v1:10.20.193.162:6800/3889602630 conn(0x7f2a90077ef0 legacy=0x7f2a900983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.582 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.566+0000 7f2ac6213640 10 monclient: shutdown 2026-02-24T19:18:09.582 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.566+0000 7f2ac6213640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.582 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.566+0000 7f2ac6213640 1 -- 10.20.193.26:0/1231125686 >> v1:10.20.193.26:6789/0 conn(0x7f2ac016ad30 legacy=0x7f2ac014ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.582 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.566+0000 7f2abffff640 1 -- 10.20.193.26:0/1231125686 reap_dead start 2026-02-24T19:18:09.582 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.566+0000 7f2ac6213640 1 -- 10.20.193.26:0/1231125686 shutdown_connections 2026-02-24T19:18:09.582 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.566+0000 7f2ac6213640 1 -- 10.20.193.26:0/1231125686 >> 10.20.193.26:0/1231125686 conn(0x7f2ac00b2ef0 msgr2=0x7f2ac0160700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.582 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.566+0000 7f2ac6213640 1 -- 10.20.193.26:0/1231125686 shutdown_connections 2026-02-24T19:18:09.582 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.566+0000 7f2ac6213640 1 -- 10.20.193.26:0/1231125686 wait complete. 2026-02-24T19:18:09.582 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.566+0000 7f2ac6213640 1 librados: shutdown 2026-02-24T19:18:09.582 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.566+0000 7f861cff9640 10 client.4456.objecter ms_handle_connect 0x7f85f00a12b0 2026-02-24T19:18:09.582 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:09.583 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2026-02-24T19:18:09.583 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.567+0000 7f28c77fe640 1 -- 10.20.193.26:0/4010354651 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f28e8167520 con 0x7f28e80b91f0 2026-02-24T19:18:09.583 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.567+0000 7f28c77fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.583 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.567+0000 7f28c77fe640 1 -- 10.20.193.26:0/4010354651 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f28d0002f70 con 0x7f28e80b91f0 2026-02-24T19:18:09.583 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.567+0000 7f28c77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.583 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.567+0000 7f28c77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.583 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.567+0000 7f28c77fe640 10 monclient: dump: 2026-02-24T19:18:09.583 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.583 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.583 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.583 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.583 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.583 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.583 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.583 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.583 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.583 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.583 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.567+0000 7f28e57fa640 4 set_mon_vals no callback set 2026-02-24T19:18:09.583 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.567+0000 7f82bffff640 1 -- 10.20.193.26:0/368358355 <== osd.3 v1:10.20.193.162:6805/920272754 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f82e8056500 con 0x7f82b80a1230 2026-02-24T19:18:09.583 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.567+0000 7f82bffff640 10 client.4447.objecter ms_dispatch2 0x7f82e8000b90 command_reply(tid 2: 0 ) 2026-02-24T19:18:09.583 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.567+0000 7f82bffff640 10 client.4447.objecter _finish_command 2 = system:0 2026-02-24T19:18:09.583 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.567+0000 7f82bffff640 20 client.4447.objecter put_session s=0x7f82b80a0b80 osd=3 4 2026-02-24T19:18:09.584 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.567+0000 7f82bffff640 15 client.4447.objecter _session_command_op_remove 3 2 2026-02-24T19:18:09.584 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.567+0000 7f82eda32640 10 librados: watch_flush enter 2026-02-24T19:18:09.584 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.567+0000 7f82eda32640 10 librados: watch_flush exit 2026-02-24T19:18:09.584 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.567+0000 7f82eda32640 10 client.4447.objecter close_session for osd.3 2026-02-24T19:18:09.584 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.567+0000 7f82eda32640 1 -- 10.20.193.26:0/368358355 >> v1:10.20.193.162:6805/920272754 conn(0x7f82b80a1230 legacy=0x7f82b80c1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.584 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.568+0000 7f82eda32640 20 client.4447.objecter put_session s=0x7f82b80a0b80 osd=3 1 2026-02-24T19:18:09.584 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.568+0000 7f82eda32640 20 client.4447.objecter shutdown clearing up homeless session... 2026-02-24T19:18:09.584 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.568+0000 7f82eda32640 10 client.4447.objecter successfully canceled tick 2026-02-24T19:18:09.584 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.568+0000 7f82eda32640 1 -- 10.20.193.26:0/368358355 >> v1:10.20.193.162:6800/3889602630 conn(0x7f82b8077d00 legacy=0x7f82b80981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.584 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.568+0000 7f82eda32640 10 monclient: shutdown 2026-02-24T19:18:09.584 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.568+0000 7f82eda32640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.584 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.568+0000 7f82eda32640 1 -- 10.20.193.26:0/368358355 >> v1:10.20.193.70:6789/0 conn(0x7f82e80b9f80 legacy=0x7f82e81564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.584 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.568+0000 7f82e77fe640 1 -- 10.20.193.26:0/368358355 reap_dead start 2026-02-24T19:18:09.584 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.568+0000 7f82eda32640 1 -- 10.20.193.26:0/368358355 shutdown_connections 2026-02-24T19:18:09.584 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.568+0000 7f82eda32640 1 -- 10.20.193.26:0/368358355 >> 10.20.193.26:0/368358355 conn(0x7f82e80b7990 msgr2=0x7f82e8056830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.584 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.568+0000 7f82eda32640 1 -- 10.20.193.26:0/368358355 shutdown_connections 2026-02-24T19:18:09.584 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.568+0000 7f82eda32640 1 -- 10.20.193.26:0/368358355 wait complete. 2026-02-24T19:18:09.584 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.568+0000 7f82eda32640 1 librados: shutdown 2026-02-24T19:18:09.584 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.567+0000 7f861cff9640 1 -- 10.20.193.26:0/1159143980 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f8614058af0 con 0x7f86200ba350 2026-02-24T19:18:09.584 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.567+0000 7f861cff9640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:18:09.584 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.568+0000 7f28c77fe640 1 -- 10.20.193.26:0/4010354651 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f28d001d850 con 0x7f28e80b91f0 2026-02-24T19:18:09.584 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.568+0000 7f7ad67fc640 1 -- 10.20.193.26:0/3517643153 <== osd.6 v1:10.20.193.103:6808/3149418268 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f7ab80c3030 con 0x7f7ab80a1430 2026-02-24T19:18:09.584 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.568+0000 7f7ad67fc640 10 client.4463.objecter ms_dispatch2 0x7f7ae8000b90 command_reply(tid 1: 0 ) 2026-02-24T19:18:09.584 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.568+0000 7f7ad67fc640 10 client.4463.objecter _finish_command 1 = system:0 2026-02-24T19:18:09.584 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.568+0000 7f7ad67fc640 20 client.4463.objecter put_session s=0x7f7ab80a0d80 osd=6 4 2026-02-24T19:18:09.584 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.568+0000 7f7ad67fc640 15 client.4463.objecter _session_command_op_remove 6 1 2026-02-24T19:18:09.585 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.569+0000 7f28e6ffd640 10 monclient: get_auth_request con 0x7f28b4077d50 auth_method 0 2026-02-24T19:18:09.585 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.569+0000 7f28c77fe640 1 -- 10.20.193.26:0/4010354651 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f28d0092f90 con 0x7f28e80b91f0 2026-02-24T19:18:09.585 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.569+0000 7f28c77fe640 10 client.4453.objecter ms_dispatch2 0x7f28e8000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:09.585 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.569+0000 7f28c77fe640 3 client.4453.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:09.585 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.569+0000 7f28c77fe640 3 client.4453.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:09.585 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.569+0000 7f28c77fe640 10 client.4453.objecter checking command 1 2026-02-24T19:18:09.585 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.569+0000 7f28c77fe640 20 client.4453.objecter _get_session s=0x7f28b40a0bd0 osd=2 3 2026-02-24T19:18:09.585 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.569+0000 7f28c77fe640 20 client.4453.objecter put_session s=0x7f28b40a0bd0 osd=2 3 2026-02-24T19:18:09.585 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.569+0000 7f28c77fe640 15 client.4453.objecter _session_command_op_remove -1 1 2026-02-24T19:18:09.585 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.569+0000 7f28c77fe640 20 client.4453.objecter _get_session s=0x7f28b40a0bd0 osd=2 3 2026-02-24T19:18:09.585 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.569+0000 7f28c77fe640 20 client.4453.objecter get_session s=0x7f28b40a0bd0 osd=2 3 2026-02-24T19:18:09.585 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.569+0000 7f28c77fe640 15 client.4453.objecter _session_command_op_assign 2 1 2026-02-24T19:18:09.585 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.569+0000 7f28c77fe640 20 client.4453.objecter put_session s=0x7f28b40a0bd0 osd=2 4 2026-02-24T19:18:09.585 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.569+0000 7f28c77fe640 10 client.4453.objecter _send_command 1 2026-02-24T19:18:09.585 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.569+0000 7f28c77fe640 1 -- 10.20.193.26:0/4010354651 --> v1:10.20.193.103:6800/3800806982 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f28b40c2f20 con 0x7f28b40a1280 2026-02-24T19:18:09.585 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.569+0000 7f28c77fe640 20 client.4453.objecter dump_active .. 0 homeless 2026-02-24T19:18:09.585 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.570+0000 7f28c77fe640 1 -- 10.20.193.26:0/4010354651 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f28d005d090 con 0x7f28e80b91f0 2026-02-24T19:18:09.585 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.570+0000 7f28c77fe640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:18:09.585 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.570+0000 7f28c77fe640 10 client.4453.objecter ms_handle_connect 0x7f28b4077d50 2026-02-24T19:18:09.585 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.570+0000 7f28e77fe640 10 monclient: get_auth_request con 0x7f28b40a1280 auth_method 0 2026-02-24T19:18:09.585 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.570+0000 7f8983fff640 1 -- 10.20.193.26:0/989299693 <== osd.4 v1:10.20.193.26:6800/3717327686 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f89780c3050 con 0x7f89780a1450 2026-02-24T19:18:09.585 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.570+0000 7f8983fff640 10 client.4446.objecter ms_dispatch2 0x7f89a8000b90 command_reply(tid 1: 0 ) 2026-02-24T19:18:09.586 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.570+0000 7f8983fff640 10 client.4446.objecter _finish_command 1 = system:0 2026-02-24T19:18:09.586 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.570+0000 7f8983fff640 20 client.4446.objecter put_session s=0x7f89780a0da0 osd=4 4 2026-02-24T19:18:09.586 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.570+0000 7f8983fff640 15 client.4446.objecter _session_command_op_remove 4 1 2026-02-24T19:18:09.586 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.571+0000 7f28c77fe640 10 client.4453.objecter ms_handle_connect 0x7f28b40a1280 2026-02-24T19:18:09.586 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.573+0000 7fb683fff640 1 -- 10.20.193.26:0/4238003527 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb6a80b64c0 con 0x7fb6a80b9f80 2026-02-24T19:18:09.586 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.573+0000 7fb683fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.586 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.573+0000 7fb683fff640 1 -- 10.20.193.26:0/4238003527 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fb6980034b0 con 0x7fb6a80b9f80 2026-02-24T19:18:09.586 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.573+0000 7fb683fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.586 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.573+0000 7fb683fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.586 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.573+0000 7fb683fff640 10 monclient: dump: 2026-02-24T19:18:09.586 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.586 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.586 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.586 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.586 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.586 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.586 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.586 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.586 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.586 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.586 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.573+0000 7fb6a5ffb640 4 set_mon_vals no callback set 2026-02-24T19:18:09.586 INFO:teuthology.orchestra.run.trial026.stdout:90194313221 2026-02-24T19:18:09.587 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-24T19:18:09.587 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.574+0000 7fb683fff640 1 -- 10.20.193.26:0/4238003527 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fb69801d850 con 0x7fb6a80b9f80 2026-02-24T19:18:09.587 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.575+0000 7fb6a77fe640 10 monclient: get_auth_request con 0x7fb678077e20 auth_method 0 2026-02-24T19:18:09.587 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.575+0000 7fb683fff640 10 client.4465.objecter ms_handle_connect 0x7fb678077e20 2026-02-24T19:18:09.587 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.575+0000 7f64567fc640 1 -- 10.20.193.26:0/2922835923 <== osd.9 v1:10.20.193.70:6804/3709696191 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f64380c2e90 con 0x7f64380a1290 2026-02-24T19:18:09.587 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.575+0000 7f64567fc640 10 client.4469.objecter ms_dispatch2 0x7f6468000b90 command_reply(tid 1: 0 ) 2026-02-24T19:18:09.587 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.575+0000 7f64567fc640 10 client.4469.objecter _finish_command 1 = system:0 2026-02-24T19:18:09.587 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.575+0000 7f64567fc640 20 client.4469.objecter put_session s=0x7f64380a0be0 osd=9 4 2026-02-24T19:18:09.587 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.575+0000 7f64567fc640 15 client.4469.objecter _session_command_op_remove 9 1 2026-02-24T19:18:09.587 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:09.588 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-24T19:18:09.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.576+0000 7fb683fff640 1 -- 10.20.193.26:0/4238003527 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7fb698093060 con 0x7fb6a80b9f80 2026-02-24T19:18:09.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.576+0000 7fb683fff640 10 client.4465.objecter ms_dispatch2 0x7fb6a8000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:09.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.576+0000 7fb683fff640 3 client.4465.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:09.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.576+0000 7fb683fff640 3 client.4465.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:09.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.576+0000 7fb683fff640 10 client.4465.objecter checking command 1 2026-02-24T19:18:09.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.576+0000 7fb683fff640 20 client.4465.objecter _get_session s=0x7fb6780a0ca0 osd=5 3 2026-02-24T19:18:09.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.576+0000 7fb683fff640 20 client.4465.objecter put_session s=0x7fb6780a0ca0 osd=5 3 2026-02-24T19:18:09.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.576+0000 7fb683fff640 15 client.4465.objecter _session_command_op_remove -1 1 2026-02-24T19:18:09.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.576+0000 7fb683fff640 20 client.4465.objecter _get_session s=0x7fb6780a0ca0 osd=5 3 2026-02-24T19:18:09.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.576+0000 7fb683fff640 20 client.4465.objecter get_session s=0x7fb6780a0ca0 osd=5 3 2026-02-24T19:18:09.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.576+0000 7fb683fff640 15 client.4465.objecter _session_command_op_assign 5 1 2026-02-24T19:18:09.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.576+0000 7fb683fff640 20 client.4465.objecter put_session s=0x7fb6780a0ca0 osd=5 4 2026-02-24T19:18:09.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.576+0000 7fb683fff640 10 client.4465.objecter _send_command 1 2026-02-24T19:18:09.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.576+0000 7fb683fff640 1 -- 10.20.193.26:0/4238003527 --> v1:10.20.193.70:6812/1419227842 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb698002fc0 con 0x7fb6780a1350 2026-02-24T19:18:09.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.576+0000 7fb683fff640 20 client.4465.objecter dump_active .. 0 homeless 2026-02-24T19:18:09.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.576+0000 7fb683fff640 1 -- 10.20.193.26:0/4238003527 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7fb698059700 con 0x7fb6a80b9f80 2026-02-24T19:18:09.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.576+0000 7fb683fff640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:18:09.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.576+0000 7fb6a7fff640 10 monclient: get_auth_request con 0x7fb6780a1350 auth_method 0 2026-02-24T19:18:09.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.577+0000 7f7af0001640 10 client.4463.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:18:09.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.577+0000 7f7af0001640 15 client.4463.objecter _session_command_op_assign -1 2 2026-02-24T19:18:09.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.577+0000 7f7af0001640 20 client.4463.objecter _get_session s=0x7f7ab80a0d80 osd=6 3 2026-02-24T19:18:09.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.577+0000 7f7af0001640 20 client.4463.objecter put_session s=0x7f7ab80a0d80 osd=6 3 2026-02-24T19:18:09.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.577+0000 7f7af0001640 20 client.4463.objecter _get_session s=0x7f7ab80a0d80 osd=6 3 2026-02-24T19:18:09.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.577+0000 7f7af0001640 15 client.4463.objecter _session_command_op_remove -1 2 2026-02-24T19:18:09.589 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.577+0000 7f7af0001640 20 client.4463.objecter get_session s=0x7f7ab80a0d80 osd=6 3 2026-02-24T19:18:09.589 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.577+0000 7f7af0001640 15 client.4463.objecter _session_command_op_assign 6 2 2026-02-24T19:18:09.589 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.577+0000 7f7af0001640 20 client.4463.objecter put_session s=0x7f7ab80a0d80 osd=6 4 2026-02-24T19:18:09.589 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.577+0000 7f7af0001640 10 client.4463.objecter _send_command 2 2026-02-24T19:18:09.589 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.577+0000 7f7af0001640 1 -- 10.20.193.26:0/3517643153 --> v1:10.20.193.103:6808/3149418268 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7ae8161180 con 0x7f7ab80a1430 2026-02-24T19:18:09.589 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.578+0000 7fb683fff640 10 client.4465.objecter ms_handle_connect 0x7fb6780a1350 2026-02-24T19:18:09.589 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.578+0000 7f89ae1c0640 10 client.4446.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:18:09.589 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.578+0000 7f89ae1c0640 15 client.4446.objecter _session_command_op_assign -1 2 2026-02-24T19:18:09.589 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.578+0000 7f89ae1c0640 20 client.4446.objecter _get_session s=0x7f89780a0da0 osd=4 3 2026-02-24T19:18:09.589 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.578+0000 7f89ae1c0640 20 client.4446.objecter put_session s=0x7f89780a0da0 osd=4 3 2026-02-24T19:18:09.589 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.578+0000 7f89ae1c0640 20 client.4446.objecter _get_session s=0x7f89780a0da0 osd=4 3 2026-02-24T19:18:09.589 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.578+0000 7f89ae1c0640 15 client.4446.objecter _session_command_op_remove -1 2 2026-02-24T19:18:09.589 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.578+0000 7f89ae1c0640 20 client.4446.objecter get_session s=0x7f89780a0da0 osd=4 3 2026-02-24T19:18:09.589 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.578+0000 7f89ae1c0640 15 client.4446.objecter _session_command_op_assign 4 2 2026-02-24T19:18:09.589 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.578+0000 7f89ae1c0640 20 client.4446.objecter put_session s=0x7f89780a0da0 osd=4 4 2026-02-24T19:18:09.589 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.578+0000 7f89ae1c0640 10 client.4446.objecter _send_command 2 2026-02-24T19:18:09.589 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.578+0000 7f89ae1c0640 1 -- 10.20.193.26:0/989299693 --> v1:10.20.193.26:6800/3717327686 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f89a80b96f0 con 0x7f89780a1450 2026-02-24T19:18:09.589 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.580+0000 7f70beffd640 1 -- 10.20.193.26:0/2159113441 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f70d815e210 con 0x7f70d80585e0 2026-02-24T19:18:09.589 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.580+0000 7f70beffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.589 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.580+0000 7f70beffd640 1 -- 10.20.193.26:0/2159113441 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f70cc0039b0 con 0x7f70d80585e0 2026-02-24T19:18:09.589 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.580+0000 7f70beffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.589 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.580+0000 7f70beffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.589 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.580+0000 7f70beffd640 10 monclient: dump: 2026-02-24T19:18:09.589 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.589 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.589 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.590 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.590 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.590 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.590 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.590 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.590 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.590 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.590 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.580+0000 7f70d4d72640 4 set_mon_vals no callback set 2026-02-24T19:18:09.590 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.580+0000 7f50927fc640 1 -- 10.20.193.26:0/2908256076 <== osd.7 v1:10.20.193.162:6809/2963240067 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f50740c2fa0 con 0x7f50740a1300 2026-02-24T19:18:09.590 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.580+0000 7f50927fc640 10 client.4444.objecter ms_dispatch2 0x7f50a4000b90 command_reply(tid 1: 0 ) 2026-02-24T19:18:09.590 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.580+0000 7f50927fc640 10 client.4444.objecter _finish_command 1 = system:0 2026-02-24T19:18:09.590 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.580+0000 7f50927fc640 20 client.4444.objecter put_session s=0x7f50740a0c50 osd=7 4 2026-02-24T19:18:09.590 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.580+0000 7f50927fc640 15 client.4444.objecter _session_command_op_remove 7 1 2026-02-24T19:18:09.590 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.581+0000 7f70beffd640 1 -- 10.20.193.26:0/2159113441 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f70cc003bc0 con 0x7f70d80585e0 2026-02-24T19:18:09.590 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.581+0000 7f8983fff640 1 -- 10.20.193.26:0/989299693 <== osd.4 v1:10.20.193.26:6800/3717327686 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f89a80b96f0 con 0x7f89780a1450 2026-02-24T19:18:09.590 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.581+0000 7f8983fff640 10 client.4446.objecter ms_dispatch2 0x7f89a8000b90 command_reply(tid 2: 0 ) 2026-02-24T19:18:09.590 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.581+0000 7f8983fff640 10 client.4446.objecter _finish_command 2 = system:0 2026-02-24T19:18:09.590 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.581+0000 7f8983fff640 20 client.4446.objecter put_session s=0x7f89780a0da0 osd=4 4 2026-02-24T19:18:09.590 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.581+0000 7f8983fff640 15 client.4446.objecter _session_command_op_remove 4 2 2026-02-24T19:18:09.590 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.581+0000 7f89ae1c0640 10 librados: watch_flush enter 2026-02-24T19:18:09.590 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.581+0000 7f89ae1c0640 10 librados: watch_flush exit 2026-02-24T19:18:09.591 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.581+0000 7f89ae1c0640 10 client.4446.objecter close_session for osd.4 2026-02-24T19:18:09.591 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.581+0000 7f89ae1c0640 1 -- 10.20.193.26:0/989299693 >> v1:10.20.193.26:6800/3717327686 conn(0x7f89780a1450 legacy=0x7f89780c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.591 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.581+0000 7f89ae1c0640 20 client.4446.objecter put_session s=0x7f89780a0da0 osd=4 1 2026-02-24T19:18:09.591 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.581+0000 7f89ae1c0640 20 client.4446.objecter shutdown clearing up homeless session... 2026-02-24T19:18:09.591 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.581+0000 7f89ae1c0640 10 client.4446.objecter successfully canceled tick 2026-02-24T19:18:09.591 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.581+0000 7f70d5d74640 10 monclient: get_auth_request con 0x7f70a4077d30 auth_method 0 2026-02-24T19:18:09.591 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.581+0000 7f70beffd640 10 client.4462.objecter ms_handle_connect 0x7f70a4077d30 2026-02-24T19:18:09.591 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.581+0000 7f89ae1c0640 1 -- 10.20.193.26:0/989299693 >> v1:10.20.193.162:6800/3889602630 conn(0x7f8978077f20 legacy=0x7f89780983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.591 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.581+0000 7f89ae1c0640 10 monclient: shutdown 2026-02-24T19:18:09.591 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.581+0000 7f89ae1c0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.591 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.581+0000 7f89ae1c0640 1 -- 10.20.193.26:0/989299693 >> v1:10.20.193.26:6789/0 conn(0x7f89a80ba350 legacy=0x7f89a8164c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.591 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.581+0000 7f89a7fff640 1 -- 10.20.193.26:0/989299693 reap_dead start 2026-02-24T19:18:09.591 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.581+0000 7f89ae1c0640 1 -- 10.20.193.26:0/989299693 shutdown_connections 2026-02-24T19:18:09.591 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.581+0000 7f89ae1c0640 1 -- 10.20.193.26:0/989299693 >> 10.20.193.26:0/989299693 conn(0x7f89a80b7990 msgr2=0x7f89a815bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.591 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.582+0000 7f89ae1c0640 1 -- 10.20.193.26:0/989299693 shutdown_connections 2026-02-24T19:18:09.591 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.582+0000 7f89ae1c0640 1 -- 10.20.193.26:0/989299693 wait complete. 2026-02-24T19:18:09.591 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.582+0000 7f70beffd640 1 -- 10.20.193.26:0/2159113441 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f70cc093150 con 0x7f70d80585e0 2026-02-24T19:18:09.591 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.582+0000 7f70beffd640 10 client.4462.objecter ms_dispatch2 0x7f70d8000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:09.591 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.582+0000 7f70beffd640 3 client.4462.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:09.591 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.582+0000 7f70beffd640 3 client.4462.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:09.591 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.582+0000 7f89ae1c0640 1 librados: shutdown 2026-02-24T19:18:09.592 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.582+0000 7f70beffd640 10 client.4462.objecter checking command 1 2026-02-24T19:18:09.592 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.582+0000 7f70beffd640 20 client.4462.objecter _get_session s=0x7f70a40a0c10 osd=13 3 2026-02-24T19:18:09.592 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.582+0000 7f70beffd640 20 client.4462.objecter put_session s=0x7f70a40a0c10 osd=13 3 2026-02-24T19:18:09.592 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.582+0000 7f70beffd640 15 client.4462.objecter _session_command_op_remove -1 1 2026-02-24T19:18:09.592 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.582+0000 7f70beffd640 20 client.4462.objecter _get_session s=0x7f70a40a0c10 osd=13 3 2026-02-24T19:18:09.592 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.582+0000 7f70beffd640 20 client.4462.objecter get_session s=0x7f70a40a0c10 osd=13 3 2026-02-24T19:18:09.592 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.582+0000 7f70beffd640 15 client.4462.objecter _session_command_op_assign 13 1 2026-02-24T19:18:09.592 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.582+0000 7f70beffd640 20 client.4462.objecter put_session s=0x7f70a40a0c10 osd=13 4 2026-02-24T19:18:09.592 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.582+0000 7f70beffd640 10 client.4462.objecter _send_command 1 2026-02-24T19:18:09.592 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.582+0000 7f70beffd640 1 -- 10.20.193.26:0/2159113441 --> v1:10.20.193.70:6808/2949423039 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f70a40c2ec0 con 0x7f70a40a12c0 2026-02-24T19:18:09.592 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.582+0000 7f70beffd640 20 client.4462.objecter dump_active .. 0 homeless 2026-02-24T19:18:09.592 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.582+0000 7f70beffd640 1 -- 10.20.193.26:0/2159113441 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f70cc0597f0 con 0x7f70d80585e0 2026-02-24T19:18:09.592 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.582+0000 7f70beffd640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-24T19:18:09.592 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.582+0000 7f70d6d76640 10 monclient: get_auth_request con 0x7f70a40a12c0 auth_method 0 2026-02-24T19:18:09.592 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.583+0000 7f7ad67fc640 1 -- 10.20.193.26:0/3517643153 <== osd.6 v1:10.20.193.103:6808/3149418268 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f7ae8161180 con 0x7f7ab80a1430 2026-02-24T19:18:09.592 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.583+0000 7f7ad67fc640 10 client.4463.objecter ms_dispatch2 0x7f7ae8000b90 command_reply(tid 2: 0 ) 2026-02-24T19:18:09.592 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.583+0000 7f7ad67fc640 10 client.4463.objecter _finish_command 2 = system:0 2026-02-24T19:18:09.592 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.583+0000 7f7ad67fc640 20 client.4463.objecter put_session s=0x7f7ab80a0d80 osd=6 4 2026-02-24T19:18:09.592 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.583+0000 7f7ad67fc640 15 client.4463.objecter _session_command_op_remove 6 2 2026-02-24T19:18:09.592 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.583+0000 7f35c77fe640 1 -- 10.20.193.26:0/2813836055 <== osd.0 v1:10.20.193.26:6808/4098203721 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f35b40c2f30 con 0x7f35b40a1330 2026-02-24T19:18:09.592 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.583+0000 7f35c77fe640 10 client.4449.objecter ms_dispatch2 0x7f35e8000b90 command_reply(tid 1: 0 ) 2026-02-24T19:18:09.592 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.583+0000 7f35c77fe640 10 client.4449.objecter _finish_command 1 = system:0 2026-02-24T19:18:09.592 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.583+0000 7f35c77fe640 20 client.4449.objecter put_session s=0x7f35b40a0c80 osd=0 4 2026-02-24T19:18:09.593 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.583+0000 7f35c77fe640 15 client.4449.objecter _session_command_op_remove 0 1 2026-02-24T19:18:09.593 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.583+0000 7f610f7fe640 1 -- 10.20.193.26:0/1994107782 <== osd.15 v1:10.20.193.162:6801/3445416924 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f6124003000 con 0x7f60fc0a1420 2026-02-24T19:18:09.593 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.583+0000 7f610f7fe640 10 client.4484.objecter ms_dispatch2 0x7f6130000b90 command_reply(tid 1: 0 ) 2026-02-24T19:18:09.593 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.583+0000 7f610f7fe640 10 client.4484.objecter _finish_command 1 = system:0 2026-02-24T19:18:09.593 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.583+0000 7f610f7fe640 20 client.4484.objecter put_session s=0x7f60fc0a0d70 osd=15 4 2026-02-24T19:18:09.593 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.583+0000 7f610f7fe640 15 client.4484.objecter _session_command_op_remove 15 1 2026-02-24T19:18:09.593 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.583+0000 7f7af0001640 10 librados: watch_flush enter 2026-02-24T19:18:09.593 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.583+0000 7f7af0001640 10 librados: watch_flush exit 2026-02-24T19:18:09.593 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.583+0000 7f7af0001640 10 client.4463.objecter close_session for osd.6 2026-02-24T19:18:09.593 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.583+0000 7f7af0001640 1 -- 10.20.193.26:0/3517643153 >> v1:10.20.193.103:6808/3149418268 conn(0x7f7ab80a1430 legacy=0x7f7ab80c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.593 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.583+0000 7f7af0001640 20 client.4463.objecter put_session s=0x7f7ab80a0d80 osd=6 1 2026-02-24T19:18:09.593 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.583+0000 7f7af0001640 20 client.4463.objecter shutdown clearing up homeless session... 2026-02-24T19:18:09.593 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.583+0000 7f7af0001640 10 client.4463.objecter successfully canceled tick 2026-02-24T19:18:09.593 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.583+0000 7f7af0001640 1 -- 10.20.193.26:0/3517643153 >> v1:10.20.193.162:6800/3889602630 conn(0x7f7ab8077f00 legacy=0x7f7ab80983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.593 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.583+0000 7f7af0001640 10 monclient: shutdown 2026-02-24T19:18:09.593 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.583+0000 7f7af0001640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.593 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.583+0000 7f7af0001640 1 -- 10.20.193.26:0/3517643153 >> v1:10.20.193.103:6789/0 conn(0x7f7ae8159e40 legacy=0x7f7ae81582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.593 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.583+0000 7f7aee577640 1 -- 10.20.193.26:0/3517643153 reap_dead start 2026-02-24T19:18:09.593 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.584+0000 7f7af0001640 1 -- 10.20.193.26:0/3517643153 shutdown_connections 2026-02-24T19:18:09.593 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.584+0000 7f7af0001640 1 -- 10.20.193.26:0/3517643153 >> 10.20.193.26:0/3517643153 conn(0x7f7ae80b7780 msgr2=0x7f7ae80b8900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.593 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.584+0000 7f7af0001640 1 -- 10.20.193.26:0/3517643153 shutdown_connections 2026-02-24T19:18:09.594 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.584+0000 7f70beffd640 10 client.4462.objecter ms_handle_connect 0x7f70a40a12c0 2026-02-24T19:18:09.594 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.584+0000 7f7af0001640 1 -- 10.20.193.26:0/3517643153 wait complete. 2026-02-24T19:18:09.594 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.584+0000 7f7af0001640 1 librados: shutdown 2026-02-24T19:18:09.594 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.584+0000 7f646fc3c640 10 client.4469.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:18:09.594 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.584+0000 7f646fc3c640 15 client.4469.objecter _session_command_op_assign -1 2 2026-02-24T19:18:09.594 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.584+0000 7f646fc3c640 20 client.4469.objecter _get_session s=0x7f64380a0be0 osd=9 3 2026-02-24T19:18:09.594 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.584+0000 7f646fc3c640 20 client.4469.objecter put_session s=0x7f64380a0be0 osd=9 3 2026-02-24T19:18:09.594 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.584+0000 7f646fc3c640 20 client.4469.objecter _get_session s=0x7f64380a0be0 osd=9 3 2026-02-24T19:18:09.594 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.584+0000 7f646fc3c640 15 client.4469.objecter _session_command_op_remove -1 2 2026-02-24T19:18:09.594 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.584+0000 7f646fc3c640 20 client.4469.objecter get_session s=0x7f64380a0be0 osd=9 3 2026-02-24T19:18:09.594 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.584+0000 7f646fc3c640 15 client.4469.objecter _session_command_op_assign 9 2 2026-02-24T19:18:09.594 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.584+0000 7f646fc3c640 20 client.4469.objecter put_session s=0x7f64380a0be0 osd=9 4 2026-02-24T19:18:09.594 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.584+0000 7f646fc3c640 10 client.4469.objecter _send_command 2 2026-02-24T19:18:09.594 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.584+0000 7f646fc3c640 1 -- 10.20.193.26:0/2922835923 --> v1:10.20.193.70:6804/3709696191 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f64680b93c0 con 0x7f64380a1290 2026-02-24T19:18:09.594 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.585+0000 7f861cff9640 1 -- 10.20.193.26:0/1159143980 <== osd.14 v1:10.20.193.103:6812/1276189911 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f85f00c2eb0 con 0x7f85f00a12b0 2026-02-24T19:18:09.594 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.585+0000 7f861cff9640 10 client.4456.objecter ms_dispatch2 0x7f8620000b90 command_reply(tid 1: 0 ) 2026-02-24T19:18:09.594 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.585+0000 7f861cff9640 10 client.4456.objecter _finish_command 1 = system:0 2026-02-24T19:18:09.594 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.585+0000 7f861cff9640 20 client.4456.objecter put_session s=0x7f85f00a0c00 osd=14 4 2026-02-24T19:18:09.594 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.585+0000 7f861cff9640 15 client.4456.objecter _session_command_op_remove 14 1 2026-02-24T19:18:09.594 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f64567fc640 1 -- 10.20.193.26:0/2922835923 <== osd.9 v1:10.20.193.70:6804/3709696191 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f64680b93c0 con 0x7f64380a1290 2026-02-24T19:18:09.594 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f64567fc640 10 client.4469.objecter ms_dispatch2 0x7f6468000b90 command_reply(tid 2: 0 ) 2026-02-24T19:18:09.595 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f64567fc640 10 client.4469.objecter _finish_command 2 = system:0 2026-02-24T19:18:09.595 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f64567fc640 20 client.4469.objecter put_session s=0x7f64380a0be0 osd=9 4 2026-02-24T19:18:09.595 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f64567fc640 15 client.4469.objecter _session_command_op_remove 9 2 2026-02-24T19:18:09.595 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f646fc3c640 10 librados: watch_flush enter 2026-02-24T19:18:09.595 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f646fc3c640 10 librados: watch_flush exit 2026-02-24T19:18:09.595 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f646fc3c640 10 client.4469.objecter close_session for osd.9 2026-02-24T19:18:09.595 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f646fc3c640 1 -- 10.20.193.26:0/2922835923 >> v1:10.20.193.70:6804/3709696191 conn(0x7f64380a1290 legacy=0x7f64380c16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.595 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f646fc3c640 20 client.4469.objecter put_session s=0x7f64380a0be0 osd=9 1 2026-02-24T19:18:09.595 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f646fc3c640 20 client.4469.objecter shutdown clearing up homeless session... 2026-02-24T19:18:09.595 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f646fc3c640 10 client.4469.objecter successfully canceled tick 2026-02-24T19:18:09.595 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f646fc3c640 1 -- 10.20.193.26:0/2922835923 >> v1:10.20.193.162:6800/3889602630 conn(0x7f6438077d60 legacy=0x7f6438098210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.595 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f646fc3c640 10 monclient: shutdown 2026-02-24T19:18:09.595 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f646fc3c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.595 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f646fc3c640 1 -- 10.20.193.26:0/2922835923 >> v1:10.20.193.103:6789/0 conn(0x7f64680b9f80 legacy=0x7f6468156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.595 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f646e1b2640 1 -- 10.20.193.26:0/2922835923 reap_dead start 2026-02-24T19:18:09.595 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f646fc3c640 1 -- 10.20.193.26:0/2922835923 shutdown_connections 2026-02-24T19:18:09.595 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f646fc3c640 1 -- 10.20.193.26:0/2922835923 >> 10.20.193.26:0/2922835923 conn(0x7f64680b7990 msgr2=0x7f646815acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.595 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f646fc3c640 1 -- 10.20.193.26:0/2922835923 shutdown_connections 2026-02-24T19:18:09.595 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f646fc3c640 1 -- 10.20.193.26:0/2922835923 wait complete. 2026-02-24T19:18:09.595 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f646fc3c640 1 librados: shutdown 2026-02-24T19:18:09.596 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f50ac24d640 10 client.4444.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:18:09.596 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f50ac24d640 15 client.4444.objecter _session_command_op_assign -1 2 2026-02-24T19:18:09.596 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f50ac24d640 20 client.4444.objecter _get_session s=0x7f50740a0c50 osd=7 3 2026-02-24T19:18:09.596 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f50ac24d640 20 client.4444.objecter put_session s=0x7f50740a0c50 osd=7 3 2026-02-24T19:18:09.596 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f50ac24d640 20 client.4444.objecter _get_session s=0x7f50740a0c50 osd=7 3 2026-02-24T19:18:09.596 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f50ac24d640 15 client.4444.objecter _session_command_op_remove -1 2 2026-02-24T19:18:09.596 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f50ac24d640 20 client.4444.objecter get_session s=0x7f50740a0c50 osd=7 3 2026-02-24T19:18:09.596 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f50ac24d640 15 client.4444.objecter _session_command_op_assign 7 2 2026-02-24T19:18:09.596 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f50ac24d640 20 client.4444.objecter put_session s=0x7f50740a0c50 osd=7 4 2026-02-24T19:18:09.596 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f50ac24d640 10 client.4444.objecter _send_command 2 2026-02-24T19:18:09.596 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.588+0000 7f50ac24d640 1 -- 10.20.193.26:0/2908256076 --> v1:10.20.193.162:6809/2963240067 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f50a4056500 con 0x7f50740a1300 2026-02-24T19:18:09.596 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:09.596 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-24T19:18:09.596 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f50927fc640 1 -- 10.20.193.26:0/2908256076 <== osd.7 v1:10.20.193.162:6809/2963240067 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f50a4056500 con 0x7f50740a1300 2026-02-24T19:18:09.596 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f50927fc640 10 client.4444.objecter ms_dispatch2 0x7f50a4000b90 command_reply(tid 2: 0 ) 2026-02-24T19:18:09.596 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f50927fc640 10 client.4444.objecter _finish_command 2 = system:0 2026-02-24T19:18:09.596 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f50927fc640 20 client.4444.objecter put_session s=0x7f50740a0c50 osd=7 4 2026-02-24T19:18:09.597 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f50927fc640 15 client.4444.objecter _session_command_op_remove 7 2 2026-02-24T19:18:09.597 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f50ac24d640 10 librados: watch_flush enter 2026-02-24T19:18:09.597 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f50ac24d640 10 librados: watch_flush exit 2026-02-24T19:18:09.597 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f50ac24d640 10 client.4444.objecter close_session for osd.7 2026-02-24T19:18:09.597 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f50ac24d640 1 -- 10.20.193.26:0/2908256076 >> v1:10.20.193.162:6809/2963240067 conn(0x7f50740a1300 legacy=0x7f50740c1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.597 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f50ac24d640 20 client.4444.objecter put_session s=0x7f50740a0c50 osd=7 1 2026-02-24T19:18:09.597 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f50ac24d640 20 client.4444.objecter shutdown clearing up homeless session... 2026-02-24T19:18:09.597 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f50ac24d640 10 client.4444.objecter successfully canceled tick 2026-02-24T19:18:09.597 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f50ac24d640 1 -- 10.20.193.26:0/2908256076 >> v1:10.20.193.162:6800/3889602630 conn(0x7f5074077dd0 legacy=0x7f5074098280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.597 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f50ac24d640 10 monclient: shutdown 2026-02-24T19:18:09.597 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f50ac24d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.597 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f50ac24d640 1 -- 10.20.193.26:0/2908256076 >> v1:10.20.193.70:6789/0 conn(0x7f50a40585e0 legacy=0x7f50a4160df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.597 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f50aa7c3640 1 -- 10.20.193.26:0/2908256076 reap_dead start 2026-02-24T19:18:09.597 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f50ac24d640 1 -- 10.20.193.26:0/2908256076 shutdown_connections 2026-02-24T19:18:09.597 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f50ac24d640 1 -- 10.20.193.26:0/2908256076 >> 10.20.193.26:0/2908256076 conn(0x7f50a40b7990 msgr2=0x7f50a4056830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.597 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.592+0000 7f35ed767640 10 client.4449.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.592+0000 7f35ed767640 15 client.4449.objecter _session_command_op_assign -1 2 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.592+0000 7f35ed767640 20 client.4449.objecter _get_session s=0x7f35b40a0c80 osd=0 3 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.592+0000 7f35ed767640 20 client.4449.objecter put_session s=0x7f35b40a0c80 osd=0 3 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.592+0000 7f35ed767640 20 client.4449.objecter _get_session s=0x7f35b40a0c80 osd=0 3 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.592+0000 7f35ed767640 15 client.4449.objecter _session_command_op_remove -1 2 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.592+0000 7f35ed767640 20 client.4449.objecter get_session s=0x7f35b40a0c80 osd=0 3 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.592+0000 7f35ed767640 15 client.4449.objecter _session_command_op_assign 0 2 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.592+0000 7f35ed767640 20 client.4449.objecter put_session s=0x7f35b40a0c80 osd=0 4 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.592+0000 7f35ed767640 10 client.4449.objecter _send_command 2 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.592+0000 7f35ed767640 1 -- 10.20.193.26:0/2813836055 --> v1:10.20.193.26:6808/4098203721 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f35e81572e0 con 0x7f35b40a1330 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.592+0000 7f28c77fe640 1 -- 10.20.193.26:0/4010354651 <== osd.2 v1:10.20.193.103:6800/3800806982 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f28b40c2f20 con 0x7f28b40a1280 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.592+0000 7f28c77fe640 10 client.4453.objecter ms_dispatch2 0x7f28e8000b90 command_reply(tid 1: 0 ) 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.592+0000 7f28c77fe640 10 client.4453.objecter _finish_command 1 = system:0 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.592+0000 7f28c77fe640 20 client.4453.objecter put_session s=0x7f28b40a0bd0 osd=2 4 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.592+0000 7f28c77fe640 15 client.4453.objecter _session_command_op_remove 2 1 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f50ac24d640 1 -- 10.20.193.26:0/2908256076 shutdown_connections 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f50ac24d640 1 -- 10.20.193.26:0/2908256076 wait complete. 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f50ac24d640 1 librados: shutdown 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f613507b640 10 client.4484.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f613507b640 15 client.4484.objecter _session_command_op_assign -1 2 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f613507b640 20 client.4484.objecter _get_session s=0x7f60fc0a0d70 osd=15 3 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f613507b640 20 client.4484.objecter put_session s=0x7f60fc0a0d70 osd=15 3 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f613507b640 20 client.4484.objecter _get_session s=0x7f60fc0a0d70 osd=15 3 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f613507b640 15 client.4484.objecter _session_command_op_remove -1 2 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f613507b640 20 client.4484.objecter get_session s=0x7f60fc0a0d70 osd=15 3 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f613507b640 15 client.4484.objecter _session_command_op_assign 15 2 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f613507b640 20 client.4484.objecter put_session s=0x7f60fc0a0d70 osd=15 4 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f613507b640 10 client.4484.objecter _send_command 2 2026-02-24T19:18:09.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.591+0000 7f613507b640 1 -- 10.20.193.26:0/1994107782 --> v1:10.20.193.162:6801/3445416924 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f61300ad670 con 0x7f60fc0a1420 2026-02-24T19:18:09.599 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:09.599 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-24T19:18:09.599 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.594+0000 7f86262e1640 10 client.4456.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:18:09.599 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.594+0000 7f86262e1640 15 client.4456.objecter _session_command_op_assign -1 2 2026-02-24T19:18:09.599 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.594+0000 7f86262e1640 20 client.4456.objecter _get_session s=0x7f85f00a0c00 osd=14 3 2026-02-24T19:18:09.599 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.594+0000 7f86262e1640 20 client.4456.objecter put_session s=0x7f85f00a0c00 osd=14 3 2026-02-24T19:18:09.599 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.594+0000 7f86262e1640 20 client.4456.objecter _get_session s=0x7f85f00a0c00 osd=14 3 2026-02-24T19:18:09.599 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f35c77fe640 1 -- 10.20.193.26:0/2813836055 <== osd.0 v1:10.20.193.26:6808/4098203721 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f35e81572e0 con 0x7f35b40a1330 2026-02-24T19:18:09.599 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f35c77fe640 10 client.4449.objecter ms_dispatch2 0x7f35e8000b90 command_reply(tid 2: 0 ) 2026-02-24T19:18:09.599 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f35c77fe640 10 client.4449.objecter _finish_command 2 = system:0 2026-02-24T19:18:09.599 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f35c77fe640 20 client.4449.objecter put_session s=0x7f35b40a0c80 osd=0 4 2026-02-24T19:18:09.599 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f35c77fe640 15 client.4449.objecter _session_command_op_remove 0 2 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.594+0000 7f86262e1640 15 client.4456.objecter _session_command_op_remove -1 2 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.594+0000 7f86262e1640 20 client.4456.objecter get_session s=0x7f85f00a0c00 osd=14 3 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.594+0000 7f86262e1640 15 client.4456.objecter _session_command_op_assign 14 2 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.594+0000 7f86262e1640 20 client.4456.objecter put_session s=0x7f85f00a0c00 osd=14 4 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.594+0000 7f86262e1640 10 client.4456.objecter _send_command 2 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.594+0000 7f86262e1640 1 -- 10.20.193.26:0/1159143980 --> v1:10.20.193.103:6812/1276189911 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8620160410 con 0x7f85f00a12b0 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.594+0000 7f610f7fe640 1 -- 10.20.193.26:0/1994107782 <== osd.15 v1:10.20.193.162:6801/3445416924 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1506399442) 0x7f61300ad670 con 0x7f60fc0a1420 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.594+0000 7f610f7fe640 10 client.4484.objecter ms_dispatch2 0x7f6130000b90 command_reply(tid 2: 0 ) 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.594+0000 7f610f7fe640 10 client.4484.objecter _finish_command 2 = system:0 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.594+0000 7f610f7fe640 20 client.4484.objecter put_session s=0x7f60fc0a0d70 osd=15 4 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.594+0000 7f610f7fe640 15 client.4484.objecter _session_command_op_remove 15 2 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f613507b640 10 librados: watch_flush enter 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f613507b640 10 librados: watch_flush exit 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f613507b640 10 client.4484.objecter close_session for osd.15 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f613507b640 1 -- 10.20.193.26:0/1994107782 >> v1:10.20.193.162:6801/3445416924 conn(0x7f60fc0a1420 legacy=0x7f60fc0c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f613507b640 20 client.4484.objecter put_session s=0x7f60fc0a0d70 osd=15 1 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f613507b640 20 client.4484.objecter shutdown clearing up homeless session... 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f613507b640 10 client.4484.objecter successfully canceled tick 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f613507b640 1 -- 10.20.193.26:0/1994107782 >> v1:10.20.193.162:6800/3889602630 conn(0x7f60fc077ef0 legacy=0x7f60fc0983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f613507b640 10 monclient: shutdown 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f613507b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f613507b640 1 -- 10.20.193.26:0/1994107782 >> v1:10.20.193.103:6789/0 conn(0x7f61300585e0 legacy=0x7f6130166400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f612f577640 1 -- 10.20.193.26:0/1994107782 reap_dead start 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f613507b640 1 -- 10.20.193.26:0/1994107782 shutdown_connections 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f613507b640 1 -- 10.20.193.26:0/1994107782 >> 10.20.193.26:0/1994107782 conn(0x7f61300b7990 msgr2=0x7f6130158460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f613507b640 1 -- 10.20.193.26:0/1994107782 shutdown_connections 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f613507b640 1 -- 10.20.193.26:0/1994107782 wait complete. 2026-02-24T19:18:09.600 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f613507b640 1 librados: shutdown 2026-02-24T19:18:09.601 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f35ed767640 10 librados: watch_flush enter 2026-02-24T19:18:09.601 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f35ed767640 10 librados: watch_flush exit 2026-02-24T19:18:09.601 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f35ed767640 10 client.4449.objecter close_session for osd.0 2026-02-24T19:18:09.601 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f35ed767640 1 -- 10.20.193.26:0/2813836055 >> v1:10.20.193.26:6808/4098203721 conn(0x7f35b40a1330 legacy=0x7f35b40c1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.601 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f35ed767640 20 client.4449.objecter put_session s=0x7f35b40a0c80 osd=0 1 2026-02-24T19:18:09.601 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f35ed767640 20 client.4449.objecter shutdown clearing up homeless session... 2026-02-24T19:18:09.601 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f35ed767640 10 client.4449.objecter successfully canceled tick 2026-02-24T19:18:09.601 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f35ed767640 1 -- 10.20.193.26:0/2813836055 >> v1:10.20.193.162:6800/3889602630 conn(0x7f35b4077e00 legacy=0x7f35b40982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.601 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f35ed767640 10 monclient: shutdown 2026-02-24T19:18:09.601 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f35ed767640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.601 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f35ed767640 1 -- 10.20.193.26:0/2813836055 >> v1:10.20.193.26:6789/0 conn(0x7f35e80b9f80 legacy=0x7f35e81fe840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.601 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f35e77fe640 1 -- 10.20.193.26:0/2813836055 reap_dead start 2026-02-24T19:18:09.601 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f35ed767640 1 -- 10.20.193.26:0/2813836055 shutdown_connections 2026-02-24T19:18:09.601 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f35ed767640 1 -- 10.20.193.26:0/2813836055 >> 10.20.193.26:0/2813836055 conn(0x7f35e80b7990 msgr2=0x7f35e815acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.601 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f35ed767640 1 -- 10.20.193.26:0/2813836055 shutdown_connections 2026-02-24T19:18:09.601 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f35ed767640 1 -- 10.20.193.26:0/2813836055 wait complete. 2026-02-24T19:18:09.601 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.595+0000 7f35ed767640 1 librados: shutdown 2026-02-24T19:18:09.601 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.596+0000 7f861cff9640 1 -- 10.20.193.26:0/1159143980 <== osd.14 v1:10.20.193.103:6812/1276189911 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f8620160410 con 0x7f85f00a12b0 2026-02-24T19:18:09.601 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.596+0000 7f861cff9640 10 client.4456.objecter ms_dispatch2 0x7f8620000b90 command_reply(tid 2: 0 ) 2026-02-24T19:18:09.601 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.596+0000 7f861cff9640 10 client.4456.objecter _finish_command 2 = system:0 2026-02-24T19:18:09.601 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.596+0000 7f861cff9640 20 client.4456.objecter put_session s=0x7f85f00a0c00 osd=14 4 2026-02-24T19:18:09.601 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.596+0000 7f861cff9640 15 client.4456.objecter _session_command_op_remove 14 2 2026-02-24T19:18:09.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.597+0000 7f86262e1640 10 librados: watch_flush enter 2026-02-24T19:18:09.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.597+0000 7f86262e1640 10 librados: watch_flush exit 2026-02-24T19:18:09.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.597+0000 7f86262e1640 10 client.4456.objecter close_session for osd.14 2026-02-24T19:18:09.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.597+0000 7f86262e1640 1 -- 10.20.193.26:0/1159143980 >> v1:10.20.193.103:6812/1276189911 conn(0x7f85f00a12b0 legacy=0x7f85f00c16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.597+0000 7f86262e1640 20 client.4456.objecter put_session s=0x7f85f00a0c00 osd=14 1 2026-02-24T19:18:09.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.597+0000 7f86262e1640 20 client.4456.objecter shutdown clearing up homeless session... 2026-02-24T19:18:09.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.597+0000 7f86262e1640 10 client.4456.objecter successfully canceled tick 2026-02-24T19:18:09.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.597+0000 7f86262e1640 1 -- 10.20.193.26:0/1159143980 >> v1:10.20.193.162:6800/3889602630 conn(0x7f85f0077d80 legacy=0x7f85f0098230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.597+0000 7f86262e1640 10 monclient: shutdown 2026-02-24T19:18:09.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.597+0000 7f86262e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.597+0000 7f86262e1640 1 -- 10.20.193.26:0/1159143980 >> v1:10.20.193.70:6789/0 conn(0x7f86200ba350 legacy=0x7f8620264230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.597+0000 7f8624857640 1 -- 10.20.193.26:0/1159143980 reap_dead start 2026-02-24T19:18:09.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.597+0000 7f86262e1640 1 -- 10.20.193.26:0/1159143980 shutdown_connections 2026-02-24T19:18:09.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.597+0000 7f86262e1640 1 -- 10.20.193.26:0/1159143980 >> 10.20.193.26:0/1159143980 conn(0x7f86200b7990 msgr2=0x7f8620056830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.597+0000 7f86262e1640 1 -- 10.20.193.26:0/1159143980 shutdown_connections 2026-02-24T19:18:09.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.597+0000 7f86262e1640 1 -- 10.20.193.26:0/1159143980 wait complete. 2026-02-24T19:18:09.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.597+0000 7f86262e1640 1 librados: shutdown 2026-02-24T19:18:09.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.597+0000 7fb683fff640 1 -- 10.20.193.26:0/4238003527 <== osd.5 v1:10.20.193.70:6812/1419227842 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fb698002fc0 con 0x7fb6780a1350 2026-02-24T19:18:09.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.597+0000 7fb683fff640 10 client.4465.objecter ms_dispatch2 0x7fb6a8000b90 command_reply(tid 1: 0 ) 2026-02-24T19:18:09.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.597+0000 7fb683fff640 10 client.4465.objecter _finish_command 1 = system:0 2026-02-24T19:18:09.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.597+0000 7fb683fff640 20 client.4465.objecter put_session s=0x7fb6780a0ca0 osd=5 4 2026-02-24T19:18:09.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.597+0000 7fb683fff640 15 client.4465.objecter _session_command_op_remove 5 1 2026-02-24T19:18:09.603 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:09.603 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-24T19:18:09.603 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:09.603 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-24T19:18:09.603 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.601+0000 7f28e7fff640 10 client.4453.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:18:09.603 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.601+0000 7f28e7fff640 15 client.4453.objecter _session_command_op_assign -1 2 2026-02-24T19:18:09.603 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.601+0000 7f28e7fff640 20 client.4453.objecter _get_session s=0x7f28b40a0bd0 osd=2 3 2026-02-24T19:18:09.604 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.601+0000 7f28e7fff640 20 client.4453.objecter put_session s=0x7f28b40a0bd0 osd=2 3 2026-02-24T19:18:09.604 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.601+0000 7f28e7fff640 20 client.4453.objecter _get_session s=0x7f28b40a0bd0 osd=2 3 2026-02-24T19:18:09.604 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.601+0000 7f28e7fff640 15 client.4453.objecter _session_command_op_remove -1 2 2026-02-24T19:18:09.604 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.601+0000 7f28e7fff640 20 client.4453.objecter get_session s=0x7f28b40a0bd0 osd=2 3 2026-02-24T19:18:09.604 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.601+0000 7f28e7fff640 15 client.4453.objecter _session_command_op_assign 2 2 2026-02-24T19:18:09.604 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.601+0000 7f28e7fff640 20 client.4453.objecter put_session s=0x7f28b40a0bd0 osd=2 4 2026-02-24T19:18:09.604 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.601+0000 7f28e7fff640 10 client.4453.objecter _send_command 2 2026-02-24T19:18:09.604 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.601+0000 7f28e7fff640 1 -- 10.20.193.26:0/4010354651 --> v1:10.20.193.103:6800/3800806982 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f28e80b99b0 con 0x7f28b40a1280 2026-02-24T19:18:09.604 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.603+0000 7f70beffd640 1 -- 10.20.193.26:0/2159113441 <== osd.13 v1:10.20.193.70:6808/2949423039 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f70a40c2ec0 con 0x7f70a40a12c0 2026-02-24T19:18:09.604 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.604+0000 7f70beffd640 10 client.4462.objecter ms_dispatch2 0x7f70d8000b90 command_reply(tid 1: 0 ) 2026-02-24T19:18:09.604 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.604+0000 7f70beffd640 10 client.4462.objecter _finish_command 1 = system:0 2026-02-24T19:18:09.604 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.604+0000 7f70beffd640 20 client.4462.objecter put_session s=0x7f70a40a0c10 osd=13 4 2026-02-24T19:18:09.605 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.604+0000 7f70beffd640 15 client.4462.objecter _session_command_op_remove 13 1 2026-02-24T19:18:09.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.604+0000 7f28c77fe640 1 -- 10.20.193.26:0/4010354651 <== osd.2 v1:10.20.193.103:6800/3800806982 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f28e80b99b0 con 0x7f28b40a1280 2026-02-24T19:18:09.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.604+0000 7f28c77fe640 10 client.4453.objecter ms_dispatch2 0x7f28e8000b90 command_reply(tid 2: 0 ) 2026-02-24T19:18:09.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.604+0000 7f28c77fe640 10 client.4453.objecter _finish_command 2 = system:0 2026-02-24T19:18:09.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.604+0000 7f28c77fe640 20 client.4453.objecter put_session s=0x7f28b40a0bd0 osd=2 4 2026-02-24T19:18:09.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.604+0000 7f28c77fe640 15 client.4453.objecter _session_command_op_remove 2 2 2026-02-24T19:18:09.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.604+0000 7f28e7fff640 10 librados: watch_flush enter 2026-02-24T19:18:09.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.604+0000 7f28e7fff640 10 librados: watch_flush exit 2026-02-24T19:18:09.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.604+0000 7f28e7fff640 10 client.4453.objecter close_session for osd.2 2026-02-24T19:18:09.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.604+0000 7f28e7fff640 1 -- 10.20.193.26:0/4010354651 >> v1:10.20.193.103:6800/3800806982 conn(0x7f28b40a1280 legacy=0x7f28b40c16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.604+0000 7f28e7fff640 20 client.4453.objecter put_session s=0x7f28b40a0bd0 osd=2 1 2026-02-24T19:18:09.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.604+0000 7f28e7fff640 20 client.4453.objecter shutdown clearing up homeless session... 2026-02-24T19:18:09.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.604+0000 7f28e7fff640 10 client.4453.objecter successfully canceled tick 2026-02-24T19:18:09.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.604+0000 7f28e7fff640 1 -- 10.20.193.26:0/4010354651 >> v1:10.20.193.162:6800/3889602630 conn(0x7f28b4077d50 legacy=0x7f28b4098200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.604+0000 7f28e7fff640 10 monclient: shutdown 2026-02-24T19:18:09.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.604+0000 7f28e7fff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.604+0000 7f28e7fff640 1 -- 10.20.193.26:0/4010354651 >> v1:10.20.193.70:6789/0 conn(0x7f28e80b91f0 legacy=0x7f28e814e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.604+0000 7f28e77fe640 1 -- 10.20.193.26:0/4010354651 reap_dead start 2026-02-24T19:18:09.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.604+0000 7f28e7fff640 1 -- 10.20.193.26:0/4010354651 shutdown_connections 2026-02-24T19:18:09.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.604+0000 7f28e7fff640 1 -- 10.20.193.26:0/4010354651 >> 10.20.193.26:0/4010354651 conn(0x7f28e80b7730 msgr2=0x7f28e8158480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.604+0000 7f28e7fff640 1 -- 10.20.193.26:0/4010354651 shutdown_connections 2026-02-24T19:18:09.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.604+0000 7f28e7fff640 1 -- 10.20.193.26:0/4010354651 wait complete. 2026-02-24T19:18:09.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.604+0000 7f28e7fff640 1 librados: shutdown 2026-02-24T19:18:09.607 INFO:teuthology.orchestra.run.trial026.stdout:90194313221 2026-02-24T19:18:09.607 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2026-02-24T19:18:09.607 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:09.607 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-24T19:18:09.608 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:09.609 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2026-02-24T19:18:09.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.608+0000 7fb6ae10a640 10 client.4465.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:18:09.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.608+0000 7fb6ae10a640 15 client.4465.objecter _session_command_op_assign -1 2 2026-02-24T19:18:09.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.608+0000 7fb6ae10a640 20 client.4465.objecter _get_session s=0x7fb6780a0ca0 osd=5 3 2026-02-24T19:18:09.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.608+0000 7fb6ae10a640 20 client.4465.objecter put_session s=0x7fb6780a0ca0 osd=5 3 2026-02-24T19:18:09.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.608+0000 7fb6ae10a640 20 client.4465.objecter _get_session s=0x7fb6780a0ca0 osd=5 3 2026-02-24T19:18:09.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.608+0000 7fb6ae10a640 15 client.4465.objecter _session_command_op_remove -1 2 2026-02-24T19:18:09.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.608+0000 7fb6ae10a640 20 client.4465.objecter get_session s=0x7fb6780a0ca0 osd=5 3 2026-02-24T19:18:09.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.608+0000 7fb6ae10a640 15 client.4465.objecter _session_command_op_assign 5 2 2026-02-24T19:18:09.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.608+0000 7fb6ae10a640 20 client.4465.objecter put_session s=0x7fb6780a0ca0 osd=5 4 2026-02-24T19:18:09.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.608+0000 7fb6ae10a640 10 client.4465.objecter _send_command 2 2026-02-24T19:18:09.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.608+0000 7fb6ae10a640 1 -- 10.20.193.26:0/4238003527 --> v1:10.20.193.70:6812/1419227842 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb6a80b94f0 con 0x7fb6780a1350 2026-02-24T19:18:09.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.611+0000 7fb683fff640 1 -- 10.20.193.26:0/4238003527 <== osd.5 v1:10.20.193.70:6812/1419227842 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7fb6a80b94f0 con 0x7fb6780a1350 2026-02-24T19:18:09.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.611+0000 7fb683fff640 10 client.4465.objecter ms_dispatch2 0x7fb6a8000b90 command_reply(tid 2: 0 ) 2026-02-24T19:18:09.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.611+0000 7fb683fff640 10 client.4465.objecter _finish_command 2 = system:0 2026-02-24T19:18:09.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.611+0000 7fb683fff640 20 client.4465.objecter put_session s=0x7fb6780a0ca0 osd=5 4 2026-02-24T19:18:09.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.611+0000 7fb683fff640 15 client.4465.objecter _session_command_op_remove 5 2 2026-02-24T19:18:09.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.611+0000 7fb6ae10a640 10 librados: watch_flush enter 2026-02-24T19:18:09.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.611+0000 7fb6ae10a640 10 librados: watch_flush exit 2026-02-24T19:18:09.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.611+0000 7fb6ae10a640 10 client.4465.objecter close_session for osd.5 2026-02-24T19:18:09.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.611+0000 7fb6ae10a640 1 -- 10.20.193.26:0/4238003527 >> v1:10.20.193.70:6812/1419227842 conn(0x7fb6780a1350 legacy=0x7fb6780c1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.611+0000 7fb6ae10a640 20 client.4465.objecter put_session s=0x7fb6780a0ca0 osd=5 1 2026-02-24T19:18:09.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.611+0000 7fb6ae10a640 20 client.4465.objecter shutdown clearing up homeless session... 2026-02-24T19:18:09.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.611+0000 7fb6ae10a640 10 client.4465.objecter successfully canceled tick 2026-02-24T19:18:09.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.611+0000 7fb6ae10a640 1 -- 10.20.193.26:0/4238003527 >> v1:10.20.193.162:6800/3889602630 conn(0x7fb678077e20 legacy=0x7fb6780982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.611+0000 7fb6ae10a640 10 monclient: shutdown 2026-02-24T19:18:09.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.611+0000 7fb6ae10a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.611+0000 7fb6ae10a640 1 -- 10.20.193.26:0/4238003527 >> v1:10.20.193.70:6789/0 conn(0x7fb6a80b9f80 legacy=0x7fb6a81fc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.611+0000 7fb6a7fff640 1 -- 10.20.193.26:0/4238003527 reap_dead start 2026-02-24T19:18:09.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.611+0000 7fb6ae10a640 1 -- 10.20.193.26:0/4238003527 shutdown_connections 2026-02-24T19:18:09.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.611+0000 7fb6ae10a640 1 -- 10.20.193.26:0/4238003527 >> 10.20.193.26:0/4238003527 conn(0x7fb6a80b7990 msgr2=0x7fb6a80b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.611+0000 7fb6ae10a640 1 -- 10.20.193.26:0/4238003527 shutdown_connections 2026-02-24T19:18:09.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.611+0000 7fb6ae10a640 1 -- 10.20.193.26:0/4238003527 wait complete. 2026-02-24T19:18:09.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.611+0000 7fb6ae10a640 1 librados: shutdown 2026-02-24T19:18:09.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.612+0000 7f70dcd33640 10 client.4462.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-24T19:18:09.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.612+0000 7f70dcd33640 15 client.4462.objecter _session_command_op_assign -1 2 2026-02-24T19:18:09.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.612+0000 7f70dcd33640 20 client.4462.objecter _get_session s=0x7f70a40a0c10 osd=13 3 2026-02-24T19:18:09.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.612+0000 7f70dcd33640 20 client.4462.objecter put_session s=0x7f70a40a0c10 osd=13 3 2026-02-24T19:18:09.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.612+0000 7f70dcd33640 20 client.4462.objecter _get_session s=0x7f70a40a0c10 osd=13 3 2026-02-24T19:18:09.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.612+0000 7f70dcd33640 15 client.4462.objecter _session_command_op_remove -1 2 2026-02-24T19:18:09.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.612+0000 7f70dcd33640 20 client.4462.objecter get_session s=0x7f70a40a0c10 osd=13 3 2026-02-24T19:18:09.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.612+0000 7f70dcd33640 15 client.4462.objecter _session_command_op_assign 13 2 2026-02-24T19:18:09.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.612+0000 7f70dcd33640 20 client.4462.objecter put_session s=0x7f70a40a0c10 osd=13 4 2026-02-24T19:18:09.614 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.612+0000 7f70dcd33640 10 client.4462.objecter _send_command 2 2026-02-24T19:18:09.614 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.612+0000 7f70dcd33640 1 -- 10.20.193.26:0/2159113441 --> v1:10.20.193.70:6808/2949423039 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f70d8157dc0 con 0x7f70a40a12c0 2026-02-24T19:18:09.614 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:09.614 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-24T19:18:09.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.615+0000 7f70beffd640 1 -- 10.20.193.26:0/2159113441 <== osd.13 v1:10.20.193.70:6808/2949423039 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f70d8157dc0 con 0x7f70a40a12c0 2026-02-24T19:18:09.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.615+0000 7f70beffd640 10 client.4462.objecter ms_dispatch2 0x7f70d8000b90 command_reply(tid 2: 0 ) 2026-02-24T19:18:09.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.615+0000 7f70beffd640 10 client.4462.objecter _finish_command 2 = system:0 2026-02-24T19:18:09.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.615+0000 7f70beffd640 20 client.4462.objecter put_session s=0x7f70a40a0c10 osd=13 4 2026-02-24T19:18:09.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.615+0000 7f70beffd640 15 client.4462.objecter _session_command_op_remove 13 2 2026-02-24T19:18:09.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.615+0000 7f70dcd33640 10 librados: watch_flush enter 2026-02-24T19:18:09.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.615+0000 7f70dcd33640 10 librados: watch_flush exit 2026-02-24T19:18:09.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.615+0000 7f70dcd33640 10 client.4462.objecter close_session for osd.13 2026-02-24T19:18:09.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.615+0000 7f70dcd33640 1 -- 10.20.193.26:0/2159113441 >> v1:10.20.193.70:6808/2949423039 conn(0x7f70a40a12c0 legacy=0x7f70a40c16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.615+0000 7f70dcd33640 20 client.4462.objecter put_session s=0x7f70a40a0c10 osd=13 1 2026-02-24T19:18:09.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.615+0000 7f70dcd33640 20 client.4462.objecter shutdown clearing up homeless session... 2026-02-24T19:18:09.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.615+0000 7f70dcd33640 10 client.4462.objecter successfully canceled tick 2026-02-24T19:18:09.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.615+0000 7f70dcd33640 1 -- 10.20.193.26:0/2159113441 >> v1:10.20.193.162:6800/3889602630 conn(0x7f70a4077d30 legacy=0x7f70a40981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.615+0000 7f70dcd33640 10 monclient: shutdown 2026-02-24T19:18:09.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.615+0000 7f70dcd33640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.615+0000 7f70dcd33640 1 -- 10.20.193.26:0/2159113441 >> v1:10.20.193.70:6789/0 conn(0x7f70d80585e0 legacy=0x7f70d8159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.615+0000 7f70d6d76640 1 -- 10.20.193.26:0/2159113441 reap_dead start 2026-02-24T19:18:09.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.615+0000 7f70dcd33640 1 -- 10.20.193.26:0/2159113441 shutdown_connections 2026-02-24T19:18:09.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.615+0000 7f70dcd33640 1 -- 10.20.193.26:0/2159113441 >> 10.20.193.26:0/2159113441 conn(0x7f70d80b7990 msgr2=0x7f70d815ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.615+0000 7f70dcd33640 1 -- 10.20.193.26:0/2159113441 shutdown_connections 2026-02-24T19:18:09.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.615+0000 7f70dcd33640 1 -- 10.20.193.26:0/2159113441 wait complete. 2026-02-24T19:18:09.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.615+0000 7f70dcd33640 1 librados: shutdown 2026-02-24T19:18:09.622 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:09.622 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-24T19:18:09.626 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:09.627 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2026-02-24T19:18:09.643 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.642+0000 7ff5e1013640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.643 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.642+0000 7ff5e1013640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.643 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.642+0000 7ff5e1013640 10 monclient: monmap: 2026-02-24T19:18:09.643 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.643 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.643 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.642852+0000 2026-02-24T19:18:09.643 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.642852+0000 2026-02-24T19:18:09.643 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.643 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.643 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.643 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.643 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.643 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.643 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.642+0000 7ff5e1013640 1 Processor -- start 2026-02-24T19:18:09.643 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.642+0000 7ff5e1013640 1 -- start start 2026-02-24T19:18:09.643 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.642+0000 7ff5e1013640 10 monclient: init 2026-02-24T19:18:09.644 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.643+0000 7ff5e1013640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.644 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.643+0000 7ff5e1013640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:18:09.644 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.643+0000 7ff5e1013640 10 monclient(hunting): picked mon.noname-c con 0x7ff5dc0b9f80 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.644 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.643+0000 7ff5e1013640 10 monclient(hunting): picked mon.noname-b con 0x7ff5dc0ba350 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.644 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.643+0000 7ff5e1013640 10 monclient(hunting): picked mon.noname-a con 0x7ff5dc0585e0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.644 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.643+0000 7ff5e1013640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5dc163930 con 0x7ff5dc0585e0 2026-02-24T19:18:09.644 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.643+0000 7ff5e1013640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5dc163bb0 con 0x7ff5dc0ba350 2026-02-24T19:18:09.644 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.643+0000 7ff5e1013640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5dc163e90 con 0x7ff5dc0b9f80 2026-02-24T19:18:09.644 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.643+0000 7ff5e1013640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.644 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.643+0000 7ff5e1013640 10 monclient(hunting): authenticate will time out at 3672.325653s 2026-02-24T19:18:09.644 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.644+0000 7ff5dad76640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7ff5dc0b9f80 0x7ff5dc163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:55744/0 (socket says 10.20.193.26:55744) 2026-02-24T19:18:09.644 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.644+0000 7ff5dad76640 1 -- 10.20.193.26:0/3132147491 learned_addr learned my addr 10.20.193.26:0/3132147491 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.647 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.645+0000 7ff5d9d74640 1 -- 10.20.193.26:0/3132147491 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2811510606 0 0) 0x7ff5dc163e90 con 0x7ff5dc0b9f80 2026-02-24T19:18:09.647 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.645+0000 7ff5d9d74640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.647 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.645+0000 7ff5d9d74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.647 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.645+0000 7ff5d9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.647 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.645+0000 7ff5d9d74640 10 monclient(hunting): my global_id is 4487 2026-02-24T19:18:09.647 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.645+0000 7ff5d9d74640 1 -- 10.20.193.26:0/3132147491 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5c8003610 con 0x7ff5dc0b9f80 2026-02-24T19:18:09.647 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.646+0000 7ff5d9d74640 1 -- 10.20.193.26:0/3132147491 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 422528900 0 0) 0x7ff5cc002c90 con 0x7ff5dc0585e0 2026-02-24T19:18:09.647 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.646+0000 7ff5d9d74640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.647 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.646+0000 7ff5d9d74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.647 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.646+0000 7ff5d9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.647 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.646+0000 7ff5d9d74640 10 monclient(hunting): my global_id is 4482 2026-02-24T19:18:09.647 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.646+0000 7ff5d9d74640 1 -- 10.20.193.26:0/3132147491 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5dc163e90 con 0x7ff5dc0585e0 2026-02-24T19:18:09.647 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.646+0000 7ff5d9d74640 1 -- 10.20.193.26:0/3132147491 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1833444160 0 0) 0x7ff5dc163bb0 con 0x7ff5dc0ba350 2026-02-24T19:18:09.647 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.646+0000 7ff5d9d74640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.647 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.646+0000 7ff5d9d74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.646+0000 7ff5d9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.646+0000 7ff5d9d74640 10 monclient(hunting): my global_id is 4474 2026-02-24T19:18:09.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.646+0000 7ff5d9d74640 1 -- 10.20.193.26:0/3132147491 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5cc002c90 con 0x7ff5dc0ba350 2026-02-24T19:18:09.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.647+0000 7ff5d9d74640 1 -- 10.20.193.26:0/3132147491 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 910305593 0 0) 0x7ff5c8003610 con 0x7ff5dc0b9f80 2026-02-24T19:18:09.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.647+0000 7ff5d9d74640 1 -- 10.20.193.26:0/3132147491 >> v1:10.20.193.70:6789/0 conn(0x7ff5dc0ba350 legacy=0x7ff5dc057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.647+0000 7ff5d9d74640 1 -- 10.20.193.26:0/3132147491 >> v1:10.20.193.26:6789/0 conn(0x7ff5dc0585e0 legacy=0x7ff5dc166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.647+0000 7ff5d9d74640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.647+0000 7ff5d9d74640 1 monclient: found mon.noname-c 2026-02-24T19:18:09.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.647+0000 7ff5d9d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.647+0000 7ff5d9d74640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.647+0000 7ff5d9d74640 1 -- 10.20.193.26:0/3132147491 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5dc0573f0 con 0x7ff5dc0b9f80 2026-02-24T19:18:09.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.647+0000 7ff5d9d74640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.647+0000 7ff5d9d74640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.647+0000 7ff5d9d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.647+0000 7ff5d9d74640 1 -- 10.20.193.26:0/3132147491 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ff5d0002df0 con 0x7ff5dc0b9f80 2026-02-24T19:18:09.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.647+0000 7ff5d9d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.647+0000 7ff5d9d74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.647+0000 7ff5d9d74640 10 monclient: dump: 2026-02-24T19:18:09.648 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.648 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.648 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.648 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.648 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.648 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.648 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.648 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.648 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.647+0000 7ff5e1013640 5 monclient: authenticate success, global_id 4487 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.647+0000 7ff5e1013640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.648+0000 7ff5d9d74640 1 -- 10.20.193.26:0/3132147491 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff5d0002fc0 con 0x7ff5dc0b9f80 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.648+0000 7ff5d9d74640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.648+0000 7ff5d9d74640 1 -- 10.20.193.26:0/3132147491 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ff5d0003400 con 0x7ff5dc0b9f80 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.648+0000 7ff5d9d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.648+0000 7ff5d9d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.648+0000 7ff5d9d74640 10 monclient: dump: 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.648+0000 7ff5e1013640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.648+0000 7ff5e1013640 4 set_mon_vals no callback set 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.648+0000 7fdda98b1640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.648+0000 7fdda98b1640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.648+0000 7fdda98b1640 10 monclient: monmap: 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.649373+0000 2026-02-24T19:18:09.649 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.649373+0000 2026-02-24T19:18:09.650 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.650 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.650 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.650 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.650 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.650 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.650 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.648+0000 7ff5e1013640 10 monclient: shutdown 2026-02-24T19:18:09.650 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.648+0000 7ff5e1013640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.650 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.648+0000 7ff5e1013640 1 -- 10.20.193.26:0/3132147491 >> v1:10.20.193.103:6789/0 conn(0x7ff5dc0b9f80 legacy=0x7ff5dc163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.650 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.648+0000 7ff5e1013640 1 -- 10.20.193.26:0/3132147491 shutdown_connections 2026-02-24T19:18:09.651 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.648+0000 7ff5e1013640 1 -- 10.20.193.26:0/3132147491 >> 10.20.193.26:0/3132147491 conn(0x7ff5dc0b7990 msgr2=0x7ff5dc0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.651 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.648+0000 7ff5e1013640 1 -- 10.20.193.26:0/3132147491 shutdown_connections 2026-02-24T19:18:09.651 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.648+0000 7ff5e1013640 1 -- 10.20.193.26:0/3132147491 wait complete. 2026-02-24T19:18:09.651 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.649+0000 7ff5e1013640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.651 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.649+0000 7ff5e1013640 10 monclient: monmap: 2026-02-24T19:18:09.651 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.651 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.651 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.651 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.651 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.651 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.651 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.651 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.651 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.651 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.651 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.649+0000 7fdda98b1640 1 Processor -- start 2026-02-24T19:18:09.651 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.649+0000 7fdda98b1640 1 -- start start 2026-02-24T19:18:09.651 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.649+0000 7fdda98b1640 10 monclient: init 2026-02-24T19:18:09.651 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.650+0000 7ff5e1013640 1 librados: starting msgr at 2026-02-24T19:18:09.651 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.650+0000 7ff5e1013640 1 librados: starting objecter 2026-02-24T19:18:09.651 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.650+0000 7fdda98b1640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.651 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.650+0000 7fdda98b1640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:18:09.652 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.650+0000 7ff5e1013640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.652 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.650+0000 7ff5e1013640 1 Processor -- start 2026-02-24T19:18:09.652 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.650+0000 7fdda98b1640 10 monclient(hunting): picked mon.noname-b con 0x7fdda415d310 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.652 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.650+0000 7fdda98b1640 10 monclient(hunting): picked mon.noname-a con 0x7fdda40b3d00 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.652 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.650+0000 7ff5e1013640 1 -- start start 2026-02-24T19:18:09.652 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.650+0000 7ff5e1013640 1 librados: setting wanted keys 2026-02-24T19:18:09.652 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.650+0000 7ff5e1013640 1 librados: calling monclient init 2026-02-24T19:18:09.652 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.650+0000 7ff5e1013640 10 monclient: init 2026-02-24T19:18:09.652 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.650+0000 7fdda98b1640 10 monclient(hunting): picked mon.noname-c con 0x7fdda40571e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.652 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.650+0000 7fdda98b1640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda4164200 con 0x7fdda40b3d00 2026-02-24T19:18:09.652 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.650+0000 7fdda98b1640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda40b4c30 con 0x7fdda415d310 2026-02-24T19:18:09.652 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.650+0000 7fdda98b1640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda40b4f10 con 0x7fdda40571e0 2026-02-24T19:18:09.652 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.650+0000 7fdda98b1640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.652 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.650+0000 7fdda98b1640 10 monclient(hunting): authenticate will time out at 3672.332355s 2026-02-24T19:18:09.652 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.650+0000 7fdda2ffd640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7fdda415d310 0x7fdda4056ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:59748/0 (socket says 10.20.193.26:59748) 2026-02-24T19:18:09.652 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.650+0000 7fdda2ffd640 1 -- 10.20.193.26:0/3961189842 learned_addr learned my addr 10.20.193.26:0/3961189842 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.650+0000 7ff5e1013640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.650+0000 7ff5e1013640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:18:09.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.650+0000 7ff5e1013640 10 monclient(hunting): picked mon.noname-b con 0x7ff5dc0585e0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.650+0000 7ff5e1013640 10 monclient(hunting): picked mon.noname-c con 0x7ff5dc0b9f80 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.651+0000 7ff5e1013640 10 monclient(hunting): picked mon.noname-a con 0x7ff5dc0ba350 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.651+0000 7ff5e1013640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5dc0b2bf0 con 0x7ff5dc0ba350 2026-02-24T19:18:09.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.651+0000 7ff5e1013640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5dc0b3b00 con 0x7ff5dc0585e0 2026-02-24T19:18:09.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.651+0000 7ff5e1013640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5dc0b3de0 con 0x7ff5dc0b9f80 2026-02-24T19:18:09.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.651+0000 7ff5e1013640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.651+0000 7ff5e1013640 10 monclient(hunting): authenticate will time out at 3672.333235s 2026-02-24T19:18:09.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.651+0000 7fdda1ffb640 1 -- 10.20.193.26:0/3961189842 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 810804255 0 0) 0x7fdda40b4c30 con 0x7fdda415d310 2026-02-24T19:18:09.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.651+0000 7fdda1ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.651+0000 7fdda1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.651+0000 7fdda1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.651+0000 7fdda1ffb640 10 monclient(hunting): my global_id is 4477 2026-02-24T19:18:09.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.651+0000 7fdda1ffb640 1 -- 10.20.193.26:0/3961189842 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd90003610 con 0x7fdda415d310 2026-02-24T19:18:09.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.651+0000 7ff5dad76640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7ff5dc0585e0 0x7ff5dc1629d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:59760/0 (socket says 10.20.193.26:59760) 2026-02-24T19:18:09.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.651+0000 7ff5dad76640 1 -- 10.20.193.26:0/1471862225 learned_addr learned my addr 10.20.193.26:0/1471862225 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.652+0000 7ff5bb7fe640 10 client.?.objecter ms_handle_connect 0x7ff5dc0b9f80 2026-02-24T19:18:09.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.652+0000 7ff5bb7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.652+0000 7ff5bb7fe640 10 client.?.objecter ms_handle_connect 0x7ff5dc0585e0 2026-02-24T19:18:09.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.652+0000 7ff5bb7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.652+0000 7fdda1ffb640 1 -- 10.20.193.26:0/3961189842 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2690922460 0 0) 0x7fdda40b4f10 con 0x7fdda40571e0 2026-02-24T19:18:09.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.652+0000 7fdda1ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.652+0000 7fdda1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.652+0000 7fdda1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.652+0000 7fdda1ffb640 10 monclient(hunting): my global_id is 4490 2026-02-24T19:18:09.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.652+0000 7fdda1ffb640 1 -- 10.20.193.26:0/3961189842 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdda40b4c30 con 0x7fdda40571e0 2026-02-24T19:18:09.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.654+0000 7fdda1ffb640 1 -- 10.20.193.26:0/3961189842 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1622185232 0 0) 0x7fdda4164200 con 0x7fdda40b3d00 2026-02-24T19:18:09.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.654+0000 7fdda1ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.654+0000 7fdda1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.654+0000 7fdda1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.654+0000 7fdda1ffb640 10 monclient(hunting): my global_id is 4485 2026-02-24T19:18:09.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.654+0000 7fdda1ffb640 1 -- 10.20.193.26:0/3961189842 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdda40b4f10 con 0x7fdda40b3d00 2026-02-24T19:18:09.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.654+0000 7fdda1ffb640 1 -- 10.20.193.26:0/3961189842 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2251342218 0 0) 0x7fdd90003610 con 0x7fdda415d310 2026-02-24T19:18:09.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.654+0000 7fdda1ffb640 1 -- 10.20.193.26:0/3961189842 >> v1:10.20.193.103:6789/0 conn(0x7fdda40571e0 legacy=0x7fdda41c5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.654+0000 7fdda1ffb640 1 -- 10.20.193.26:0/3961189842 >> v1:10.20.193.26:6789/0 conn(0x7fdda40b3d00 legacy=0x7fdda4163400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.654+0000 7fdda1ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.654+0000 7fdda1ffb640 1 monclient: found mon.noname-b 2026-02-24T19:18:09.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.654+0000 7fdda1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.654+0000 7fdda1ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.654+0000 7fdda1ffb640 1 -- 10.20.193.26:0/3961189842 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda4160910 con 0x7fdda415d310 2026-02-24T19:18:09.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.654+0000 7fdda1ffb640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.654+0000 7fdda1ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.654+0000 7fdda1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.654+0000 7fdda1ffb640 1 -- 10.20.193.26:0/3961189842 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fdd98002df0 con 0x7fdda415d310 2026-02-24T19:18:09.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.654+0000 7fdda1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.654+0000 7fdda1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:09.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.654+0000 7fdda1ffb640 10 monclient: dump: 2026-02-24T19:18:09.657 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.657 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.657 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.657 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.657 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.657 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.657 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.657 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.657 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.657 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.654+0000 7fdda98b1640 5 monclient: authenticate success, global_id 4477 2026-02-24T19:18:09.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.654+0000 7fdda98b1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.655+0000 7ff5bb7fe640 1 -- 10.20.193.26:0/1471862225 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3387097183 0 0) 0x7ff5dc0b3de0 con 0x7ff5dc0b9f80 2026-02-24T19:18:09.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.655+0000 7ff5bb7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.655+0000 7ff5bb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.655+0000 7ff5bb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.655+0000 7ff5bb7fe640 10 monclient(hunting): my global_id is 4493 2026-02-24T19:18:09.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.655+0000 7ff5bb7fe640 1 -- 10.20.193.26:0/1471862225 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5a8003610 con 0x7ff5dc0b9f80 2026-02-24T19:18:09.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.655+0000 7ff5bb7fe640 10 client.?.objecter ms_handle_connect 0x7ff5dc0ba350 2026-02-24T19:18:09.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.655+0000 7ff5bb7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.655+0000 7ff5bb7fe640 1 -- 10.20.193.26:0/1471862225 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3133598245 0 0) 0x7ff5dc0b3b00 con 0x7ff5dc0585e0 2026-02-24T19:18:09.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.655+0000 7ff5bb7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.655+0000 7ff5bb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.655+0000 7ff5bb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.655+0000 7ff5bb7fe640 10 monclient(hunting): my global_id is 4480 2026-02-24T19:18:09.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.655+0000 7ff5bb7fe640 1 -- 10.20.193.26:0/1471862225 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5dc0b3de0 con 0x7ff5dc0585e0 2026-02-24T19:18:09.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.655+0000 7fdda1ffb640 1 -- 10.20.193.26:0/3961189842 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd98002fc0 con 0x7fdda415d310 2026-02-24T19:18:09.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.655+0000 7fdda1ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.655+0000 7fdda1ffb640 1 -- 10.20.193.26:0/3961189842 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fdd98003400 con 0x7fdda415d310 2026-02-24T19:18:09.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.655+0000 7fdda1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.655+0000 7fdda1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.655+0000 7fdda1ffb640 10 monclient: dump: 2026-02-24T19:18:09.659 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.659 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.659 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.659 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.659 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.659 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.659 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.659 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.659 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.660 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.655+0000 7fdda98b1640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.655+0000 7fdda98b1640 4 set_mon_vals no callback set 2026-02-24T19:18:09.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.656+0000 7fdda98b1640 10 monclient: shutdown 2026-02-24T19:18:09.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.656+0000 7fdda98b1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.656+0000 7fdda98b1640 1 -- 10.20.193.26:0/3961189842 >> v1:10.20.193.70:6789/0 conn(0x7fdda415d310 legacy=0x7fdda4056ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.657+0000 7fdda98b1640 1 -- 10.20.193.26:0/3961189842 shutdown_connections 2026-02-24T19:18:09.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.657+0000 7fdda98b1640 1 -- 10.20.193.26:0/3961189842 >> 10.20.193.26:0/3961189842 conn(0x7fdda40b4120 msgr2=0x7fdda40b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.657+0000 7ff5bb7fe640 1 -- 10.20.193.26:0/1471862225 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3027439481 0 0) 0x7ff5a8003610 con 0x7ff5dc0b9f80 2026-02-24T19:18:09.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.657+0000 7ff5bb7fe640 1 -- 10.20.193.26:0/1471862225 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff5dc0b3b00 con 0x7ff5dc0b9f80 2026-02-24T19:18:09.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.657+0000 7ff5bb7fe640 1 -- 10.20.193.26:0/1471862225 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ff5c4002fb0 con 0x7ff5dc0b9f80 2026-02-24T19:18:09.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.657+0000 7ff5bb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.657+0000 7ff5bb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.657+0000 7ff5bb7fe640 10 monclient(hunting): dump: 2026-02-24T19:18:09.660 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.660 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.660 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.660 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.660 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.660 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.661 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.661 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.661 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.661 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.657+0000 7ff5bb7fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:09.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.658+0000 7fdda98b1640 1 -- 10.20.193.26:0/3961189842 shutdown_connections 2026-02-24T19:18:09.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.658+0000 7fdda98b1640 1 -- 10.20.193.26:0/3961189842 wait complete. 2026-02-24T19:18:09.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.658+0000 7ff5bb7fe640 1 -- 10.20.193.26:0/1471862225 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 719060693 0 0) 0x7ff5dc0b2bf0 con 0x7ff5dc0ba350 2026-02-24T19:18:09.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.658+0000 7ff5bb7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.658+0000 7ff5bb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.658+0000 7ff5bb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.658+0000 7ff5bb7fe640 10 monclient(hunting): my global_id is 4488 2026-02-24T19:18:09.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.658+0000 7ff5bb7fe640 1 -- 10.20.193.26:0/1471862225 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5a8003610 con 0x7ff5dc0ba350 2026-02-24T19:18:09.663 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.658+0000 7f3b55c16640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.663 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.658+0000 7f3b55c16640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.663 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.658+0000 7f3b55c16640 10 monclient: monmap: 2026-02-24T19:18:09.663 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.663 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.663 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.659567+0000 2026-02-24T19:18:09.663 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.659567+0000 2026-02-24T19:18:09.663 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.663 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.664 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.664 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.664 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.664 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.664 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7ff5bb7fe640 1 -- 10.20.193.26:0/1471862225 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2274378137 0 0) 0x7ff5dc0b3de0 con 0x7ff5dc0585e0 2026-02-24T19:18:09.664 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7ff5bb7fe640 1 -- 10.20.193.26:0/1471862225 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff5dc0b2bf0 con 0x7ff5dc0585e0 2026-02-24T19:18:09.664 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7ff5bb7fe640 1 -- 10.20.193.26:0/1471862225 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ff5d0003310 con 0x7ff5dc0585e0 2026-02-24T19:18:09.664 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7ff5bb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.664 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7ff5bb7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.664 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7ff5bb7fe640 10 monclient(hunting): dump: 2026-02-24T19:18:09.664 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.664 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.664 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.664 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.664 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.664 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.664 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.664 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.664 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.664 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.665 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7fdda98b1640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.665 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7fdda98b1640 10 monclient: monmap: 2026-02-24T19:18:09.665 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.665 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.665 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.665 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.665 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.665 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.665 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.665 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.665 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.665 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.665 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7f3b55c16640 1 Processor -- start 2026-02-24T19:18:09.665 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7f3b55c16640 1 -- start start 2026-02-24T19:18:09.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7ff5bb7fe640 1 -- 10.20.193.26:0/1471862225 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1522489936 0 0) 0x7ff5dc0b3b00 con 0x7ff5dc0b9f80 2026-02-24T19:18:09.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7ff5bb7fe640 1 -- 10.20.193.26:0/1471862225 >> v1:10.20.193.70:6789/0 conn(0x7ff5dc0585e0 legacy=0x7ff5dc1629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7ff5bb7fe640 1 -- 10.20.193.26:0/1471862225 >> v1:10.20.193.26:6789/0 conn(0x7ff5dc0ba350 legacy=0x7ff5dc0b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7ff5bb7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7ff5bb7fe640 1 monclient: found mon.c 2026-02-24T19:18:09.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7ff5bb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7ff5bb7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7ff5bb7fe640 1 -- 10.20.193.26:0/1471862225 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5dc0b40c0 con 0x7ff5dc0b9f80 2026-02-24T19:18:09.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7ff5bb7fe640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7ff5bb7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7ff5bb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7f3b55c16640 10 monclient: init 2026-02-24T19:18:09.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7fdda98b1640 1 librados: starting msgr at 2026-02-24T19:18:09.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7fdda98b1640 1 librados: starting objecter 2026-02-24T19:18:09.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7ff5e1013640 5 monclient: authenticate success, global_id 4493 2026-02-24T19:18:09.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7ff5e1013640 10 monclient: _renew_subs 2026-02-24T19:18:09.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7ff5e1013640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7ff5e1013640 1 -- 10.20.193.26:0/1471862225 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff5dc0b43a0 con 0x7ff5dc0b9f80 2026-02-24T19:18:09.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7fdda98b1640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7ff5e1013640 10 client.4493.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7ff5e1013640 10 monclient: _renew_subs 2026-02-24T19:18:09.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7ff5e1013640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7ff5e1013640 1 -- 10.20.193.26:0/1471862225 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff5dc1630e0 con 0x7ff5dc0b9f80 2026-02-24T19:18:09.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7fdda98b1640 1 Processor -- start 2026-02-24T19:18:09.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7ff5e1013640 1 librados: init done 2026-02-24T19:18:09.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7fdda98b1640 1 -- start start 2026-02-24T19:18:09.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7fdda98b1640 1 librados: setting wanted keys 2026-02-24T19:18:09.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7fdda98b1640 1 librados: calling monclient init 2026-02-24T19:18:09.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.659+0000 7fdda98b1640 10 monclient: init 2026-02-24T19:18:09.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.660+0000 7f3b55c16640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.660+0000 7f3b55c16640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:18:09.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.660+0000 7f3b55c16640 10 monclient(hunting): picked mon.noname-a con 0x7f3b500b9f80 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.660+0000 7f3b55c16640 10 monclient(hunting): picked mon.noname-b con 0x7f3b500ba350 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.660+0000 7f3b55c16640 10 monclient(hunting): picked mon.noname-c con 0x7f3b500585e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.660+0000 7f3b55c16640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b50163930 con 0x7f3b500b9f80 2026-02-24T19:18:09.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.660+0000 7f3b55c16640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b50163bb0 con 0x7f3b500ba350 2026-02-24T19:18:09.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.660+0000 7f3b55c16640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b50163e90 con 0x7f3b500585e0 2026-02-24T19:18:09.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.660+0000 7f3b55c16640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.660+0000 7f3b55c16640 10 monclient(hunting): authenticate will time out at 3672.342224s 2026-02-24T19:18:09.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.660+0000 7fdda98b1640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.660+0000 7fdda98b1640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:18:09.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.660+0000 7fdda98b1640 10 monclient(hunting): picked mon.noname-c con 0x7fdda40571e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.660+0000 7fdda98b1640 10 monclient(hunting): picked mon.noname-b con 0x7fdda40b3d00 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.660+0000 7fdda98b1640 10 monclient(hunting): picked mon.noname-a con 0x7fdda415d310 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.660+0000 7fdda98b1640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda40aaee0 con 0x7fdda415d310 2026-02-24T19:18:09.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.660+0000 7fdda98b1640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda4170240 con 0x7fdda40b3d00 2026-02-24T19:18:09.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.660+0000 7fdda98b1640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda4170520 con 0x7fdda40571e0 2026-02-24T19:18:09.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.660+0000 7fdda98b1640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.660+0000 7fdda98b1640 10 monclient(hunting): authenticate will time out at 3672.342362s 2026-02-24T19:18:09.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.661+0000 7f3b4effd640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f3b500ba350 0x7f3b50057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:59772/0 (socket says 10.20.193.26:59772) 2026-02-24T19:18:09.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.661+0000 7ff5e1013640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.661+0000 7ff5e1013640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.661+0000 7ff5e1013640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.661+0000 7f3b4effd640 1 -- 10.20.193.26:0/4159839120 learned_addr learned my addr 10.20.193.26:0/4159839120 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.661+0000 7ff5e1013640 1 -- 10.20.193.26:0/1471862225 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5dc0b64c0 con 0x7ff5dc0b9f80 2026-02-24T19:18:09.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.661+0000 7fdda27fc640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7fdda40b3d00 0x7fdda40ab390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:59780/0 (socket says 10.20.193.26:59780) 2026-02-24T19:18:09.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.661+0000 7fdda27fc640 1 -- 10.20.193.26:0/1611509555 learned_addr learned my addr 10.20.193.26:0/1611509555 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.662+0000 7fdd7bfff640 10 client.?.objecter ms_handle_connect 0x7fdda40b3d00 2026-02-24T19:18:09.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.662+0000 7fdd7bfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.663+0000 7f3b4e7fc640 1 -- 10.20.193.26:0/4159839120 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1776450527 0 0) 0x7f3b50163bb0 con 0x7f3b500ba350 2026-02-24T19:18:09.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.663+0000 7f3b4e7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.663+0000 7f3b4e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.663+0000 7f3b4e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.663+0000 7f3b4e7fc640 10 monclient(hunting): my global_id is 4483 2026-02-24T19:18:09.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.663+0000 7f3b4e7fc640 1 -- 10.20.193.26:0/4159839120 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b34003610 con 0x7f3b500ba350 2026-02-24T19:18:09.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.663+0000 7fdd7bfff640 1 -- 10.20.193.26:0/1611509555 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2701085997 0 0) 0x7fdda4170240 con 0x7fdda40b3d00 2026-02-24T19:18:09.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.663+0000 7fdd7bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.663+0000 7fdd7bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.663+0000 7fdd7bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.664+0000 7fdd7bfff640 10 monclient(hunting): my global_id is 4486 2026-02-24T19:18:09.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.664+0000 7fdd7bfff640 1 -- 10.20.193.26:0/1611509555 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd74003610 con 0x7fdda40b3d00 2026-02-24T19:18:09.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.664+0000 7fdd7bfff640 10 client.?.objecter ms_handle_connect 0x7fdda415d310 2026-02-24T19:18:09.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.664+0000 7fdd7bfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.667+0000 7ff5bb7fe640 1 -- 10.20.193.26:0/1471862225 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff5c4003700 con 0x7ff5dc0b9f80 2026-02-24T19:18:09.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.667+0000 7ff5bb7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.667+0000 7ff5bb7fe640 1 -- 10.20.193.26:0/1471862225 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ff5c40038b0 con 0x7ff5dc0b9f80 2026-02-24T19:18:09.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.667+0000 7ff5bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.667+0000 7ff5bb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.667+0000 7ff5d9573640 4 set_mon_vals no callback set 2026-02-24T19:18:09.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.667+0000 7ff5bb7fe640 10 monclient: dump: 2026-02-24T19:18:09.672 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.672 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.672 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.672 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.672 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.672 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.672 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.672 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.672 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.672 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7fdd7bfff640 1 -- 10.20.193.26:0/1611509555 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2199330912 0 0) 0x7fdda40aaee0 con 0x7fdda415d310 2026-02-24T19:18:09.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7fdd7bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7fdd7bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7fdd7bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7fdd7bfff640 10 monclient(hunting): my global_id is 4491 2026-02-24T19:18:09.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7fdd7bfff640 1 -- 10.20.193.26:0/1611509555 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdda4170240 con 0x7fdda415d310 2026-02-24T19:18:09.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7fdd7bfff640 1 -- 10.20.193.26:0/1611509555 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1428771620 0 0) 0x7fdd74003610 con 0x7fdda40b3d00 2026-02-24T19:18:09.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7fdd7bfff640 1 -- 10.20.193.26:0/1611509555 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdda40aaee0 con 0x7fdda40b3d00 2026-02-24T19:18:09.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7fdd7bfff640 1 -- 10.20.193.26:0/1611509555 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fdd8c0030c0 con 0x7fdda40b3d00 2026-02-24T19:18:09.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7fdd7bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7fdd7bfff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:09.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7fdd7bfff640 10 monclient(hunting): dump: 2026-02-24T19:18:09.673 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.673 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.673 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.673 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.673 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.673 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.673 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.673 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.673 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.673 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7fdd7bfff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:09.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7f3b4e7fc640 1 -- 10.20.193.26:0/4159839120 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 553318440 0 0) 0x7f3b34003610 con 0x7f3b500ba350 2026-02-24T19:18:09.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7f3b4e7fc640 1 -- 10.20.193.26:0/4159839120 >> v1:10.20.193.103:6789/0 conn(0x7f3b500585e0 legacy=0x7f3b50166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:09.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7f3b4e7fc640 1 -- 10.20.193.26:0/4159839120 >> v1:10.20.193.26:6789/0 conn(0x7f3b500b9f80 legacy=0x7f3b50163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7f3b4e7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7f3b4e7fc640 1 monclient: found mon.noname-b 2026-02-24T19:18:09.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7f3b4e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7f3b4e7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7f3b4e7fc640 1 -- 10.20.193.26:0/4159839120 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b500573f0 con 0x7f3b500ba350 2026-02-24T19:18:09.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7f3b4e7fc640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7f3b4e7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7f3b4e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7f3b4e7fc640 1 -- 10.20.193.26:0/4159839120 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f3b40002df0 con 0x7f3b500ba350 2026-02-24T19:18:09.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7f3b4e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7f3b4e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:09.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7f3b4e7fc640 10 monclient: dump: 2026-02-24T19:18:09.674 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.674 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.674 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.674 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.674 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.674 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.675 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.675 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.675 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.675 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7f3b55c16640 5 monclient: authenticate success, global_id 4483 2026-02-24T19:18:09.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.668+0000 7f3b55c16640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.669+0000 7ff5bb7fe640 1 -- 10.20.193.26:0/1471862225 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7ff5c401c720 con 0x7ff5dc0b9f80 2026-02-24T19:18:09.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.669+0000 7ff5bb7fe640 1 -- 10.20.193.26:0/1471862225 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7ff5c4094390 con 0x7ff5dc0b9f80 2026-02-24T19:18:09.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.669+0000 7ff5bb7fe640 10 client.4493.objecter ms_dispatch2 0x7ff5dc000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:09.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.669+0000 7ff5bb7fe640 3 client.4493.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:09.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.669+0000 7ff5bb7fe640 3 client.4493.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:09.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.669+0000 7ff5bb7fe640 20 client.4493.objecter dump_active .. 0 homeless 2026-02-24T19:18:09.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.669+0000 7ff5dad76640 10 monclient: get_auth_request con 0x7ff5a8077dc0 auth_method 0 2026-02-24T19:18:09.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.670+0000 7ff5bb7fe640 10 client.4493.objecter ms_handle_connect 0x7ff5a8077dc0 2026-02-24T19:18:09.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.670+0000 7fdd7bfff640 10 client.?.objecter ms_handle_connect 0x7fdda40571e0 2026-02-24T19:18:09.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.670+0000 7fdd7bfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.670+0000 7f3b4e7fc640 1 -- 10.20.193.26:0/4159839120 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3b40003000 con 0x7f3b500ba350 2026-02-24T19:18:09.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.670+0000 7f3b4e7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.670+0000 7f3b4e7fc640 1 -- 10.20.193.26:0/4159839120 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f3b40003440 con 0x7f3b500ba350 2026-02-24T19:18:09.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.670+0000 7f3b4e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.670+0000 7f3b4e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.670+0000 7f3b4e7fc640 10 monclient: dump: 2026-02-24T19:18:09.676 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.676 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.676 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.676 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.676 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.676 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.676 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.676 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.676 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.676 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.670+0000 7f3b55c16640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.670+0000 7f3b55c16640 4 set_mon_vals no callback set 2026-02-24T19:18:09.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.670+0000 7fdd7bfff640 1 -- 10.20.193.26:0/1611509555 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1043921754 0 0) 0x7fdda40aaee0 con 0x7fdda40b3d00 2026-02-24T19:18:09.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.670+0000 7fdd7bfff640 1 -- 10.20.193.26:0/1611509555 >> v1:10.20.193.103:6789/0 conn(0x7fdda40571e0 legacy=0x7fdda41597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.670+0000 7fdd7bfff640 1 -- 10.20.193.26:0/1611509555 >> v1:10.20.193.26:6789/0 conn(0x7fdda415d310 legacy=0x7fdda415ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.670+0000 7fdd7bfff640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.670+0000 7fdd7bfff640 1 monclient: found mon.b 2026-02-24T19:18:09.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.670+0000 7fdd7bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.670+0000 7fdd7bfff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.670+0000 7fdd7bfff640 1 -- 10.20.193.26:0/1611509555 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda4170800 con 0x7fdda40b3d00 2026-02-24T19:18:09.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.670+0000 7fdd7bfff640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.670+0000 7fdd7bfff640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.670+0000 7fdd7bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.671+0000 7fdda98b1640 5 monclient: authenticate success, global_id 4486 2026-02-24T19:18:09.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.671+0000 7fdda98b1640 10 monclient: _renew_subs 2026-02-24T19:18:09.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.671+0000 7fdda98b1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.671+0000 7fdda98b1640 1 -- 10.20.193.26:0/1611509555 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdda4170ae0 con 0x7fdda40b3d00 2026-02-24T19:18:09.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.671+0000 7f3b55c16640 10 monclient: shutdown 2026-02-24T19:18:09.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.671+0000 7fdda98b1640 10 client.4486.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.671+0000 7fdda98b1640 10 monclient: _renew_subs 2026-02-24T19:18:09.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.671+0000 7fdda98b1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.678 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.671+0000 7fdda98b1640 1 -- 10.20.193.26:0/1611509555 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdda41710a0 con 0x7fdda40b3d00 2026-02-24T19:18:09.678 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.671+0000 7f3b55c16640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.678 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.671+0000 7f3b55c16640 1 -- 10.20.193.26:0/4159839120 >> v1:10.20.193.70:6789/0 conn(0x7f3b500ba350 legacy=0x7f3b50057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.678 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.671+0000 7fdda98b1640 1 librados: init done 2026-02-24T19:18:09.678 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.671+0000 7f3b55c16640 1 -- 10.20.193.26:0/4159839120 shutdown_connections 2026-02-24T19:18:09.678 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.671+0000 7f3b55c16640 1 -- 10.20.193.26:0/4159839120 >> 10.20.193.26:0/4159839120 conn(0x7f3b500b7990 msgr2=0x7f3b500b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.678 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.671+0000 7f3b55c16640 1 -- 10.20.193.26:0/4159839120 shutdown_connections 2026-02-24T19:18:09.678 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.671+0000 7f3b55c16640 1 -- 10.20.193.26:0/4159839120 wait complete. 2026-02-24T19:18:09.678 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.671+0000 7fdd7bfff640 1 -- 10.20.193.26:0/1611509555 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd8c003470 con 0x7fdda40b3d00 2026-02-24T19:18:09.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.671+0000 7fdd7bfff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.671+0000 7fdd7bfff640 1 -- 10.20.193.26:0/1611509555 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fdd8c003b50 con 0x7fdda40b3d00 2026-02-24T19:18:09.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.671+0000 7fdd7bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.671+0000 7fdd7bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.671+0000 7fdda17fa640 4 set_mon_vals no callback set 2026-02-24T19:18:09.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.671+0000 7fdd7bfff640 10 monclient: dump: 2026-02-24T19:18:09.679 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.679 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.679 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.679 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.679 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.679 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.679 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.679 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.679 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.679 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.671+0000 7fdda98b1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.672+0000 7f3b55c16640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.672+0000 7f3b55c16640 10 monclient: monmap: 2026-02-24T19:18:09.679 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.679 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.679 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.680 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.680 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.680 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.680 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.680 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.680 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.680 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.672+0000 7f3b55c16640 1 librados: starting msgr at 2026-02-24T19:18:09.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.672+0000 7f3b55c16640 1 librados: starting objecter 2026-02-24T19:18:09.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.672+0000 7fa71bd4d640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.672+0000 7fa71bd4d640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.672+0000 7fa71bd4d640 10 monclient: monmap: 2026-02-24T19:18:09.680 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.680 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.680 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.673345+0000 2026-02-24T19:18:09.680 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.673345+0000 2026-02-24T19:18:09.680 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.680 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.680 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.680 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.680 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.680 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.672+0000 7f3b55c16640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.672+0000 7fdda98b1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.672+0000 7fdda98b1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.672+0000 7fdda98b1640 1 -- 10.20.193.26:0/1611509555 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdda40531e0 con 0x7fdda40b3d00 2026-02-24T19:18:09.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.672+0000 7f3b55c16640 1 Processor -- start 2026-02-24T19:18:09.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.672+0000 7f3b55c16640 1 -- start start 2026-02-24T19:18:09.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.672+0000 7f3b55c16640 1 librados: setting wanted keys 2026-02-24T19:18:09.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.672+0000 7f3b55c16640 1 librados: calling monclient init 2026-02-24T19:18:09.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.672+0000 7f3b55c16640 10 monclient: init 2026-02-24T19:18:09.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.673+0000 7f3b55c16640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.673+0000 7fa71bd4d640 1 Processor -- start 2026-02-24T19:18:09.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.673+0000 7f3b55c16640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:18:09.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.673+0000 7f3b55c16640 10 monclient(hunting): picked mon.noname-c con 0x7f3b500585e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.673+0000 7f3b55c16640 10 monclient(hunting): picked mon.noname-a con 0x7f3b500b9f80 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.673+0000 7f3b55c16640 10 monclient(hunting): picked mon.noname-b con 0x7f3b500ba350 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.673+0000 7f3b55c16640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b501fb0a0 con 0x7f3b500b9f80 2026-02-24T19:18:09.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.673+0000 7f3b55c16640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b501fb380 con 0x7f3b500ba350 2026-02-24T19:18:09.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.673+0000 7f3b55c16640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b501fb660 con 0x7f3b500585e0 2026-02-24T19:18:09.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.673+0000 7f3b55c16640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.673+0000 7f3b55c16640 10 monclient(hunting): authenticate will time out at 3672.355328s 2026-02-24T19:18:09.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.673+0000 7fa71bd4d640 1 -- start start 2026-02-24T19:18:09.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.673+0000 7fa71bd4d640 10 monclient: init 2026-02-24T19:18:09.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.674+0000 7f3b4effd640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f3b500b9f80 0x7f3b501fc800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:47044/0 (socket says 10.20.193.26:47044) 2026-02-24T19:18:09.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.674+0000 7f3b4effd640 1 -- 10.20.193.26:0/1078597095 learned_addr learned my addr 10.20.193.26:0/1078597095 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.674+0000 7fa71bd4d640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.674+0000 7fa71bd4d640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:18:09.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.674+0000 7fa71bd4d640 10 monclient(hunting): picked mon.noname-a con 0x7fa7140b9f80 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.674+0000 7fa3d15e3640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.674+0000 7fa3d15e3640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.674+0000 7fa3d15e3640 10 monclient: monmap: 2026-02-24T19:18:09.683 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.683 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.683 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.675094+0000 2026-02-24T19:18:09.683 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.675094+0000 2026-02-24T19:18:09.683 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.683 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.683 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.683 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.683 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.683 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.674+0000 7fa71bd4d640 10 monclient(hunting): picked mon.noname-c con 0x7fa7140ba350 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.674+0000 7fa71bd4d640 10 monclient(hunting): picked mon.noname-b con 0x7fa7140585e0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.674+0000 7fa71bd4d640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa714163930 con 0x7fa7140b9f80 2026-02-24T19:18:09.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.674+0000 7fa71bd4d640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa714163bb0 con 0x7fa7140585e0 2026-02-24T19:18:09.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.674+0000 7fa71bd4d640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa714163e90 con 0x7fa7140ba350 2026-02-24T19:18:09.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.674+0000 7fa71bd4d640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.674+0000 7fa71bd4d640 10 monclient(hunting): authenticate will time out at 3672.356486s 2026-02-24T19:18:09.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.674+0000 7f3b2bfff640 10 client.?.objecter ms_handle_connect 0x7f3b500b9f80 2026-02-24T19:18:09.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.674+0000 7f3b2bfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.674+0000 7fa3d15e3640 1 Processor -- start 2026-02-24T19:18:09.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.674+0000 7fa3d15e3640 1 -- start start 2026-02-24T19:18:09.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.674+0000 7fa3d15e3640 10 monclient: init 2026-02-24T19:18:09.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.675+0000 7ff17dc2b640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.675+0000 7ff17dc2b640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.675+0000 7ff17dc2b640 10 monclient: monmap: 2026-02-24T19:18:09.684 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.684 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.684 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.675904+0000 2026-02-24T19:18:09.684 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.675904+0000 2026-02-24T19:18:09.685 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.685 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.685 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.685 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.685 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.685 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.675+0000 7fa3d15e3640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.675+0000 7fa3d15e3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:18:09.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.675+0000 7fa3d15e3640 10 monclient(hunting): picked mon.noname-c con 0x7fa3cc0b9f80 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.675+0000 7fa3d15e3640 10 monclient(hunting): picked mon.noname-b con 0x7fa3cc0ba350 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.675+0000 7fa3d15e3640 10 monclient(hunting): picked mon.noname-a con 0x7fa3cc0585e0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.675+0000 7fa3d15e3640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3cc163930 con 0x7fa3cc0585e0 2026-02-24T19:18:09.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.675+0000 7fa3d15e3640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3cc163bb0 con 0x7fa3cc0ba350 2026-02-24T19:18:09.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.675+0000 7fa3d15e3640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3cc163e90 con 0x7fa3cc0b9f80 2026-02-24T19:18:09.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.675+0000 7fa3d15e3640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.675+0000 7fa3d15e3640 10 monclient(hunting): authenticate will time out at 3672.357647s 2026-02-24T19:18:09.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.675+0000 7ff17dc2b640 1 Processor -- start 2026-02-24T19:18:09.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.675+0000 7ff17dc2b640 1 -- start start 2026-02-24T19:18:09.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.675+0000 7ff17dc2b640 10 monclient: init 2026-02-24T19:18:09.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.676+0000 7ff17dc2b640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.676+0000 7ff17dc2b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:18:09.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.676+0000 7ff17dc2b640 10 monclient(hunting): picked mon.noname-a con 0x7ff1780b9f80 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.676+0000 7ff17dc2b640 10 monclient(hunting): picked mon.noname-b con 0x7ff1780ba350 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.676+0000 7ff17dc2b640 10 monclient(hunting): picked mon.noname-c con 0x7ff1780585e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.676+0000 7ff17dc2b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff178163930 con 0x7ff1780b9f80 2026-02-24T19:18:09.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.676+0000 7ff17dc2b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff178163bb0 con 0x7ff1780ba350 2026-02-24T19:18:09.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.676+0000 7ff17dc2b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff178163e90 con 0x7ff1780585e0 2026-02-24T19:18:09.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.676+0000 7ff17dc2b640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.676+0000 7ff17dc2b640 10 monclient(hunting): authenticate will time out at 3672.358326s 2026-02-24T19:18:09.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.676+0000 7fa3cb7fe640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fa3cc0585e0 0x7fa3cc166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:47074/0 (socket says 10.20.193.26:47074) 2026-02-24T19:18:09.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.676+0000 7fa3cb7fe640 1 -- 10.20.193.26:0/2745650018 learned_addr learned my addr 10.20.193.26:0/2745650018 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.676+0000 7fa719ac2640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fa7140b9f80 0x7fa714163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:47060/0 (socket says 10.20.193.26:47060) 2026-02-24T19:18:09.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.676+0000 7fa719ac2640 1 -- 10.20.193.26:0/1819109326 learned_addr learned my addr 10.20.193.26:0/1819109326 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.677+0000 7f3b2bfff640 1 -- 10.20.193.26:0/1078597095 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3861556966 0 0) 0x7f3b501fb0a0 con 0x7f3b500b9f80 2026-02-24T19:18:09.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.677+0000 7f3b2bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.677+0000 7f3b2bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.677+0000 7f3b2bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.677+0000 7f3b2bfff640 10 monclient(hunting): my global_id is 4497 2026-02-24T19:18:09.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.677+0000 7f3b2bfff640 1 -- 10.20.193.26:0/1078597095 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b20003610 con 0x7f3b500b9f80 2026-02-24T19:18:09.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.677+0000 7ff1777fe640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7ff1780b9f80 0x7ff178163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:47080/0 (socket says 10.20.193.26:47080) 2026-02-24T19:18:09.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.677+0000 7ff1777fe640 1 -- 10.20.193.26:0/1830332545 learned_addr learned my addr 10.20.193.26:0/1830332545 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.688 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.680+0000 7fdd7bfff640 1 -- 10.20.193.26:0/1611509555 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fdd8c003cf0 con 0x7fdda40b3d00 2026-02-24T19:18:09.688 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.681+0000 7f7afc013640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.688 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.681+0000 7f7afc013640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.688 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.681+0000 7f7afc013640 10 monclient: monmap: 2026-02-24T19:18:09.688 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.688 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.688 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.681943+0000 2026-02-24T19:18:09.688 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.681943+0000 2026-02-24T19:18:09.688 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.688 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.688 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.688 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.688 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.688 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.688 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.681+0000 7fdd7bfff640 1 -- 10.20.193.26:0/1611509555 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7fdd8c0932c0 con 0x7fdda40b3d00 2026-02-24T19:18:09.688 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.681+0000 7fdd7bfff640 10 client.4486.objecter ms_dispatch2 0x7fdda4000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:09.688 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.681+0000 7fdd7bfff640 3 client.4486.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:09.688 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.681+0000 7fdd7bfff640 3 client.4486.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:09.688 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.681+0000 7fdd7bfff640 20 client.4486.objecter dump_active .. 0 homeless 2026-02-24T19:18:09.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.681+0000 7f7afc013640 1 Processor -- start 2026-02-24T19:18:09.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.681+0000 7f7afc013640 1 -- start start 2026-02-24T19:18:09.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.682+0000 7fa3c9ffb640 1 -- 10.20.193.26:0/2745650018 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4134027098 0 0) 0x7fa3bc002c90 con 0x7fa3cc0585e0 2026-02-24T19:18:09.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.682+0000 7fa3c9ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.682+0000 7fa3c9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.682+0000 7fa3c9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.682+0000 7fa3c9ffb640 10 monclient(hunting): my global_id is 4500 2026-02-24T19:18:09.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.682+0000 7fa3c9ffb640 1 -- 10.20.193.26:0/2745650018 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3b8003610 con 0x7fa3cc0585e0 2026-02-24T19:18:09.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.681+0000 7f7afc013640 10 monclient: init 2026-02-24T19:18:09.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.682+0000 7f7afc013640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.682+0000 7f7afc013640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:18:09.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.682+0000 7f7afc013640 10 monclient(hunting): picked mon.noname-a con 0x7f7af4161430 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.682+0000 7f7afc013640 10 monclient(hunting): picked mon.noname-c con 0x7f7af4161800 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.682+0000 7f7afc013640 10 monclient(hunting): picked mon.noname-b con 0x7f7af416ad30 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.682+0000 7f7afc013640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7af40b1800 con 0x7f7af4161430 2026-02-24T19:18:09.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.682+0000 7f7afc013640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7af40b1ae0 con 0x7f7af416ad30 2026-02-24T19:18:09.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.682+0000 7f7afc013640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7af40b1dc0 con 0x7f7af4161800 2026-02-24T19:18:09.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.682+0000 7f7afc013640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.682+0000 7f7afc013640 10 monclient(hunting): authenticate will time out at 3672.364303s 2026-02-24T19:18:09.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.682+0000 7fdda2ffd640 10 monclient: get_auth_request con 0x7fdd74077cb0 auth_method 0 2026-02-24T19:18:09.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.682+0000 7fdd7bfff640 10 client.4486.objecter ms_handle_connect 0x7fdd74077cb0 2026-02-24T19:18:09.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.683+0000 7fa718ac0640 1 -- 10.20.193.26:0/1819109326 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 810176772 0 0) 0x7fa704002910 con 0x7fa7140b9f80 2026-02-24T19:18:09.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.683+0000 7fa718ac0640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.683+0000 7fa718ac0640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.683+0000 7fa718ac0640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.683+0000 7fa718ac0640 10 monclient(hunting): my global_id is 4503 2026-02-24T19:18:09.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.683+0000 7fa718ac0640 1 -- 10.20.193.26:0/1819109326 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6fc003610 con 0x7fa7140b9f80 2026-02-24T19:18:09.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.683+0000 7ff1767fc640 1 -- 10.20.193.26:0/1830332545 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2450888452 0 0) 0x7ff164002910 con 0x7ff1780b9f80 2026-02-24T19:18:09.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.683+0000 7ff1767fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.691 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.683+0000 7ff1767fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.691 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.683+0000 7ff1767fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.691 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.683+0000 7ff1767fc640 10 monclient(hunting): my global_id is 4506 2026-02-24T19:18:09.691 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.683+0000 7ff1767fc640 1 -- 10.20.193.26:0/1830332545 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff15c003610 con 0x7ff1780b9f80 2026-02-24T19:18:09.691 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.684+0000 7ff6d6b45640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.691 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.684+0000 7ff6d6b45640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.691 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.684+0000 7ff6d6b45640 10 monclient: monmap: 2026-02-24T19:18:09.691 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.691 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.691 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.685086+0000 2026-02-24T19:18:09.691 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.685086+0000 2026-02-24T19:18:09.691 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.691 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.691 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.691 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.691 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.691 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.691 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.684+0000 7ff05bf8a640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.691 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.684+0000 7ff05bf8a640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.692 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.684+0000 7ff6d6b45640 1 Processor -- start 2026-02-24T19:18:09.692 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.684+0000 7ff05bf8a640 10 monclient: monmap: 2026-02-24T19:18:09.692 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.692 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.692 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.685197+0000 2026-02-24T19:18:09.692 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.685197+0000 2026-02-24T19:18:09.692 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.692 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.692 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.692 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.692 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.692 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.692 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.685+0000 7ff6d6b45640 1 -- start start 2026-02-24T19:18:09.692 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.685+0000 7ff6d6b45640 10 monclient: init 2026-02-24T19:18:09.692 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.685+0000 7ff6d6b45640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.692 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.685+0000 7ff6d6b45640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:18:09.692 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.685+0000 7ff6d6b45640 10 monclient(hunting): picked mon.noname-b con 0x7ff6d00b9f80 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.693 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.685+0000 7ff6d6b45640 10 monclient(hunting): picked mon.noname-c con 0x7ff6d00ba350 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.693 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.685+0000 7ff6d6b45640 10 monclient(hunting): picked mon.noname-a con 0x7ff6d00585e0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.693 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.685+0000 7ff6d6b45640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6d0163930 con 0x7ff6d00585e0 2026-02-24T19:18:09.693 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.685+0000 7ff6d6b45640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6d0163bb0 con 0x7ff6d00b9f80 2026-02-24T19:18:09.693 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.685+0000 7ff6d6b45640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6d0163e90 con 0x7ff6d00ba350 2026-02-24T19:18:09.693 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.685+0000 7ff6d6b45640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.693 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.685+0000 7ff6d6b45640 10 monclient(hunting): authenticate will time out at 3672.367868s 2026-02-24T19:18:09.693 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.685+0000 7ff05bf8a640 1 Processor -- start 2026-02-24T19:18:09.693 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.685+0000 7ff05bf8a640 1 -- start start 2026-02-24T19:18:09.693 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.685+0000 7ff05bf8a640 10 monclient: init 2026-02-24T19:18:09.693 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.685+0000 7ff05bf8a640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.693 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.685+0000 7ff05bf8a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:18:09.693 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.685+0000 7ff05bf8a640 10 monclient(hunting): picked mon.noname-b con 0x7ff0541617a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.693 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.685+0000 7ff05bf8a640 10 monclient(hunting): picked mon.noname-c con 0x7ff054161b70 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.693 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.685+0000 7ff05bf8a640 10 monclient(hunting): picked mon.noname-a con 0x7ff0540b5de0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.693 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.685+0000 7ff05bf8a640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff054167aa0 con 0x7ff0540b5de0 2026-02-24T19:18:09.693 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.685+0000 7ff05bf8a640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff054167d80 con 0x7ff0541617a0 2026-02-24T19:18:09.693 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.685+0000 7ff05bf8a640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff054168060 con 0x7ff054161b70 2026-02-24T19:18:09.693 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.685+0000 7ff05bf8a640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.693 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.685+0000 7ff05bf8a640 10 monclient(hunting): authenticate will time out at 3672.367666s 2026-02-24T19:18:09.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.689+0000 7fa718ac0640 1 -- 10.20.193.26:0/1819109326 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 439320388 0 0) 0x7fa6fc003610 con 0x7fa7140b9f80 2026-02-24T19:18:09.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.689+0000 7fa718ac0640 1 -- 10.20.193.26:0/1819109326 >> v1:10.20.193.103:6789/0 conn(0x7fa7140ba350 legacy=0x7fa714057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:09.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.689+0000 7fa718ac0640 1 -- 10.20.193.26:0/1819109326 >> v1:10.20.193.70:6789/0 conn(0x7fa7140585e0 legacy=0x7fa714166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:09.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.689+0000 7fa718ac0640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.689+0000 7fa718ac0640 1 monclient: found mon.noname-a 2026-02-24T19:18:09.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.689+0000 7fa718ac0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.689+0000 7fa718ac0640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.689+0000 7fa718ac0640 1 -- 10.20.193.26:0/1819109326 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7140573f0 con 0x7fa7140b9f80 2026-02-24T19:18:09.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.689+0000 7fa718ac0640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.689+0000 7fa718ac0640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.689+0000 7fa718ac0640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.689+0000 7fa718ac0640 1 -- 10.20.193.26:0/1819109326 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa704002fc0 con 0x7fa7140b9f80 2026-02-24T19:18:09.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.689+0000 7fa718ac0640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.689+0000 7fa718ac0640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:09.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.689+0000 7fa718ac0640 10 monclient: dump: 2026-02-24T19:18:09.694 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.694 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.694 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.694 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.694 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.694 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.694 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.694 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.695 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.695 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.690+0000 7fa71bd4d640 5 monclient: authenticate success, global_id 4503 2026-02-24T19:18:09.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.690+0000 7fa71bd4d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.690+0000 7fa3c9ffb640 1 -- 10.20.193.26:0/2745650018 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1933293129 0 0) 0x7fa3b8003610 con 0x7fa3cc0585e0 2026-02-24T19:18:09.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.690+0000 7fa3c9ffb640 1 -- 10.20.193.26:0/2745650018 >> v1:10.20.193.103:6789/0 conn(0x7fa3cc0b9f80 legacy=0x7fa3cc163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:09.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.690+0000 7fa3c9ffb640 1 -- 10.20.193.26:0/2745650018 >> v1:10.20.193.70:6789/0 conn(0x7fa3cc0ba350 legacy=0x7fa3cc057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:09.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.690+0000 7fa3c9ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.690+0000 7fa3c9ffb640 1 monclient: found mon.noname-a 2026-02-24T19:18:09.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.690+0000 7fa3c9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.690+0000 7fa3c9ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.690+0000 7fa3c9ffb640 1 -- 10.20.193.26:0/2745650018 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3cc0573f0 con 0x7fa3cc0585e0 2026-02-24T19:18:09.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.690+0000 7fa3c9ffb640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.690+0000 7fa3c9ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.690+0000 7fa3c9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.690+0000 7fa3c9ffb640 1 -- 10.20.193.26:0/2745650018 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa3bc003340 con 0x7fa3cc0585e0 2026-02-24T19:18:09.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.690+0000 7fa3c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.690+0000 7fa3c9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:09.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.690+0000 7fa3c9ffb640 10 monclient: dump: 2026-02-24T19:18:09.695 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.695 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.695 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.696 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.696 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.696 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.696 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.696 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.696 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.696 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.696 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.690+0000 7fa3d15e3640 5 monclient: authenticate success, global_id 4500 2026-02-24T19:18:09.696 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.690+0000 7fa3d15e3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.696 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.690+0000 7ffbbc313640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.696 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.690+0000 7ffbbc313640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.696 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.690+0000 7ffbbc313640 10 monclient: monmap: 2026-02-24T19:18:09.696 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.696 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.696 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.691044+0000 2026-02-24T19:18:09.696 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.691044+0000 2026-02-24T19:18:09.696 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.697 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.697 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.697 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.697 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.697 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.690+0000 7ffbbc313640 1 Processor -- start 2026-02-24T19:18:09.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.690+0000 7ffbbc313640 1 -- start start 2026-02-24T19:18:09.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.690+0000 7ffbbc313640 10 monclient: init 2026-02-24T19:18:09.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.691+0000 7ffbbc313640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.691+0000 7ffbbc313640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:18:09.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.691+0000 7ffbbc313640 10 monclient(hunting): picked mon.noname-b con 0x7ffbb40b9f80 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.691+0000 7ffbbc313640 10 monclient(hunting): picked mon.noname-a con 0x7ffbb40ba350 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.691+0000 7ffbbc313640 10 monclient(hunting): picked mon.noname-c con 0x7ffbb40585e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.691+0000 7ffbbc313640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbb4163930 con 0x7ffbb40ba350 2026-02-24T19:18:09.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.691+0000 7ffbbc313640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbb4163bb0 con 0x7ffbb40b9f80 2026-02-24T19:18:09.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.691+0000 7ffbbc313640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbb4163e90 con 0x7ffbb40585e0 2026-02-24T19:18:09.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.691+0000 7ffbbc313640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.691+0000 7ffbbc313640 10 monclient(hunting): authenticate will time out at 3672.373664s 2026-02-24T19:18:09.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.691+0000 7ff05a500640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7ff0540b5de0 0x7ff0540b0b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:47096/0 (socket says 10.20.193.26:47096) 2026-02-24T19:18:09.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.691+0000 7ff05a500640 1 -- 10.20.193.26:0/2307351764 learned_addr learned my addr 10.20.193.26:0/2307351764 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.692+0000 7f7af9d88640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f7af4161430 0x7f7af40b0ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:47094/0 (socket says 10.20.193.26:47094) 2026-02-24T19:18:09.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.692+0000 7f7af9d88640 1 -- 10.20.193.26:0/2268165793 learned_addr learned my addr 10.20.193.26:0/2268165793 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.698 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.693+0000 7f3b2bfff640 1 -- 10.20.193.26:0/1078597095 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 892400724 0 0) 0x7f3b20003610 con 0x7f3b500b9f80 2026-02-24T19:18:09.698 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.693+0000 7f3b2bfff640 1 -- 10.20.193.26:0/1078597095 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3b501fb0a0 con 0x7f3b500b9f80 2026-02-24T19:18:09.698 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.693+0000 7f3b2bfff640 1 -- 10.20.193.26:0/1078597095 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f3b40003350 con 0x7f3b500b9f80 2026-02-24T19:18:09.698 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.693+0000 7f3b2bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.698 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.693+0000 7f3b2bfff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:09.698 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.693+0000 7f3b2bfff640 10 monclient(hunting): dump: 2026-02-24T19:18:09.698 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.698 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.698 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.698 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.698 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.698 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.698 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.698 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.698 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.698 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.698 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.693+0000 7f3b2bfff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:09.698 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.694+0000 7fb27a110640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.698 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.694+0000 7fb27a110640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.694+0000 7fb27a110640 10 monclient: monmap: 2026-02-24T19:18:09.699 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.699 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.699 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.695146+0000 2026-02-24T19:18:09.699 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.695146+0000 2026-02-24T19:18:09.699 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.699 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.699 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.699 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.699 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.699 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.694+0000 7ff6d50bb640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7ff6d00585e0 0x7ff6d0166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:47108/0 (socket says 10.20.193.26:47108) 2026-02-24T19:18:09.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.694+0000 7ff6d50bb640 1 -- 10.20.193.26:0/3460022707 learned_addr learned my addr 10.20.193.26:0/3460022707 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.694+0000 7fb27a110640 1 Processor -- start 2026-02-24T19:18:09.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.694+0000 7fb27a110640 1 -- start start 2026-02-24T19:18:09.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.694+0000 7fb27a110640 10 monclient: init 2026-02-24T19:18:09.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.695+0000 7fb27a110640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.695+0000 7fb27a110640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:18:09.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.695+0000 7fb27a110640 10 monclient(hunting): picked mon.noname-a con 0x7fb2740b9f80 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.695+0000 7fb27a110640 10 monclient(hunting): picked mon.noname-b con 0x7fb2740ba350 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.695+0000 7fb27a110640 10 monclient(hunting): picked mon.noname-c con 0x7fb2740585e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.695+0000 7fb27a110640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb274163930 con 0x7fb2740b9f80 2026-02-24T19:18:09.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.695+0000 7fb27a110640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb274163bb0 con 0x7fb2740ba350 2026-02-24T19:18:09.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.695+0000 7fb27a110640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb274163e90 con 0x7fb2740585e0 2026-02-24T19:18:09.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.695+0000 7fb27a110640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.695+0000 7fb27a110640 10 monclient(hunting): authenticate will time out at 3672.377436s 2026-02-24T19:18:09.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.698+0000 7f05c8e16640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.698+0000 7f05c8e16640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.698+0000 7f05c8e16640 10 monclient: monmap: 2026-02-24T19:18:09.700 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.700 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.700 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.699126+0000 2026-02-24T19:18:09.700 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.699126+0000 2026-02-24T19:18:09.700 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.700 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.700 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.700 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.701 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.701 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.701 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.698+0000 7f05c8e16640 1 Processor -- start 2026-02-24T19:18:09.701 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.698+0000 7f05c8e16640 1 -- start start 2026-02-24T19:18:09.701 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.698+0000 7f05c8e16640 10 monclient: init 2026-02-24T19:18:09.701 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7fc74794c640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.701 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7fc74794c640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.701 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7fc74794c640 10 monclient: monmap: 2026-02-24T19:18:09.701 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.701 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.701 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.699823+0000 2026-02-24T19:18:09.701 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.699823+0000 2026-02-24T19:18:09.701 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.701 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.701 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.701 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.701 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.701 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.701 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7ff058cfd640 1 -- 10.20.193.26:0/2307351764 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1605647844 0 0) 0x7ff054167aa0 con 0x7ff0540b5de0 2026-02-24T19:18:09.701 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7ff058cfd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.702 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7ff058cfd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.702 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7ff058cfd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.702 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7ff058cfd640 10 monclient(hunting): my global_id is 4509 2026-02-24T19:18:09.702 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7ff058cfd640 1 -- 10.20.193.26:0/2307351764 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff03c003610 con 0x7ff0540b5de0 2026-02-24T19:18:09.702 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7fa718ac0640 1 -- 10.20.193.26:0/1819109326 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa7040031d0 con 0x7fa7140b9f80 2026-02-24T19:18:09.702 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7fa718ac0640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.702 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7fa718ac0640 1 -- 10.20.193.26:0/1819109326 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa704004990 con 0x7fa7140b9f80 2026-02-24T19:18:09.702 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7fa718ac0640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.702 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7fa718ac0640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:09.702 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7fa718ac0640 10 monclient: dump: 2026-02-24T19:18:09.702 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.702 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.702 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.702 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.702 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.702 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.702 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.702 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.702 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.702 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.702 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7fa71bd4d640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.702 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7fa71bd4d640 4 set_mon_vals no callback set 2026-02-24T19:18:09.703 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7f05c8e16640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.703 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7f05c8e16640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:18:09.703 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7fc74794c640 1 Processor -- start 2026-02-24T19:18:09.703 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7f05c8e16640 10 monclient(hunting): picked mon.noname-a con 0x7f05c4057500 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.703 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7fa3c9ffb640 1 -- 10.20.193.26:0/2745650018 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa3bc003550 con 0x7fa3cc0585e0 2026-02-24T19:18:09.703 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7fa3c9ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.703 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7fa3d15e3640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.703 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7fa3c9ffb640 1 -- 10.20.193.26:0/2745650018 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa3bc004d10 con 0x7fa3cc0585e0 2026-02-24T19:18:09.703 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7fa3d15e3640 4 set_mon_vals no callback set 2026-02-24T19:18:09.703 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7fa3c9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.703 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7fa3c9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:09.703 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7f05c8e16640 10 monclient(hunting): picked mon.noname-b con 0x7f05c40b91f0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.704 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7fa3c9ffb640 10 monclient: dump: 2026-02-24T19:18:09.704 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.704 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.704 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.704 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.704 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.704 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.704 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.704 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.704 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.704 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.704 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7f05c8e16640 10 monclient(hunting): picked mon.noname-c con 0x7f05c4159b40 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.704 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7fc74794c640 1 -- start start 2026-02-24T19:18:09.704 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7fc74794c640 10 monclient: init 2026-02-24T19:18:09.705 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7f05c8e16640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05c40b4d10 con 0x7f05c4057500 2026-02-24T19:18:09.705 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7f05c8e16640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05c40b3eb0 con 0x7f05c40b91f0 2026-02-24T19:18:09.705 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7f05c8e16640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05c40b4190 con 0x7f05c4159b40 2026-02-24T19:18:09.705 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7f05c8e16640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.705 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7f05c8e16640 10 monclient(hunting): authenticate will time out at 3672.381876s 2026-02-24T19:18:09.705 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7fb2737fe640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fb2740b9f80 0x7fb274163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:47126/0 (socket says 10.20.193.26:47126) 2026-02-24T19:18:09.705 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.699+0000 7fb2737fe640 1 -- 10.20.193.26:0/648618700 learned_addr learned my addr 10.20.193.26:0/648618700 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.705 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7fa71bd4d640 10 monclient: shutdown 2026-02-24T19:18:09.705 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7fa71bd4d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.705 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7fa71bd4d640 1 -- 10.20.193.26:0/1819109326 >> v1:10.20.193.26:6789/0 conn(0x7fa7140b9f80 legacy=0x7fa714163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.705 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7fa71bd4d640 1 -- 10.20.193.26:0/1819109326 shutdown_connections 2026-02-24T19:18:09.705 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7fa71bd4d640 1 -- 10.20.193.26:0/1819109326 >> 10.20.193.26:0/1819109326 conn(0x7fa7140b7990 msgr2=0x7fa7140b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.706 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7fa3d15e3640 10 monclient: shutdown 2026-02-24T19:18:09.706 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7fa3d15e3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.706 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7fa3d15e3640 1 -- 10.20.193.26:0/2745650018 >> v1:10.20.193.26:6789/0 conn(0x7fa3cc0585e0 legacy=0x7fa3cc166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.706 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7fa71bd4d640 1 -- 10.20.193.26:0/1819109326 shutdown_connections 2026-02-24T19:18:09.706 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7fa71bd4d640 1 -- 10.20.193.26:0/1819109326 wait complete. 2026-02-24T19:18:09.706 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7f8b0296b640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.706 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7f8b0296b640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.706 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7fc74794c640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.706 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7fc74794c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:18:09.706 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7f8b0296b640 10 monclient: monmap: 2026-02-24T19:18:09.706 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.706 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.707 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.701224+0000 2026-02-24T19:18:09.707 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.701224+0000 2026-02-24T19:18:09.707 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.707 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.707 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.707 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.707 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.707 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.707 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7fa3d15e3640 1 -- 10.20.193.26:0/2745650018 shutdown_connections 2026-02-24T19:18:09.707 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7fa3d15e3640 1 -- 10.20.193.26:0/2745650018 >> 10.20.193.26:0/2745650018 conn(0x7fa3cc0b7990 msgr2=0x7fa3cc0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.707 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7fa3d15e3640 1 -- 10.20.193.26:0/2745650018 shutdown_connections 2026-02-24T19:18:09.707 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7fc74794c640 10 monclient(hunting): picked mon.noname-c con 0x7fc7400b9f80 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.707 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7fc74794c640 10 monclient(hunting): picked mon.noname-a con 0x7fc7400ba350 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.707 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7fc74794c640 10 monclient(hunting): picked mon.noname-b con 0x7fc7400585e0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.707 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7fc74794c640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc740163930 con 0x7fc7400ba350 2026-02-24T19:18:09.707 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7fc74794c640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc740163bb0 con 0x7fc7400585e0 2026-02-24T19:18:09.708 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7fc74794c640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc740163e90 con 0x7fc7400b9f80 2026-02-24T19:18:09.708 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7fc74794c640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.708 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7fc74794c640 10 monclient(hunting): authenticate will time out at 3672.382686s 2026-02-24T19:18:09.708 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7fa3d15e3640 1 -- 10.20.193.26:0/2745650018 wait complete. 2026-02-24T19:18:09.708 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7ff1767fc640 1 -- 10.20.193.26:0/1830332545 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 405683406 0 0) 0x7ff15c003610 con 0x7ff1780b9f80 2026-02-24T19:18:09.708 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7ff1767fc640 1 -- 10.20.193.26:0/1830332545 >> v1:10.20.193.103:6789/0 conn(0x7ff1780585e0 legacy=0x7ff178166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:09.708 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7ff1767fc640 1 -- 10.20.193.26:0/1830332545 >> v1:10.20.193.70:6789/0 conn(0x7ff1780ba350 legacy=0x7ff178057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:09.708 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7ff1767fc640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.708 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7ff1767fc640 1 monclient: found mon.noname-a 2026-02-24T19:18:09.708 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7ff1767fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.708 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7ff1767fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.708 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7ff1767fc640 1 -- 10.20.193.26:0/1830332545 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1780573f0 con 0x7ff1780b9f80 2026-02-24T19:18:09.708 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7ff1767fc640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.708 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7ff1767fc640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.708 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7ff1767fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.708 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7ff1767fc640 1 -- 10.20.193.26:0/1830332545 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ff164002fc0 con 0x7ff1780b9f80 2026-02-24T19:18:09.708 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7ff1767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.708 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7ff1767fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:09.708 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7ff1767fc640 10 monclient: dump: 2026-02-24T19:18:09.708 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.708 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.708 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.708 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.709 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.709 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.709 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.709 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.709 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.709 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.709 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7ff17dc2b640 5 monclient: authenticate success, global_id 4506 2026-02-24T19:18:09.709 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.700+0000 7ff17dc2b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.709 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa71bd4d640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.709 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7f8b0296b640 1 Processor -- start 2026-02-24T19:18:09.709 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa71bd4d640 10 monclient: monmap: 2026-02-24T19:18:09.709 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.709 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.709 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.709 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.709 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.709 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.709 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.709 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.709 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.710 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.710 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7f8b0296b640 1 -- start start 2026-02-24T19:18:09.710 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7f8b0296b640 10 monclient: init 2026-02-24T19:18:09.710 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa71bd4d640 1 librados: starting msgr at 2026-02-24T19:18:09.710 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa71bd4d640 1 librados: starting objecter 2026-02-24T19:18:09.710 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa71bd4d640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.710 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa71bd4d640 1 Processor -- start 2026-02-24T19:18:09.710 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa71bd4d640 1 -- start start 2026-02-24T19:18:09.710 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa71bd4d640 1 librados: setting wanted keys 2026-02-24T19:18:09.710 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa71bd4d640 1 librados: calling monclient init 2026-02-24T19:18:09.710 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa71bd4d640 10 monclient: init 2026-02-24T19:18:09.710 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa3d15e3640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.711 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa3d15e3640 10 monclient: monmap: 2026-02-24T19:18:09.711 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.711 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.711 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.711 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.711 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.711 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.711 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.711 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.711 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.711 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.711 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa3d15e3640 1 librados: starting msgr at 2026-02-24T19:18:09.711 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa3d15e3640 1 librados: starting objecter 2026-02-24T19:18:09.711 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa3d15e3640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.711 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa3d15e3640 1 Processor -- start 2026-02-24T19:18:09.711 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa71bd4d640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.711 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7f8b0296b640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.711 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7f8b0296b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:18:09.711 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7f8b0296b640 10 monclient(hunting): picked mon.noname-c con 0x7f8afc159a70 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.712 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa71bd4d640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:18:09.712 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa71bd4d640 10 monclient(hunting): picked mon.noname-a con 0x7fa7140585e0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.712 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa71bd4d640 10 monclient(hunting): picked mon.noname-b con 0x7fa7140b9f80 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.712 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa71bd4d640 10 monclient(hunting): picked mon.noname-c con 0x7fa7140ba350 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.712 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa71bd4d640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7140b37e0 con 0x7fa7140585e0 2026-02-24T19:18:09.712 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa71bd4d640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7140b4c70 con 0x7fa7140b9f80 2026-02-24T19:18:09.712 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa71bd4d640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7141f7c00 con 0x7fa7140ba350 2026-02-24T19:18:09.712 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa71bd4d640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.712 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa71bd4d640 10 monclient(hunting): authenticate will time out at 3672.383792s 2026-02-24T19:18:09.712 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7f8b0296b640 10 monclient(hunting): picked mon.noname-b con 0x7f8afc159e40 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.712 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7f8b0296b640 10 monclient(hunting): picked mon.noname-a con 0x7f8afc058070 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.712 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7f8b0296b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8afc163930 con 0x7f8afc058070 2026-02-24T19:18:09.712 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7f8b0296b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8afc163bf0 con 0x7f8afc159e40 2026-02-24T19:18:09.712 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7f8b0296b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8afc163ed0 con 0x7f8afc159a70 2026-02-24T19:18:09.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7f8b0296b640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7f8b0296b640 10 monclient(hunting): authenticate will time out at 3672.383915s 2026-02-24T19:18:09.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa3d15e3640 1 -- start start 2026-02-24T19:18:09.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa3d15e3640 1 librados: setting wanted keys 2026-02-24T19:18:09.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa3d15e3640 1 librados: calling monclient init 2026-02-24T19:18:09.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.701+0000 7fa3d15e3640 10 monclient: init 2026-02-24T19:18:09.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.702+0000 7fa3d15e3640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.702+0000 7fa3d15e3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:18:09.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.702+0000 7fa3d15e3640 10 monclient(hunting): picked mon.noname-b con 0x7fa3cc0585e0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.702+0000 7fa3d15e3640 10 monclient(hunting): picked mon.noname-c con 0x7fa3cc0b9f80 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.702+0000 7fa3d15e3640 10 monclient(hunting): picked mon.noname-a con 0x7fa3cc0ba350 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.702+0000 7fa3d15e3640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3cc0ad850 con 0x7fa3cc0ba350 2026-02-24T19:18:09.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.702+0000 7fa3d15e3640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3cc0b2270 con 0x7fa3cc0585e0 2026-02-24T19:18:09.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.702+0000 7fa3d15e3640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3cc0b2550 con 0x7fa3cc0b9f80 2026-02-24T19:18:09.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.702+0000 7fa3d15e3640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.702+0000 7fa3d15e3640 10 monclient(hunting): authenticate will time out at 3672.384229s 2026-02-24T19:18:09.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.702+0000 7f7af8d86640 1 -- 10.20.193.26:0/2268165793 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3967086701 0 0) 0x7f7af40b1800 con 0x7f7af4161430 2026-02-24T19:18:09.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.702+0000 7f7af8d86640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.702+0000 7f7af8d86640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.702+0000 7f7af8d86640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.702+0000 7f7af8d86640 10 monclient(hunting): my global_id is 4515 2026-02-24T19:18:09.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.702+0000 7f7af8d86640 1 -- 10.20.193.26:0/2268165793 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7adc003610 con 0x7f7af4161430 2026-02-24T19:18:09.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.702+0000 7ff6c77fe640 1 -- 10.20.193.26:0/3460022707 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1081990662 0 0) 0x7ff6cc002c90 con 0x7ff6d00585e0 2026-02-24T19:18:09.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.702+0000 7ff6c77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.702+0000 7ff6c77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.702+0000 7ff6c77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.702+0000 7ff6c77fe640 10 monclient(hunting): my global_id is 4512 2026-02-24T19:18:09.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.702+0000 7ff6c77fe640 1 -- 10.20.193.26:0/3460022707 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6bc003610 con 0x7ff6d00585e0 2026-02-24T19:18:09.715 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.704+0000 7f3b2bfff640 1 -- 10.20.193.26:0/1078597095 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1063948322 0 0) 0x7f3b501fb0a0 con 0x7f3b500b9f80 2026-02-24T19:18:09.715 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.704+0000 7f3b2bfff640 1 -- 10.20.193.26:0/1078597095 >> v1:10.20.193.103:6789/0 conn(0x7f3b500585e0 legacy=0x7f3b50155330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.715 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.704+0000 7f3b2bfff640 1 -- 10.20.193.26:0/1078597095 >> v1:10.20.193.70:6789/0 conn(0x7f3b500ba350 legacy=0x7f3b50162130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.715 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.704+0000 7f3b2bfff640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.715 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.704+0000 7f3b2bfff640 1 monclient: found mon.a 2026-02-24T19:18:09.715 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.704+0000 7f3b2bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.704+0000 7f3b2bfff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.704+0000 7f3b2bfff640 1 -- 10.20.193.26:0/1078597095 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b501fb940 con 0x7f3b500b9f80 2026-02-24T19:18:09.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.704+0000 7f3b2bfff640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.704+0000 7f3b2bfff640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.704+0000 7f3b2bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.704+0000 7f3b55c16640 5 monclient: authenticate success, global_id 4497 2026-02-24T19:18:09.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.704+0000 7f3b55c16640 10 monclient: _renew_subs 2026-02-24T19:18:09.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.704+0000 7f3b55c16640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.704+0000 7f3b55c16640 1 -- 10.20.193.26:0/1078597095 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3b501fbc20 con 0x7f3b500b9f80 2026-02-24T19:18:09.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.704+0000 7f3b55c16640 10 client.4497.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.704+0000 7f3b55c16640 10 monclient: _renew_subs 2026-02-24T19:18:09.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.704+0000 7f3b55c16640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.704+0000 7f3b55c16640 1 -- 10.20.193.26:0/1078597095 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3b50155a40 con 0x7f3b500b9f80 2026-02-24T19:18:09.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.704+0000 7f3b55c16640 1 librados: init done 2026-02-24T19:18:09.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.704+0000 7f05c37fe640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f05c4057500 0x7f05c40b8ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:47132/0 (socket says 10.20.193.26:47132) 2026-02-24T19:18:09.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.704+0000 7f05c37fe640 1 -- 10.20.193.26:0/1466586960 learned_addr learned my addr 10.20.193.26:0/1466586960 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.705+0000 7f3b55c16640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.705+0000 7f3b55c16640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.705+0000 7f3b55c16640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.705+0000 7f3b55c16640 1 -- 10.20.193.26:0/1078597095 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b5015a050 con 0x7f3b500b9f80 2026-02-24T19:18:09.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.707+0000 7ffbb9887640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7ffbb40ba350 0x7ffbb4057ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:47122/0 (socket says 10.20.193.26:47122) 2026-02-24T19:18:09.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.707+0000 7ffbb9887640 1 -- 10.20.193.26:0/2981721403 learned_addr learned my addr 10.20.193.26:0/2981721403 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.708+0000 7f8b00ee1640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f8afc058070 0x7f8afc058460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:47154/0 (socket says 10.20.193.26:47154) 2026-02-24T19:18:09.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.708+0000 7f8b00ee1640 1 -- 10.20.193.26:0/1788666139 learned_addr learned my addr 10.20.193.26:0/1788666139 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.708+0000 7fb2727fc640 1 -- 10.20.193.26:0/648618700 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2514013125 0 0) 0x7fb260002910 con 0x7fb2740b9f80 2026-02-24T19:18:09.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.708+0000 7fb2727fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.708+0000 7fb2727fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.708+0000 7fb2727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.708+0000 7fb2727fc640 10 monclient(hunting): my global_id is 4518 2026-02-24T19:18:09.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.708+0000 7fb2727fc640 1 -- 10.20.193.26:0/648618700 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb258003610 con 0x7fb2740b9f80 2026-02-24T19:18:09.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.709+0000 7fa719ac2640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fa7140585e0 0x7fa7140b4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:47142/0 (socket says 10.20.193.26:47142) 2026-02-24T19:18:09.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.709+0000 7fa719ac2640 1 -- 10.20.193.26:0/2342867036 learned_addr learned my addr 10.20.193.26:0/2342867036 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.710+0000 7fa7027fc640 10 client.?.objecter ms_handle_connect 0x7fa7140585e0 2026-02-24T19:18:09.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.710+0000 7fa7027fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.720 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.719+0000 7f5ef7b8a640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.720 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.719+0000 7f5ef7b8a640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.720 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.719+0000 7f5ef7b8a640 10 monclient: monmap: 2026-02-24T19:18:09.720 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.720 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.720 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.720343+0000 2026-02-24T19:18:09.720 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.720343+0000 2026-02-24T19:18:09.721 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.721 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.721 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.721 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.721 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.721 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.723 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.720+0000 7f5ef7b8a640 1 Processor -- start 2026-02-24T19:18:09.723 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.720+0000 7f5ef7b8a640 1 -- start start 2026-02-24T19:18:09.723 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.720+0000 7f5ef7b8a640 10 monclient: init 2026-02-24T19:18:09.723 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.720+0000 7f5ef7b8a640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.723 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.720+0000 7f5ef7b8a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:18:09.723 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.720+0000 7f5ef7b8a640 10 monclient(hunting): picked mon.noname-b con 0x7f5ef0155b20 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.723 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.721+0000 7f5ef7b8a640 10 monclient(hunting): picked mon.noname-c con 0x7f5ef0056c70 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.723 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.721+0000 7f5ef7b8a640 10 monclient(hunting): picked mon.noname-a con 0x7f5ef0162f10 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.723 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.721+0000 7f5ef7b8a640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ef00b18f0 con 0x7f5ef0162f10 2026-02-24T19:18:09.723 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.721+0000 7f5ef7b8a640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ef00b1bd0 con 0x7f5ef0155b20 2026-02-24T19:18:09.723 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.721+0000 7f5ef7b8a640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ef00b1eb0 con 0x7f5ef0056c70 2026-02-24T19:18:09.723 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.721+0000 7f5ef7b8a640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.723 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.721+0000 7f5ef7b8a640 10 monclient(hunting): authenticate will time out at 3672.403099s 2026-02-24T19:18:09.724 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.723+0000 7f9e1de7b640 10 monclient: get_monmap_and_config 2026-02-24T19:18:09.724 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.723+0000 7f9e1de7b640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.724 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.723+0000 7f9e1de7b640 10 monclient: monmap: 2026-02-24T19:18:09.724 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.724 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.724 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:09.723912+0000 2026-02-24T19:18:09.724 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:09.723912+0000 2026-02-24T19:18:09.724 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.724 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.724 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.724 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.724 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.724 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.724 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.723+0000 7f9e1de7b640 1 Processor -- start 2026-02-24T19:18:09.724 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.723+0000 7f9e1de7b640 1 -- start start 2026-02-24T19:18:09.724 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.723+0000 7f9e1de7b640 10 monclient: init 2026-02-24T19:18:09.725 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.724+0000 7f9e1de7b640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.725 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.724+0000 7f9e1de7b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:18:09.725 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.724+0000 7f9e1de7b640 10 monclient(hunting): picked mon.noname-c con 0x7f9e18155b20 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.725 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.724+0000 7f9e1de7b640 10 monclient(hunting): picked mon.noname-a con 0x7f9e18056c70 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.725 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.724+0000 7f9e1de7b640 10 monclient(hunting): picked mon.noname-b con 0x7f9e18162f10 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.725 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.724+0000 7f9e1de7b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e180b18f0 con 0x7f9e18056c70 2026-02-24T19:18:09.725 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.724+0000 7f9e1de7b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e180b1bd0 con 0x7f9e18162f10 2026-02-24T19:18:09.725 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.724+0000 7f9e1de7b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e180b1eb0 con 0x7f9e18155b20 2026-02-24T19:18:09.725 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.724+0000 7f9e1de7b640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.725 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.724+0000 7f9e1de7b640 10 monclient(hunting): authenticate will time out at 3672.406283s 2026-02-24T19:18:09.760 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.759+0000 7ff5bb7fe640 1 -- 10.20.193.26:0/1471862225 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7ff5c405cae0 con 0x7ff5dc0b9f80 2026-02-24T19:18:09.760 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.759+0000 7ff5bb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.760 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.759+0000 7ff5bb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:09.768 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.768+0000 7fc7456c1640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fc7400b9f80 0x7fc740163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:55892/0 (socket says 10.20.193.26:55892) 2026-02-24T19:18:09.768 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.768+0000 7fc7456c1640 1 -- 10.20.193.26:0/424075817 learned_addr learned my addr 10.20.193.26:0/424075817 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.769 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.768+0000 7fa7027fc640 10 client.?.objecter ms_handle_connect 0x7fa7140ba350 2026-02-24T19:18:09.769 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.768+0000 7fa7027fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.770 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.769+0000 7fdd7bfff640 1 -- 10.20.193.26:0/1611509555 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fdd8c05dcf0 con 0x7fdda40b3d00 2026-02-24T19:18:09.770 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.769+0000 7fdd7bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.770 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.769+0000 7fdd7bfff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:09.771 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.770+0000 7f9e177fe640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f9e18155b20 0x7f9e180b0ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:55940/0 (socket says 10.20.193.26:55940) 2026-02-24T19:18:09.771 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.770+0000 7f9e177fe640 1 -- 10.20.193.26:0/709356264 learned_addr learned my addr 10.20.193.26:0/709356264 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.773 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.772+0000 7fa3ca7fc640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fa3cc0b9f80 0x7fa3cc161820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:55920/0 (socket says 10.20.193.26:55920) 2026-02-24T19:18:09.773 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.772+0000 7fa3ca7fc640 1 -- 10.20.193.26:0/3094193673 learned_addr learned my addr 10.20.193.26:0/3094193673 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.773+0000 7fa3ab7fe640 10 client.?.objecter ms_handle_connect 0x7fa3cc0b9f80 2026-02-24T19:18:09.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.773+0000 7fa3ab7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.773+0000 7f5ef50fe640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f5ef0056c70 0x7f5ef0162800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:55930/0 (socket says 10.20.193.26:55930) 2026-02-24T19:18:09.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.773+0000 7f5ef50fe640 1 -- 10.20.193.26:0/3840689891 learned_addr learned my addr 10.20.193.26:0/3840689891 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.774+0000 7ffbb9086640 1 -- 10.20.193.26:0/2981721403 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4130309649 0 0) 0x7ffbb4163e90 con 0x7ffbb40585e0 2026-02-24T19:18:09.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.774+0000 7ffbb9086640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.774+0000 7ffbb9086640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.774+0000 7ffbb9086640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.774+0000 7ffbb9086640 10 monclient(hunting): my global_id is 4499 2026-02-24T19:18:09.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.774+0000 7ffbb9086640 1 -- 10.20.193.26:0/2981721403 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb9c003610 con 0x7ffbb40585e0 2026-02-24T19:18:09.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.774+0000 7fb2727fc640 1 -- 10.20.193.26:0/648618700 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 547881106 0 0) 0x7fb274163e90 con 0x7fb2740585e0 2026-02-24T19:18:09.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.774+0000 7fb2727fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.774+0000 7fb2727fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.774+0000 7fb2727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.774+0000 7fb2727fc640 10 monclient(hunting): my global_id is 4508 2026-02-24T19:18:09.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.774+0000 7fb2727fc640 1 -- 10.20.193.26:0/648618700 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb260002910 con 0x7fb2740585e0 2026-02-24T19:18:09.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.776+0000 7f7af8d86640 1 -- 10.20.193.26:0/2268165793 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2664814645 0 0) 0x7f7af40b1dc0 con 0x7f7af4161800 2026-02-24T19:18:09.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.776+0000 7f7af8d86640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.776+0000 7f7af8d86640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.776+0000 7f7af8d86640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.776+0000 7f7af8d86640 10 monclient(hunting): my global_id is 4514 2026-02-24T19:18:09.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.776+0000 7f7af8d86640 1 -- 10.20.193.26:0/2268165793 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7af40b1800 con 0x7f7af4161800 2026-02-24T19:18:09.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.777+0000 7ff058cfd640 1 -- 10.20.193.26:0/2307351764 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 916072296 0 0) 0x7ff054167d80 con 0x7ff0541617a0 2026-02-24T19:18:09.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.777+0000 7ff058cfd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.777+0000 7ff058cfd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.777+0000 7ff058cfd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.777+0000 7ff058cfd640 10 monclient(hunting): my global_id is 4489 2026-02-24T19:18:09.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.777+0000 7ff058cfd640 1 -- 10.20.193.26:0/2307351764 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff054167aa0 con 0x7ff0541617a0 2026-02-24T19:18:09.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.777+0000 7ff058cfd640 1 -- 10.20.193.26:0/2307351764 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1048831704 0 0) 0x7ff054168060 con 0x7ff054161b70 2026-02-24T19:18:09.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.777+0000 7ff058cfd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.779 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.777+0000 7ff058cfd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.779 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.777+0000 7ff058cfd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.779 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.777+0000 7ff058cfd640 10 monclient(hunting): my global_id is 4502 2026-02-24T19:18:09.779 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.777+0000 7ff058cfd640 1 -- 10.20.193.26:0/2307351764 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff054167d80 con 0x7ff054161b70 2026-02-24T19:18:09.779 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.778+0000 7f05c27fc640 1 -- 10.20.193.26:0/1466586960 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1210531217 0 0) 0x7f05c40b4190 con 0x7f05c4159b40 2026-02-24T19:18:09.779 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.778+0000 7f05c27fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.779 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.778+0000 7f05c27fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.779 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.778+0000 7f05c27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.779 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.778+0000 7f05c27fc640 10 monclient(hunting): my global_id is 4520 2026-02-24T19:18:09.779 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.778+0000 7f05c27fc640 1 -- 10.20.193.26:0/1466586960 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05a8003610 con 0x7f05c4159b40 2026-02-24T19:18:09.779 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.778+0000 7fa7027fc640 10 client.?.objecter ms_handle_connect 0x7fa7140b9f80 2026-02-24T19:18:09.780 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.778+0000 7fa7027fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.780 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.778+0000 7ff6c77fe640 1 -- 10.20.193.26:0/3460022707 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2253278616 0 0) 0x7ff6d0163e90 con 0x7ff6d00ba350 2026-02-24T19:18:09.780 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.778+0000 7ff6c77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.780 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.778+0000 7ff6c77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.780 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.778+0000 7ff6c77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.780 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.778+0000 7ff6c77fe640 10 monclient(hunting): my global_id is 4505 2026-02-24T19:18:09.780 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.778+0000 7ff6c77fe640 1 -- 10.20.193.26:0/3460022707 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6cc002c90 con 0x7ff6d00ba350 2026-02-24T19:18:09.780 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.778+0000 7fa3ab7fe640 1 -- 10.20.193.26:0/3094193673 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3560891841 0 0) 0x7fa3cc0b2550 con 0x7fa3cc0b9f80 2026-02-24T19:18:09.780 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.778+0000 7fa3ab7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.780 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.778+0000 7fa3ab7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.778+0000 7fa3ab7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.778+0000 7fa3ab7fe640 10 monclient(hunting): my global_id is 4529 2026-02-24T19:18:09.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.778+0000 7fa3ab7fe640 1 -- 10.20.193.26:0/3094193673 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa398003610 con 0x7fa3cc0b9f80 2026-02-24T19:18:09.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.779+0000 7fa7027fc640 1 -- 10.20.193.26:0/2342867036 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3500696103 0 0) 0x7fa7141f7c00 con 0x7fa7140ba350 2026-02-24T19:18:09.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.779+0000 7fa7027fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.779+0000 7fa7027fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.779+0000 7fa7027fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.779+0000 7fa7027fc640 10 monclient(hunting): my global_id is 4517 2026-02-24T19:18:09.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.779+0000 7fa7027fc640 1 -- 10.20.193.26:0/2342867036 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6e4003610 con 0x7fa7140ba350 2026-02-24T19:18:09.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.779+0000 7fa3ab7fe640 10 client.?.objecter ms_handle_connect 0x7fa3cc0585e0 2026-02-24T19:18:09.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.779+0000 7fa3ab7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.781+0000 7f9e167fc640 1 -- 10.20.193.26:0/709356264 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1323155533 0 0) 0x7f9e180b1eb0 con 0x7f9e18155b20 2026-02-24T19:18:09.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.781+0000 7f9e167fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.781+0000 7f9e167fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.781+0000 7f9e167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.781+0000 7f9e167fc640 10 monclient(hunting): my global_id is 4526 2026-02-24T19:18:09.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.781+0000 7f9e167fc640 1 -- 10.20.193.26:0/709356264 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9dfc003610 con 0x7f9e18155b20 2026-02-24T19:18:09.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.782+0000 7ffbb9086640 1 -- 10.20.193.26:0/2981721403 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3405414864 0 0) 0x7ffb9c003610 con 0x7ffbb40585e0 2026-02-24T19:18:09.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.782+0000 7ffbb9086640 1 -- 10.20.193.26:0/2981721403 >> v1:10.20.193.70:6789/0 conn(0x7ffbb40b9f80 legacy=0x7ffbb4163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.782+0000 7ffbb9086640 1 -- 10.20.193.26:0/2981721403 >> v1:10.20.193.26:6789/0 conn(0x7ffbb40ba350 legacy=0x7ffbb4057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.782+0000 7ffbb9086640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.782+0000 7ffbb9086640 1 monclient: found mon.noname-c 2026-02-24T19:18:09.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.782+0000 7ffbb9086640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.782+0000 7ffbb9086640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.782+0000 7ffbb9086640 1 -- 10.20.193.26:0/2981721403 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbb40573f0 con 0x7ffbb40585e0 2026-02-24T19:18:09.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.782+0000 7ffbb9086640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.784 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.782+0000 7ffbb9086640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.784 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.782+0000 7ffbb9086640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.784 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.782+0000 7ffbb9086640 1 -- 10.20.193.26:0/2981721403 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ffbb0003170 con 0x7ffbb40585e0 2026-02-24T19:18:09.784 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.782+0000 7ffbb9086640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.784 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.782+0000 7ffbb9086640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.784 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.782+0000 7ffbb9086640 10 monclient: dump: 2026-02-24T19:18:09.784 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.784 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.784 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.784 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.784 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.784 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.784 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.784 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.784 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.784 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.784 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.782+0000 7ffbbc313640 5 monclient: authenticate success, global_id 4499 2026-02-24T19:18:09.784 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.782+0000 7ffbbc313640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.786 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.784+0000 7fc72ffff640 1 -- 10.20.193.26:0/424075817 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 424376989 0 0) 0x7fc740163e90 con 0x7fc7400b9f80 2026-02-24T19:18:09.786 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.785+0000 7fc72ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.786 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.785+0000 7fc72ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.786 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.785+0000 7fc72ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.786 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.785+0000 7fc72ffff640 10 monclient(hunting): my global_id is 4511 2026-02-24T19:18:09.786 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.785+0000 7fc72ffff640 1 -- 10.20.193.26:0/424075817 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc728003610 con 0x7fc7400b9f80 2026-02-24T19:18:09.787 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.786+0000 7fc72ffff640 1 -- 10.20.193.26:0/424075817 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2815068252 0 0) 0x7fc740163bb0 con 0x7fc7400585e0 2026-02-24T19:18:09.787 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.786+0000 7fc72ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.787 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.786+0000 7fc72ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.787 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.786+0000 7fc72ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.787 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.786+0000 7fc72ffff640 10 monclient(hunting): my global_id is 4501 2026-02-24T19:18:09.787 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.786+0000 7fc72ffff640 1 -- 10.20.193.26:0/424075817 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc740163e90 con 0x7fc7400585e0 2026-02-24T19:18:09.788 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.787+0000 7fb2727fc640 1 -- 10.20.193.26:0/648618700 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1478104011 0 0) 0x7fb274163bb0 con 0x7fb2740ba350 2026-02-24T19:18:09.788 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.787+0000 7fb2727fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.788 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.787+0000 7fb2727fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.788 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.787+0000 7fb2727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.788 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.787+0000 7fb2727fc640 10 monclient(hunting): my global_id is 4495 2026-02-24T19:18:09.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.787+0000 7fb2727fc640 1 -- 10.20.193.26:0/648618700 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb274163e90 con 0x7fb2740ba350 2026-02-24T19:18:09.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.788+0000 7fa3ab7fe640 1 -- 10.20.193.26:0/3094193673 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3477423728 0 0) 0x7fa3cc0b2270 con 0x7fa3cc0585e0 2026-02-24T19:18:09.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.788+0000 7fa3ab7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.788+0000 7fa3ab7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.788+0000 7fa3ab7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.788+0000 7fa3ab7fe640 10 monclient(hunting): my global_id is 4510 2026-02-24T19:18:09.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.788+0000 7fa3ab7fe640 1 -- 10.20.193.26:0/3094193673 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3cc0b2550 con 0x7fa3cc0585e0 2026-02-24T19:18:09.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.788+0000 7fa7027fc640 1 -- 10.20.193.26:0/2342867036 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 951596281 0 0) 0x7fa7140b4c70 con 0x7fa7140b9f80 2026-02-24T19:18:09.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.788+0000 7fa7027fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.788+0000 7fa7027fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.788+0000 7fa7027fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.788+0000 7fa7027fc640 10 monclient(hunting): my global_id is 4504 2026-02-24T19:18:09.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.788+0000 7fa7027fc640 1 -- 10.20.193.26:0/2342867036 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7141f7c00 con 0x7fa7140b9f80 2026-02-24T19:18:09.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.788+0000 7f8afaffd640 1 -- 10.20.193.26:0/1788666139 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3349977329 0 0) 0x7f8afc163ed0 con 0x7f8afc159a70 2026-02-24T19:18:09.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.788+0000 7f8afaffd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.788+0000 7f8afaffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.788+0000 7f8afaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.788+0000 7f8afaffd640 10 monclient(hunting): my global_id is 4523 2026-02-24T19:18:09.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.788+0000 7f8afaffd640 1 -- 10.20.193.26:0/1788666139 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ae0003610 con 0x7f8afc159a70 2026-02-24T19:18:09.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.788+0000 7f5ef48fd640 1 -- 10.20.193.26:0/3840689891 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2319285994 0 0) 0x7f5ef00b1bd0 con 0x7f5ef0155b20 2026-02-24T19:18:09.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.788+0000 7f5ef48fd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.788+0000 7f5ef48fd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.788+0000 7f5ef48fd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.788+0000 7f5ef48fd640 10 monclient(hunting): my global_id is 4513 2026-02-24T19:18:09.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.788+0000 7f5ef48fd640 1 -- 10.20.193.26:0/3840689891 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ed8003610 con 0x7f5ef0155b20 2026-02-24T19:18:09.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7f5ef48fd640 1 -- 10.20.193.26:0/3840689891 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2214844494 0 0) 0x7f5ef00b1eb0 con 0x7f5ef0056c70 2026-02-24T19:18:09.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7f5ef48fd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7f5ef48fd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7f5ef48fd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7f5ef48fd640 10 monclient(hunting): my global_id is 4532 2026-02-24T19:18:09.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7f5ef48fd640 1 -- 10.20.193.26:0/3840689891 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ef00b1bd0 con 0x7f5ef0056c70 2026-02-24T19:18:09.792 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7f7af8d86640 1 -- 10.20.193.26:0/2268165793 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3705546608 0 0) 0x7f7af40b1800 con 0x7f7af4161800 2026-02-24T19:18:09.792 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7f7af8d86640 1 -- 10.20.193.26:0/2268165793 >> v1:10.20.193.70:6789/0 conn(0x7f7af416ad30 legacy=0x7f7af416b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.792 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7f7af8d86640 1 -- 10.20.193.26:0/2268165793 >> v1:10.20.193.26:6789/0 conn(0x7f7af4161430 legacy=0x7f7af40b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.792 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7f7af8d86640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.792 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7f7af8d86640 1 monclient: found mon.noname-c 2026-02-24T19:18:09.792 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7f7af8d86640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.792 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7f7af8d86640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.792 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7f7af8d86640 1 -- 10.20.193.26:0/2268165793 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7af40b20a0 con 0x7f7af4161800 2026-02-24T19:18:09.792 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7f7af8d86640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.792 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7f7af8d86640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.792 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7f7af8d86640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.792 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7f7af8d86640 1 -- 10.20.193.26:0/2268165793 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7ae8002df0 con 0x7f7af4161800 2026-02-24T19:18:09.792 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7f7af8d86640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.792 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7f7af8d86640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.792 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7f7af8d86640 10 monclient: dump: 2026-02-24T19:18:09.792 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.792 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.792 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.792 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.792 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.793 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.793 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.793 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.793 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.793 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.793 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7f7afc013640 5 monclient: authenticate success, global_id 4514 2026-02-24T19:18:09.793 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7f7afc013640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.793 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7ff058cfd640 1 -- 10.20.193.26:0/2307351764 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3418109149 0 0) 0x7ff054167d80 con 0x7ff054161b70 2026-02-24T19:18:09.793 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7ff058cfd640 1 -- 10.20.193.26:0/2307351764 >> v1:10.20.193.70:6789/0 conn(0x7ff0541617a0 legacy=0x7ff0540b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.793 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7ff058cfd640 1 -- 10.20.193.26:0/2307351764 >> v1:10.20.193.26:6789/0 conn(0x7ff0540b5de0 legacy=0x7ff0540b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.793 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7ff058cfd640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.793 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7ff058cfd640 1 monclient: found mon.noname-c 2026-02-24T19:18:09.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7ff058cfd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7ff058cfd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7ff058cfd640 1 -- 10.20.193.26:0/2307351764 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff054168340 con 0x7ff054161b70 2026-02-24T19:18:09.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7ff058cfd640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7ff058cfd640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7ff058cfd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7ff058cfd640 1 -- 10.20.193.26:0/2307351764 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ff048002dd0 con 0x7ff054161b70 2026-02-24T19:18:09.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7ff058cfd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7ff058cfd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7ff058cfd640 10 monclient: dump: 2026-02-24T19:18:09.794 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.794 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.794 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.794 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.794 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.794 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.794 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.794 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.794 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.794 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7ff05bf8a640 5 monclient: authenticate success, global_id 4502 2026-02-24T19:18:09.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.789+0000 7ff05bf8a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7f05c27fc640 1 -- 10.20.193.26:0/1466586960 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2079378736 0 0) 0x7f05a8003610 con 0x7f05c4159b40 2026-02-24T19:18:09.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7f05c27fc640 1 -- 10.20.193.26:0/1466586960 >> v1:10.20.193.70:6789/0 conn(0x7f05c40b91f0 legacy=0x7f05c4159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7f05c27fc640 1 -- 10.20.193.26:0/1466586960 >> v1:10.20.193.26:6789/0 conn(0x7f05c4057500 legacy=0x7f05c40b8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7f05c27fc640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7f05c27fc640 1 monclient: found mon.noname-c 2026-02-24T19:18:09.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7f05c27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7f05c27fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7f05c27fc640 1 -- 10.20.193.26:0/1466586960 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c40b4470 con 0x7f05c4159b40 2026-02-24T19:18:09.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7f05c27fc640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7f05c27fc640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7f05c27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7f05c27fc640 1 -- 10.20.193.26:0/1466586960 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f05b8003170 con 0x7f05c4159b40 2026-02-24T19:18:09.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7f05c27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7f05c27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7f05c27fc640 10 monclient: dump: 2026-02-24T19:18:09.795 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.795 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.796 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.796 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.796 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.796 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.796 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.796 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.796 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.796 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7f05c8e16640 5 monclient: authenticate success, global_id 4520 2026-02-24T19:18:09.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7f05c8e16640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7fb2727fc640 1 -- 10.20.193.26:0/648618700 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1200671473 0 0) 0x7fb260002910 con 0x7fb2740585e0 2026-02-24T19:18:09.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7fb2727fc640 1 -- 10.20.193.26:0/648618700 >> v1:10.20.193.70:6789/0 conn(0x7fb2740ba350 legacy=0x7fb274057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7fb2727fc640 1 -- 10.20.193.26:0/648618700 >> v1:10.20.193.26:6789/0 conn(0x7fb2740b9f80 legacy=0x7fb274163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7fb2727fc640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7fb2727fc640 1 monclient: found mon.noname-c 2026-02-24T19:18:09.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7fb2727fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7fb2727fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7fb2727fc640 1 -- 10.20.193.26:0/648618700 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2740573f0 con 0x7fb2740585e0 2026-02-24T19:18:09.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7fb2727fc640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7fb2727fc640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7fb2727fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7fb2727fc640 1 -- 10.20.193.26:0/648618700 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fb268003170 con 0x7fb2740585e0 2026-02-24T19:18:09.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7fb27a110640 5 monclient: authenticate success, global_id 4508 2026-02-24T19:18:09.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7fb27a110640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7fb2727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7fb2727fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7fb2727fc640 10 monclient: dump: 2026-02-24T19:18:09.797 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.797 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.797 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.797 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.797 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.797 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.797 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.797 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.797 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.797 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.792+0000 7fb27a110640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.793+0000 7fc72ffff640 1 -- 10.20.193.26:0/424075817 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3290064583 0 0) 0x7fc740163e90 con 0x7fc7400585e0 2026-02-24T19:18:09.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.793+0000 7fc72ffff640 1 -- 10.20.193.26:0/424075817 >> v1:10.20.193.103:6789/0 conn(0x7fc7400b9f80 legacy=0x7fc740163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.793+0000 7fc72ffff640 1 -- 10.20.193.26:0/424075817 >> v1:10.20.193.26:6789/0 conn(0x7fc7400ba350 legacy=0x7fc740057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:09.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.793+0000 7fc72ffff640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.793+0000 7fc72ffff640 1 monclient: found mon.noname-b 2026-02-24T19:18:09.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.793+0000 7fc72ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.793+0000 7fc72ffff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.793+0000 7fc72ffff640 1 -- 10.20.193.26:0/424075817 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7400573f0 con 0x7fc7400585e0 2026-02-24T19:18:09.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.793+0000 7fc72ffff640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.793+0000 7fc72ffff640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.793+0000 7fc72ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.793+0000 7fc72ffff640 1 -- 10.20.193.26:0/424075817 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc73c003170 con 0x7fc7400585e0 2026-02-24T19:18:09.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.793+0000 7fc72ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.793+0000 7fc72ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:09.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.793+0000 7fc72ffff640 10 monclient: dump: 2026-02-24T19:18:09.798 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.798 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.799 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.799 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.799 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.799 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.799 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.799 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.799 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.799 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.799 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.793+0000 7fc74794c640 5 monclient: authenticate success, global_id 4501 2026-02-24T19:18:09.799 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.793+0000 7fc74794c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.799 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.793+0000 7fa7027fc640 1 -- 10.20.193.26:0/2342867036 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4062714954 0 0) 0x7fa6e4003610 con 0x7fa7140ba350 2026-02-24T19:18:09.799 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.793+0000 7fa7027fc640 1 -- 10.20.193.26:0/2342867036 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa7140b4c70 con 0x7fa7140ba350 2026-02-24T19:18:09.799 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.793+0000 7fa7027fc640 1 -- 10.20.193.26:0/2342867036 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa710003040 con 0x7fa7140ba350 2026-02-24T19:18:09.799 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.793+0000 7fa7027fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.799 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.793+0000 7fa7027fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.799 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.793+0000 7fa7027fc640 10 monclient(hunting): dump: 2026-02-24T19:18:09.799 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.799 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.799 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.799 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.799 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.800 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.800 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.800 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.800 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.800 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.800 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.793+0000 7fa7027fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:09.800 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.795+0000 7fa3ab7fe640 1 -- 10.20.193.26:0/3094193673 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4145895874 0 0) 0x7fa398003610 con 0x7fa3cc0b9f80 2026-02-24T19:18:09.800 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.795+0000 7fa3ab7fe640 1 -- 10.20.193.26:0/3094193673 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa3cc0b2270 con 0x7fa3cc0b9f80 2026-02-24T19:18:09.800 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.795+0000 7fa3ab7fe640 1 -- 10.20.193.26:0/3094193673 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa3b4002f30 con 0x7fa3cc0b9f80 2026-02-24T19:18:09.800 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.795+0000 7fa3ab7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.800 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.795+0000 7fa3ab7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.800 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.795+0000 7fa3ab7fe640 10 monclient(hunting): dump: 2026-02-24T19:18:09.800 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.800 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.800 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.800 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.800 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.800 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.800 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.800 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.800 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.800 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.801 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.795+0000 7fa3ab7fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:09.801 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f7af8d86640 1 -- 10.20.193.26:0/2268165793 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7ae8003000 con 0x7f7af4161800 2026-02-24T19:18:09.801 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f7af8d86640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.801 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f7af8d86640 1 -- 10.20.193.26:0/2268165793 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7ae8003400 con 0x7f7af4161800 2026-02-24T19:18:09.801 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f7af8d86640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.801 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f7af8d86640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.801 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f7af8d86640 10 monclient: dump: 2026-02-24T19:18:09.801 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.801 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.801 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.801 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.801 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.801 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.801 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.801 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.801 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.801 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.801 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f7afc013640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.801 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f7afc013640 4 set_mon_vals no callback set 2026-02-24T19:18:09.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f05c27fc640 1 -- 10.20.193.26:0/1466586960 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f05b8003380 con 0x7f05c4159b40 2026-02-24T19:18:09.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f05c27fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f05c27fc640 1 -- 10.20.193.26:0/1466586960 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f05b8003780 con 0x7f05c4159b40 2026-02-24T19:18:09.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f05c8e16640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f05c8e16640 4 set_mon_vals no callback set 2026-02-24T19:18:09.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f05c27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f05c27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f05c27fc640 10 monclient: dump: 2026-02-24T19:18:09.802 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.802 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.802 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.802 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.802 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.802 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.802 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.802 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.802 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.802 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f7afc013640 10 monclient: shutdown 2026-02-24T19:18:09.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f7afc013640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f7afc013640 1 -- 10.20.193.26:0/2268165793 >> v1:10.20.193.103:6789/0 conn(0x7f7af4161800 legacy=0x7f7af4168c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f7afc013640 1 -- 10.20.193.26:0/2268165793 shutdown_connections 2026-02-24T19:18:09.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f7afc013640 1 -- 10.20.193.26:0/2268165793 >> 10.20.193.26:0/2268165793 conn(0x7f7af40b2ef0 msgr2=0x7f7af40b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f7afc013640 1 -- 10.20.193.26:0/2268165793 shutdown_connections 2026-02-24T19:18:09.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f7afc013640 1 -- 10.20.193.26:0/2268165793 wait complete. 2026-02-24T19:18:09.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f9e167fc640 1 -- 10.20.193.26:0/709356264 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 278456382 0 0) 0x7f9dfc003610 con 0x7f9e18155b20 2026-02-24T19:18:09.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f9e167fc640 1 -- 10.20.193.26:0/709356264 >> v1:10.20.193.70:6789/0 conn(0x7f9e18162f10 legacy=0x7f9e180b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f9e167fc640 1 -- 10.20.193.26:0/709356264 >> v1:10.20.193.26:6789/0 conn(0x7f9e18056c70 legacy=0x7f9e18162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:09.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f9e167fc640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f9e167fc640 1 monclient: found mon.noname-c 2026-02-24T19:18:09.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f9e167fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f9e167fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f9e167fc640 1 -- 10.20.193.26:0/709356264 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e180b2190 con 0x7f9e18155b20 2026-02-24T19:18:09.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f9e167fc640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.804 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f9e167fc640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.804 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f9e167fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.804 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f9e167fc640 1 -- 10.20.193.26:0/709356264 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9e04002df0 con 0x7f9e18155b20 2026-02-24T19:18:09.804 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f9e167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.804 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f9e167fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.804 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f9e167fc640 10 monclient: dump: 2026-02-24T19:18:09.804 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.804 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.804 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.804 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.804 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.804 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.804 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.804 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.804 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.804 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.804 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f9e1de7b640 5 monclient: authenticate success, global_id 4526 2026-02-24T19:18:09.804 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.796+0000 7f9e1de7b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.804 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.797+0000 7f05c8e16640 10 monclient: shutdown 2026-02-24T19:18:09.804 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.797+0000 7f05c8e16640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.805 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.797+0000 7f05c8e16640 1 -- 10.20.193.26:0/1466586960 >> v1:10.20.193.103:6789/0 conn(0x7f05c4159b40 legacy=0x7f05c4163270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.805 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.797+0000 7f05c8e16640 1 -- 10.20.193.26:0/1466586960 shutdown_connections 2026-02-24T19:18:09.805 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.797+0000 7f05c8e16640 1 -- 10.20.193.26:0/1466586960 >> 10.20.193.26:0/1466586960 conn(0x7f05c40b7730 msgr2=0x7f05c40b7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.805 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.797+0000 7f05c8e16640 1 -- 10.20.193.26:0/1466586960 shutdown_connections 2026-02-24T19:18:09.805 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.797+0000 7f05c8e16640 1 -- 10.20.193.26:0/1466586960 wait complete. 2026-02-24T19:18:09.805 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.797+0000 7f7afc013640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.805 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.797+0000 7f7afc013640 10 monclient: monmap: 2026-02-24T19:18:09.805 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.805 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.805 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.805 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.805 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.805 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.805 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.805 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.805 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.805 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.805 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.797+0000 7f7afc013640 1 librados: starting msgr at 2026-02-24T19:18:09.805 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.797+0000 7f7afc013640 1 librados: starting objecter 2026-02-24T19:18:09.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.797+0000 7f7afc013640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.797+0000 7f7afc013640 1 Processor -- start 2026-02-24T19:18:09.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.797+0000 7f7afc013640 1 -- start start 2026-02-24T19:18:09.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.797+0000 7f7afc013640 1 librados: setting wanted keys 2026-02-24T19:18:09.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.797+0000 7f7afc013640 1 librados: calling monclient init 2026-02-24T19:18:09.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.797+0000 7f7afc013640 10 monclient: init 2026-02-24T19:18:09.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.797+0000 7f05c8e16640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.797+0000 7f05c8e16640 10 monclient: monmap: 2026-02-24T19:18:09.806 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.806 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.806 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.806 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.806 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.806 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.806 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.806 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.806 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.806 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.797+0000 7f7afc013640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.797+0000 7f7afc013640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:18:09.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.797+0000 7f7afc013640 10 monclient(hunting): picked mon.noname-c con 0x7f7af4161430 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.797+0000 7f7afc013640 10 monclient(hunting): picked mon.noname-a con 0x7f7af4161800 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.797+0000 7f7afc013640 10 monclient(hunting): picked mon.noname-b con 0x7f7af416ad30 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.798+0000 7f7afc013640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7af40ae7c0 con 0x7f7af4161800 2026-02-24T19:18:09.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.798+0000 7f7afc013640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7af40aeaa0 con 0x7f7af416ad30 2026-02-24T19:18:09.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.798+0000 7f7afc013640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7af40aed80 con 0x7f7af4161430 2026-02-24T19:18:09.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.798+0000 7f7afc013640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.798+0000 7f7afc013640 10 monclient(hunting): authenticate will time out at 3672.480017s 2026-02-24T19:18:09.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.798+0000 7f05c8e16640 1 librados: starting msgr at 2026-02-24T19:18:09.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.798+0000 7f05c8e16640 1 librados: starting objecter 2026-02-24T19:18:09.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.798+0000 7f05c8e16640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.798+0000 7f05c8e16640 1 Processor -- start 2026-02-24T19:18:09.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.798+0000 7f05c8e16640 1 -- start start 2026-02-24T19:18:09.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.798+0000 7f05c8e16640 1 librados: setting wanted keys 2026-02-24T19:18:09.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.798+0000 7f05c8e16640 1 librados: calling monclient init 2026-02-24T19:18:09.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.798+0000 7f05c8e16640 10 monclient: init 2026-02-24T19:18:09.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.798+0000 7f05c8e16640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.798+0000 7f05c8e16640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:18:09.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.798+0000 7f05c8e16640 10 monclient(hunting): picked mon.noname-b con 0x7f05c4057500 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.798+0000 7f05c8e16640 10 monclient(hunting): picked mon.noname-c con 0x7f05c40b91f0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.798+0000 7f05c8e16640 10 monclient(hunting): picked mon.noname-a con 0x7f05c4159b40 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.798+0000 7f05c8e16640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05c4133390 con 0x7f05c4159b40 2026-02-24T19:18:09.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.798+0000 7f05c8e16640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05c4133670 con 0x7f05c4057500 2026-02-24T19:18:09.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.798+0000 7f05c8e16640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05c4133950 con 0x7f05c40b91f0 2026-02-24T19:18:09.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.798+0000 7f05c8e16640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.798+0000 7f05c8e16640 10 monclient(hunting): authenticate will time out at 3672.480657s 2026-02-24T19:18:09.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.800+0000 7fa3ab7fe640 1 -- 10.20.193.26:0/3094193673 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4230669113 0 0) 0x7fa3cc0b2550 con 0x7fa3cc0585e0 2026-02-24T19:18:09.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.800+0000 7fa3ab7fe640 1 -- 10.20.193.26:0/3094193673 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa398003610 con 0x7fa3cc0585e0 2026-02-24T19:18:09.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.800+0000 7fa3ab7fe640 1 -- 10.20.193.26:0/3094193673 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa3c0002f70 con 0x7fa3cc0585e0 2026-02-24T19:18:09.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.800+0000 7fa3ab7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.800+0000 7fa3ab7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.800+0000 7fa3ab7fe640 10 monclient(hunting): dump: 2026-02-24T19:18:09.808 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.808 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.808 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.808 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.808 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.808 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.808 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.808 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.809 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.809 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.809 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ffbb9086640 1 -- 10.20.193.26:0/2981721403 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffbb0003380 con 0x7ffbb40585e0 2026-02-24T19:18:09.809 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ffbb9086640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.809 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ffbb9086640 1 -- 10.20.193.26:0/2981721403 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ffbb0003780 con 0x7ffbb40585e0 2026-02-24T19:18:09.809 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ffbb9086640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.809 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ffbb9086640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.809 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ffbb9086640 10 monclient: dump: 2026-02-24T19:18:09.809 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.809 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.809 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.809 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.809 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.809 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.809 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.809 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.809 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.809 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.809 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ffbbc313640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.809 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ffbbc313640 4 set_mon_vals no callback set 2026-02-24T19:18:09.809 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7fc72ffff640 1 -- 10.20.193.26:0/424075817 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc73c003380 con 0x7fc7400585e0 2026-02-24T19:18:09.810 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7fc72ffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.810 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7fc72ffff640 1 -- 10.20.193.26:0/424075817 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc73c0037c0 con 0x7fc7400585e0 2026-02-24T19:18:09.810 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7fc72ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.810 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7fc72ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.810 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7fc72ffff640 10 monclient: dump: 2026-02-24T19:18:09.810 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.810 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.810 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.810 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.810 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.810 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.810 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.810 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.810 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.810 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.810 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7fc74794c640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.810 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7fc74794c640 4 set_mon_vals no callback set 2026-02-24T19:18:09.810 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ffbbc313640 10 monclient: shutdown 2026-02-24T19:18:09.810 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ffbbc313640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.810 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ffbbc313640 1 -- 10.20.193.26:0/2981721403 >> v1:10.20.193.103:6789/0 conn(0x7ffbb40585e0 legacy=0x7ffbb4166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.810 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ffbbc313640 1 -- 10.20.193.26:0/2981721403 shutdown_connections 2026-02-24T19:18:09.810 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ffbbc313640 1 -- 10.20.193.26:0/2981721403 >> 10.20.193.26:0/2981721403 conn(0x7ffbb40b7990 msgr2=0x7ffbb40b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.810 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ffbbc313640 1 -- 10.20.193.26:0/2981721403 shutdown_connections 2026-02-24T19:18:09.810 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ffbbc313640 1 -- 10.20.193.26:0/2981721403 wait complete. 2026-02-24T19:18:09.811 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ff6c77fe640 1 -- 10.20.193.26:0/3460022707 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3651346614 0 0) 0x7ff6cc002c90 con 0x7ff6d00ba350 2026-02-24T19:18:09.811 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ff6c77fe640 1 -- 10.20.193.26:0/3460022707 >> v1:10.20.193.70:6789/0 conn(0x7ff6d00b9f80 legacy=0x7ff6d0163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.811 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ff6c77fe640 1 -- 10.20.193.26:0/3460022707 >> v1:10.20.193.26:6789/0 conn(0x7ff6d00585e0 legacy=0x7ff6d0166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.811 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ff6c77fe640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.811 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ff6c77fe640 1 monclient: found mon.noname-c 2026-02-24T19:18:09.811 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ff6c77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.811 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ff6c77fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.811 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ff6c77fe640 1 -- 10.20.193.26:0/3460022707 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d00573f0 con 0x7ff6d00ba350 2026-02-24T19:18:09.811 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ff6c77fe640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.811 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ff6c77fe640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.811 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ff6c77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.811 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ff6c77fe640 1 -- 10.20.193.26:0/3460022707 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ff6b8002df0 con 0x7ff6d00ba350 2026-02-24T19:18:09.811 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ff6c77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.812 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ff6c77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.812 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ff6c77fe640 10 monclient: dump: 2026-02-24T19:18:09.812 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.812 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.812 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.812 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.812 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.812 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.812 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.812 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.812 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.812 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.812 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ff6d6b45640 5 monclient: authenticate success, global_id 4505 2026-02-24T19:18:09.812 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.801+0000 7ff6d6b45640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.812 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7fc74794c640 10 monclient: shutdown 2026-02-24T19:18:09.812 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7fc74794c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.812 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7fc74794c640 1 -- 10.20.193.26:0/424075817 >> v1:10.20.193.70:6789/0 conn(0x7fc7400585e0 legacy=0x7fc740166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.812 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7fc74794c640 1 -- 10.20.193.26:0/424075817 shutdown_connections 2026-02-24T19:18:09.812 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7fc74794c640 1 -- 10.20.193.26:0/424075817 >> 10.20.193.26:0/424075817 conn(0x7fc7400b7990 msgr2=0x7fc7400b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.812 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7fc74794c640 1 -- 10.20.193.26:0/424075817 shutdown_connections 2026-02-24T19:18:09.812 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7fc74794c640 1 -- 10.20.193.26:0/424075817 wait complete. 2026-02-24T19:18:09.813 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7ff1767fc640 1 -- 10.20.193.26:0/1830332545 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff1640031d0 con 0x7ff1780b9f80 2026-02-24T19:18:09.813 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7ff1767fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.813 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7ff1767fc640 1 -- 10.20.193.26:0/1830332545 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ff164004990 con 0x7ff1780b9f80 2026-02-24T19:18:09.813 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7ff1767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.813 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7ff1767fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:09.813 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7ff1767fc640 10 monclient: dump: 2026-02-24T19:18:09.813 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.813 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.813 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.813 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.813 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.813 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.813 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.813 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.813 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.813 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.813 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7ff17dc2b640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.813 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7ffbbc313640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.813 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7ffbbc313640 10 monclient: monmap: 2026-02-24T19:18:09.813 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.813 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.813 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.813 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.813 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.813 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.813 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.814 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.814 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.814 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.814 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7ff17dc2b640 4 set_mon_vals no callback set 2026-02-24T19:18:09.814 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7ffbbc313640 1 librados: starting msgr at 2026-02-24T19:18:09.814 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7ffbbc313640 1 librados: starting objecter 2026-02-24T19:18:09.814 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7ffbbc313640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.814 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7ffbbc313640 1 Processor -- start 2026-02-24T19:18:09.814 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7ffbbc313640 1 -- start start 2026-02-24T19:18:09.814 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7ffbbc313640 1 librados: setting wanted keys 2026-02-24T19:18:09.814 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7ffbbc313640 1 librados: calling monclient init 2026-02-24T19:18:09.814 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7ffbbc313640 10 monclient: init 2026-02-24T19:18:09.814 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7fc74794c640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.814 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7fc74794c640 10 monclient: monmap: 2026-02-24T19:18:09.814 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.814 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.814 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.814 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.815 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.815 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.815 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.815 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.815 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.815 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.815 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7ff17dc2b640 10 monclient: shutdown 2026-02-24T19:18:09.815 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7ff17dc2b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.815 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7ff17dc2b640 1 -- 10.20.193.26:0/1830332545 >> v1:10.20.193.26:6789/0 conn(0x7ff1780b9f80 legacy=0x7ff178163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.815 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7ff17dc2b640 1 -- 10.20.193.26:0/1830332545 shutdown_connections 2026-02-24T19:18:09.815 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7ff17dc2b640 1 -- 10.20.193.26:0/1830332545 >> 10.20.193.26:0/1830332545 conn(0x7ff1780b7990 msgr2=0x7ff1780b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.815 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7ff17dc2b640 1 -- 10.20.193.26:0/1830332545 shutdown_connections 2026-02-24T19:18:09.815 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7ff17dc2b640 1 -- 10.20.193.26:0/1830332545 wait complete. 2026-02-24T19:18:09.815 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7fc74794c640 1 librados: starting msgr at 2026-02-24T19:18:09.815 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.802+0000 7fc74794c640 1 librados: starting objecter 2026-02-24T19:18:09.815 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7fc74794c640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.815 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7fc74794c640 1 Processor -- start 2026-02-24T19:18:09.816 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7ffbbc313640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.816 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7ffbbc313640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:18:09.816 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7ffbbc313640 10 monclient(hunting): picked mon.noname-b con 0x7ffbb40585e0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.816 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7ffbbc313640 10 monclient(hunting): picked mon.noname-a con 0x7ffbb40b9f80 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.816 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7ffbbc313640 10 monclient(hunting): picked mon.noname-c con 0x7ffbb40ba350 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.816 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7ffbbc313640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbb40b1420 con 0x7ffbb40b9f80 2026-02-24T19:18:09.816 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7ffbbc313640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbb40af470 con 0x7ffbb40585e0 2026-02-24T19:18:09.816 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7ffbbc313640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbb40af750 con 0x7ffbb40ba350 2026-02-24T19:18:09.816 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7ffbbc313640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.816 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7ffbbc313640 10 monclient(hunting): authenticate will time out at 3672.485133s 2026-02-24T19:18:09.816 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7fc74794c640 1 -- start start 2026-02-24T19:18:09.816 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7fc74794c640 1 librados: setting wanted keys 2026-02-24T19:18:09.816 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7fc74794c640 1 librados: calling monclient init 2026-02-24T19:18:09.816 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7fc74794c640 10 monclient: init 2026-02-24T19:18:09.816 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7ff17dc2b640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.816 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7ff17dc2b640 10 monclient: monmap: 2026-02-24T19:18:09.816 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.817 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.817 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.817 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.817 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.817 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.817 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.817 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.817 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.817 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7fc74794c640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7fc74794c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:18:09.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7fc74794c640 10 monclient(hunting): picked mon.noname-b con 0x7fc7400585e0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7fc74794c640 10 monclient(hunting): picked mon.noname-a con 0x7fc7400b9f80 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7fc74794c640 10 monclient(hunting): picked mon.noname-c con 0x7fc7400ba350 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7fc74794c640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc740162b20 con 0x7fc7400b9f80 2026-02-24T19:18:09.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7fc74794c640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7401faf60 con 0x7fc7400585e0 2026-02-24T19:18:09.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7fc74794c640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7401fb240 con 0x7fc7400ba350 2026-02-24T19:18:09.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7fc74794c640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7fc74794c640 10 monclient(hunting): authenticate will time out at 3672.485650s 2026-02-24T19:18:09.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7fa7027fc640 1 -- 10.20.193.26:0/2342867036 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2661491146 0 0) 0x7fa7141f7c00 con 0x7fa7140b9f80 2026-02-24T19:18:09.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7fa7027fc640 1 -- 10.20.193.26:0/2342867036 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa6e4003610 con 0x7fa7140b9f80 2026-02-24T19:18:09.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7fa7027fc640 1 -- 10.20.193.26:0/2342867036 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa708002ed0 con 0x7fa7140b9f80 2026-02-24T19:18:09.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7fa7027fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7fa7027fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7fa7027fc640 10 monclient(hunting): dump: 2026-02-24T19:18:09.818 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.818 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.818 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.818 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.818 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.818 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.818 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.818 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.818 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.818 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7ff17dc2b640 1 librados: starting msgr at 2026-02-24T19:18:09.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7ff17dc2b640 1 librados: starting objecter 2026-02-24T19:18:09.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7ff17dc2b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7ff17dc2b640 1 Processor -- start 2026-02-24T19:18:09.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7ff17dc2b640 1 -- start start 2026-02-24T19:18:09.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7ff17dc2b640 1 librados: setting wanted keys 2026-02-24T19:18:09.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7ff17dc2b640 1 librados: calling monclient init 2026-02-24T19:18:09.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7ff17dc2b640 10 monclient: init 2026-02-24T19:18:09.819 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.803+0000 7fa3ab7fe640 1 -- 10.20.193.26:0/3094193673 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1252026107 0 0) 0x7fa398003610 con 0x7fa3cc0585e0 2026-02-24T19:18:09.819 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa3ab7fe640 1 -- 10.20.193.26:0/3094193673 >> v1:10.20.193.103:6789/0 conn(0x7fa3cc0b9f80 legacy=0x7fa3cc161820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.819 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa3ab7fe640 1 -- 10.20.193.26:0/3094193673 >> v1:10.20.193.26:6789/0 conn(0x7fa3cc0ba350 legacy=0x7fa3cc0b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.819 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa3ab7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.819 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa3ab7fe640 1 monclient: found mon.b 2026-02-24T19:18:09.819 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa3ab7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.819 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa3ab7fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.819 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa3ab7fe640 1 -- 10.20.193.26:0/3094193673 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3cc0b2830 con 0x7fa3cc0585e0 2026-02-24T19:18:09.819 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa3ab7fe640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.819 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa3ab7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.819 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa3ab7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.819 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa3d15e3640 5 monclient: authenticate success, global_id 4510 2026-02-24T19:18:09.819 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa3d15e3640 10 monclient: _renew_subs 2026-02-24T19:18:09.819 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa3d15e3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.819 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa3d15e3640 1 -- 10.20.193.26:0/3094193673 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa3cc0b2b10 con 0x7fa3cc0585e0 2026-02-24T19:18:09.819 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa3d15e3640 10 client.4510.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.819 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa3d15e3640 10 monclient: _renew_subs 2026-02-24T19:18:09.819 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa3d15e3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.819 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa3d15e3640 1 -- 10.20.193.26:0/3094193673 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa3cc161020 con 0x7fa3cc0585e0 2026-02-24T19:18:09.819 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa3d15e3640 1 librados: init done 2026-02-24T19:18:09.820 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7ff17dc2b640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.820 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7ff17dc2b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:18:09.820 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7ff17dc2b640 10 monclient(hunting): picked mon.noname-a con 0x7ff1780585e0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.820 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7ff17dc2b640 10 monclient(hunting): picked mon.noname-c con 0x7ff1780b9f80 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.820 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7ff17dc2b640 10 monclient(hunting): picked mon.noname-b con 0x7ff1780ba350 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.820 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7ff17dc2b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff178155880 con 0x7ff1780585e0 2026-02-24T19:18:09.820 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7ff17dc2b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1781fd090 con 0x7ff1780ba350 2026-02-24T19:18:09.820 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7ff17dc2b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1781fd370 con 0x7ff1780b9f80 2026-02-24T19:18:09.820 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fb2727fc640 1 -- 10.20.193.26:0/648618700 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb268003340 con 0x7fb2740585e0 2026-02-24T19:18:09.820 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fb2727fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.820 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fb2727fc640 1 -- 10.20.193.26:0/648618700 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fb268003780 con 0x7fb2740585e0 2026-02-24T19:18:09.820 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7ff17dc2b640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.820 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7ff17dc2b640 10 monclient(hunting): authenticate will time out at 3672.486531s 2026-02-24T19:18:09.820 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fb27a110640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.820 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fb27a110640 4 set_mon_vals no callback set 2026-02-24T19:18:09.820 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fb2727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.820 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fb2727fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.820 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fb2727fc640 10 monclient: dump: 2026-02-24T19:18:09.820 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.820 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.820 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.820 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.820 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.820 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f5ef48fd640 1 -- 10.20.193.26:0/3840689891 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1451030618 0 0) 0x7f5ed8003610 con 0x7f5ef0155b20 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f5ef48fd640 1 -- 10.20.193.26:0/3840689891 >> v1:10.20.193.103:6789/0 conn(0x7f5ef0056c70 legacy=0x7f5ef0162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f5ef48fd640 1 -- 10.20.193.26:0/3840689891 >> v1:10.20.193.26:6789/0 conn(0x7f5ef0162f10 legacy=0x7f5ef00b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f5ef48fd640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f5ef48fd640 1 monclient: found mon.noname-b 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f5ef48fd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f5ef48fd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f5ef48fd640 1 -- 10.20.193.26:0/3840689891 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef00b2190 con 0x7f5ef0155b20 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f5ef48fd640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f5ef48fd640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f5ef48fd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f5ef48fd640 1 -- 10.20.193.26:0/3840689891 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f5ee0002df0 con 0x7f5ef0155b20 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f5ef48fd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f5ef48fd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f5ef48fd640 10 monclient: dump: 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.821 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa3d15e3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.822 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f5ef7b8a640 5 monclient: authenticate success, global_id 4513 2026-02-24T19:18:09.822 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f5ef7b8a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.822 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa3d15e3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.822 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa3d15e3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.822 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa3d15e3640 1 -- 10.20.193.26:0/3094193673 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3cc056df0 con 0x7fa3cc0585e0 2026-02-24T19:18:09.822 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f8afaffd640 1 -- 10.20.193.26:0/1788666139 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2722608170 0 0) 0x7f8ae0003610 con 0x7f8afc159a70 2026-02-24T19:18:09.822 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f8afaffd640 1 -- 10.20.193.26:0/1788666139 >> v1:10.20.193.70:6789/0 conn(0x7f8afc159e40 legacy=0x7f8afc163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.822 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f8afaffd640 1 -- 10.20.193.26:0/1788666139 >> v1:10.20.193.26:6789/0 conn(0x7f8afc058070 legacy=0x7f8afc058460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.822 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f8afaffd640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.822 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f8afaffd640 1 monclient: found mon.noname-c 2026-02-24T19:18:09.822 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f8afaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.822 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f8afaffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.822 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f8afaffd640 1 -- 10.20.193.26:0/1788666139 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8afc057590 con 0x7f8afc159a70 2026-02-24T19:18:09.822 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f8afaffd640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.822 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f8afaffd640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.822 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f8afaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.822 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f8afaffd640 1 -- 10.20.193.26:0/1788666139 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f8ae8002df0 con 0x7f8afc159a70 2026-02-24T19:18:09.822 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f8afaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.822 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f8afaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.822 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f8afaffd640 10 monclient: dump: 2026-02-24T19:18:09.822 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.823 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.823 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.823 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.823 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.823 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.823 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.823 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.823 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.823 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.823 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f8b0296b640 5 monclient: authenticate success, global_id 4523 2026-02-24T19:18:09.823 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7f8b0296b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:09.823 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa7027fc640 1 -- 10.20.193.26:0/2342867036 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3813337812 0 0) 0x7fa7140b4c70 con 0x7fa7140ba350 2026-02-24T19:18:09.823 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa7027fc640 1 -- 10.20.193.26:0/2342867036 >> v1:10.20.193.70:6789/0 conn(0x7fa7140b9f80 legacy=0x7fa7141f8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.823 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa7027fc640 1 -- 10.20.193.26:0/2342867036 >> v1:10.20.193.26:6789/0 conn(0x7fa7140585e0 legacy=0x7fa7140b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.823 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa7027fc640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.823 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa7027fc640 1 monclient: found mon.c 2026-02-24T19:18:09.823 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa7027fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.823 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa7027fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.823 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa7027fc640 1 -- 10.20.193.26:0/2342867036 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7141f7ee0 con 0x7fa7140ba350 2026-02-24T19:18:09.823 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa7027fc640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.823 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa7027fc640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.823 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa7027fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.823 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa71bd4d640 5 monclient: authenticate success, global_id 4517 2026-02-24T19:18:09.823 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa71bd4d640 10 monclient: _renew_subs 2026-02-24T19:18:09.823 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa71bd4d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.823 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fa71bd4d640 1 -- 10.20.193.26:0/2342867036 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa7141f81c0 con 0x7fa7140ba350 2026-02-24T19:18:09.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fb27a110640 10 monclient: shutdown 2026-02-24T19:18:09.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fb27a110640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.804+0000 7fb27a110640 1 -- 10.20.193.26:0/648618700 >> v1:10.20.193.103:6789/0 conn(0x7fb2740585e0 legacy=0x7fb274166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.805+0000 7fa71bd4d640 10 client.4517.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.805+0000 7fa71bd4d640 10 monclient: _renew_subs 2026-02-24T19:18:09.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.805+0000 7fa71bd4d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.805+0000 7fa71bd4d640 1 -- 10.20.193.26:0/2342867036 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa7141f8780 con 0x7fa7140ba350 2026-02-24T19:18:09.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.805+0000 7fa71bd4d640 1 librados: init done 2026-02-24T19:18:09.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.805+0000 7fb27a110640 1 -- 10.20.193.26:0/648618700 shutdown_connections 2026-02-24T19:18:09.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.805+0000 7fb27a110640 1 -- 10.20.193.26:0/648618700 >> 10.20.193.26:0/648618700 conn(0x7fb2740b7990 msgr2=0x7fb2740b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.805+0000 7fb27a110640 1 -- 10.20.193.26:0/648618700 shutdown_connections 2026-02-24T19:18:09.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.805+0000 7fb27a110640 1 -- 10.20.193.26:0/648618700 wait complete. 2026-02-24T19:18:09.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.805+0000 7fb27a110640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.805+0000 7fb27a110640 10 monclient: monmap: 2026-02-24T19:18:09.824 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.824 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.824 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.824 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.824 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.824 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.824 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.824 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.824 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.824 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.805+0000 7fa71bd4d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.805+0000 7fa71bd4d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.805+0000 7fa71bd4d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.805+0000 7fa71bd4d640 1 -- 10.20.193.26:0/2342867036 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7140b8e00 con 0x7fa7140ba350 2026-02-24T19:18:09.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.805+0000 7fb27a110640 1 librados: starting msgr at 2026-02-24T19:18:09.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.805+0000 7fb27a110640 1 librados: starting objecter 2026-02-24T19:18:09.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.805+0000 7fb27a110640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.805+0000 7fb27a110640 1 Processor -- start 2026-02-24T19:18:09.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.805+0000 7fb27a110640 1 -- start start 2026-02-24T19:18:09.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.805+0000 7fb27a110640 1 librados: setting wanted keys 2026-02-24T19:18:09.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.805+0000 7fb27a110640 1 librados: calling monclient init 2026-02-24T19:18:09.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.805+0000 7fb27a110640 10 monclient: init 2026-02-24T19:18:09.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.806+0000 7fb27a110640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.806+0000 7fb27a110640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:18:09.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.806+0000 7fb27a110640 10 monclient(hunting): picked mon.noname-c con 0x7fb2740585e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.806+0000 7fb27a110640 10 monclient(hunting): picked mon.noname-a con 0x7fb2740b9f80 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.806+0000 7fb27a110640 10 monclient(hunting): picked mon.noname-b con 0x7fb2740ba350 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.806+0000 7fb27a110640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2741fef50 con 0x7fb2740b9f80 2026-02-24T19:18:09.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.806+0000 7fb27a110640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2741605d0 con 0x7fb2740ba350 2026-02-24T19:18:09.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.806+0000 7fb27a110640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2741608b0 con 0x7fb2740585e0 2026-02-24T19:18:09.826 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.806+0000 7fb27a110640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.826 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.806+0000 7fb27a110640 10 monclient(hunting): authenticate will time out at 3672.488274s 2026-02-24T19:18:09.826 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.811+0000 7f05c37fe640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f05c4057500 0x7f05c4164e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:59910/0 (socket says 10.20.193.26:59910) 2026-02-24T19:18:09.826 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.811+0000 7f05c37fe640 1 -- 10.20.193.26:0/4089243475 learned_addr learned my addr 10.20.193.26:0/4089243475 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.826 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.813+0000 7f3b2bfff640 1 -- 10.20.193.26:0/1078597095 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3b40002fe0 con 0x7f3b500b9f80 2026-02-24T19:18:09.826 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.813+0000 7f3b2bfff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.826 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.813+0000 7f3b2bfff640 1 -- 10.20.193.26:0/1078597095 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f3b40004d20 con 0x7f3b500b9f80 2026-02-24T19:18:09.826 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.813+0000 7f3b2bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.826 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.813+0000 7f3b2bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:09.826 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.813+0000 7f3b2bfff640 10 monclient: dump: 2026-02-24T19:18:09.826 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.826 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.826 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.826 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.826 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.826 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.826 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.826 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.826 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.826 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.826 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.813+0000 7f3b4dffb640 4 set_mon_vals no callback set 2026-02-24T19:18:09.826 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.814+0000 7f3b2bfff640 1 -- 10.20.193.26:0/1078597095 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f3b4001db90 con 0x7f3b500b9f80 2026-02-24T19:18:09.826 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.814+0000 7f3b4f7fe640 10 monclient: get_auth_request con 0x7f3b20077c50 auth_method 0 2026-02-24T19:18:09.826 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.815+0000 7f3b2bfff640 10 client.4497.objecter ms_handle_connect 0x7f3b20077c50 2026-02-24T19:18:09.826 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.817+0000 7f3b2bfff640 1 -- 10.20.193.26:0/1078597095 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f3b40093380 con 0x7f3b500b9f80 2026-02-24T19:18:09.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.817+0000 7f3b2bfff640 10 client.4497.objecter ms_dispatch2 0x7f3b50000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:09.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.817+0000 7f3b2bfff640 3 client.4497.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:09.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.817+0000 7f3b2bfff640 3 client.4497.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:09.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.818+0000 7f3b2bfff640 20 client.4497.objecter dump_active .. 0 homeless 2026-02-24T19:18:09.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.818+0000 7f3b2bfff640 1 -- 10.20.193.26:0/1078597095 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f3b5015a050 con 0x7f3b500b9f80 2026-02-24T19:18:09.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.818+0000 7f3b2bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.818+0000 7f3b2bfff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:09.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.823+0000 7f7af9587640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f7af4161800 0x7f7af412c4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:47180/0 (socket says 10.20.193.26:47180) 2026-02-24T19:18:09.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.823+0000 7f7af9587640 1 -- 10.20.193.26:0/996126610 learned_addr learned my addr 10.20.193.26:0/996126610 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.826+0000 7f7ae27fc640 10 client.?.objecter ms_handle_connect 0x7f7af4161800 2026-02-24T19:18:09.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.826+0000 7f7ae27fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.826+0000 7fc744ec0640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fc7400b9f80 0x7fc740162410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:47208/0 (socket says 10.20.193.26:47208) 2026-02-24T19:18:09.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.826+0000 7fc744ec0640 1 -- 10.20.193.26:0/1730388677 learned_addr learned my addr 10.20.193.26:0/1730388677 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.828 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.827+0000 7fc72dffb640 10 client.?.objecter ms_handle_connect 0x7fc7400b9f80 2026-02-24T19:18:09.828 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.827+0000 7fc72dffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.828+0000 7ffbb9887640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7ffbb40b9f80 0x7ffbb41fc850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:47200/0 (socket says 10.20.193.26:47200) 2026-02-24T19:18:09.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.828+0000 7ffbb9887640 1 -- 10.20.193.26:0/735250402 learned_addr learned my addr 10.20.193.26:0/735250402 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.830 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.829+0000 7f059ffff640 10 client.?.objecter ms_handle_connect 0x7f05c4159b40 2026-02-24T19:18:09.830 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.829+0000 7f059ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.830 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.829+0000 7ffb9affd640 10 client.?.objecter ms_handle_connect 0x7ffbb40b9f80 2026-02-24T19:18:09.830 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.829+0000 7ffb9affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.830+0000 7fc72dffb640 1 -- 10.20.193.26:0/1730388677 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2020384953 0 0) 0x7fc740162b20 con 0x7fc7400b9f80 2026-02-24T19:18:09.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.830+0000 7fc72dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.830+0000 7fc72dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.830+0000 7fc72dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.830+0000 7fc72dffb640 10 monclient(hunting): my global_id is 4536 2026-02-24T19:18:09.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.830+0000 7fc72dffb640 1 -- 10.20.193.26:0/1730388677 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc710003610 con 0x7fc7400b9f80 2026-02-24T19:18:09.832 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.831+0000 7ff1777fe640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7ff1780585e0 0x7ff1781fb660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:47210/0 (socket says 10.20.193.26:47210) 2026-02-24T19:18:09.832 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.831+0000 7ff1777fe640 1 -- 10.20.193.26:0/1884566179 learned_addr learned my addr 10.20.193.26:0/1884566179 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.833 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.832+0000 7ff153fff640 10 client.?.objecter ms_handle_connect 0x7ff1780585e0 2026-02-24T19:18:09.833 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.832+0000 7ff153fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.833 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.832+0000 7f7ae27fc640 1 -- 10.20.193.26:0/996126610 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3936027873 0 0) 0x7f7af40ae7c0 con 0x7f7af4161800 2026-02-24T19:18:09.833 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.832+0000 7f7ae27fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.833 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.832+0000 7f7ae27fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.833 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.832+0000 7f7ae27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.833 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.832+0000 7f7ae27fc640 10 monclient(hunting): my global_id is 4533 2026-02-24T19:18:09.834 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.832+0000 7f7ae27fc640 1 -- 10.20.193.26:0/996126610 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ac4003610 con 0x7f7af4161800 2026-02-24T19:18:09.836 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.836+0000 7ffb9affd640 1 -- 10.20.193.26:0/735250402 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 776944098 0 0) 0x7ffbb40b1420 con 0x7ffbb40b9f80 2026-02-24T19:18:09.837 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.836+0000 7ffb9affd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.837 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.836+0000 7ffb9affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.837 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.836+0000 7ffb9affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.837 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.836+0000 7ffb9affd640 10 monclient(hunting): my global_id is 4542 2026-02-24T19:18:09.837 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.836+0000 7ffb9affd640 1 -- 10.20.193.26:0/735250402 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb84003610 con 0x7ffbb40b9f80 2026-02-24T19:18:09.837 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.836+0000 7fc72dffb640 1 -- 10.20.193.26:0/1730388677 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4172740628 0 0) 0x7fc710003610 con 0x7fc7400b9f80 2026-02-24T19:18:09.837 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.836+0000 7fc72dffb640 1 -- 10.20.193.26:0/1730388677 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc740162b20 con 0x7fc7400b9f80 2026-02-24T19:18:09.837 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.836+0000 7fc72dffb640 1 -- 10.20.193.26:0/1730388677 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc734002f30 con 0x7fc7400b9f80 2026-02-24T19:18:09.837 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.836+0000 7fc72dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.837 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.836+0000 7fc72dffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:09.837 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.836+0000 7fc72dffb640 10 monclient(hunting): dump: 2026-02-24T19:18:09.837 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.837 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.837 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.838 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.838 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.838 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.838 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.838 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.838 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.838 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.836+0000 7fc72dffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:09.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.837+0000 7fb272ffd640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fb2740b9f80 0x7fb2741fe840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:47224/0 (socket says 10.20.193.26:47224) 2026-02-24T19:18:09.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.837+0000 7fb272ffd640 1 -- 10.20.193.26:0/2865969087 learned_addr learned my addr 10.20.193.26:0/2865969087 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.841 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.841+0000 7fb24ffff640 10 client.?.objecter ms_handle_connect 0x7fb2740b9f80 2026-02-24T19:18:09.842 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.841+0000 7fb24ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.843 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.842+0000 7f7ae27fc640 1 -- 10.20.193.26:0/996126610 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2429200398 0 0) 0x7f7ac4003610 con 0x7f7af4161800 2026-02-24T19:18:09.843 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.842+0000 7f7ae27fc640 1 -- 10.20.193.26:0/996126610 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7af40ae7c0 con 0x7f7af4161800 2026-02-24T19:18:09.843 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.842+0000 7f7ae27fc640 1 -- 10.20.193.26:0/996126610 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7ae8003350 con 0x7f7af4161800 2026-02-24T19:18:09.843 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.842+0000 7f7ae27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.843 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.842+0000 7f7ae27fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:09.843 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.842+0000 7f7ae27fc640 10 monclient(hunting): dump: 2026-02-24T19:18:09.843 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.843 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.843 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.843 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.844 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.844 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.844 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.844 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.844 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.844 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.844 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.842+0000 7f7ae27fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:09.844 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.843+0000 7fc72dffb640 1 -- 10.20.193.26:0/1730388677 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4241317342 0 0) 0x7fc740162b20 con 0x7fc7400b9f80 2026-02-24T19:18:09.844 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.843+0000 7fc72dffb640 1 -- 10.20.193.26:0/1730388677 >> v1:10.20.193.103:6789/0 conn(0x7fc7400ba350 legacy=0x7fc740157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.844 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.843+0000 7fc72dffb640 1 -- 10.20.193.26:0/1730388677 >> v1:10.20.193.70:6789/0 conn(0x7fc7400585e0 legacy=0x7fc7401606c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.844 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.843+0000 7fc72dffb640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.844 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.843+0000 7fc72dffb640 1 monclient: found mon.a 2026-02-24T19:18:09.844 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.843+0000 7fc72dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.844 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.843+0000 7fc72dffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.845 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.843+0000 7fc72dffb640 1 -- 10.20.193.26:0/1730388677 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7401fb520 con 0x7fc7400b9f80 2026-02-24T19:18:09.845 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.843+0000 7fc72dffb640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.845 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.843+0000 7fc72dffb640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.845 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.843+0000 7fc72dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.845 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.843+0000 7fc74794c640 5 monclient: authenticate success, global_id 4536 2026-02-24T19:18:09.845 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.843+0000 7fc74794c640 10 monclient: _renew_subs 2026-02-24T19:18:09.845 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.843+0000 7fc74794c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.845 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.843+0000 7fc74794c640 1 -- 10.20.193.26:0/1730388677 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc74015fec0 con 0x7fc7400b9f80 2026-02-24T19:18:09.845 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.843+0000 7fc74794c640 10 client.4536.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.845 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.843+0000 7fc74794c640 10 monclient: _renew_subs 2026-02-24T19:18:09.845 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.843+0000 7fc74794c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.845 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.843+0000 7fc74794c640 1 -- 10.20.193.26:0/1730388677 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc7401fbdc0 con 0x7fc7400b9f80 2026-02-24T19:18:09.845 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.843+0000 7fc74794c640 1 librados: init done 2026-02-24T19:18:09.845 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.843+0000 7ffb9affd640 1 -- 10.20.193.26:0/735250402 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4169566339 0 0) 0x7ffb84003610 con 0x7ffbb40b9f80 2026-02-24T19:18:09.845 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.843+0000 7ffb9affd640 1 -- 10.20.193.26:0/735250402 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffbb40b1420 con 0x7ffbb40b9f80 2026-02-24T19:18:09.845 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.843+0000 7ffb9affd640 1 -- 10.20.193.26:0/735250402 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ffba8002f70 con 0x7ffbb40b9f80 2026-02-24T19:18:09.845 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.843+0000 7ffb9affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.845 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.843+0000 7ffb9affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:09.845 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.843+0000 7ffb9affd640 10 monclient(hunting): dump: 2026-02-24T19:18:09.845 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.845 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.845 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.846 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.846 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.846 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.846 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.846 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.846 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.846 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.846 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.843+0000 7ffb9affd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:09.846 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.844+0000 7fc74794c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.846 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.844+0000 7fc74794c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.846 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.844+0000 7fc74794c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.846 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.844+0000 7fc74794c640 1 -- 10.20.193.26:0/1730388677 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7400b64c0 con 0x7fc7400b9f80 2026-02-24T19:18:09.846 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.844+0000 7f059ffff640 1 -- 10.20.193.26:0/4089243475 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2293983604 0 0) 0x7f05c4133390 con 0x7f05c4159b40 2026-02-24T19:18:09.846 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.844+0000 7f059ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.846 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.844+0000 7f059ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.846 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.844+0000 7f059ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.846 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.844+0000 7f059ffff640 10 monclient(hunting): my global_id is 4539 2026-02-24T19:18:09.846 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.844+0000 7f059ffff640 1 -- 10.20.193.26:0/4089243475 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0594003610 con 0x7f05c4159b40 2026-02-24T19:18:09.847 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.845+0000 7ff153fff640 1 -- 10.20.193.26:0/1884566179 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2916592638 0 0) 0x7ff178155880 con 0x7ff1780585e0 2026-02-24T19:18:09.847 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.845+0000 7ff153fff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.847 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.845+0000 7ff153fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.847 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.845+0000 7ff153fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.847 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.845+0000 7ff153fff640 10 monclient(hunting): my global_id is 4545 2026-02-24T19:18:09.847 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.845+0000 7ff153fff640 1 -- 10.20.193.26:0/1884566179 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff148003610 con 0x7ff1780585e0 2026-02-24T19:18:09.852 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.851+0000 7fb24ffff640 1 -- 10.20.193.26:0/2865969087 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2644547307 0 0) 0x7fb2741fef50 con 0x7fb2740b9f80 2026-02-24T19:18:09.852 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.851+0000 7fb24ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.852 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.851+0000 7fb24ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.852 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.851+0000 7fb24ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.852 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.851+0000 7fb24ffff640 10 monclient(hunting): my global_id is 4548 2026-02-24T19:18:09.852 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.851+0000 7fb24ffff640 1 -- 10.20.193.26:0/2865969087 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb244003610 con 0x7fb2740b9f80 2026-02-24T19:18:09.871 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.870+0000 7ff5e1013640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-24T19:18:09.871 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.870+0000 7ff5e1013640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-24T19:18:09.871 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.870+0000 7ff5e1013640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.871 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.870+0000 7ff5e1013640 1 -- 10.20.193.26:0/1471862225 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff5dc0b94f0 con 0x7ff5dc0b9f80 2026-02-24T19:18:09.883 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.882+0000 7fdda98b1640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-24T19:18:09.883 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.882+0000 7fdda98b1640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-24T19:18:09.883 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.882+0000 7fdda98b1640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:09.883 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.882+0000 7fdda98b1640 1 -- 10.20.193.26:0/1611509555 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fdda4052b90 con 0x7fdda40b3d00 2026-02-24T19:18:09.894 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.893+0000 7f9e167fc640 1 -- 10.20.193.26:0/709356264 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9e04003000 con 0x7f9e18155b20 2026-02-24T19:18:09.894 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.893+0000 7f9e167fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.894 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.893+0000 7f9e167fc640 1 -- 10.20.193.26:0/709356264 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9e04003440 con 0x7f9e18155b20 2026-02-24T19:18:09.894 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.893+0000 7f9e167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.894 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.893+0000 7f9e167fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.894 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.893+0000 7f9e167fc640 10 monclient: dump: 2026-02-24T19:18:09.894 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.894 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.894 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.895 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.895 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.895 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.895 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.895 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.895 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.895 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.895 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.893+0000 7f9e1de7b640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.895 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.893+0000 7f9e1de7b640 4 set_mon_vals no callback set 2026-02-24T19:18:09.895 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.893+0000 7f059ffff640 10 client.?.objecter ms_handle_connect 0x7f05c4057500 2026-02-24T19:18:09.895 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.893+0000 7f059ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.895 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.893+0000 7ff058cfd640 1 -- 10.20.193.26:0/2307351764 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff048002fa0 con 0x7ff054161b70 2026-02-24T19:18:09.895 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.893+0000 7ff058cfd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.895 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.893+0000 7ff058cfd640 1 -- 10.20.193.26:0/2307351764 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ff0480033e0 con 0x7ff054161b70 2026-02-24T19:18:09.896 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.893+0000 7ff058cfd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.896 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.893+0000 7ff058cfd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.896 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.893+0000 7ff058cfd640 10 monclient: dump: 2026-02-24T19:18:09.896 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.896 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.896 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.896 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.896 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.896 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.896 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.896 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.896 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.896 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.896 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.893+0000 7ff05bf8a640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.896 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.893+0000 7ff05bf8a640 4 set_mon_vals no callback set 2026-02-24T19:18:09.897 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7ff6c77fe640 1 -- 10.20.193.26:0/3460022707 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff6b8003000 con 0x7ff6d00ba350 2026-02-24T19:18:09.897 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7ff6c77fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.897 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7ff6c77fe640 1 -- 10.20.193.26:0/3460022707 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ff6b8003400 con 0x7ff6d00ba350 2026-02-24T19:18:09.897 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7ff6c77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.897 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7ff6c77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.897 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7ff6c77fe640 10 monclient: dump: 2026-02-24T19:18:09.897 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.897 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.897 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.897 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.897 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.897 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.897 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.897 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.897 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.897 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.897 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7ff6d6b45640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.897 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7ff6d6b45640 4 set_mon_vals no callback set 2026-02-24T19:18:09.898 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7f9e1de7b640 10 monclient: shutdown 2026-02-24T19:18:09.898 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7f9e1de7b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.898 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7f9e1de7b640 1 -- 10.20.193.26:0/709356264 >> v1:10.20.193.103:6789/0 conn(0x7f9e18155b20 legacy=0x7f9e180b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.898 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7f9e1de7b640 1 -- 10.20.193.26:0/709356264 shutdown_connections 2026-02-24T19:18:09.898 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7f9e1de7b640 1 -- 10.20.193.26:0/709356264 >> 10.20.193.26:0/709356264 conn(0x7f9e180b2ef0 msgr2=0x7f9e180b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.898 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7f9e1de7b640 1 -- 10.20.193.26:0/709356264 shutdown_connections 2026-02-24T19:18:09.898 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7f9e1de7b640 1 -- 10.20.193.26:0/709356264 wait complete. 2026-02-24T19:18:09.898 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7ff05bf8a640 10 monclient: shutdown 2026-02-24T19:18:09.899 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7ff05bf8a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.899 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7ff05bf8a640 1 -- 10.20.193.26:0/2307351764 >> v1:10.20.193.103:6789/0 conn(0x7ff054161b70 legacy=0x7ff0540af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.899 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7ff05bf8a640 1 -- 10.20.193.26:0/2307351764 shutdown_connections 2026-02-24T19:18:09.899 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7ff05bf8a640 1 -- 10.20.193.26:0/2307351764 >> 10.20.193.26:0/2307351764 conn(0x7ff0540b8c00 msgr2=0x7ff0540b9000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.899 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7ff05bf8a640 1 -- 10.20.193.26:0/2307351764 shutdown_connections 2026-02-24T19:18:09.899 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7ff05bf8a640 1 -- 10.20.193.26:0/2307351764 wait complete. 2026-02-24T19:18:09.899 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7ff6d6b45640 10 monclient: shutdown 2026-02-24T19:18:09.899 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7ff6d6b45640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.899 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7ff6d6b45640 1 -- 10.20.193.26:0/3460022707 >> v1:10.20.193.103:6789/0 conn(0x7ff6d00ba350 legacy=0x7ff6d0057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.899 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7ff153fff640 10 client.?.objecter ms_handle_connect 0x7ff1780b9f80 2026-02-24T19:18:09.899 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7ff153fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.900 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7ff6d6b45640 1 -- 10.20.193.26:0/3460022707 shutdown_connections 2026-02-24T19:18:09.900 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7ff6d6b45640 1 -- 10.20.193.26:0/3460022707 >> 10.20.193.26:0/3460022707 conn(0x7ff6d00b7990 msgr2=0x7ff6d00b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.900 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7ff6d6b45640 1 -- 10.20.193.26:0/3460022707 shutdown_connections 2026-02-24T19:18:09.900 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7ff6d6b45640 1 -- 10.20.193.26:0/3460022707 wait complete. 2026-02-24T19:18:09.900 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7f9e1de7b640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.900 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.894+0000 7f9e1de7b640 10 monclient: monmap: 2026-02-24T19:18:09.900 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.900 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.900 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.900 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.901 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.901 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.901 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.901 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.901 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.901 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.901 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7f9e1de7b640 1 librados: starting msgr at 2026-02-24T19:18:09.901 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7f9e1de7b640 1 librados: starting objecter 2026-02-24T19:18:09.901 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7f9e1de7b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.901 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7f9e1de7b640 1 Processor -- start 2026-02-24T19:18:09.901 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7ff05bf8a640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.901 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7ff05bf8a640 10 monclient: monmap: 2026-02-24T19:18:09.901 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.901 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.901 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.901 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.901 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.902 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.902 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.902 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.902 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.902 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.902 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7ff6d6b45640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.902 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7ff6d6b45640 10 monclient: monmap: 2026-02-24T19:18:09.902 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.902 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.902 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.902 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.902 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.902 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.902 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.902 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.902 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.902 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.903 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7f9e1de7b640 1 -- start start 2026-02-24T19:18:09.903 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7f9e1de7b640 1 librados: setting wanted keys 2026-02-24T19:18:09.903 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7f9e1de7b640 1 librados: calling monclient init 2026-02-24T19:18:09.903 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7f9e1de7b640 10 monclient: init 2026-02-24T19:18:09.903 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7f7ae27fc640 10 client.?.objecter ms_handle_connect 0x7f7af4161430 2026-02-24T19:18:09.903 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7f7ae27fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.903 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7ff05bf8a640 1 librados: starting msgr at 2026-02-24T19:18:09.903 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7ff05bf8a640 1 librados: starting objecter 2026-02-24T19:18:09.903 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7ff6d6b45640 1 librados: starting msgr at 2026-02-24T19:18:09.904 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7ff6d6b45640 1 librados: starting objecter 2026-02-24T19:18:09.904 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7ff6d6b45640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.904 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7ff05bf8a640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.904 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7ff6d6b45640 1 Processor -- start 2026-02-24T19:18:09.904 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7ff05bf8a640 1 Processor -- start 2026-02-24T19:18:09.904 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7ff6d6b45640 1 -- start start 2026-02-24T19:18:09.904 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7ff6d6b45640 1 librados: setting wanted keys 2026-02-24T19:18:09.904 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7ff6d6b45640 1 librados: calling monclient init 2026-02-24T19:18:09.904 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7ff6d6b45640 10 monclient: init 2026-02-24T19:18:09.905 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7ff05bf8a640 1 -- start start 2026-02-24T19:18:09.905 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7ff05bf8a640 1 librados: setting wanted keys 2026-02-24T19:18:09.905 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7ff05bf8a640 1 librados: calling monclient init 2026-02-24T19:18:09.905 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7ff05bf8a640 10 monclient: init 2026-02-24T19:18:09.905 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7f9e1de7b640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.905 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7f9e1de7b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:18:09.905 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7f9e1de7b640 10 monclient(hunting): picked mon.noname-c con 0x7f9e18056c70 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.906 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7f9e1de7b640 10 monclient(hunting): picked mon.noname-a con 0x7f9e18155b20 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.906 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7f9e1de7b640 10 monclient(hunting): picked mon.noname-b con 0x7f9e18162f10 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.906 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7f9e1de7b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e180a7f80 con 0x7f9e18155b20 2026-02-24T19:18:09.906 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7f9e1de7b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e180a8230 con 0x7f9e18162f10 2026-02-24T19:18:09.906 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7f9e1de7b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e180a7ca0 con 0x7f9e18056c70 2026-02-24T19:18:09.906 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7f9e1de7b640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.906 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.895+0000 7f9e1de7b640 10 monclient(hunting): authenticate will time out at 3672.577872s 2026-02-24T19:18:09.906 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.896+0000 7ff6d6b45640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.906 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.896+0000 7ff6d6b45640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:18:09.906 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.896+0000 7ff6d6b45640 10 monclient(hunting): picked mon.noname-b con 0x7ff6d00585e0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.906 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.896+0000 7ff6d6b45640 10 monclient(hunting): picked mon.noname-c con 0x7ff6d00b9f80 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.906 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.896+0000 7ff05bf8a640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.906 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.896+0000 7ff05bf8a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:18:09.907 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.896+0000 7ff6d6b45640 10 monclient(hunting): picked mon.noname-a con 0x7ff6d00ba350 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.907 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.896+0000 7ff6d6b45640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6d0165ee0 con 0x7ff6d00ba350 2026-02-24T19:18:09.907 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.896+0000 7ff05bf8a640 10 monclient(hunting): picked mon.noname-a con 0x7ff0540b5de0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.907 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.896+0000 7ff6d6b45640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6d0156d30 con 0x7ff6d00585e0 2026-02-24T19:18:09.907 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.896+0000 7ff05bf8a640 10 monclient(hunting): picked mon.noname-b con 0x7ff0541617a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.908 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.896+0000 7ff6d6b45640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6d0166170 con 0x7ff6d00b9f80 2026-02-24T19:18:09.908 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.896+0000 7ff6d6b45640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.908 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.896+0000 7ff6d6b45640 10 monclient(hunting): authenticate will time out at 3672.578092s 2026-02-24T19:18:09.908 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.896+0000 7ff05bf8a640 10 monclient(hunting): picked mon.noname-c con 0x7ff05413d350 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.908 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.896+0000 7ff05bf8a640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0541667f0 con 0x7ff0540b5de0 2026-02-24T19:18:09.908 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.896+0000 7ff05bf8a640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0542003a0 con 0x7ff0541617a0 2026-02-24T19:18:09.908 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.896+0000 7ff05bf8a640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff054200680 con 0x7ff05413d350 2026-02-24T19:18:09.908 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.896+0000 7ff05bf8a640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.908 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.896+0000 7ff05bf8a640 10 monclient(hunting): authenticate will time out at 3672.578113s 2026-02-24T19:18:09.909 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.897+0000 7fa3ab7fe640 1 -- 10.20.193.26:0/3094193673 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa3c0003560 con 0x7fa3cc0585e0 2026-02-24T19:18:09.909 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.897+0000 7fa3ab7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.909 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.897+0000 7fa3ab7fe640 1 -- 10.20.193.26:0/3094193673 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa3c00038b0 con 0x7fa3cc0585e0 2026-02-24T19:18:09.909 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.897+0000 7fa3ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.909 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.897+0000 7fa3ab7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.909 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.897+0000 7fa3ab7fe640 10 monclient: dump: 2026-02-24T19:18:09.909 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.909 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.909 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.909 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.909 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.909 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.909 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.909 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.909 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.909 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.909 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.897+0000 7fa3c97fa640 4 set_mon_vals no callback set 2026-02-24T19:18:09.910 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.898+0000 7fa3ab7fe640 1 -- 10.20.193.26:0/3094193673 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fa3c001c720 con 0x7fa3cc0585e0 2026-02-24T19:18:09.910 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.899+0000 7fa3ca7fc640 10 monclient: get_auth_request con 0x7fa398077c40 auth_method 0 2026-02-24T19:18:09.910 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.899+0000 7fa3ab7fe640 10 client.4510.objecter ms_handle_connect 0x7fa398077c40 2026-02-24T19:18:09.910 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.899+0000 7fa3ab7fe640 1 -- 10.20.193.26:0/3094193673 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7fa3c0092070 con 0x7fa3cc0585e0 2026-02-24T19:18:09.910 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.899+0000 7fa3ab7fe640 10 client.4510.objecter ms_dispatch2 0x7fa3cc000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:09.910 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.899+0000 7fa3ab7fe640 3 client.4510.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:09.910 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.899+0000 7fa3ab7fe640 3 client.4510.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:09.910 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.899+0000 7fa3ab7fe640 20 client.4510.objecter dump_active .. 0 homeless 2026-02-24T19:18:09.910 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.900+0000 7fa7027fc640 1 -- 10.20.193.26:0/2342867036 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa7100036c0 con 0x7fa7140ba350 2026-02-24T19:18:09.910 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.900+0000 7fa7027fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.910 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.900+0000 7fa7027fc640 1 -- 10.20.193.26:0/2342867036 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa710003c80 con 0x7fa7140ba350 2026-02-24T19:18:09.910 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.900+0000 7fa7027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.910 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.900+0000 7fa7027fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.910 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.900+0000 7fa703fff640 4 set_mon_vals no callback set 2026-02-24T19:18:09.910 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.900+0000 7fa7027fc640 10 monclient: dump: 2026-02-24T19:18:09.910 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.910 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.910 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.911 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.911 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.911 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.911 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.911 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.911 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.911 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.911 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.900+0000 7fa7027fc640 1 -- 10.20.193.26:0/2342867036 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fa71001caf0 con 0x7fa7140ba350 2026-02-24T19:18:09.911 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.901+0000 7fa3ab7fe640 1 -- 10.20.193.26:0/3094193673 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fa3c005caa0 con 0x7fa3cc0585e0 2026-02-24T19:18:09.911 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.901+0000 7fa3ab7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.911 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.901+0000 7fa3ab7fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:09.911 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.901+0000 7fa719ac2640 10 monclient: get_auth_request con 0x7fa6e4077d10 auth_method 0 2026-02-24T19:18:09.912 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.901+0000 7fa7027fc640 1 -- 10.20.193.26:0/2342867036 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7fa710092330 con 0x7fa7140ba350 2026-02-24T19:18:09.912 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.901+0000 7fa7027fc640 10 client.4517.objecter ms_dispatch2 0x7fa714000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:09.912 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.901+0000 7fa7027fc640 3 client.4517.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:09.912 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.901+0000 7fa7027fc640 3 client.4517.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:09.912 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.901+0000 7fa7027fc640 20 client.4517.objecter dump_active .. 0 homeless 2026-02-24T19:18:09.912 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.901+0000 7fa7027fc640 10 client.4517.objecter ms_handle_connect 0x7fa6e4077d10 2026-02-24T19:18:09.912 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.902+0000 7f7ae27fc640 10 client.?.objecter ms_handle_connect 0x7f7af416ad30 2026-02-24T19:18:09.912 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.902+0000 7f7ae27fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.912 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.903+0000 7f5ef48fd640 1 -- 10.20.193.26:0/3840689891 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5ee0003000 con 0x7f5ef0155b20 2026-02-24T19:18:09.913 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.903+0000 7f5ef48fd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.913 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.903+0000 7f5ef48fd640 1 -- 10.20.193.26:0/3840689891 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f5ee0003440 con 0x7f5ef0155b20 2026-02-24T19:18:09.913 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.903+0000 7f5ef48fd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.913 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.903+0000 7f5ef48fd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:09.913 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.903+0000 7f5ef48fd640 10 monclient: dump: 2026-02-24T19:18:09.913 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.913 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.913 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.913 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.913 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.913 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.913 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.913 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.913 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.913 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.913 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.903+0000 7f5ef7b8a640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.913 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.903+0000 7f5ef7b8a640 4 set_mon_vals no callback set 2026-02-24T19:18:09.913 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.903+0000 7f5ef7b8a640 10 monclient: shutdown 2026-02-24T19:18:09.913 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.903+0000 7f5ef7b8a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.913 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.903+0000 7f5ef7b8a640 1 -- 10.20.193.26:0/3840689891 >> v1:10.20.193.70:6789/0 conn(0x7f5ef0155b20 legacy=0x7f5ef00b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.913 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.903+0000 7f5ef7b8a640 1 -- 10.20.193.26:0/3840689891 shutdown_connections 2026-02-24T19:18:09.913 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.903+0000 7f5ef7b8a640 1 -- 10.20.193.26:0/3840689891 >> 10.20.193.26:0/3840689891 conn(0x7f5ef00b2ef0 msgr2=0x7f5ef00b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.914 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.903+0000 7f5ef7b8a640 1 -- 10.20.193.26:0/3840689891 shutdown_connections 2026-02-24T19:18:09.914 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.903+0000 7f5ef7b8a640 1 -- 10.20.193.26:0/3840689891 wait complete. 2026-02-24T19:18:09.914 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7f5ef7b8a640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.914 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7f5ef7b8a640 10 monclient: monmap: 2026-02-24T19:18:09.914 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.914 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.914 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.914 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.914 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.914 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.914 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.914 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.914 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.914 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.914 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7fa7027fc640 1 -- 10.20.193.26:0/2342867036 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fa71005cd60 con 0x7fa7140ba350 2026-02-24T19:18:09.914 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7fa7027fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.914 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7fa7027fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:09.915 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7f5ef7b8a640 1 librados: starting msgr at 2026-02-24T19:18:09.915 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7f5ef7b8a640 1 librados: starting objecter 2026-02-24T19:18:09.915 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7f5ef7b8a640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.915 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7f5ef7b8a640 1 Processor -- start 2026-02-24T19:18:09.915 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7ffb9affd640 10 client.?.objecter ms_handle_connect 0x7ffbb40585e0 2026-02-24T19:18:09.915 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7ffb9affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.915 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7f5ef7b8a640 1 -- start start 2026-02-24T19:18:09.915 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7f5ef7b8a640 1 librados: setting wanted keys 2026-02-24T19:18:09.915 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7f5ef7b8a640 1 librados: calling monclient init 2026-02-24T19:18:09.915 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7f5ef7b8a640 10 monclient: init 2026-02-24T19:18:09.916 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7ff153fff640 10 client.?.objecter ms_handle_connect 0x7ff1780ba350 2026-02-24T19:18:09.916 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7ff153fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.916 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7fb24ffff640 10 client.?.objecter ms_handle_connect 0x7fb2740585e0 2026-02-24T19:18:09.916 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7fb24ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.916 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7f059ffff640 10 client.?.objecter ms_handle_connect 0x7f05c40b91f0 2026-02-24T19:18:09.916 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7f059ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.917 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7f5ef7b8a640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.917 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7f5ef7b8a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:18:09.917 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7f5ef7b8a640 10 monclient(hunting): picked mon.noname-c con 0x7f5ef0056c70 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.917 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7f5ef7b8a640 10 monclient(hunting): picked mon.noname-a con 0x7f5ef0155b20 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.917 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7f5ef7b8a640 10 monclient(hunting): picked mon.noname-b con 0x7f5ef0162f10 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.917 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7f5ef7b8a640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ef01fec90 con 0x7f5ef0155b20 2026-02-24T19:18:09.917 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7f5ef7b8a640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ef00abed0 con 0x7f5ef0162f10 2026-02-24T19:18:09.917 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7f5ef7b8a640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ef00ac1b0 con 0x7f5ef0056c70 2026-02-24T19:18:09.917 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7f5ef7b8a640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.917 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.904+0000 7f5ef7b8a640 10 monclient(hunting): authenticate will time out at 3672.586844s 2026-02-24T19:18:09.918 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.905+0000 7f8afaffd640 1 -- 10.20.193.26:0/1788666139 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8ae8003000 con 0x7f8afc159a70 2026-02-24T19:18:09.918 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.905+0000 7f8afaffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.918 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.905+0000 7f8afaffd640 1 -- 10.20.193.26:0/1788666139 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f8ae8003440 con 0x7f8afc159a70 2026-02-24T19:18:09.918 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.905+0000 7f8afaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.918 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.905+0000 7f8afaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:09.918 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.905+0000 7f8afaffd640 10 monclient: dump: 2026-02-24T19:18:09.918 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.918 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.918 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.918 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.918 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.918 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.918 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.918 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.919 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.919 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.919 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.905+0000 7f8b0296b640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:09.919 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.905+0000 7f8b0296b640 4 set_mon_vals no callback set 2026-02-24T19:18:09.919 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.906+0000 7f8b0296b640 10 monclient: shutdown 2026-02-24T19:18:09.919 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.906+0000 7f8b0296b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.919 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.906+0000 7f8b0296b640 1 -- 10.20.193.26:0/1788666139 >> v1:10.20.193.103:6789/0 conn(0x7f8afc159a70 legacy=0x7f8afc0b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.919 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.906+0000 7f8b0296b640 1 -- 10.20.193.26:0/1788666139 shutdown_connections 2026-02-24T19:18:09.919 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.906+0000 7f8b0296b640 1 -- 10.20.193.26:0/1788666139 >> 10.20.193.26:0/1788666139 conn(0x7f8afc0b7780 msgr2=0x7f8afc0b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.919 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.906+0000 7f8b0296b640 1 -- 10.20.193.26:0/1788666139 shutdown_connections 2026-02-24T19:18:09.919 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.906+0000 7f8b0296b640 1 -- 10.20.193.26:0/1788666139 wait complete. 2026-02-24T19:18:09.919 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.906+0000 7f059ffff640 1 -- 10.20.193.26:0/4089243475 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 966282162 0 0) 0x7f05c4133670 con 0x7f05c4057500 2026-02-24T19:18:09.919 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.906+0000 7f059ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.919 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.906+0000 7f059ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.919 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.906+0000 7f059ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.919 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.906+0000 7f059ffff640 10 monclient(hunting): my global_id is 4525 2026-02-24T19:18:09.919 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.906+0000 7f059ffff640 1 -- 10.20.193.26:0/4089243475 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05c4133390 con 0x7f05c4057500 2026-02-24T19:18:09.920 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.906+0000 7f8b0296b640 10 monclient: build_initial_monmap 2026-02-24T19:18:09.920 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.906+0000 7f8b0296b640 10 monclient: monmap: 2026-02-24T19:18:09.920 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:09.920 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:09.920 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:09.920 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:09.920 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:09.920 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:09.920 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:09.920 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:09.920 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:09.920 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.920 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.906+0000 7ff153fff640 1 -- 10.20.193.26:0/1884566179 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3799132676 0 0) 0x7ff1781fd370 con 0x7ff1780b9f80 2026-02-24T19:18:09.920 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.906+0000 7ff153fff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.921 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.906+0000 7ff153fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.921 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.906+0000 7ff153fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.921 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.906+0000 7ff153fff640 10 monclient(hunting): my global_id is 4535 2026-02-24T19:18:09.921 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.906+0000 7ff153fff640 1 -- 10.20.193.26:0/1884566179 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff178155880 con 0x7ff1780b9f80 2026-02-24T19:18:09.921 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.907+0000 7f8b0296b640 1 librados: starting msgr at 2026-02-24T19:18:09.921 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.907+0000 7f8b0296b640 1 librados: starting objecter 2026-02-24T19:18:09.921 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.907+0000 7f8b0296b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:09.921 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.907+0000 7f8b0296b640 1 Processor -- start 2026-02-24T19:18:09.921 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.907+0000 7f8b0296b640 1 -- start start 2026-02-24T19:18:09.921 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.907+0000 7f8b0296b640 1 librados: setting wanted keys 2026-02-24T19:18:09.921 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.907+0000 7f8b0296b640 1 librados: calling monclient init 2026-02-24T19:18:09.921 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.907+0000 7f8b0296b640 10 monclient: init 2026-02-24T19:18:09.921 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.907+0000 7f8b0296b640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:09.922 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.907+0000 7f8b0296b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:18:09.922 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.907+0000 7f8b0296b640 10 monclient(hunting): picked mon.noname-b con 0x7f8afc058070 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:09.922 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.907+0000 7f8b0296b640 10 monclient(hunting): picked mon.noname-a con 0x7f8afc159a70 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:09.922 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.907+0000 7f8b0296b640 10 monclient(hunting): picked mon.noname-c con 0x7f8afc159e40 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:09.922 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.907+0000 7f8b0296b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8afc13c090 con 0x7f8afc159a70 2026-02-24T19:18:09.922 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.907+0000 7f8b0296b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8afc156490 con 0x7f8afc058070 2026-02-24T19:18:09.922 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.907+0000 7f8b0296b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8afc13b7f0 con 0x7f8afc159e40 2026-02-24T19:18:09.922 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.907+0000 7f8b0296b640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:09.922 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.907+0000 7f8b0296b640 10 monclient(hunting): authenticate will time out at 3672.589502s 2026-02-24T19:18:09.922 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.910+0000 7fb24ffff640 10 client.?.objecter ms_handle_connect 0x7fb2740ba350 2026-02-24T19:18:09.922 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.910+0000 7fb24ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.922 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.910+0000 7fdd7bfff640 1 -- 10.20.193.26:0/1611509555 <== mon.1 v1:10.20.193.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+12 (unknown 3646472635 0 1257367751) 0x7fdd8c05d5f0 con 0x7fdda40b3d00 2026-02-24T19:18:09.922 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.910+0000 7fdd7bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-24T19:18:09.922 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.910+0000 7fdd7bfff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:09.922 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:09.923 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.911+0000 7ffb9affd640 10 client.?.objecter ms_handle_connect 0x7ffbb40ba350 2026-02-24T19:18:09.923 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.911+0000 7ffb9affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.923 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.912+0000 7f9e17fff640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f9e18162f10 0x7f9e180a8fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:59954/0 (socket says 10.20.193.26:59954) 2026-02-24T19:18:09.923 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.912+0000 7f9e17fff640 1 -- 10.20.193.26:0/1835522637 learned_addr learned my addr 10.20.193.26:0/1835522637 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.923 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.912+0000 7ff6d48ba640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7ff6d00585e0 0x7ff6d01657d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:59970/0 (socket says 10.20.193.26:59970) 2026-02-24T19:18:09.923 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.912+0000 7ff6d48ba640 1 -- 10.20.193.26:0/2700680131 learned_addr learned my addr 10.20.193.26:0/2700680131 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.923 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.912+0000 7f7ae27fc640 1 -- 10.20.193.26:0/996126610 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1679635464 0 0) 0x7f7af40aeaa0 con 0x7f7af416ad30 2026-02-24T19:18:09.923 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.912+0000 7f7ae27fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.923 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.912+0000 7f7ae27fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.923 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.912+0000 7f7ae27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.923 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.912+0000 7f7ae27fc640 10 monclient(hunting): my global_id is 4528 2026-02-24T19:18:09.923 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.912+0000 7f7ae27fc640 1 -- 10.20.193.26:0/996126610 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ac4003610 con 0x7f7af416ad30 2026-02-24T19:18:09.924 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.912+0000 7f9df3fff640 10 client.?.objecter ms_handle_connect 0x7f9e18162f10 2026-02-24T19:18:09.924 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.912+0000 7f9df3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.924 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.912+0000 7ff6c57fa640 10 client.?.objecter ms_handle_connect 0x7ff6d00585e0 2026-02-24T19:18:09.924 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.913+0000 7ff6c57fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.924 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.913+0000 7ff0594fe640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7ff0541617a0 0x7ff0541660e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:59980/0 (socket says 10.20.193.26:59980) 2026-02-24T19:18:09.924 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.913+0000 7ff0594fe640 1 -- 10.20.193.26:0/1022253249 learned_addr learned my addr 10.20.193.26:0/1022253249 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.925 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.913+0000 7fdda98b1640 10 librados: watch_flush enter 2026-02-24T19:18:09.925 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.913+0000 7fdda98b1640 10 librados: watch_flush exit 2026-02-24T19:18:09.925 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.913+0000 7fdda98b1640 20 client.4486.objecter shutdown clearing up homeless session... 2026-02-24T19:18:09.925 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.913+0000 7fdda98b1640 10 client.4486.objecter successfully canceled tick 2026-02-24T19:18:09.925 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.913+0000 7fdda98b1640 1 -- 10.20.193.26:0/1611509555 >> v1:10.20.193.162:6800/3889602630 conn(0x7fdd74077cb0 legacy=0x7fdd74098160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.925 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.913+0000 7fdda98b1640 10 monclient: shutdown 2026-02-24T19:18:09.925 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.913+0000 7fdda98b1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.925 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.913+0000 7fdda98b1640 1 -- 10.20.193.26:0/1611509555 >> v1:10.20.193.70:6789/0 conn(0x7fdda40b3d00 legacy=0x7fdda40ab390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.925 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.913+0000 7fdda98b1640 1 -- 10.20.193.26:0/1611509555 shutdown_connections 2026-02-24T19:18:09.925 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.913+0000 7fdda98b1640 1 -- 10.20.193.26:0/1611509555 >> 10.20.193.26:0/1611509555 conn(0x7fdda40b4120 msgr2=0x7fdda415bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.925 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.913+0000 7fdda98b1640 1 -- 10.20.193.26:0/1611509555 shutdown_connections 2026-02-24T19:18:09.925 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.913+0000 7fdda98b1640 1 -- 10.20.193.26:0/1611509555 wait complete. 2026-02-24T19:18:09.925 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.913+0000 7fdda98b1640 1 librados: shutdown 2026-02-24T19:18:09.925 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.914+0000 7ff0427fc640 10 client.?.objecter ms_handle_connect 0x7ff0541617a0 2026-02-24T19:18:09.925 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.914+0000 7ff0427fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.925 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.915+0000 7f8afbfff640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f8afc058070 0x7f8afc13af20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:60004/0 (socket says 10.20.193.26:60004) 2026-02-24T19:18:09.925 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.915+0000 7f8afbfff640 1 -- 10.20.193.26:0/4228833030 learned_addr learned my addr 10.20.193.26:0/4228833030 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.925 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.915+0000 7f8af8ff9640 10 client.?.objecter ms_handle_connect 0x7f8afc058070 2026-02-24T19:18:09.925 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.915+0000 7f8af8ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.926 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.915+0000 7f5ef6100640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f5ef0162f10 0x7f5ef00a8130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:59996/0 (socket says 10.20.193.26:59996) 2026-02-24T19:18:09.926 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.915+0000 7f5ef6100640 1 -- 10.20.193.26:0/3163239507 learned_addr learned my addr 10.20.193.26:0/3163239507 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:09.926 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.916+0000 7f5ede7fc640 10 client.?.objecter ms_handle_connect 0x7f5ef0162f10 2026-02-24T19:18:09.926 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.916+0000 7f5ede7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.926 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.917+0000 7ff5bb7fe640 1 -- 10.20.193.26:0/1471862225 <== mon.2 v1:10.20.193.103:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 778662779) 0x7ff5c405c3e0 con 0x7ff5dc0b9f80 2026-02-24T19:18:09.926 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.917+0000 7ff5bb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-24T19:18:09.926 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.917+0000 7ff5bb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:09.926 INFO:teuthology.orchestra.run.trial026.stdout:90194313219 2026-02-24T19:18:09.926 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.918+0000 7ff153fff640 1 -- 10.20.193.26:0/1884566179 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1042601211 0 0) 0x7ff178155880 con 0x7ff1780b9f80 2026-02-24T19:18:09.926 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.918+0000 7ff153fff640 1 -- 10.20.193.26:0/1884566179 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff1781fd370 con 0x7ff1780b9f80 2026-02-24T19:18:09.926 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.918+0000 7ff153fff640 1 -- 10.20.193.26:0/1884566179 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ff168002ed0 con 0x7ff1780b9f80 2026-02-24T19:18:09.927 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.918+0000 7ff153fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:09.927 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.918+0000 7ff153fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:09.927 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.918+0000 7ff153fff640 10 monclient(hunting): dump: 2026-02-24T19:18:09.927 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.927 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.927 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.927 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.927 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.927 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.927 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.927 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.927 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.927 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.927 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.918+0000 7ff153fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:09.927 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.918+0000 7fb24ffff640 1 -- 10.20.193.26:0/2865969087 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 584670259 0 0) 0x7fb2741608b0 con 0x7fb2740585e0 2026-02-24T19:18:09.927 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.918+0000 7fb24ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.927 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.918+0000 7fb24ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.927 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.918+0000 7fb24ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.927 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.918+0000 7fb24ffff640 10 monclient(hunting): my global_id is 4544 2026-02-24T19:18:09.927 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.918+0000 7fb24ffff640 1 -- 10.20.193.26:0/2865969087 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2741fef50 con 0x7fb2740585e0 2026-02-24T19:18:09.928 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.920+0000 7ff5e1013640 10 librados: watch_flush enter 2026-02-24T19:18:09.928 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.920+0000 7ff5e1013640 10 librados: watch_flush exit 2026-02-24T19:18:09.928 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.920+0000 7ff5e1013640 20 client.4493.objecter shutdown clearing up homeless session... 2026-02-24T19:18:09.928 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.920+0000 7ff5e1013640 10 client.4493.objecter successfully canceled tick 2026-02-24T19:18:09.928 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.920+0000 7ff5e1013640 1 -- 10.20.193.26:0/1471862225 >> v1:10.20.193.162:6800/3889602630 conn(0x7ff5a8077dc0 legacy=0x7ff5a8098270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.928 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.920+0000 7ff5e1013640 10 monclient: shutdown 2026-02-24T19:18:09.928 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.920+0000 7ff5e1013640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:09.928 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.920+0000 7ff5e1013640 1 -- 10.20.193.26:0/1471862225 >> v1:10.20.193.103:6789/0 conn(0x7ff5dc0b9f80 legacy=0x7ff5dc165c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.928 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.920+0000 7ff5e1013640 1 -- 10.20.193.26:0/1471862225 shutdown_connections 2026-02-24T19:18:09.928 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.920+0000 7ff5e1013640 1 -- 10.20.193.26:0/1471862225 >> 10.20.193.26:0/1471862225 conn(0x7ff5dc0b7990 msgr2=0x7ff5dc15acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:09.928 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.920+0000 7ff5e1013640 1 -- 10.20.193.26:0/1471862225 shutdown_connections 2026-02-24T19:18:09.928 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.920+0000 7ff5e1013640 1 -- 10.20.193.26:0/1471862225 wait complete. 2026-02-24T19:18:09.928 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.920+0000 7ff5e1013640 1 librados: shutdown 2026-02-24T19:18:09.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313220 for osd.10 2026-02-24T19:18:09.929 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7f7ae27fc640 1 -- 10.20.193.26:0/996126610 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1814460875 0 0) 0x7f7af40aed80 con 0x7f7af4161430 2026-02-24T19:18:09.929 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7f7ae27fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.929 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7f7ae27fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.929 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7f7ae27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.929 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7f7ae27fc640 10 monclient(hunting): my global_id is 4538 2026-02-24T19:18:09.929 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7f7ae27fc640 1 -- 10.20.193.26:0/996126610 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7af40aeaa0 con 0x7f7af4161430 2026-02-24T19:18:09.929 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7ff153fff640 1 -- 10.20.193.26:0/1884566179 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2831430267 0 0) 0x7ff1781fd370 con 0x7ff1780b9f80 2026-02-24T19:18:09.929 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7ff153fff640 1 -- 10.20.193.26:0/1884566179 >> v1:10.20.193.70:6789/0 conn(0x7ff1780ba350 legacy=0x7ff1781f8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7ff153fff640 1 -- 10.20.193.26:0/1884566179 >> v1:10.20.193.26:6789/0 conn(0x7ff1780585e0 legacy=0x7ff1781fb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7ff153fff640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7ff153fff640 1 monclient: found mon.c 2026-02-24T19:18:09.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7ff153fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7ff153fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7ff153fff640 1 -- 10.20.193.26:0/1884566179 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1781fd650 con 0x7ff1780b9f80 2026-02-24T19:18:09.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7ff153fff640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7ff153fff640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7ff153fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7ff17dc2b640 5 monclient: authenticate success, global_id 4535 2026-02-24T19:18:09.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7ff17dc2b640 10 monclient: _renew_subs 2026-02-24T19:18:09.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7ff17dc2b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7ff17dc2b640 1 -- 10.20.193.26:0/1884566179 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff1781fd930 con 0x7ff1780b9f80 2026-02-24T19:18:09.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7ff17dc2b640 10 client.4535.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7ff17dc2b640 10 monclient: _renew_subs 2026-02-24T19:18:09.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7ff17dc2b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7ff17dc2b640 1 -- 10.20.193.26:0/1884566179 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff1781f9510 con 0x7ff1780b9f80 2026-02-24T19:18:09.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7ff17dc2b640 1 librados: init done 2026-02-24T19:18:09.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7f059ffff640 1 -- 10.20.193.26:0/4089243475 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 547896744 0 0) 0x7f05c4133950 con 0x7f05c40b91f0 2026-02-24T19:18:09.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7f059ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7f059ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7f059ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7f059ffff640 10 monclient(hunting): my global_id is 4541 2026-02-24T19:18:09.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.922+0000 7f059ffff640 1 -- 10.20.193.26:0/4089243475 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05c4133670 con 0x7f05c40b91f0 2026-02-24T19:18:09.931 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.923+0000 7ff17dc2b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.931 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.923+0000 7ff17dc2b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.931 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.923+0000 7ff17dc2b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:09.931 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.923+0000 7ff17dc2b640 1 -- 10.20.193.26:0/1884566179 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff178159080 con 0x7ff1780b9f80 2026-02-24T19:18:09.931 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.925+0000 7f5ede7fc640 10 client.?.objecter ms_handle_connect 0x7f5ef0056c70 2026-02-24T19:18:09.931 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.925+0000 7f5ede7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.931 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.925+0000 7ffb9affd640 1 -- 10.20.193.26:0/735250402 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1675751326 0 0) 0x7ffbb40af750 con 0x7ffbb40ba350 2026-02-24T19:18:09.931 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.925+0000 7ffb9affd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:09.931 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.925+0000 7ffb9affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:09.931 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.925+0000 7ffb9affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:09.931 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.925+0000 7ffb9affd640 10 monclient(hunting): my global_id is 4547 2026-02-24T19:18:09.931 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.925+0000 7ffb9affd640 1 -- 10.20.193.26:0/735250402 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb84003610 con 0x7ffbb40ba350 2026-02-24T19:18:09.931 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.925+0000 7f9df3fff640 10 client.?.objecter ms_handle_connect 0x7f9e18056c70 2026-02-24T19:18:09.931 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.925+0000 7f9df3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.931 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.926+0000 7f8af8ff9640 10 client.?.objecter ms_handle_connect 0x7f8afc159e40 2026-02-24T19:18:09.932 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.926+0000 7f8af8ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:09.932 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.928+0000 7f3b55c16640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-24T19:18:09.932 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.928+0000 7f3b55c16640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-24T19:18:09.932 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.928+0000 7f3b55c16640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.932 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.928+0000 7f3b55c16640 1 -- 10.20.193.26:0/1078597095 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f3b500b6c80 con 0x7f3b500b9f80 2026-02-24T19:18:09.932 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.1 2026-02-24T19:18:09.951 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.950+0000 7fc72dffb640 1 -- 10.20.193.26:0/1730388677 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc734004950 con 0x7fc7400b9f80 2026-02-24T19:18:09.952 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.950+0000 7fc72dffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:09.952 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.950+0000 7fc72dffb640 1 -- 10.20.193.26:0/1730388677 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc734004b00 con 0x7fc7400b9f80 2026-02-24T19:18:09.952 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.950+0000 7fc72dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:09.952 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.950+0000 7fc72dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:09.952 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.950+0000 7fc72dffb640 10 monclient: dump: 2026-02-24T19:18:09.952 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:09.952 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:09.952 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.952 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:09.952 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:09.952 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:09.952 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:09.952 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:09.952 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:09.952 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:09.952 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.950+0000 7fc72f7fe640 4 set_mon_vals no callback set 2026-02-24T19:18:09.952 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7f7ae27fc640 1 -- 10.20.193.26:0/996126610 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2191156280 0 0) 0x7f7af40ae7c0 con 0x7f7af4161800 2026-02-24T19:18:09.952 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7f7ae27fc640 1 -- 10.20.193.26:0/996126610 >> v1:10.20.193.103:6789/0 conn(0x7f7af4161430 legacy=0x7f7af412d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7f7ae27fc640 1 -- 10.20.193.26:0/996126610 >> v1:10.20.193.70:6789/0 conn(0x7f7af416ad30 legacy=0x7f7af40a88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7f7ae27fc640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7f7ae27fc640 1 monclient: found mon.a 2026-02-24T19:18:09.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7f7ae27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7f7ae27fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7f7ae27fc640 1 -- 10.20.193.26:0/996126610 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7af40af060 con 0x7f7af4161800 2026-02-24T19:18:09.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7f7ae27fc640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7f7ae27fc640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7f7ae27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7f7afc013640 5 monclient: authenticate success, global_id 4533 2026-02-24T19:18:09.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7f7afc013640 10 monclient: _renew_subs 2026-02-24T19:18:09.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7f7afc013640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7f7afc013640 1 -- 10.20.193.26:0/996126610 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7af412cc00 con 0x7f7af4161800 2026-02-24T19:18:09.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7f7afc013640 10 client.4533.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7f7afc013640 10 monclient: _renew_subs 2026-02-24T19:18:09.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7f7afc013640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7f7afc013640 1 -- 10.20.193.26:0/996126610 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7af412ac20 con 0x7f7af4161800 2026-02-24T19:18:09.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7f7afc013640 1 librados: init done 2026-02-24T19:18:09.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7ffb9affd640 1 -- 10.20.193.26:0/735250402 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2007019497 0 0) 0x7ffbb40b1420 con 0x7ffbb40b9f80 2026-02-24T19:18:09.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7ffb9affd640 1 -- 10.20.193.26:0/735250402 >> v1:10.20.193.103:6789/0 conn(0x7ffbb40ba350 legacy=0x7ffbb41560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7ffb9affd640 1 -- 10.20.193.26:0/735250402 >> v1:10.20.193.70:6789/0 conn(0x7ffbb40585e0 legacy=0x7ffbb40b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:09.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7ffb9affd640 10 monclient: _finish_hunting 0 2026-02-24T19:18:09.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7ffb9affd640 1 monclient: found mon.a 2026-02-24T19:18:09.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7ffb9affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:09.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7ffb9affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7ffb9affd640 1 -- 10.20.193.26:0/735250402 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbb40afa30 con 0x7ffbb40b9f80 2026-02-24T19:18:09.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7ffb9affd640 10 monclient: _finish_auth 0 2026-02-24T19:18:09.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7ffb9affd640 10 monclient: _check_auth_tickets 2026-02-24T19:18:09.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7ffb9affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:09.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7ffbbc313640 5 monclient: authenticate success, global_id 4542 2026-02-24T19:18:09.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7ffbbc313640 10 monclient: _renew_subs 2026-02-24T19:18:09.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7ffbbc313640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7ffbbc313640 1 -- 10.20.193.26:0/735250402 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffbb40afd10 con 0x7ffbb40b9f80 2026-02-24T19:18:09.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7ffbbc313640 10 client.4542.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:09.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7ffbbc313640 10 monclient: _renew_subs 2026-02-24T19:18:09.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7ffbbc313640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7ffbbc313640 1 -- 10.20.193.26:0/735250402 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ffbb41fcf60 con 0x7ffbb40b9f80 2026-02-24T19:18:09.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7ffbbc313640 1 librados: init done 2026-02-24T19:18:09.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7fc72dffb640 1 -- 10.20.193.26:0/1730388677 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fc73401d970 con 0x7fc7400b9f80 2026-02-24T19:18:09.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7f7afc013640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7f7afc013640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7f7afc013640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.951+0000 7f7afc013640 1 -- 10.20.193.26:0/996126610 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7af4168630 con 0x7f7af4161800 2026-02-24T19:18:09.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.952+0000 7ffbbc313640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.955 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.952+0000 7ffbbc313640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.955 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.952+0000 7ffbbc313640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:09.955 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.952+0000 7ffbbc313640 1 -- 10.20.193.26:0/735250402 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbb4159300 con 0x7ffbb40b9f80 2026-02-24T19:18:09.955 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.952+0000 7fc7456c1640 10 monclient: get_auth_request con 0x7fc710077d50 auth_method 0 2026-02-24T19:18:09.955 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.952+0000 7fc72dffb640 10 client.4536.objecter ms_handle_connect 0x7fc710077d50 2026-02-24T19:18:09.955 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.955+0000 7fc72dffb640 1 -- 10.20.193.26:0/1730388677 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7fc734093350 con 0x7fc7400b9f80 2026-02-24T19:18:09.956 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.955+0000 7fc72dffb640 10 client.4536.objecter ms_dispatch2 0x7fc740000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:09.956 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.955+0000 7fc72dffb640 3 client.4536.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:09.956 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.955+0000 7fc72dffb640 3 client.4536.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:09.956 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.955+0000 7fc72dffb640 20 client.4536.objecter dump_active .. 0 homeless 2026-02-24T19:18:09.956 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.955+0000 7fc72dffb640 1 -- 10.20.193.26:0/1730388677 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fc73405dd80 con 0x7fc7400b9f80 2026-02-24T19:18:09.956 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.955+0000 7fc72dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:09.956 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:09.955+0000 7fc72dffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:10.016 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.015+0000 7fa3d15e3640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-24T19:18:10.016 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.015+0000 7fa3d15e3640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-24T19:18:10.016 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.015+0000 7fa3d15e3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:10.016 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.015+0000 7fa3d15e3640 1 -- 10.20.193.26:0/3094193673 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fa3cc0b64c0 con 0x7fa3cc0585e0 2026-02-24T19:18:10.016 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.015+0000 7fa71bd4d640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-24T19:18:10.016 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.015+0000 7fa71bd4d640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-24T19:18:10.016 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.015+0000 7fa71bd4d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:10.016 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.015+0000 7fa71bd4d640 1 -- 10.20.193.26:0/2342867036 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 12} v 0) -- 0x7fa7140b8b20 con 0x7fa7140ba350 2026-02-24T19:18:10.018 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.017+0000 7fa3ab7fe640 1 -- 10.20.193.26:0/3094193673 <== mon.1 v1:10.20.193.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+12 (unknown 3405404620 0 1257367751) 0x7fa3c005c3a0 con 0x7fa3cc0585e0 2026-02-24T19:18:10.018 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.017+0000 7fa3ab7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-24T19:18:10.018 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.017+0000 7fa3ab7fe640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:10.019 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.017+0000 7f5ede7fc640 1 -- 10.20.193.26:0/3163239507 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1105394820 0 0) 0x7f5ef00ac1b0 con 0x7f5ef0056c70 2026-02-24T19:18:10.019 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.017+0000 7f5ede7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:10.019 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.017+0000 7f5ede7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:10.019 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.017+0000 7f5ede7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:10.019 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.017+0000 7f5ede7fc640 10 monclient(hunting): my global_id is 4550 2026-02-24T19:18:10.019 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.017+0000 7f5ede7fc640 1 -- 10.20.193.26:0/3163239507 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ec0003610 con 0x7f5ef0056c70 2026-02-24T19:18:10.019 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:10.019 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.017+0000 7ff6c57fa640 10 client.?.objecter ms_handle_connect 0x7ff6d00b9f80 2026-02-24T19:18:10.019 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.017+0000 7ff6c57fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:10.021 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.020+0000 7fa3d15e3640 10 librados: watch_flush enter 2026-02-24T19:18:10.021 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.020+0000 7fa3d15e3640 10 librados: watch_flush exit 2026-02-24T19:18:10.022 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.020+0000 7fa3d15e3640 20 client.4510.objecter shutdown clearing up homeless session... 2026-02-24T19:18:10.022 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.020+0000 7fa3d15e3640 10 client.4510.objecter successfully canceled tick 2026-02-24T19:18:10.022 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.020+0000 7fa3d15e3640 1 -- 10.20.193.26:0/3094193673 >> v1:10.20.193.162:6800/3889602630 conn(0x7fa398077c40 legacy=0x7fa3980980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.022 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.020+0000 7fa3d15e3640 10 monclient: shutdown 2026-02-24T19:18:10.022 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.020+0000 7fa3d15e3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:10.022 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.020+0000 7fa3d15e3640 1 -- 10.20.193.26:0/3094193673 >> v1:10.20.193.70:6789/0 conn(0x7fa3cc0585e0 legacy=0x7fa3cc0ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.022 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.020+0000 7fa3d15e3640 1 -- 10.20.193.26:0/3094193673 shutdown_connections 2026-02-24T19:18:10.022 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.020+0000 7fa3d15e3640 1 -- 10.20.193.26:0/3094193673 >> 10.20.193.26:0/3094193673 conn(0x7fa3cc0b7990 msgr2=0x7fa3cc158a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:10.022 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.020+0000 7fa3d15e3640 1 -- 10.20.193.26:0/3094193673 shutdown_connections 2026-02-24T19:18:10.022 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.020+0000 7fa3d15e3640 1 -- 10.20.193.26:0/3094193673 wait complete. 2026-02-24T19:18:10.022 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.020+0000 7fa3d15e3640 1 librados: shutdown 2026-02-24T19:18:10.023 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.021+0000 7ff153fff640 1 -- 10.20.193.26:0/1884566179 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff168003550 con 0x7ff1780b9f80 2026-02-24T19:18:10.023 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.021+0000 7ff153fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:10.023 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.021+0000 7ff153fff640 1 -- 10.20.193.26:0/1884566179 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ff1680038a0 con 0x7ff1780b9f80 2026-02-24T19:18:10.023 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.021+0000 7ff153fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:10.023 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.021+0000 7ff153fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:10.023 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.021+0000 7ff153fff640 10 monclient: dump: 2026-02-24T19:18:10.023 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:10.023 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:10.023 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.023 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.023 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:10.023 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:10.023 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:10.023 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:10.023 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:10.023 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:10.024 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.021+0000 7ff175ffb640 4 set_mon_vals no callback set 2026-02-24T19:18:10.024 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.022+0000 7ff153fff640 1 -- 10.20.193.26:0/1884566179 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7ff16801c710 con 0x7ff1780b9f80 2026-02-24T19:18:10.024 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.023+0000 7ff1777fe640 10 monclient: get_auth_request con 0x7ff148077da0 auth_method 0 2026-02-24T19:18:10.024 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.023+0000 7ff153fff640 10 client.4535.objecter ms_handle_connect 0x7ff148077da0 2026-02-24T19:18:10.025 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.023+0000 7ff153fff640 1 -- 10.20.193.26:0/1884566179 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7ff1680920c0 con 0x7ff1780b9f80 2026-02-24T19:18:10.025 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.023+0000 7ff153fff640 10 client.4535.objecter ms_dispatch2 0x7ff178000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:10.025 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.023+0000 7ff153fff640 3 client.4535.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:10.025 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.023+0000 7ff153fff640 3 client.4535.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:10.025 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.023+0000 7ff153fff640 20 client.4535.objecter dump_active .. 0 homeless 2026-02-24T19:18:10.029 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.028+0000 7ff153fff640 1 -- 10.20.193.26:0/1884566179 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7ff178159080 con 0x7ff1780b9f80 2026-02-24T19:18:10.029 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.028+0000 7ff153fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:10.029 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.028+0000 7ff153fff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:10.030 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313220 for osd.11 2026-02-24T19:18:10.032 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.031+0000 7ff0427fc640 10 client.?.objecter ms_handle_connect 0x7ff05413d350 2026-02-24T19:18:10.032 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.031+0000 7ff0427fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:10.037 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.036+0000 7f8af8ff9640 1 -- 10.20.193.26:0/4228833030 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1339225180 0 0) 0x7f8afc13b7f0 con 0x7f8afc159e40 2026-02-24T19:18:10.037 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.036+0000 7f8af8ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:18:10.037 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.036+0000 7f8af8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:10.037 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.036+0000 7f8af8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:10.037 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.036+0000 7f8af8ff9640 10 monclient(hunting): my global_id is 4556 2026-02-24T19:18:10.037 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.036+0000 7f8af8ff9640 1 -- 10.20.193.26:0/4228833030 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8acc003610 con 0x7f8afc159e40 2026-02-24T19:18:10.038 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.037+0000 7f059ffff640 1 -- 10.20.193.26:0/4089243475 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 889765180 0 0) 0x7f05c4133670 con 0x7f05c40b91f0 2026-02-24T19:18:10.038 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.037+0000 7f059ffff640 1 -- 10.20.193.26:0/4089243475 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f05c4133950 con 0x7f05c40b91f0 2026-02-24T19:18:10.038 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.037+0000 7f059ffff640 1 -- 10.20.193.26:0/4089243475 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f05b4003060 con 0x7f05c40b91f0 2026-02-24T19:18:10.038 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.037+0000 7f059ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:10.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.037+0000 7f059ffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:10.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.037+0000 7f059ffff640 10 monclient(hunting): dump: 2026-02-24T19:18:10.039 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:10.039 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:10.039 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.039 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.039 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:10.039 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:10.039 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:10.039 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:10.039 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:10.039 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:10.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.037+0000 7f059ffff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:10.040 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.039+0000 7fa7027fc640 1 -- 10.20.193.26:0/2342867036 <== mon.2 v1:10.20.193.103:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 12}]=0 v0) ==== 75+0+12 (unknown 4263375189 0 778662779) 0x7fa71005c660 con 0x7fa7140ba350 2026-02-24T19:18:10.040 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.039+0000 7fa7027fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-24T19:18:10.040 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.039+0000 7fa7027fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:10.041 INFO:teuthology.orchestra.run.trial026.stdout:90194313219 2026-02-24T19:18:10.041 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.040+0000 7f5ede7fc640 1 -- 10.20.193.26:0/3163239507 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2013828401 0 0) 0x7f5ec0003610 con 0x7f5ef0056c70 2026-02-24T19:18:10.041 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.040+0000 7f5ede7fc640 1 -- 10.20.193.26:0/3163239507 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5ef00ac1b0 con 0x7f5ef0056c70 2026-02-24T19:18:10.042 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.040+0000 7f5ede7fc640 1 -- 10.20.193.26:0/3163239507 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f5ee0003350 con 0x7f5ef0056c70 2026-02-24T19:18:10.042 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.040+0000 7f5ede7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:10.042 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.040+0000 7f5ede7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:10.042 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.040+0000 7f5ede7fc640 10 monclient(hunting): dump: 2026-02-24T19:18:10.042 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:10.042 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:10.042 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.042 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.042 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:10.042 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:10.042 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:10.042 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:10.043 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:10.043 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:10.043 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.040+0000 7f5ede7fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:10.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.042+0000 7fa71bd4d640 10 librados: watch_flush enter 2026-02-24T19:18:10.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.042+0000 7fa71bd4d640 10 librados: watch_flush exit 2026-02-24T19:18:10.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.042+0000 7fa71bd4d640 20 client.4517.objecter shutdown clearing up homeless session... 2026-02-24T19:18:10.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.042+0000 7fa71bd4d640 10 client.4517.objecter successfully canceled tick 2026-02-24T19:18:10.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.042+0000 7fa71bd4d640 1 -- 10.20.193.26:0/2342867036 >> v1:10.20.193.162:6800/3889602630 conn(0x7fa6e4077d10 legacy=0x7fa6e40981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.042+0000 7fa71bd4d640 10 monclient: shutdown 2026-02-24T19:18:10.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.042+0000 7fa71bd4d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:10.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.042+0000 7fa71bd4d640 1 -- 10.20.193.26:0/2342867036 >> v1:10.20.193.103:6789/0 conn(0x7fa7140ba350 legacy=0x7fa7141574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.042+0000 7fa71bd4d640 1 -- 10.20.193.26:0/2342867036 shutdown_connections 2026-02-24T19:18:10.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.042+0000 7fa71bd4d640 1 -- 10.20.193.26:0/2342867036 >> 10.20.193.26:0/2342867036 conn(0x7fa7140b7990 msgr2=0x7fa7140b5370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:10.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.042+0000 7fa71bd4d640 1 -- 10.20.193.26:0/2342867036 shutdown_connections 2026-02-24T19:18:10.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.042+0000 7fa71bd4d640 1 -- 10.20.193.26:0/2342867036 wait complete. 2026-02-24T19:18:10.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.042+0000 7fa71bd4d640 1 librados: shutdown 2026-02-24T19:18:10.046 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.043+0000 7fb24ffff640 1 -- 10.20.193.26:0/2865969087 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 38994586 0 0) 0x7fb2741fef50 con 0x7fb2740585e0 2026-02-24T19:18:10.046 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.043+0000 7fb24ffff640 1 -- 10.20.193.26:0/2865969087 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb2741608b0 con 0x7fb2740585e0 2026-02-24T19:18:10.046 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.043+0000 7fb24ffff640 1 -- 10.20.193.26:0/2865969087 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fb260003280 con 0x7fb2740585e0 2026-02-24T19:18:10.046 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.043+0000 7fb24ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:10.046 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.043+0000 7fb24ffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:10.046 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.043+0000 7fb24ffff640 10 monclient(hunting): dump: 2026-02-24T19:18:10.046 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:10.046 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:10.046 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.046 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.047 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:10.047 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:10.047 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:10.047 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:10.047 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:10.047 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:10.047 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.043+0000 7fb24ffff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:10.048 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.044+0000 7f9df3fff640 1 -- 10.20.193.26:0/1835522637 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4147894691 0 0) 0x7f9e180a7ca0 con 0x7f9e18056c70 2026-02-24T19:18:10.048 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.044+0000 7f9df3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:10.048 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.044+0000 7f9df3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:10.048 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.044+0000 7f9df3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:10.048 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.044+0000 7f9df3fff640 10 monclient(hunting): my global_id is 4553 2026-02-24T19:18:10.048 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.044+0000 7f9df3fff640 1 -- 10.20.193.26:0/1835522637 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9de8003610 con 0x7f9e18056c70 2026-02-24T19:18:10.049 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.044+0000 7f8af8ff9640 1 -- 10.20.193.26:0/4228833030 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1931731919 0 0) 0x7f8acc003610 con 0x7f8afc159e40 2026-02-24T19:18:10.049 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.044+0000 7f8af8ff9640 1 -- 10.20.193.26:0/4228833030 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8afc13b7f0 con 0x7f8afc159e40 2026-02-24T19:18:10.049 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.044+0000 7f8af8ff9640 1 -- 10.20.193.26:0/4228833030 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f8af00031b0 con 0x7f8afc159e40 2026-02-24T19:18:10.049 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.044+0000 7f8af8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:10.049 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.044+0000 7f8af8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:10.049 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.044+0000 7f8af8ff9640 10 monclient(hunting): dump: 2026-02-24T19:18:10.049 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:10.049 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:10.049 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.049 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.050 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:10.050 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:10.050 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:10.050 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:10.050 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:10.050 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:10.050 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.044+0000 7f8af8ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:10.050 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.045+0000 7ff6c57fa640 1 -- 10.20.193.26:0/2700680131 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 451108262 0 0) 0x7ff6d0166170 con 0x7ff6d00b9f80 2026-02-24T19:18:10.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.045+0000 7ff6c57fa640 10 monclient(hunting): _negotiate 2026-02-24T19:18:10.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.045+0000 7ff6c57fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:10.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.045+0000 7ff6c57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:10.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.045+0000 7ff6c57fa640 10 monclient(hunting): my global_id is 4559 2026-02-24T19:18:10.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.045+0000 7ff6c57fa640 1 -- 10.20.193.26:0/2700680131 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6a0003610 con 0x7ff6d00b9f80 2026-02-24T19:18:10.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.046+0000 7ff0427fc640 1 -- 10.20.193.26:0/1022253249 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2284843991 0 0) 0x7ff054200680 con 0x7ff05413d350 2026-02-24T19:18:10.052 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.046+0000 7ff0427fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:10.052 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.046+0000 7ff0427fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:10.052 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.046+0000 7ff0427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:10.052 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.046+0000 7ff0427fc640 10 monclient(hunting): my global_id is 4562 2026-02-24T19:18:10.052 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.046+0000 7ff0427fc640 1 -- 10.20.193.26:0/1022253249 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff024003610 con 0x7ff05413d350 2026-02-24T19:18:10.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.12 2026-02-24T19:18:10.067 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.066+0000 7fc74794c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-24T19:18:10.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.066+0000 7fc74794c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-24T19:18:10.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.066+0000 7fc74794c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:10.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.066+0000 7fc74794c640 1 -- 10.20.193.26:0/1730388677 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc74015afd0 con 0x7fc7400b9f80 2026-02-24T19:18:10.140 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.139+0000 7ff6c57fa640 10 client.?.objecter ms_handle_connect 0x7ff6d00ba350 2026-02-24T19:18:10.140 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.139+0000 7ff6c57fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:10.141 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.139+0000 7f9df3fff640 10 client.?.objecter ms_handle_connect 0x7f9e18155b20 2026-02-24T19:18:10.141 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.139+0000 7f9df3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:10.144 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.143+0000 7ff17dc2b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-24T19:18:10.144 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.143+0000 7ff17dc2b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-24T19:18:10.144 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.143+0000 7ff17dc2b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:10.144 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.143+0000 7ff17dc2b640 1 -- 10.20.193.26:0/1884566179 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff17815b710 con 0x7ff1780b9f80 2026-02-24T19:18:10.145 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.143+0000 7f059ffff640 1 -- 10.20.193.26:0/4089243475 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2510381813 0 0) 0x7f0594003610 con 0x7f05c4159b40 2026-02-24T19:18:10.145 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.143+0000 7f059ffff640 1 -- 10.20.193.26:0/4089243475 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f05c4133670 con 0x7f05c4159b40 2026-02-24T19:18:10.145 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.143+0000 7f059ffff640 1 -- 10.20.193.26:0/4089243475 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f05b8003080 con 0x7f05c4159b40 2026-02-24T19:18:10.145 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.143+0000 7f059ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:10.145 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.143+0000 7f059ffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:10.145 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.143+0000 7f059ffff640 10 monclient(hunting): dump: 2026-02-24T19:18:10.145 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:10.145 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:10.145 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.145 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.145 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:10.146 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:10.146 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:10.146 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:10.146 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:10.146 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:10.147 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.144+0000 7fb24ffff640 1 -- 10.20.193.26:0/2865969087 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1792694948 0 0) 0x7fb244003610 con 0x7fb2740b9f80 2026-02-24T19:18:10.147 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.144+0000 7fb24ffff640 1 -- 10.20.193.26:0/2865969087 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb2741fef50 con 0x7fb2740b9f80 2026-02-24T19:18:10.147 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.144+0000 7fb24ffff640 1 -- 10.20.193.26:0/2865969087 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fb264003150 con 0x7fb2740b9f80 2026-02-24T19:18:10.147 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.144+0000 7fb24ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:10.147 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.144+0000 7fb24ffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:10.147 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.144+0000 7fb24ffff640 10 monclient(hunting): dump: 2026-02-24T19:18:10.147 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:10.147 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:10.147 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.147 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.148 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:10.148 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:10.148 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:10.148 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:10.148 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:10.148 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:10.148 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.144+0000 7ff153fff640 1 -- 10.20.193.26:0/1884566179 <== mon.2 v1:10.20.193.103:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 778662779) 0x7ff16805caf0 con 0x7ff1780b9f80 2026-02-24T19:18:10.148 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.144+0000 7ff153fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-24T19:18:10.148 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.144+0000 7ff153fff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:10.149 INFO:teuthology.orchestra.run.trial026.stdout:90194313219 2026-02-24T19:18:10.150 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.146+0000 7ff17dc2b640 10 librados: watch_flush enter 2026-02-24T19:18:10.150 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.146+0000 7ff17dc2b640 10 librados: watch_flush exit 2026-02-24T19:18:10.150 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.146+0000 7ff17dc2b640 20 client.4535.objecter shutdown clearing up homeless session... 2026-02-24T19:18:10.150 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.146+0000 7ff17dc2b640 10 client.4535.objecter successfully canceled tick 2026-02-24T19:18:10.150 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.146+0000 7ff17dc2b640 1 -- 10.20.193.26:0/1884566179 >> v1:10.20.193.162:6800/3889602630 conn(0x7ff148077da0 legacy=0x7ff148098250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.150 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.146+0000 7ff17dc2b640 10 monclient: shutdown 2026-02-24T19:18:10.151 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.146+0000 7ff17dc2b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:10.151 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.146+0000 7ff17dc2b640 1 -- 10.20.193.26:0/1884566179 >> v1:10.20.193.103:6789/0 conn(0x7ff1780b9f80 legacy=0x7ff178155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.151 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.146+0000 7ff17dc2b640 1 -- 10.20.193.26:0/1884566179 shutdown_connections 2026-02-24T19:18:10.151 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.146+0000 7ff17dc2b640 1 -- 10.20.193.26:0/1884566179 >> 10.20.193.26:0/1884566179 conn(0x7ff1780b7990 msgr2=0x7ff1780b7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:10.151 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.146+0000 7ff17dc2b640 1 -- 10.20.193.26:0/1884566179 shutdown_connections 2026-02-24T19:18:10.151 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.146+0000 7ff17dc2b640 1 -- 10.20.193.26:0/1884566179 wait complete. 2026-02-24T19:18:10.151 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.146+0000 7ff17dc2b640 1 librados: shutdown 2026-02-24T19:18:10.151 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.147+0000 7f8af8ff9640 10 client.?.objecter ms_handle_connect 0x7f8afc159a70 2026-02-24T19:18:10.151 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.147+0000 7f8af8ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:10.152 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.147+0000 7f5ede7fc640 10 client.?.objecter ms_handle_connect 0x7f5ef0155b20 2026-02-24T19:18:10.152 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.147+0000 7f5ede7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:10.152 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.148+0000 7ff0427fc640 10 client.?.objecter ms_handle_connect 0x7ff0540b5de0 2026-02-24T19:18:10.152 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.148+0000 7ff0427fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:10.155 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.153+0000 7f7ae27fc640 1 -- 10.20.193.26:0/996126610 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7ae8002fb0 con 0x7f7af4161800 2026-02-24T19:18:10.155 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.153+0000 7f7ae27fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:10.156 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.153+0000 7f7ae27fc640 1 -- 10.20.193.26:0/996126610 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7ae80039d0 con 0x7f7af4161800 2026-02-24T19:18:10.156 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.153+0000 7f7ae27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:10.156 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.153+0000 7f7ae27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:10.156 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.153+0000 7f7ae27fc640 10 monclient: dump: 2026-02-24T19:18:10.156 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:10.156 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:10.156 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.156 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.156 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:10.156 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:10.156 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:10.157 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:10.157 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:10.157 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:10.157 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.153+0000 7f7ae3fff640 4 set_mon_vals no callback set 2026-02-24T19:18:10.157 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.154+0000 7f7ae27fc640 1 -- 10.20.193.26:0/996126610 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f7ae8003bb0 con 0x7f7af4161800 2026-02-24T19:18:10.157 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.155+0000 7f7af9d88640 10 monclient: get_auth_request con 0x7f7ac4077e10 auth_method 0 2026-02-24T19:18:10.158 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.155+0000 7f7ae27fc640 10 client.4533.objecter ms_handle_connect 0x7f7ac4077e10 2026-02-24T19:18:10.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.3 2026-02-24T19:18:10.159 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.157+0000 7f7ae27fc640 1 -- 10.20.193.26:0/996126610 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f7ae8093270 con 0x7f7af4161800 2026-02-24T19:18:10.160 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.157+0000 7f7ae27fc640 10 client.4533.objecter ms_dispatch2 0x7f7af4000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:10.160 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.157+0000 7f7ae27fc640 3 client.4533.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:10.160 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.157+0000 7f7ae27fc640 3 client.4533.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:10.160 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.157+0000 7f7ae27fc640 20 client.4533.objecter dump_active .. 0 homeless 2026-02-24T19:18:10.160 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.157+0000 7f7ae27fc640 1 -- 10.20.193.26:0/996126610 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f7ae805dca0 con 0x7f7af4161800 2026-02-24T19:18:10.160 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.157+0000 7f7ae27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:10.160 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.157+0000 7f7ae27fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:10.163 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.162+0000 7ffb9affd640 1 -- 10.20.193.26:0/735250402 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffba80048d0 con 0x7ffbb40b9f80 2026-02-24T19:18:10.163 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.162+0000 7ffb9affd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:10.163 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.162+0000 7ffb9affd640 1 -- 10.20.193.26:0/735250402 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ffba8004b40 con 0x7ffbb40b9f80 2026-02-24T19:18:10.163 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.162+0000 7ffb9affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:10.163 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.162+0000 7ffb9affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:10.163 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.162+0000 7ffbb8885640 4 set_mon_vals no callback set 2026-02-24T19:18:10.164 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.162+0000 7ffb9affd640 10 monclient: dump: 2026-02-24T19:18:10.164 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:10.164 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:10.164 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.164 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.164 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:10.164 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:10.164 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:10.164 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:10.164 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:10.164 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:10.165 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.162+0000 7ffb9affd640 1 -- 10.20.193.26:0/735250402 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7ffba8004d20 con 0x7ffbb40b9f80 2026-02-24T19:18:10.165 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.163+0000 7ffbba088640 10 monclient: get_auth_request con 0x7ffb84077d90 auth_method 0 2026-02-24T19:18:10.165 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.163+0000 7ffb9affd640 10 client.4542.objecter ms_handle_connect 0x7ffb84077d90 2026-02-24T19:18:10.190 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.189+0000 7f3b2bfff640 1 -- 10.20.193.26:0/1078597095 <== mon.0 v1:10.20.193.26:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+12 (unknown 3207554136 0 778662779) 0x7f3b4005ddb0 con 0x7f3b500b9f80 2026-02-24T19:18:10.190 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.189+0000 7f3b2bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-24T19:18:10.190 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.189+0000 7f3b2bfff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:10.190 INFO:teuthology.orchestra.run.trial026.stdout:90194313219 2026-02-24T19:18:10.192 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.190+0000 7ffb9affd640 1 -- 10.20.193.26:0/735250402 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7ffba80932f0 con 0x7ffbb40b9f80 2026-02-24T19:18:10.192 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.190+0000 7ffb9affd640 10 client.4542.objecter ms_dispatch2 0x7ffbb4000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:10.192 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.190+0000 7ffb9affd640 3 client.4542.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:10.192 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.190+0000 7ffb9affd640 3 client.4542.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:10.192 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.190+0000 7ffb9affd640 20 client.4542.objecter dump_active .. 0 homeless 2026-02-24T19:18:10.192 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.190+0000 7ffb9affd640 1 -- 10.20.193.26:0/735250402 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7ffbb4163930 con 0x7ffbb40b9f80 2026-02-24T19:18:10.192 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.190+0000 7ffb9affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:10.192 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.190+0000 7ffb9affd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:10.194 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.192+0000 7f3b55c16640 10 librados: watch_flush enter 2026-02-24T19:18:10.194 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.192+0000 7f3b55c16640 10 librados: watch_flush exit 2026-02-24T19:18:10.194 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.192+0000 7f3b55c16640 20 client.4497.objecter shutdown clearing up homeless session... 2026-02-24T19:18:10.194 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.192+0000 7f3b55c16640 10 client.4497.objecter successfully canceled tick 2026-02-24T19:18:10.194 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.192+0000 7f3b55c16640 1 -- 10.20.193.26:0/1078597095 >> v1:10.20.193.162:6800/3889602630 conn(0x7f3b20077c50 legacy=0x7f3b20098100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.194 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.192+0000 7f3b55c16640 10 monclient: shutdown 2026-02-24T19:18:10.194 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.192+0000 7f3b55c16640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:10.194 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.192+0000 7f3b55c16640 1 -- 10.20.193.26:0/1078597095 >> v1:10.20.193.26:6789/0 conn(0x7f3b500b9f80 legacy=0x7f3b501fc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.194 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.192+0000 7f3b55c16640 1 -- 10.20.193.26:0/1078597095 shutdown_connections 2026-02-24T19:18:10.194 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.192+0000 7f3b55c16640 1 -- 10.20.193.26:0/1078597095 >> 10.20.193.26:0/1078597095 conn(0x7f3b500b7990 msgr2=0x7f3b500b88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:10.195 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.192+0000 7f3b55c16640 1 -- 10.20.193.26:0/1078597095 shutdown_connections 2026-02-24T19:18:10.195 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.192+0000 7f3b55c16640 1 -- 10.20.193.26:0/1078597095 wait complete. 2026-02-24T19:18:10.195 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.192+0000 7f3b55c16640 1 librados: shutdown 2026-02-24T19:18:10.195 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.193+0000 7f9df3fff640 1 -- 10.20.193.26:0/1835522637 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1414172446 0 0) 0x7f9e180a7f80 con 0x7f9e18155b20 2026-02-24T19:18:10.195 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.193+0000 7f9df3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:10.195 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.193+0000 7f9df3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:10.196 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.193+0000 7f9df3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:10.196 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.193+0000 7f9df3fff640 10 monclient(hunting): my global_id is 4554 2026-02-24T19:18:10.196 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.193+0000 7f9df3fff640 1 -- 10.20.193.26:0/1835522637 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e180a7ca0 con 0x7f9e18155b20 2026-02-24T19:18:10.196 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.195+0000 7ff6c57fa640 1 -- 10.20.193.26:0/2700680131 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 790980352 0 0) 0x7ff6d0165ee0 con 0x7ff6d00ba350 2026-02-24T19:18:10.196 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.195+0000 7ff6c57fa640 10 monclient(hunting): _negotiate 2026-02-24T19:18:10.197 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.195+0000 7ff6c57fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:10.197 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.195+0000 7ff6c57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:10.197 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.195+0000 7ff6c57fa640 10 monclient(hunting): my global_id is 4551 2026-02-24T19:18:10.197 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.195+0000 7ff6c57fa640 1 -- 10.20.193.26:0/2700680131 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6d0166170 con 0x7ff6d00ba350 2026-02-24T19:18:10.197 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.195+0000 7ff0427fc640 1 -- 10.20.193.26:0/1022253249 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2691480678 0 0) 0x7ff0541667f0 con 0x7ff0540b5de0 2026-02-24T19:18:10.197 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.195+0000 7ff0427fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:10.197 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.195+0000 7ff0427fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:10.197 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.195+0000 7ff0427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:10.198 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.195+0000 7ff0427fc640 10 monclient(hunting): my global_id is 4560 2026-02-24T19:18:10.198 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.195+0000 7ff0427fc640 1 -- 10.20.193.26:0/1022253249 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff054200680 con 0x7ff0540b5de0 2026-02-24T19:18:10.200 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.199+0000 7f8af8ff9640 1 -- 10.20.193.26:0/4228833030 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1595431871 0 0) 0x7f8afc13c090 con 0x7f8afc159a70 2026-02-24T19:18:10.200 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.199+0000 7f8af8ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:18:10.200 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.199+0000 7f8af8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:10.200 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.199+0000 7f8af8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:10.200 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.199+0000 7f8af8ff9640 10 monclient(hunting): my global_id is 4557 2026-02-24T19:18:10.200 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.199+0000 7f8af8ff9640 1 -- 10.20.193.26:0/4228833030 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8acc003610 con 0x7f8afc159a70 2026-02-24T19:18:10.201 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.199+0000 7f5ede7fc640 1 -- 10.20.193.26:0/3163239507 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3554274847 0 0) 0x7f5ef01fec90 con 0x7f5ef0155b20 2026-02-24T19:18:10.201 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.199+0000 7f5ede7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:10.201 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.199+0000 7f5ede7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:10.201 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.199+0000 7f5ede7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:10.201 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.199+0000 7f5ede7fc640 10 monclient(hunting): my global_id is 4563 2026-02-24T19:18:10.201 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.199+0000 7f5ede7fc640 1 -- 10.20.193.26:0/3163239507 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ec0003610 con 0x7f5ef0155b20 2026-02-24T19:18:10.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.8 2026-02-24T19:18:10.206 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.205+0000 7fc72dffb640 1 -- 10.20.193.26:0/1730388677 <== mon.0 v1:10.20.193.26:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 778662779) 0x7fc73405d680 con 0x7fc7400b9f80 2026-02-24T19:18:10.206 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.205+0000 7fc72dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-24T19:18:10.207 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.205+0000 7fc72dffb640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:10.207 INFO:teuthology.orchestra.run.trial026.stdout:90194313219 2026-02-24T19:18:10.209 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7ff0427fc640 1 -- 10.20.193.26:0/1022253249 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1802607549 0 0) 0x7ff054200680 con 0x7ff0540b5de0 2026-02-24T19:18:10.209 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7ff0427fc640 1 -- 10.20.193.26:0/1022253249 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff0541667f0 con 0x7ff0540b5de0 2026-02-24T19:18:10.209 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7ff0427fc640 1 -- 10.20.193.26:0/1022253249 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ff0440030b0 con 0x7ff0540b5de0 2026-02-24T19:18:10.209 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7ff0427fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:10.209 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7ff0427fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:10.210 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7ff0427fc640 10 monclient(hunting): dump: 2026-02-24T19:18:10.210 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:10.210 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:10.210 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.210 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.210 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:10.210 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:10.210 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:10.210 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:10.210 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:10.210 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:10.210 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7ff0427fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:10.211 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7f059ffff640 1 -- 10.20.193.26:0/4089243475 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1686045101 0 0) 0x7f05c4133670 con 0x7f05c4159b40 2026-02-24T19:18:10.211 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7f059ffff640 1 -- 10.20.193.26:0/4089243475 >> v1:10.20.193.103:6789/0 conn(0x7f05c40b91f0 legacy=0x7f05c40b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.211 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7f059ffff640 1 -- 10.20.193.26:0/4089243475 >> v1:10.20.193.70:6789/0 conn(0x7f05c4057500 legacy=0x7f05c4164e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.212 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7f059ffff640 10 monclient: _finish_hunting 0 2026-02-24T19:18:10.212 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7f059ffff640 1 monclient: found mon.a 2026-02-24T19:18:10.212 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7f059ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:10.212 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7f059ffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:10.212 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7f059ffff640 1 -- 10.20.193.26:0/4089243475 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c4133c30 con 0x7f05c4159b40 2026-02-24T19:18:10.212 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7f059ffff640 10 monclient: _finish_auth 0 2026-02-24T19:18:10.212 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7f059ffff640 10 monclient: _check_auth_tickets 2026-02-24T19:18:10.212 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7f059ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:10.212 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7f05c8e16640 5 monclient: authenticate success, global_id 4539 2026-02-24T19:18:10.212 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7f05c8e16640 10 monclient: _renew_subs 2026-02-24T19:18:10.212 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7f05c8e16640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:10.212 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7f05c8e16640 1 -- 10.20.193.26:0/4089243475 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f05c4164600 con 0x7f05c4159b40 2026-02-24T19:18:10.213 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7f05c8e16640 10 client.4539.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:10.213 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7f05c8e16640 10 monclient: _renew_subs 2026-02-24T19:18:10.213 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7f05c8e16640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:10.213 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7f05c8e16640 1 -- 10.20.193.26:0/4089243475 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f05c4165510 con 0x7f05c4159b40 2026-02-24T19:18:10.213 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7f05c8e16640 1 librados: init done 2026-02-24T19:18:10.214 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7fc74794c640 10 librados: watch_flush enter 2026-02-24T19:18:10.214 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7fc74794c640 10 librados: watch_flush exit 2026-02-24T19:18:10.214 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7fc74794c640 20 client.4536.objecter shutdown clearing up homeless session... 2026-02-24T19:18:10.214 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7fc74794c640 10 client.4536.objecter successfully canceled tick 2026-02-24T19:18:10.214 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7fc74794c640 1 -- 10.20.193.26:0/1730388677 >> v1:10.20.193.162:6800/3889602630 conn(0x7fc710077d50 legacy=0x7fc710098200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.214 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7fc74794c640 10 monclient: shutdown 2026-02-24T19:18:10.214 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7fc74794c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:10.215 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7fc74794c640 1 -- 10.20.193.26:0/1730388677 >> v1:10.20.193.26:6789/0 conn(0x7fc7400b9f80 legacy=0x7fc740162410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.215 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7fc74794c640 1 -- 10.20.193.26:0/1730388677 shutdown_connections 2026-02-24T19:18:10.215 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7fc74794c640 1 -- 10.20.193.26:0/1730388677 >> 10.20.193.26:0/1730388677 conn(0x7fc7400b7990 msgr2=0x7fc74015b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:10.215 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7fc74794c640 1 -- 10.20.193.26:0/1730388677 shutdown_connections 2026-02-24T19:18:10.215 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7fc74794c640 1 -- 10.20.193.26:0/1730388677 wait complete. 2026-02-24T19:18:10.215 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7fc74794c640 1 librados: shutdown 2026-02-24T19:18:10.215 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7f05c8e16640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:10.216 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7f05c8e16640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:10.216 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7f05c8e16640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:10.216 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.208+0000 7f05c8e16640 1 -- 10.20.193.26:0/4089243475 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05c41643f0 con 0x7f05c4159b40 2026-02-24T19:18:10.217 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.209+0000 7f9df3fff640 1 -- 10.20.193.26:0/1835522637 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 547884134 0 0) 0x7f9e180a7ca0 con 0x7f9e18155b20 2026-02-24T19:18:10.217 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.209+0000 7f9df3fff640 1 -- 10.20.193.26:0/1835522637 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9e180a7f80 con 0x7f9e18155b20 2026-02-24T19:18:10.217 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.209+0000 7f9df3fff640 1 -- 10.20.193.26:0/1835522637 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9e08002ed0 con 0x7f9e18155b20 2026-02-24T19:18:10.217 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.209+0000 7f9df3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:10.217 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.209+0000 7f9df3fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:10.217 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.209+0000 7f9df3fff640 10 monclient(hunting): dump: 2026-02-24T19:18:10.217 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:10.217 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:10.217 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.217 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.217 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:10.218 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:10.218 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:10.218 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:10.218 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:10.218 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:10.218 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.209+0000 7f9df3fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:10.218 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.214+0000 7ff6c57fa640 1 -- 10.20.193.26:0/2700680131 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4050477427 0 0) 0x7ff6d0166170 con 0x7ff6d00ba350 2026-02-24T19:18:10.219 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.214+0000 7ff6c57fa640 1 -- 10.20.193.26:0/2700680131 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff6d0165ee0 con 0x7ff6d00ba350 2026-02-24T19:18:10.219 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.214+0000 7ff6c57fa640 1 -- 10.20.193.26:0/2700680131 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ff6cc003600 con 0x7ff6d00ba350 2026-02-24T19:18:10.219 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.214+0000 7ff6c57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:10.219 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.214+0000 7ff6c57fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:10.219 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.214+0000 7ff6c57fa640 10 monclient(hunting): dump: 2026-02-24T19:18:10.219 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:10.219 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:10.219 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.219 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.219 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:10.219 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:10.220 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:10.220 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:10.220 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:10.220 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:10.220 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.214+0000 7ff6c57fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:10.221 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7ff0427fc640 1 -- 10.20.193.26:0/1022253249 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4103738639 0 0) 0x7ff0541667f0 con 0x7ff0540b5de0 2026-02-24T19:18:10.221 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7ff0427fc640 1 -- 10.20.193.26:0/1022253249 >> v1:10.20.193.103:6789/0 conn(0x7ff05413d350 legacy=0x7ff05413edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.221 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7ff0427fc640 1 -- 10.20.193.26:0/1022253249 >> v1:10.20.193.70:6789/0 conn(0x7ff0541617a0 legacy=0x7ff0541660e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.221 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7ff0427fc640 10 monclient: _finish_hunting 0 2026-02-24T19:18:10.221 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7ff0427fc640 1 monclient: found mon.a 2026-02-24T19:18:10.221 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7ff0427fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:10.222 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7ff0427fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:10.222 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7ff0427fc640 1 -- 10.20.193.26:0/1022253249 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff05413c870 con 0x7ff0540b5de0 2026-02-24T19:18:10.222 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7ff0427fc640 10 monclient: _finish_auth 0 2026-02-24T19:18:10.222 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7ff0427fc640 10 monclient: _check_auth_tickets 2026-02-24T19:18:10.222 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7ff0427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:10.222 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7ff05bf8a640 5 monclient: authenticate success, global_id 4560 2026-02-24T19:18:10.222 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7ff05bf8a640 10 monclient: _renew_subs 2026-02-24T19:18:10.222 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7ff05bf8a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:10.222 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7ff05bf8a640 1 -- 10.20.193.26:0/1022253249 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff05413cb50 con 0x7ff0540b5de0 2026-02-24T19:18:10.222 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7ff05bf8a640 10 client.4560.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:10.222 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7ff05bf8a640 10 monclient: _renew_subs 2026-02-24T19:18:10.222 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7ff05bf8a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:10.223 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7ff05bf8a640 1 -- 10.20.193.26:0/1022253249 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff05413f4e0 con 0x7ff0540b5de0 2026-02-24T19:18:10.223 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7ff05bf8a640 1 librados: init done 2026-02-24T19:18:10.223 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7fb24ffff640 1 -- 10.20.193.26:0/2865969087 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 434908797 0 0) 0x7fb2741fef50 con 0x7fb2740b9f80 2026-02-24T19:18:10.224 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7fb24ffff640 1 -- 10.20.193.26:0/2865969087 >> v1:10.20.193.103:6789/0 conn(0x7fb2740585e0 legacy=0x7fb27415daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.224 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7fb24ffff640 1 -- 10.20.193.26:0/2865969087 >> v1:10.20.193.70:6789/0 conn(0x7fb2740ba350 legacy=0x7fb2741619c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.224 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7fb24ffff640 10 monclient: _finish_hunting 0 2026-02-24T19:18:10.224 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7fb24ffff640 1 monclient: found mon.a 2026-02-24T19:18:10.224 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7fb24ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:10.224 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7fb24ffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:10.224 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7fb24ffff640 1 -- 10.20.193.26:0/2865969087 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb274160b90 con 0x7fb2740b9f80 2026-02-24T19:18:10.224 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7fb24ffff640 10 monclient: _finish_auth 0 2026-02-24T19:18:10.224 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7fb24ffff640 10 monclient: _check_auth_tickets 2026-02-24T19:18:10.224 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7fb24ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:10.224 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7fb27a110640 5 monclient: authenticate success, global_id 4548 2026-02-24T19:18:10.224 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7fb27a110640 10 monclient: _renew_subs 2026-02-24T19:18:10.225 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7fb27a110640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:10.225 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7fb27a110640 1 -- 10.20.193.26:0/2865969087 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb2741611c0 con 0x7fb2740b9f80 2026-02-24T19:18:10.225 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7fb27a110640 10 client.4548.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:10.225 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7fb27a110640 10 monclient: _renew_subs 2026-02-24T19:18:10.225 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7fb27a110640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:10.225 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7fb27a110640 1 -- 10.20.193.26:0/2865969087 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb2741ff340 con 0x7fb2740b9f80 2026-02-24T19:18:10.225 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7fb27a110640 1 librados: init done 2026-02-24T19:18:10.225 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7ff05bf8a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:10.226 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7ff05bf8a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:10.226 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7ff05bf8a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:10.226 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.217+0000 7ff05bf8a640 1 -- 10.20.193.26:0/1022253249 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0540ae710 con 0x7ff0540b5de0 2026-02-24T19:18:10.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.218+0000 7fb27a110640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:10.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.218+0000 7fb27a110640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:10.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.218+0000 7fb27a110640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:10.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.218+0000 7fb27a110640 1 -- 10.20.193.26:0/2865969087 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb274160dd0 con 0x7fb2740b9f80 2026-02-24T19:18:10.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.0 2026-02-24T19:18:10.228 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.218+0000 7f8af8ff9640 1 -- 10.20.193.26:0/4228833030 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1336658748 0 0) 0x7f8acc003610 con 0x7f8afc159a70 2026-02-24T19:18:10.228 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.218+0000 7f8af8ff9640 1 -- 10.20.193.26:0/4228833030 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8afc13c090 con 0x7f8afc159a70 2026-02-24T19:18:10.228 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.218+0000 7f8af8ff9640 1 -- 10.20.193.26:0/4228833030 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f8aec003060 con 0x7f8afc159a70 2026-02-24T19:18:10.228 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.218+0000 7f8af8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:10.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.218+0000 7f8af8ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:10.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.218+0000 7f8af8ff9640 10 monclient(hunting): dump: 2026-02-24T19:18:10.229 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:10.229 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:10.229 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.229 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.229 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:10.229 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:10.229 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:10.229 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:10.229 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:10.229 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:10.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.218+0000 7f5ede7fc640 1 -- 10.20.193.26:0/3163239507 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 104282592 0 0) 0x7f5ec0003610 con 0x7f5ef0155b20 2026-02-24T19:18:10.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.218+0000 7f5ede7fc640 1 -- 10.20.193.26:0/3163239507 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5ef01fec90 con 0x7f5ef0155b20 2026-02-24T19:18:10.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.218+0000 7f5ede7fc640 1 -- 10.20.193.26:0/3163239507 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f5ee4002fc0 con 0x7f5ef0155b20 2026-02-24T19:18:10.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.218+0000 7f5ede7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:10.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.218+0000 7f5ede7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:10.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.218+0000 7f5ede7fc640 10 monclient(hunting): dump: 2026-02-24T19:18:10.231 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:10.231 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:10.231 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.231 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.231 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:10.231 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:10.231 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:10.232 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:10.232 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:10.232 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:10.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f5ede7fc640 1 -- 10.20.193.26:0/3163239507 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1186002572 0 0) 0x7f5ef00ac1b0 con 0x7f5ef0056c70 2026-02-24T19:18:10.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f5ede7fc640 1 -- 10.20.193.26:0/3163239507 >> v1:10.20.193.70:6789/0 conn(0x7f5ef0162f10 legacy=0x7f5ef00a8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f5ede7fc640 1 -- 10.20.193.26:0/3163239507 >> v1:10.20.193.26:6789/0 conn(0x7f5ef0155b20 legacy=0x7f5ef00ab300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f5ede7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:18:10.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f5ede7fc640 1 monclient: found mon.c 2026-02-24T19:18:10.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f5ede7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:10.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f5ede7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:10.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f5ede7fc640 1 -- 10.20.193.26:0/3163239507 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef00ac490 con 0x7f5ef0056c70 2026-02-24T19:18:10.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f5ede7fc640 10 monclient: _finish_auth 0 2026-02-24T19:18:10.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f5ede7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:18:10.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f5ede7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:10.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f5ef7b8a640 5 monclient: authenticate success, global_id 4550 2026-02-24T19:18:10.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f5ef7b8a640 10 monclient: _renew_subs 2026-02-24T19:18:10.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f5ef7b8a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:10.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f5ef7b8a640 1 -- 10.20.193.26:0/3163239507 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5ef00ac770 con 0x7f5ef0056c70 2026-02-24T19:18:10.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f5ef7b8a640 10 client.4550.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:10.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f5ef7b8a640 10 monclient: _renew_subs 2026-02-24T19:18:10.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f5ef7b8a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:10.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f5ef7b8a640 1 -- 10.20.193.26:0/3163239507 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5ef00aba10 con 0x7f5ef0056c70 2026-02-24T19:18:10.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f5ef7b8a640 1 librados: init done 2026-02-24T19:18:10.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f8af8ff9640 1 -- 10.20.193.26:0/4228833030 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 917569358 0 0) 0x7f8afc13b7f0 con 0x7f8afc159e40 2026-02-24T19:18:10.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f8af8ff9640 1 -- 10.20.193.26:0/4228833030 >> v1:10.20.193.70:6789/0 conn(0x7f8afc058070 legacy=0x7f8afc13af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f8af8ff9640 1 -- 10.20.193.26:0/4228833030 >> v1:10.20.193.26:6789/0 conn(0x7f8afc159a70 legacy=0x7f8afc13cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f8af8ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:18:10.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f8af8ff9640 1 monclient: found mon.c 2026-02-24T19:18:10.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f8af8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:10.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f8af8ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:10.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f8af8ff9640 1 -- 10.20.193.26:0/4228833030 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8afc13bad0 con 0x7f8afc159e40 2026-02-24T19:18:10.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f8af8ff9640 10 monclient: _finish_auth 0 2026-02-24T19:18:10.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f8af8ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:18:10.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f8af8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:10.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f8b0296b640 5 monclient: authenticate success, global_id 4556 2026-02-24T19:18:10.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f8b0296b640 10 monclient: _renew_subs 2026-02-24T19:18:10.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f8b0296b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:10.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.219+0000 7f8b0296b640 1 -- 10.20.193.26:0/4228833030 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8afc13bdb0 con 0x7f8afc159e40 2026-02-24T19:18:10.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.220+0000 7f8b0296b640 10 client.4556.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:10.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.220+0000 7f8b0296b640 10 monclient: _renew_subs 2026-02-24T19:18:10.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.220+0000 7f8b0296b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:10.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.220+0000 7f8b0296b640 1 -- 10.20.193.26:0/4228833030 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8afc13d2a0 con 0x7f8afc159e40 2026-02-24T19:18:10.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.220+0000 7f8b0296b640 1 librados: init done 2026-02-24T19:18:10.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.220+0000 7f5ef7b8a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:10.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.220+0000 7f5ef7b8a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:10.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.220+0000 7f5ef7b8a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:10.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.220+0000 7f5ef7b8a640 1 -- 10.20.193.26:0/3163239507 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ef015cc30 con 0x7f5ef0056c70 2026-02-24T19:18:10.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.220+0000 7f8b0296b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:10.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.220+0000 7f8b0296b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:10.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.220+0000 7f8b0296b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:10.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.220+0000 7f8b0296b640 1 -- 10.20.193.26:0/4228833030 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8afc161660 con 0x7f8afc159e40 2026-02-24T19:18:10.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.223+0000 7f9df3fff640 1 -- 10.20.193.26:0/1835522637 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1209586895 0 0) 0x7f9de8003610 con 0x7f9e18056c70 2026-02-24T19:18:10.237 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.223+0000 7f9df3fff640 1 -- 10.20.193.26:0/1835522637 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9e180a7ca0 con 0x7f9e18056c70 2026-02-24T19:18:10.237 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.223+0000 7f9df3fff640 1 -- 10.20.193.26:0/1835522637 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9e04003350 con 0x7f9e18056c70 2026-02-24T19:18:10.237 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.223+0000 7f9df3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:10.237 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.223+0000 7f9df3fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:10.237 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.223+0000 7f9df3fff640 10 monclient(hunting): dump: 2026-02-24T19:18:10.237 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:10.237 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:10.237 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.237 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.237 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:10.237 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:10.237 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:10.237 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:10.237 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:10.237 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:10.238 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.226+0000 7ff6c57fa640 1 -- 10.20.193.26:0/2700680131 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4200973952 0 0) 0x7ff6a0003610 con 0x7ff6d00b9f80 2026-02-24T19:18:10.238 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.226+0000 7ff6c57fa640 1 -- 10.20.193.26:0/2700680131 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff6d0166170 con 0x7ff6d00b9f80 2026-02-24T19:18:10.238 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.226+0000 7ff6c57fa640 1 -- 10.20.193.26:0/2700680131 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ff6b8003350 con 0x7ff6d00b9f80 2026-02-24T19:18:10.238 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.226+0000 7ff6c57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:10.238 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.226+0000 7ff6c57fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:10.238 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.226+0000 7ff6c57fa640 10 monclient(hunting): dump: 2026-02-24T19:18:10.238 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:10.238 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:10.238 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.238 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.238 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:10.238 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:10.238 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:10.239 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:10.239 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:10.239 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:10.239 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.227+0000 7f8af8ff9640 1 -- 10.20.193.26:0/4228833030 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8af0003830 con 0x7f8afc159e40 2026-02-24T19:18:10.239 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.227+0000 7f8af8ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:10.239 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.227+0000 7f8afa7fc640 4 set_mon_vals no callback set 2026-02-24T19:18:10.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.227+0000 7f9df3fff640 1 -- 10.20.193.26:0/1835522637 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2875596559 0 0) 0x7f9e180a8230 con 0x7f9e18162f10 2026-02-24T19:18:10.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.227+0000 7f9df3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:10.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.227+0000 7f9df3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:10.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.227+0000 7f9df3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:10.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.227+0000 7f9df3fff640 10 monclient(hunting): my global_id is 4534 2026-02-24T19:18:10.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.227+0000 7f9df3fff640 1 -- 10.20.193.26:0/1835522637 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9de8003610 con 0x7f9e18162f10 2026-02-24T19:18:10.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.228+0000 7ff6c57fa640 1 -- 10.20.193.26:0/2700680131 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1608029248 0 0) 0x7ff6d0156d30 con 0x7ff6d00585e0 2026-02-24T19:18:10.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.228+0000 7ff6c57fa640 10 monclient(hunting): _negotiate 2026-02-24T19:18:10.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.228+0000 7ff6c57fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:10.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.228+0000 7ff6c57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:10.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.228+0000 7ff6c57fa640 10 monclient(hunting): my global_id is 4537 2026-02-24T19:18:10.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.228+0000 7ff6c57fa640 1 -- 10.20.193.26:0/2700680131 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6a0003610 con 0x7ff6d00585e0 2026-02-24T19:18:10.241 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.231+0000 7f5ede7fc640 1 -- 10.20.193.26:0/3163239507 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5ee0003000 con 0x7f5ef0056c70 2026-02-24T19:18:10.241 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.231+0000 7f5ede7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:10.241 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.231+0000 7f5ede7fc640 1 -- 10.20.193.26:0/3163239507 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f5ee0003bf0 con 0x7f5ef0056c70 2026-02-24T19:18:10.241 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.231+0000 7f5ede7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:10.241 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.231+0000 7f5ede7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:10.241 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.231+0000 7f5ede7fc640 10 monclient: dump: 2026-02-24T19:18:10.241 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:10.241 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:10.242 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.242 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.242 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:10.242 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:10.242 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:10.242 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:10.242 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:10.242 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:10.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.231+0000 7f5edffff640 4 set_mon_vals no callback set 2026-02-24T19:18:10.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.231+0000 7f5ede7fc640 1 -- 10.20.193.26:0/3163239507 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f5ee001ca60 con 0x7f5ef0056c70 2026-02-24T19:18:10.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.232+0000 7f5ef50fe640 10 monclient: get_auth_request con 0x7f5ec0077d10 auth_method 0 2026-02-24T19:18:10.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.232+0000 7f5ede7fc640 10 client.4550.objecter ms_handle_connect 0x7f5ec0077d10 2026-02-24T19:18:10.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.233+0000 7f8af8ff9640 1 -- 10.20.193.26:0/4228833030 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f8af0004c50 con 0x7f8afc159e40 2026-02-24T19:18:10.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.233+0000 7f8af8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:10.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.233+0000 7f8af8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:10.243 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.233+0000 7ff6c57fa640 1 -- 10.20.193.26:0/2700680131 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3755366917 0 0) 0x7ff6a0003610 con 0x7ff6d00585e0 2026-02-24T19:18:10.243 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.233+0000 7ff6c57fa640 1 -- 10.20.193.26:0/2700680131 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff6d0156d30 con 0x7ff6d00585e0 2026-02-24T19:18:10.243 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.233+0000 7ff6c57fa640 1 -- 10.20.193.26:0/2700680131 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ff6c0003100 con 0x7ff6d00585e0 2026-02-24T19:18:10.243 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.233+0000 7ff6c57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:10.243 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.233+0000 7f8af8ff9640 10 monclient: dump: 2026-02-24T19:18:10.243 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:10.243 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:10.243 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.243 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.243 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:10.243 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:10.244 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:10.244 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:10.244 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:10.244 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:10.244 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.233+0000 7ff6c57fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:10.244 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.233+0000 7ff6c57fa640 10 monclient(hunting): dump: 2026-02-24T19:18:10.244 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:10.244 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:10.244 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.244 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.244 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:10.244 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:10.244 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:10.244 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:10.244 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:10.244 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:10.245 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.233+0000 7f9df3fff640 1 -- 10.20.193.26:0/1835522637 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 713926383 0 0) 0x7f9de8003610 con 0x7f9e18162f10 2026-02-24T19:18:10.245 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.233+0000 7f9df3fff640 1 -- 10.20.193.26:0/1835522637 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9e180a8230 con 0x7f9e18162f10 2026-02-24T19:18:10.245 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.233+0000 7f9df3fff640 1 -- 10.20.193.26:0/1835522637 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9e0c003420 con 0x7f9e18162f10 2026-02-24T19:18:10.245 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.233+0000 7f9df3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:10.245 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.233+0000 7f9df3fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:10.245 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.233+0000 7f9df3fff640 10 monclient(hunting): dump: 2026-02-24T19:18:10.245 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:10.245 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:10.245 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.245 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.245 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:10.245 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:10.245 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:10.245 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:10.246 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:10.246 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:10.246 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.236+0000 7ff6c57fa640 1 -- 10.20.193.26:0/2700680131 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3075114445 0 0) 0x7ff6d0156d30 con 0x7ff6d00585e0 2026-02-24T19:18:10.246 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.236+0000 7ff6c57fa640 1 -- 10.20.193.26:0/2700680131 >> v1:10.20.193.103:6789/0 conn(0x7ff6d00b9f80 legacy=0x7ff6d0156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.246 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.236+0000 7ff6c57fa640 1 -- 10.20.193.26:0/2700680131 >> v1:10.20.193.26:6789/0 conn(0x7ff6d00ba350 legacy=0x7ff6d01645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.246 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.236+0000 7ff6c57fa640 10 monclient: _finish_hunting 0 2026-02-24T19:18:10.246 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.236+0000 7ff6c57fa640 1 monclient: found mon.b 2026-02-24T19:18:10.246 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.236+0000 7ff6c57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:10.246 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.236+0000 7ff6c57fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:10.246 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.236+0000 7ff6c57fa640 1 -- 10.20.193.26:0/2700680131 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d0166450 con 0x7ff6d00585e0 2026-02-24T19:18:10.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.236+0000 7ff6c57fa640 10 monclient: _finish_auth 0 2026-02-24T19:18:10.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.236+0000 7ff6c57fa640 10 monclient: _check_auth_tickets 2026-02-24T19:18:10.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.236+0000 7ff6c57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:10.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.236+0000 7ff6d6b45640 5 monclient: authenticate success, global_id 4537 2026-02-24T19:18:10.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.236+0000 7ff6d6b45640 10 monclient: _renew_subs 2026-02-24T19:18:10.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.236+0000 7ff6d6b45640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:10.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.236+0000 7ff6d6b45640 1 -- 10.20.193.26:0/2700680131 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff6d01fb2e0 con 0x7ff6d00585e0 2026-02-24T19:18:10.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.236+0000 7ff6d6b45640 10 client.4537.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:10.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.236+0000 7ff6d6b45640 10 monclient: _renew_subs 2026-02-24T19:18:10.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.236+0000 7ff6d6b45640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:10.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.236+0000 7ff6d6b45640 1 -- 10.20.193.26:0/2700680131 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff6d01fb8a0 con 0x7ff6d00585e0 2026-02-24T19:18:10.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.236+0000 7ff6d6b45640 1 librados: init done 2026-02-24T19:18:10.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.236+0000 7f9df3fff640 1 -- 10.20.193.26:0/1835522637 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2068700027 0 0) 0x7f9e180a8230 con 0x7f9e18162f10 2026-02-24T19:18:10.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.237+0000 7f9df3fff640 1 -- 10.20.193.26:0/1835522637 >> v1:10.20.193.103:6789/0 conn(0x7f9e18056c70 legacy=0x7f9e180abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.237+0000 7f9df3fff640 1 -- 10.20.193.26:0/1835522637 >> v1:10.20.193.26:6789/0 conn(0x7f9e18155b20 legacy=0x7f9e180a6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.237+0000 7f9df3fff640 10 monclient: _finish_hunting 0 2026-02-24T19:18:10.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.237+0000 7f9df3fff640 1 monclient: found mon.b 2026-02-24T19:18:10.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.237+0000 7f9df3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:10.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.237+0000 7f9df3fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:10.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.237+0000 7f9df3fff640 1 -- 10.20.193.26:0/1835522637 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e180a84d0 con 0x7f9e18162f10 2026-02-24T19:18:10.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.237+0000 7f9df3fff640 10 monclient: _finish_auth 0 2026-02-24T19:18:10.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.237+0000 7f9df3fff640 10 monclient: _check_auth_tickets 2026-02-24T19:18:10.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.237+0000 7f9df3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:10.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.237+0000 7f9e1de7b640 5 monclient: authenticate success, global_id 4534 2026-02-24T19:18:10.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.237+0000 7f9e1de7b640 10 monclient: _renew_subs 2026-02-24T19:18:10.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.237+0000 7f9e1de7b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:10.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.237+0000 7f9e1de7b640 1 -- 10.20.193.26:0/1835522637 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9e180a87b0 con 0x7f9e18162f10 2026-02-24T19:18:10.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.237+0000 7f9e1de7b640 10 client.4534.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:10.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.237+0000 7f9e1de7b640 10 monclient: _renew_subs 2026-02-24T19:18:10.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.237+0000 7f9e1de7b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:10.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.237+0000 7f9e1de7b640 1 -- 10.20.193.26:0/1835522637 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9e180a96c0 con 0x7f9e18162f10 2026-02-24T19:18:10.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.237+0000 7f9e1de7b640 1 librados: init done 2026-02-24T19:18:10.249 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.237+0000 7ff6d6b45640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:10.249 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.237+0000 7ff6d6b45640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:10.249 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.237+0000 7ff6d6b45640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:10.249 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.237+0000 7ff6d6b45640 1 -- 10.20.193.26:0/2700680131 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6d00b6c80 con 0x7ff6d00585e0 2026-02-24T19:18:10.249 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.237+0000 7f9e1de7b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:10.249 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.237+0000 7f9e1de7b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:10.249 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.237+0000 7f9e1de7b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:10.249 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.237+0000 7f9e1de7b640 1 -- 10.20.193.26:0/1835522637 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e18154f80 con 0x7f9e18162f10 2026-02-24T19:18:10.250 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.249+0000 7f9df3fff640 1 -- 10.20.193.26:0/1835522637 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9e0c003a80 con 0x7f9e18162f10 2026-02-24T19:18:10.250 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.249+0000 7f9df3fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:10.250 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.249+0000 7f9df3fff640 1 -- 10.20.193.26:0/1835522637 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9e0c003e50 con 0x7f9e18162f10 2026-02-24T19:18:10.250 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.249+0000 7f9df3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:10.250 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.249+0000 7f9df3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:10.250 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.249+0000 7f9df3fff640 10 monclient: dump: 2026-02-24T19:18:10.251 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:10.251 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:10.251 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.251 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.251 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:10.251 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:10.251 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:10.251 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:10.251 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:10.251 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:10.251 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.249+0000 7f9e15ffb640 4 set_mon_vals no callback set 2026-02-24T19:18:10.251 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.250+0000 7f9df3fff640 1 -- 10.20.193.26:0/1835522637 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f9e0c003e50 con 0x7f9e18162f10 2026-02-24T19:18:10.252 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.251+0000 7f9e177fe640 10 monclient: get_auth_request con 0x7f9de8077f10 auth_method 0 2026-02-24T19:18:10.252 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.251+0000 7f9df3fff640 10 client.4534.objecter ms_handle_connect 0x7f9de8077f10 2026-02-24T19:18:10.268 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.267+0000 7f7afc013640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-24T19:18:10.268 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.267+0000 7f7afc013640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-24T19:18:10.268 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.267+0000 7f7afc013640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:10.268 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.267+0000 7f7afc013640 1 -- 10.20.193.26:0/996126610 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f7af41608c0 con 0x7f7af4161800 2026-02-24T19:18:10.302 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.301+0000 7ffbbc313640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-24T19:18:10.302 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.301+0000 7ffbbc313640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-24T19:18:10.302 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.301+0000 7ffbbc313640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:10.302 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.301+0000 7ffbbc313640 1 -- 10.20.193.26:0/735250402 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ffbb4157dc0 con 0x7ffbb40b9f80 2026-02-24T19:18:10.335 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.334+0000 7f9df3fff640 1 -- 10.20.193.26:0/1835522637 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f9e0c0934b0 con 0x7f9e18162f10 2026-02-24T19:18:10.336 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.334+0000 7f9df3fff640 10 client.4534.objecter ms_dispatch2 0x7f9e18000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:10.336 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.334+0000 7f9df3fff640 3 client.4534.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:10.336 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.334+0000 7f9df3fff640 3 client.4534.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:10.336 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.335+0000 7f9df3fff640 20 client.4534.objecter dump_active .. 0 homeless 2026-02-24T19:18:10.340 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.338+0000 7ff6c57fa640 1 -- 10.20.193.26:0/2700680131 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff6c0003700 con 0x7ff6d00585e0 2026-02-24T19:18:10.340 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.338+0000 7ff6c57fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:10.340 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.338+0000 7ff6c57fa640 1 -- 10.20.193.26:0/2700680131 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ff6c0003ad0 con 0x7ff6d00585e0 2026-02-24T19:18:10.340 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.338+0000 7ff6c57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:10.340 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.338+0000 7ff6c57fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:10.340 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.338+0000 7ff6c57fa640 10 monclient: dump: 2026-02-24T19:18:10.340 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:10.340 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:10.340 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.340 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.340 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:10.341 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:10.341 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:10.341 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:10.341 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:10.341 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:10.341 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.338+0000 7ff6c6ffd640 4 set_mon_vals no callback set 2026-02-24T19:18:10.342 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.339+0000 7ff6c57fa640 1 -- 10.20.193.26:0/2700680131 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7ff6c0003cb0 con 0x7ff6d00585e0 2026-02-24T19:18:10.342 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.340+0000 7ff6c7fff640 10 monclient: get_auth_request con 0x7ff6a0077f40 auth_method 0 2026-02-24T19:18:10.342 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.340+0000 7ff6c57fa640 10 client.4537.objecter ms_handle_connect 0x7ff6a0077f40 2026-02-24T19:18:10.344 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.343+0000 7ff6c57fa640 1 -- 10.20.193.26:0/2700680131 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7ff6c0093130 con 0x7ff6d00585e0 2026-02-24T19:18:10.344 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.343+0000 7ff6c57fa640 10 client.4537.objecter ms_dispatch2 0x7ff6d0000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:10.344 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.343+0000 7ff6c57fa640 3 client.4537.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:10.344 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.343+0000 7ff6c57fa640 3 client.4537.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:10.344 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.343+0000 7ff6c57fa640 20 client.4537.objecter dump_active .. 0 homeless 2026-02-24T19:18:10.345 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.344+0000 7ff6c57fa640 1 -- 10.20.193.26:0/2700680131 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7ff6c0003ad0 con 0x7ff6d00585e0 2026-02-24T19:18:10.346 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.344+0000 7ff6c57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:10.346 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.344+0000 7ff6c57fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:10.355 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.354+0000 7f5ede7fc640 1 -- 10.20.193.26:0/3163239507 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f5ee0092150 con 0x7f5ef0056c70 2026-02-24T19:18:10.355 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.354+0000 7f5ede7fc640 10 client.4550.objecter ms_dispatch2 0x7f5ef0000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:10.355 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.354+0000 7f5ede7fc640 3 client.4550.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:10.355 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.354+0000 7f5ede7fc640 3 client.4550.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:10.355 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.354+0000 7f5ede7fc640 20 client.4550.objecter dump_active .. 0 homeless 2026-02-24T19:18:10.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.401+0000 7ff0427fc640 1 -- 10.20.193.26:0/1022253249 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff044003700 con 0x7ff0540b5de0 2026-02-24T19:18:10.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.401+0000 7ff0427fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:10.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.401+0000 7ff0427fc640 1 -- 10.20.193.26:0/1022253249 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ff044003b10 con 0x7ff0540b5de0 2026-02-24T19:18:10.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.401+0000 7ff0427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:10.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.401+0000 7ff0427fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:10.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.401+0000 7ff0427fc640 10 monclient: dump: 2026-02-24T19:18:10.402 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:10.402 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:10.403 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.403 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.403 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:10.403 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:10.403 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:10.403 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:10.403 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:10.403 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:10.403 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.401+0000 7ff043fff640 4 set_mon_vals no callback set 2026-02-24T19:18:10.404 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.401+0000 7ff0427fc640 1 -- 10.20.193.26:0/1022253249 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7ff044003d30 con 0x7ff0540b5de0 2026-02-24T19:18:10.404 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.402+0000 7ff0594fe640 10 monclient: get_auth_request con 0x7ff024077d60 auth_method 0 2026-02-24T19:18:10.404 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.402+0000 7ff0427fc640 10 client.4560.objecter ms_handle_connect 0x7ff024077d60 2026-02-24T19:18:10.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.405+0000 7ff0427fc640 1 -- 10.20.193.26:0/1022253249 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7ff044092260 con 0x7ff0540b5de0 2026-02-24T19:18:10.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.405+0000 7ff0427fc640 10 client.4560.objecter ms_dispatch2 0x7ff054000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:10.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.405+0000 7ff0427fc640 3 client.4560.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:10.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.405+0000 7ff0427fc640 3 client.4560.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:10.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.405+0000 7ff0427fc640 20 client.4560.objecter dump_active .. 0 homeless 2026-02-24T19:18:10.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.405+0000 7ff0427fc640 1 -- 10.20.193.26:0/1022253249 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7ff04405cc90 con 0x7ff0540b5de0 2026-02-24T19:18:10.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.405+0000 7ff0427fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:10.407 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.405+0000 7ff0427fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:10.410 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.409+0000 7f8af8ff9640 1 -- 10.20.193.26:0/4228833030 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f8af0004e70 con 0x7f8afc159e40 2026-02-24T19:18:10.410 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.409+0000 7f5ede7fc640 1 -- 10.20.193.26:0/3163239507 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f5ee005cb80 con 0x7f5ef0056c70 2026-02-24T19:18:10.410 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.409+0000 7f5ede7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:10.410 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.409+0000 7f5ede7fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:10.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.409+0000 7f8afbfff640 10 monclient: get_auth_request con 0x7f8acc077c40 auth_method 0 2026-02-24T19:18:10.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.410+0000 7f8af8ff9640 10 client.4556.objecter ms_handle_connect 0x7f8acc077c40 2026-02-24T19:18:10.412 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.411+0000 7f8af8ff9640 1 -- 10.20.193.26:0/4228833030 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f8af0093620 con 0x7f8afc159e40 2026-02-24T19:18:10.412 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.411+0000 7f8af8ff9640 10 client.4556.objecter ms_dispatch2 0x7f8afc000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:10.412 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.411+0000 7f8af8ff9640 3 client.4556.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:10.412 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.411+0000 7f8af8ff9640 3 client.4556.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:10.412 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.411+0000 7f8af8ff9640 20 client.4556.objecter dump_active .. 0 homeless 2026-02-24T19:18:10.414 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.413+0000 7f8af8ff9640 1 -- 10.20.193.26:0/4228833030 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f8af005e050 con 0x7f8afc159e40 2026-02-24T19:18:10.414 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.413+0000 7f8af8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:10.414 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.413+0000 7f8af8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:10.435 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.434+0000 7f9df3fff640 1 -- 10.20.193.26:0/1835522637 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f9e0c05dee0 con 0x7f9e18162f10 2026-02-24T19:18:10.435 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.434+0000 7f9df3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:10.435 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.434+0000 7f9df3fff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:10.457 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.456+0000 7ff6d6b45640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-24T19:18:10.457 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.456+0000 7ff6d6b45640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-24T19:18:10.458 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.456+0000 7ff6d6b45640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:10.458 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.456+0000 7ff6d6b45640 1 -- 10.20.193.26:0/2700680131 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7ff6d00b96a0 con 0x7ff6d00585e0 2026-02-24T19:18:10.459 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.458+0000 7ff6c57fa640 1 -- 10.20.193.26:0/2700680131 <== mon.1 v1:10.20.193.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (unknown 1274345170 0 778662779) 0x7ff6c005db60 con 0x7ff6d00585e0 2026-02-24T19:18:10.459 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.458+0000 7ff6c57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-24T19:18:10.459 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.458+0000 7ff6c57fa640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:10.459 INFO:teuthology.orchestra.run.trial026.stdout:90194313219 2026-02-24T19:18:10.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.460+0000 7ff6d6b45640 10 librados: watch_flush enter 2026-02-24T19:18:10.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.460+0000 7ff6d6b45640 10 librados: watch_flush exit 2026-02-24T19:18:10.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.460+0000 7ff6d6b45640 20 client.4537.objecter shutdown clearing up homeless session... 2026-02-24T19:18:10.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.460+0000 7ff6d6b45640 10 client.4537.objecter successfully canceled tick 2026-02-24T19:18:10.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.460+0000 7ff6d6b45640 1 -- 10.20.193.26:0/2700680131 >> v1:10.20.193.162:6800/3889602630 conn(0x7ff6a0077f40 legacy=0x7ff6a00983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.460+0000 7ff6d6b45640 10 monclient: shutdown 2026-02-24T19:18:10.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.460+0000 7ff6d6b45640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:10.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.460+0000 7ff6d6b45640 1 -- 10.20.193.26:0/2700680131 >> v1:10.20.193.70:6789/0 conn(0x7ff6d00585e0 legacy=0x7ff6d01657d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.461+0000 7ff6d6b45640 1 -- 10.20.193.26:0/2700680131 shutdown_connections 2026-02-24T19:18:10.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.461+0000 7ff6d6b45640 1 -- 10.20.193.26:0/2700680131 >> 10.20.193.26:0/2700680131 conn(0x7ff6d00b7990 msgr2=0x7ff6d015acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:10.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.461+0000 7ff6d6b45640 1 -- 10.20.193.26:0/2700680131 shutdown_connections 2026-02-24T19:18:10.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.461+0000 7ff6d6b45640 1 -- 10.20.193.26:0/2700680131 wait complete. 2026-02-24T19:18:10.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.461+0000 7ff6d6b45640 1 librados: shutdown 2026-02-24T19:18:10.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.6 2026-02-24T19:18:10.520 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.520+0000 7ff05bf8a640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-24T19:18:10.521 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.520+0000 7ff05bf8a640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-24T19:18:10.521 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.520+0000 7ff05bf8a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:10.521 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.520+0000 7ff05bf8a640 1 -- 10.20.193.26:0/1022253249 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7ff0540b4780 con 0x7ff0540b5de0 2026-02-24T19:18:10.521 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.520+0000 7f5ef7b8a640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-24T19:18:10.521 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.520+0000 7f5ef7b8a640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-24T19:18:10.521 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.520+0000 7f5ef7b8a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:10.521 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.520+0000 7f5ef7b8a640 1 -- 10.20.193.26:0/3163239507 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f5ef00b45e0 con 0x7f5ef0056c70 2026-02-24T19:18:10.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.522+0000 7f5ede7fc640 1 -- 10.20.193.26:0/3163239507 <== mon.2 v1:10.20.193.103:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 778662779) 0x7f5ee005c480 con 0x7f5ef0056c70 2026-02-24T19:18:10.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.522+0000 7f5ede7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-24T19:18:10.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.522+0000 7f5ede7fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:10.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.522+0000 7f059ffff640 1 -- 10.20.193.26:0/4089243475 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f05b80032c0 con 0x7f05c4159b40 2026-02-24T19:18:10.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.522+0000 7f059ffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:10.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.522+0000 7f059ffff640 1 -- 10.20.193.26:0/4089243475 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f05b8003e80 con 0x7f05c4159b40 2026-02-24T19:18:10.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.522+0000 7f059ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:10.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.522+0000 7f059ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:10.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.522+0000 7f05c1ffb640 4 set_mon_vals no callback set 2026-02-24T19:18:10.523 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.522+0000 7f059ffff640 10 monclient: dump: 2026-02-24T19:18:10.524 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:10.524 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:10.524 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.524 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.524 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:10.524 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:10.524 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:10.524 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:10.524 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:10.524 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:10.524 INFO:teuthology.orchestra.run.trial026.stdout:90194313219 2026-02-24T19:18:10.524 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.523+0000 7f059ffff640 1 -- 10.20.193.26:0/4089243475 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f05b801ccf0 con 0x7f05c4159b40 2026-02-24T19:18:10.524 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.524+0000 7f05c37fe640 10 monclient: get_auth_request con 0x7f0594077d30 auth_method 0 2026-02-24T19:18:10.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.524+0000 7f059ffff640 10 client.4539.objecter ms_handle_connect 0x7f0594077d30 2026-02-24T19:18:10.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.525+0000 7f5ef7b8a640 10 librados: watch_flush enter 2026-02-24T19:18:10.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.525+0000 7f5ef7b8a640 10 librados: watch_flush exit 2026-02-24T19:18:10.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.525+0000 7f5ef7b8a640 20 client.4550.objecter shutdown clearing up homeless session... 2026-02-24T19:18:10.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.525+0000 7f5ef7b8a640 10 client.4550.objecter successfully canceled tick 2026-02-24T19:18:10.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.525+0000 7f5ef7b8a640 1 -- 10.20.193.26:0/3163239507 >> v1:10.20.193.162:6800/3889602630 conn(0x7f5ec0077d10 legacy=0x7f5ec00981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.525+0000 7f5ef7b8a640 10 monclient: shutdown 2026-02-24T19:18:10.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.525+0000 7f5ef7b8a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:10.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.525+0000 7f5ef7b8a640 1 -- 10.20.193.26:0/3163239507 >> v1:10.20.193.103:6789/0 conn(0x7f5ef0056c70 legacy=0x7f5ef01fe580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.525+0000 7f5ef7b8a640 1 -- 10.20.193.26:0/3163239507 shutdown_connections 2026-02-24T19:18:10.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.525+0000 7f5ef7b8a640 1 -- 10.20.193.26:0/3163239507 >> 10.20.193.26:0/3163239507 conn(0x7f5ef00b2ef0 msgr2=0x7f5ef0160c20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:10.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.525+0000 7f5ef7b8a640 1 -- 10.20.193.26:0/3163239507 shutdown_connections 2026-02-24T19:18:10.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.525+0000 7f5ef7b8a640 1 -- 10.20.193.26:0/3163239507 wait complete. 2026-02-24T19:18:10.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.525+0000 7f5ef7b8a640 1 librados: shutdown 2026-02-24T19:18:10.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.526+0000 7f059ffff640 1 -- 10.20.193.26:0/4089243475 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f05b80923a0 con 0x7f05c4159b40 2026-02-24T19:18:10.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.526+0000 7f059ffff640 10 client.4539.objecter ms_dispatch2 0x7f05c4000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:10.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.526+0000 7f059ffff640 3 client.4539.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:10.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.526+0000 7f059ffff640 3 client.4539.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:10.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.526+0000 7f059ffff640 20 client.4539.objecter dump_active .. 0 homeless 2026-02-24T19:18:10.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.526+0000 7f059ffff640 1 -- 10.20.193.26:0/4089243475 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f05b805cdd0 con 0x7f05c4159b40 2026-02-24T19:18:10.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.526+0000 7f059ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:10.527 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.526+0000 7f059ffff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:10.530 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.530+0000 7f8b0296b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-24T19:18:10.530 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.530+0000 7f8b0296b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-24T19:18:10.531 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.530+0000 7f8b0296b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:10.531 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.530+0000 7f8b0296b640 1 -- 10.20.193.26:0/4228833030 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8afc161380 con 0x7f8afc159e40 2026-02-24T19:18:10.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.531+0000 7f8af8ff9640 1 -- 10.20.193.26:0/4228833030 <== mon.2 v1:10.20.193.103:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 778662779) 0x7f8af005d950 con 0x7f8afc159e40 2026-02-24T19:18:10.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.531+0000 7f8af8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-24T19:18:10.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.531+0000 7f8af8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:10.532 INFO:teuthology.orchestra.run.trial026.stdout:90194313219 2026-02-24T19:18:10.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.534+0000 7f8b0296b640 10 librados: watch_flush enter 2026-02-24T19:18:10.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.534+0000 7f8b0296b640 10 librados: watch_flush exit 2026-02-24T19:18:10.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.534+0000 7f8b0296b640 20 client.4556.objecter shutdown clearing up homeless session... 2026-02-24T19:18:10.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.534+0000 7f8b0296b640 10 client.4556.objecter successfully canceled tick 2026-02-24T19:18:10.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.534+0000 7f8b0296b640 1 -- 10.20.193.26:0/4228833030 >> v1:10.20.193.162:6800/3889602630 conn(0x7f8acc077c40 legacy=0x7f8acc0980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.534+0000 7f8b0296b640 10 monclient: shutdown 2026-02-24T19:18:10.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.534+0000 7f8b0296b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:10.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.534+0000 7f8b0296b640 1 -- 10.20.193.26:0/4228833030 >> v1:10.20.193.103:6789/0 conn(0x7f8afc159e40 legacy=0x7f8afc0b9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.534+0000 7ff0427fc640 1 -- 10.20.193.26:0/1022253249 <== mon.0 v1:10.20.193.26:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+12 (unknown 2894986287 0 778662779) 0x7ff04405c590 con 0x7ff0540b5de0 2026-02-24T19:18:10.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.534+0000 7ff0427fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-24T19:18:10.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.534+0000 7ff0427fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:10.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.534+0000 7f8b0296b640 1 -- 10.20.193.26:0/4228833030 shutdown_connections 2026-02-24T19:18:10.535 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.5 2026-02-24T19:18:10.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.534+0000 7f8b0296b640 1 -- 10.20.193.26:0/4228833030 >> 10.20.193.26:0/4228833030 conn(0x7f8afc0b7780 msgr2=0x7f8afc1582a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:10.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.534+0000 7f8b0296b640 1 -- 10.20.193.26:0/4228833030 shutdown_connections 2026-02-24T19:18:10.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.534+0000 7f8b0296b640 1 -- 10.20.193.26:0/4228833030 wait complete. 2026-02-24T19:18:10.536 INFO:teuthology.orchestra.run.trial026.stdout:90194313219 2026-02-24T19:18:10.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.534+0000 7f8b0296b640 1 librados: shutdown 2026-02-24T19:18:10.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.536+0000 7ff05bf8a640 10 librados: watch_flush enter 2026-02-24T19:18:10.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.536+0000 7ff05bf8a640 10 librados: watch_flush exit 2026-02-24T19:18:10.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.536+0000 7ff05bf8a640 20 client.4560.objecter shutdown clearing up homeless session... 2026-02-24T19:18:10.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.536+0000 7ff05bf8a640 10 client.4560.objecter successfully canceled tick 2026-02-24T19:18:10.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.536+0000 7ff05bf8a640 1 -- 10.20.193.26:0/1022253249 >> v1:10.20.193.162:6800/3889602630 conn(0x7ff024077d60 legacy=0x7ff024098210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.536+0000 7ff05bf8a640 10 monclient: shutdown 2026-02-24T19:18:10.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.536+0000 7ff05bf8a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:10.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.536+0000 7ff05bf8a640 1 -- 10.20.193.26:0/1022253249 >> v1:10.20.193.26:6789/0 conn(0x7ff0540b5de0 legacy=0x7ff0541ffa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.536+0000 7ff05bf8a640 1 -- 10.20.193.26:0/1022253249 shutdown_connections 2026-02-24T19:18:10.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.536+0000 7ff05bf8a640 1 -- 10.20.193.26:0/1022253249 >> 10.20.193.26:0/1022253249 conn(0x7ff0540b8c00 msgr2=0x7ff0540b9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:10.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.536+0000 7ff05bf8a640 1 -- 10.20.193.26:0/1022253249 shutdown_connections 2026-02-24T19:18:10.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.537+0000 7ff05bf8a640 1 -- 10.20.193.26:0/1022253249 wait complete. 2026-02-24T19:18:10.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.537+0000 7ff05bf8a640 1 librados: shutdown 2026-02-24T19:18:10.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.538+0000 7fb24ffff640 1 -- 10.20.193.26:0/2865969087 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb264003700 con 0x7fb2740b9f80 2026-02-24T19:18:10.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.538+0000 7fb24ffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:10.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.538+0000 7fb24ffff640 1 -- 10.20.193.26:0/2865969087 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fb264003ad0 con 0x7fb2740b9f80 2026-02-24T19:18:10.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.538+0000 7fb24ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:10.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.538+0000 7fb24ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:10.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.538+0000 7fb24ffff640 10 monclient: dump: 2026-02-24T19:18:10.539 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:10.539 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:10.539 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.539 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:10.539 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:10.539 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:10.539 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:10.539 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:10.539 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:10.539 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:10.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.538+0000 7fb271ffb640 4 set_mon_vals no callback set 2026-02-24T19:18:10.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.538+0000 7fb24ffff640 1 -- 10.20.193.26:0/2865969087 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fb264003cb0 con 0x7fb2740b9f80 2026-02-24T19:18:10.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.539+0000 7fb2737fe640 10 monclient: get_auth_request con 0x7fb244077d90 auth_method 0 2026-02-24T19:18:10.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.539+0000 7fb24ffff640 10 client.4548.objecter ms_handle_connect 0x7fb244077d90 2026-02-24T19:18:10.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.541+0000 7fb24ffff640 1 -- 10.20.193.26:0/2865969087 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7fb264093320 con 0x7fb2740b9f80 2026-02-24T19:18:10.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.541+0000 7fb24ffff640 10 client.4548.objecter ms_dispatch2 0x7fb274000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:10.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.541+0000 7fb24ffff640 3 client.4548.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:10.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.541+0000 7fb24ffff640 3 client.4548.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:10.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.541+0000 7fb24ffff640 20 client.4548.objecter dump_active .. 0 homeless 2026-02-24T19:18:10.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.541+0000 7fb24ffff640 1 -- 10.20.193.26:0/2865969087 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fb274160dd0 con 0x7fb2740b9f80 2026-02-24T19:18:10.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.541+0000 7fb24ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:10.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.541+0000 7fb24ffff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:10.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.2 2026-02-24T19:18:10.546 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.9 2026-02-24T19:18:10.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.546+0000 7f9e1de7b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-24T19:18:10.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.546+0000 7f9e1de7b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-24T19:18:10.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.546+0000 7f9e1de7b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:10.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.546+0000 7f9e1de7b640 1 -- 10.20.193.26:0/1835522637 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 13} v 0) -- 0x7f9e18057b60 con 0x7f9e18162f10 2026-02-24T19:18:10.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.549+0000 7f9df3fff640 1 -- 10.20.193.26:0/1835522637 <== mon.1 v1:10.20.193.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 13}]=0 v0) ==== 75+0+12 (unknown 3988744482 0 778662779) 0x7f9e0c05d7e0 con 0x7f9e18162f10 2026-02-24T19:18:10.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.549+0000 7f9df3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-24T19:18:10.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.549+0000 7f9df3fff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:10.550 INFO:teuthology.orchestra.run.trial026.stdout:90194313219 2026-02-24T19:18:10.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.549+0000 7f7ae27fc640 1 -- 10.20.193.26:0/996126610 <== mon.0 v1:10.20.193.26:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 778662779) 0x7f7ae805d5a0 con 0x7f7af4161800 2026-02-24T19:18:10.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.549+0000 7f7ae27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-24T19:18:10.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.549+0000 7f7ae27fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:10.550 INFO:teuthology.orchestra.run.trial026.stdout:90194313219 2026-02-24T19:18:10.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.550+0000 7ffb9affd640 1 -- 10.20.193.26:0/735250402 <== mon.0 v1:10.20.193.26:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (unknown 1482059429 0 778662779) 0x7ffba805dd20 con 0x7ffbb40b9f80 2026-02-24T19:18:10.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.550+0000 7ffb9affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-24T19:18:10.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.550+0000 7ffb9affd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:10.551 INFO:teuthology.orchestra.run.trial026.stdout:90194313219 2026-02-24T19:18:10.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.551+0000 7f9e1de7b640 10 librados: watch_flush enter 2026-02-24T19:18:10.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.551+0000 7f9e1de7b640 10 librados: watch_flush exit 2026-02-24T19:18:10.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.551+0000 7f9e1de7b640 20 client.4534.objecter shutdown clearing up homeless session... 2026-02-24T19:18:10.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.551+0000 7f9e1de7b640 10 client.4534.objecter successfully canceled tick 2026-02-24T19:18:10.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.551+0000 7f9e1de7b640 1 -- 10.20.193.26:0/1835522637 >> v1:10.20.193.162:6800/3889602630 conn(0x7f9de8077f10 legacy=0x7f9de80983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.551+0000 7f9e1de7b640 10 monclient: shutdown 2026-02-24T19:18:10.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.551+0000 7f9e1de7b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:10.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.551+0000 7f9e1de7b640 1 -- 10.20.193.26:0/1835522637 >> v1:10.20.193.70:6789/0 conn(0x7f9e18162f10 legacy=0x7f9e180a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.551+0000 7f9e1de7b640 1 -- 10.20.193.26:0/1835522637 shutdown_connections 2026-02-24T19:18:10.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.551+0000 7f9e1de7b640 1 -- 10.20.193.26:0/1835522637 >> 10.20.193.26:0/1835522637 conn(0x7f9e180b2ef0 msgr2=0x7f9e18058360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:10.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.551+0000 7f9e1de7b640 1 -- 10.20.193.26:0/1835522637 shutdown_connections 2026-02-24T19:18:10.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.551+0000 7f9e1de7b640 1 -- 10.20.193.26:0/1835522637 wait complete. 2026-02-24T19:18:10.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.551+0000 7f9e1de7b640 1 librados: shutdown 2026-02-24T19:18:10.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.552+0000 7f7afc013640 10 librados: watch_flush enter 2026-02-24T19:18:10.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.552+0000 7f7afc013640 10 librados: watch_flush exit 2026-02-24T19:18:10.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.552+0000 7f7afc013640 20 client.4533.objecter shutdown clearing up homeless session... 2026-02-24T19:18:10.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.552+0000 7f7afc013640 10 client.4533.objecter successfully canceled tick 2026-02-24T19:18:10.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.552+0000 7f7afc013640 1 -- 10.20.193.26:0/996126610 >> v1:10.20.193.162:6800/3889602630 conn(0x7f7ac4077e10 legacy=0x7f7ac40982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.552+0000 7f7afc013640 10 monclient: shutdown 2026-02-24T19:18:10.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.552+0000 7f7afc013640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:10.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.552+0000 7f7afc013640 1 -- 10.20.193.26:0/996126610 >> v1:10.20.193.26:6789/0 conn(0x7f7af4161800 legacy=0x7f7af412c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.552+0000 7f7afc013640 1 -- 10.20.193.26:0/996126610 shutdown_connections 2026-02-24T19:18:10.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.552+0000 7f7afc013640 1 -- 10.20.193.26:0/996126610 >> 10.20.193.26:0/996126610 conn(0x7f7af40b2ef0 msgr2=0x7f7af40b5270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:10.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.552+0000 7f7afc013640 1 -- 10.20.193.26:0/996126610 shutdown_connections 2026-02-24T19:18:10.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.552+0000 7f7afc013640 1 -- 10.20.193.26:0/996126610 wait complete. 2026-02-24T19:18:10.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.552+0000 7f7afc013640 1 librados: shutdown 2026-02-24T19:18:10.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.553+0000 7ffbbc313640 10 librados: watch_flush enter 2026-02-24T19:18:10.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.553+0000 7ffbbc313640 10 librados: watch_flush exit 2026-02-24T19:18:10.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.553+0000 7ffbbc313640 20 client.4542.objecter shutdown clearing up homeless session... 2026-02-24T19:18:10.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.553+0000 7ffbbc313640 10 client.4542.objecter successfully canceled tick 2026-02-24T19:18:10.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.553+0000 7ffbbc313640 1 -- 10.20.193.26:0/735250402 >> v1:10.20.193.162:6800/3889602630 conn(0x7ffb84077d90 legacy=0x7ffb84098240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.553+0000 7ffbbc313640 10 monclient: shutdown 2026-02-24T19:18:10.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.553+0000 7ffbbc313640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:10.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.553+0000 7ffbbc313640 1 -- 10.20.193.26:0/735250402 >> v1:10.20.193.26:6789/0 conn(0x7ffbb40b9f80 legacy=0x7ffbb41fc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.553+0000 7ffbbc313640 1 -- 10.20.193.26:0/735250402 shutdown_connections 2026-02-24T19:18:10.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.553+0000 7ffbbc313640 1 -- 10.20.193.26:0/735250402 >> 10.20.193.26:0/735250402 conn(0x7ffbb40b7990 msgr2=0x7ffbb415ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:10.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.553+0000 7ffbbc313640 1 -- 10.20.193.26:0/735250402 shutdown_connections 2026-02-24T19:18:10.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.553+0000 7ffbbc313640 1 -- 10.20.193.26:0/735250402 wait complete. 2026-02-24T19:18:10.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.553+0000 7ffbbc313640 1 librados: shutdown 2026-02-24T19:18:10.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.13 2026-02-24T19:18:10.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.4 2026-02-24T19:18:10.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.7 2026-02-24T19:18:10.635 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.634+0000 7f05c8e16640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-24T19:18:10.635 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.634+0000 7f05c8e16640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-24T19:18:10.635 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.634+0000 7f05c8e16640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:10.635 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.634+0000 7f05c8e16640 1 -- 10.20.193.26:0/4089243475 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 15} v 0) -- 0x7f05c4154b90 con 0x7f05c4159b40 2026-02-24T19:18:10.637 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.636+0000 7f059ffff640 1 -- 10.20.193.26:0/4089243475 <== mon.0 v1:10.20.193.26:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 15}]=0 v0) ==== 75+0+12 (unknown 2221946896 0 1257367751) 0x7f05b805c6d0 con 0x7f05c4159b40 2026-02-24T19:18:10.637 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.636+0000 7f059ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-24T19:18:10.637 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.636+0000 7f059ffff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:10.637 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:10.639 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.638+0000 7f05c8e16640 10 librados: watch_flush enter 2026-02-24T19:18:10.639 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.638+0000 7f05c8e16640 10 librados: watch_flush exit 2026-02-24T19:18:10.639 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.638+0000 7f05c8e16640 20 client.4539.objecter shutdown clearing up homeless session... 2026-02-24T19:18:10.639 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.638+0000 7f05c8e16640 10 client.4539.objecter successfully canceled tick 2026-02-24T19:18:10.639 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.638+0000 7f05c8e16640 1 -- 10.20.193.26:0/4089243475 >> v1:10.20.193.162:6800/3889602630 conn(0x7f0594077d30 legacy=0x7f05940981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.639 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.638+0000 7f05c8e16640 10 monclient: shutdown 2026-02-24T19:18:10.639 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.638+0000 7f05c8e16640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:10.639 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.638+0000 7f05c8e16640 1 -- 10.20.193.26:0/4089243475 >> v1:10.20.193.26:6789/0 conn(0x7f05c4159b40 legacy=0x7f05c411e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.639 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.638+0000 7f05c8e16640 1 -- 10.20.193.26:0/4089243475 shutdown_connections 2026-02-24T19:18:10.639 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.638+0000 7f05c8e16640 1 -- 10.20.193.26:0/4089243475 >> 10.20.193.26:0/4089243475 conn(0x7f05c40b7730 msgr2=0x7f05c40b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:10.639 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.638+0000 7f05c8e16640 1 -- 10.20.193.26:0/4089243475 shutdown_connections 2026-02-24T19:18:10.639 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.638+0000 7f05c8e16640 1 -- 10.20.193.26:0/4089243475 wait complete. 2026-02-24T19:18:10.639 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.638+0000 7f05c8e16640 1 librados: shutdown 2026-02-24T19:18:10.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313220 for osd.15 2026-02-24T19:18:10.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.653+0000 7fb27a110640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-24T19:18:10.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.653+0000 7fb27a110640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-24T19:18:10.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.653+0000 7fb27a110640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:10.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.653+0000 7fb27a110640 1 -- 10.20.193.26:0/2865969087 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 14} v 0) -- 0x7fb2741572e0 con 0x7fb2740b9f80 2026-02-24T19:18:10.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.655+0000 7fb24ffff640 1 -- 10.20.193.26:0/2865969087 <== mon.0 v1:10.20.193.26:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 14}]=0 v0) ==== 75+0+12 (unknown 2547163239 0 778662779) 0x7fb26405dd50 con 0x7fb2740b9f80 2026-02-24T19:18:10.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.655+0000 7fb24ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-24T19:18:10.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.655+0000 7fb24ffff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:10.656 INFO:teuthology.orchestra.run.trial026.stdout:90194313219 2026-02-24T19:18:10.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.657+0000 7fb27a110640 10 librados: watch_flush enter 2026-02-24T19:18:10.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.657+0000 7fb27a110640 10 librados: watch_flush exit 2026-02-24T19:18:10.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.657+0000 7fb27a110640 20 client.4548.objecter shutdown clearing up homeless session... 2026-02-24T19:18:10.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.657+0000 7fb27a110640 10 client.4548.objecter successfully canceled tick 2026-02-24T19:18:10.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.657+0000 7fb27a110640 1 -- 10.20.193.26:0/2865969087 >> v1:10.20.193.162:6800/3889602630 conn(0x7fb244077d90 legacy=0x7fb244098240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.657+0000 7fb27a110640 10 monclient: shutdown 2026-02-24T19:18:10.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.657+0000 7fb27a110640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:10.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.657+0000 7fb27a110640 1 -- 10.20.193.26:0/2865969087 >> v1:10.20.193.26:6789/0 conn(0x7fb2740b9f80 legacy=0x7fb2741fe840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:10.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.657+0000 7fb27a110640 1 -- 10.20.193.26:0/2865969087 shutdown_connections 2026-02-24T19:18:10.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.657+0000 7fb27a110640 1 -- 10.20.193.26:0/2865969087 >> 10.20.193.26:0/2865969087 conn(0x7fb2740b7990 msgr2=0x7fb27415acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:10.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.657+0000 7fb27a110640 1 -- 10.20.193.26:0/2865969087 shutdown_connections 2026-02-24T19:18:10.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.657+0000 7fb27a110640 1 -- 10.20.193.26:0/2865969087 wait complete. 2026-02-24T19:18:10.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.657+0000 7fb27a110640 1 librados: shutdown 2026-02-24T19:18:10.666 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.14 2026-02-24T19:18:10.930 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-24T19:18:10.933 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-24T19:18:10.999 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.998+0000 7f19627d9640 10 monclient: get_monmap_and_config 2026-02-24T19:18:10.999 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.998+0000 7f19627d9640 10 monclient: build_initial_monmap 2026-02-24T19:18:10.999 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.998+0000 7f19627d9640 10 monclient: monmap: 2026-02-24T19:18:10.999 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:10.999 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:10.999 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:10.999115+0000 2026-02-24T19:18:10.999 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:10.999115+0000 2026-02-24T19:18:10.999 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:10.999 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:10.999 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:10.999 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:10.999 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:10.999 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:10.999 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.998+0000 7f19627d9640 1 Processor -- start 2026-02-24T19:18:10.999 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.998+0000 7f19627d9640 1 -- start start 2026-02-24T19:18:10.999 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.998+0000 7f19627d9640 10 monclient: init 2026-02-24T19:18:11.000 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.999+0000 7f19627d9640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.000 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.999+0000 7f19627d9640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:18:11.000 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.999+0000 7f19627d9640 10 monclient(hunting): picked mon.noname-c con 0x7f195c15d070 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.000 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.999+0000 7f19627d9640 10 monclient(hunting): picked mon.noname-a con 0x7f195c15d440 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.000 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.999+0000 7f19627d9640 10 monclient(hunting): picked mon.noname-b con 0x7f195c166f60 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.000 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.999+0000 7f19627d9640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f195c164e60 con 0x7f195c15d440 2026-02-24T19:18:11.000 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.999+0000 7f19627d9640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f195c0b1790 con 0x7f195c166f60 2026-02-24T19:18:11.000 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.999+0000 7f19627d9640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f195c0b1a70 con 0x7f195c15d070 2026-02-24T19:18:11.000 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.999+0000 7f19627d9640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.000 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.999+0000 7f19627d9640 10 monclient(hunting): authenticate will time out at 3673.681412s 2026-02-24T19:18:11.000 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.999+0000 7f195b7fe640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f195c15d440 0x7f195c166850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:37920/0 (socket says 10.20.193.26:37920) 2026-02-24T19:18:11.000 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:10.999+0000 7f195b7fe640 1 -- 10.20.193.26:0/2343175805 learned_addr learned my addr 10.20.193.26:0/2343175805 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.002 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.001+0000 7f195affd640 1 -- 10.20.193.26:0/2343175805 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 808694955 0 0) 0x7f195c0b1790 con 0x7f195c166f60 2026-02-24T19:18:11.002 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.001+0000 7f195affd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.002 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.001+0000 7f195affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.002 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.001+0000 7f195affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.002 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.001+0000 7f195affd640 10 monclient(hunting): my global_id is 4543 2026-02-24T19:18:11.002 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.001+0000 7f195affd640 1 -- 10.20.193.26:0/2343175805 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1940003610 con 0x7f195c166f60 2026-02-24T19:18:11.002 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.001+0000 7f195affd640 1 -- 10.20.193.26:0/2343175805 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2213406609 0 0) 0x7f195c0b1a70 con 0x7f195c15d070 2026-02-24T19:18:11.002 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.001+0000 7f195affd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.002 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.001+0000 7f195affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.002 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.001+0000 7f195affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.002 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.001+0000 7f195affd640 10 monclient(hunting): my global_id is 4565 2026-02-24T19:18:11.002 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.001+0000 7f195affd640 1 -- 10.20.193.26:0/2343175805 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f195c0b1790 con 0x7f195c15d070 2026-02-24T19:18:11.002 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.001+0000 7f195affd640 1 -- 10.20.193.26:0/2343175805 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1584534735 0 0) 0x7f195c164e60 con 0x7f195c15d440 2026-02-24T19:18:11.002 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.001+0000 7f195affd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.002 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.001+0000 7f195affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.002 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.001+0000 7f195affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.002 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.001+0000 7f195affd640 10 monclient(hunting): my global_id is 4566 2026-02-24T19:18:11.002 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.001+0000 7f195affd640 1 -- 10.20.193.26:0/2343175805 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f195c0b1a70 con 0x7f195c15d440 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.003+0000 7f195affd640 1 -- 10.20.193.26:0/2343175805 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1921822068 0 0) 0x7f195c0b1790 con 0x7f195c15d070 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.003+0000 7f195affd640 1 -- 10.20.193.26:0/2343175805 >> v1:10.20.193.70:6789/0 conn(0x7f195c166f60 legacy=0x7f195c0b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.003+0000 7f195affd640 1 -- 10.20.193.26:0/2343175805 >> v1:10.20.193.26:6789/0 conn(0x7f195c15d440 legacy=0x7f195c166850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.003+0000 7f195affd640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.003+0000 7f195affd640 1 monclient: found mon.noname-c 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.003+0000 7f195affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.003+0000 7f195affd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.003+0000 7f195affd640 1 -- 10.20.193.26:0/2343175805 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f195c0b1d50 con 0x7f195c15d070 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.003+0000 7f195affd640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.003+0000 7f195affd640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.003+0000 7f195affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.003+0000 7f19627d9640 5 monclient: authenticate success, global_id 4565 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.003+0000 7f195affd640 1 -- 10.20.193.26:0/2343175805 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f1948002df0 con 0x7f195c15d070 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.003+0000 7f195affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.003+0000 7f195affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.003+0000 7f195affd640 10 monclient: dump: 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.003+0000 7f19627d9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.004+0000 7f195affd640 1 -- 10.20.193.26:0/2343175805 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1948002fc0 con 0x7f195c15d070 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.004+0000 7f195affd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.004+0000 7f195affd640 1 -- 10.20.193.26:0/2343175805 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f1948003400 con 0x7f195c15d070 2026-02-24T19:18:11.004 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.004+0000 7f19627d9640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.004+0000 7f19627d9640 4 set_mon_vals no callback set 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.004+0000 7f195affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.004+0000 7f195affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.004+0000 7f195affd640 10 monclient: dump: 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.004+0000 7f19627d9640 10 monclient: shutdown 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.004+0000 7f19627d9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.004+0000 7f19627d9640 1 -- 10.20.193.26:0/2343175805 >> v1:10.20.193.103:6789/0 conn(0x7f195c15d070 legacy=0x7f195c164750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.004+0000 7f19627d9640 1 -- 10.20.193.26:0/2343175805 shutdown_connections 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.004+0000 7f19627d9640 1 -- 10.20.193.26:0/2343175805 >> 10.20.193.26:0/2343175805 conn(0x7f195c0b2ef0 msgr2=0x7f195c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.004+0000 7f19627d9640 1 -- 10.20.193.26:0/2343175805 shutdown_connections 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.004+0000 7f19627d9640 1 -- 10.20.193.26:0/2343175805 wait complete. 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.004+0000 7f19627d9640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.004+0000 7f19627d9640 10 monclient: monmap: 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.005 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.006 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.006 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.006 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.004+0000 7f19627d9640 1 librados: starting msgr at 2026-02-24T19:18:11.006 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.004+0000 7f19627d9640 1 librados: starting objecter 2026-02-24T19:18:11.006 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.004+0000 7f19627d9640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:11.006 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.004+0000 7f19627d9640 1 Processor -- start 2026-02-24T19:18:11.006 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.005+0000 7f19627d9640 1 -- start start 2026-02-24T19:18:11.006 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.005+0000 7f19627d9640 1 librados: setting wanted keys 2026-02-24T19:18:11.006 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.005+0000 7f19627d9640 1 librados: calling monclient init 2026-02-24T19:18:11.006 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.005+0000 7f19627d9640 10 monclient: init 2026-02-24T19:18:11.006 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.005+0000 7f19627d9640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.006 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.005+0000 7f19627d9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:18:11.006 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.005+0000 7f19627d9640 10 monclient(hunting): picked mon.noname-a con 0x7f195c15d070 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.006 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.005+0000 7f19627d9640 10 monclient(hunting): picked mon.noname-c con 0x7f195c15d440 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.006 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.005+0000 7f19627d9640 10 monclient(hunting): picked mon.noname-b con 0x7f195c166f60 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.006 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.005+0000 7f19627d9640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f195c158f60 con 0x7f195c15d070 2026-02-24T19:18:11.006 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.005+0000 7f19627d9640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f195c1ff050 con 0x7f195c166f60 2026-02-24T19:18:11.006 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.005+0000 7f19627d9640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f195c0ac040 con 0x7f195c15d440 2026-02-24T19:18:11.006 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.005+0000 7f19627d9640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.006 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.005+0000 7f19627d9640 10 monclient(hunting): authenticate will time out at 3673.687440s 2026-02-24T19:18:11.006 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.005+0000 7f195bfff640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f195c15d070 0x7f195c1fd8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:37934/0 (socket says 10.20.193.26:37934) 2026-02-24T19:18:11.006 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.005+0000 7f195bfff640 1 -- 10.20.193.26:0/1257181397 learned_addr learned my addr 10.20.193.26:0/1257181397 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.007 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.005+0000 7f1958ff9640 10 client.?.objecter ms_handle_connect 0x7f195c15d070 2026-02-24T19:18:11.007 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.005+0000 7f1958ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.007 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.006+0000 7f1958ff9640 10 client.?.objecter ms_handle_connect 0x7f195c15d440 2026-02-24T19:18:11.007 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.006+0000 7f1958ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.007 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.006+0000 7f1958ff9640 10 client.?.objecter ms_handle_connect 0x7f195c166f60 2026-02-24T19:18:11.007 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.006+0000 7f1958ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.007 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.006+0000 7f1958ff9640 1 -- 10.20.193.26:0/1257181397 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2473008138 0 0) 0x7f195c158f60 con 0x7f195c15d070 2026-02-24T19:18:11.007 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.006+0000 7f1958ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.007 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.006+0000 7f1958ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.007 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.006+0000 7f1958ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.007 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.006+0000 7f1958ff9640 10 monclient(hunting): my global_id is 4569 2026-02-24T19:18:11.007 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.006+0000 7f1958ff9640 1 -- 10.20.193.26:0/1257181397 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f192c003610 con 0x7f195c15d070 2026-02-24T19:18:11.007 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.007+0000 7f1958ff9640 1 -- 10.20.193.26:0/1257181397 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1106086572 0 0) 0x7f195c1ff050 con 0x7f195c166f60 2026-02-24T19:18:11.007 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.007+0000 7f1958ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.007 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.007+0000 7f1958ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.007 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.007+0000 7f1958ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.008 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.007+0000 7f1958ff9640 10 monclient(hunting): my global_id is 4546 2026-02-24T19:18:11.008 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.007+0000 7f1958ff9640 1 -- 10.20.193.26:0/1257181397 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f195c158f60 con 0x7f195c166f60 2026-02-24T19:18:11.008 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.007+0000 7f1958ff9640 1 -- 10.20.193.26:0/1257181397 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1606667177 0 0) 0x7f195c0ac040 con 0x7f195c15d440 2026-02-24T19:18:11.008 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.007+0000 7f1958ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.008 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.007+0000 7f1958ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.008 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.007+0000 7f1958ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.008 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.007+0000 7f1958ff9640 10 monclient(hunting): my global_id is 4568 2026-02-24T19:18:11.008 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.007+0000 7f1958ff9640 1 -- 10.20.193.26:0/1257181397 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f195c1ff050 con 0x7f195c15d440 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.009+0000 7f1958ff9640 1 -- 10.20.193.26:0/1257181397 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2873925398 0 0) 0x7f192c003610 con 0x7f195c15d070 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.009+0000 7f1958ff9640 1 -- 10.20.193.26:0/1257181397 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f195c0ac040 con 0x7f195c15d070 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.009+0000 7f1958ff9640 1 -- 10.20.193.26:0/1257181397 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f19480033d0 con 0x7f195c15d070 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.009+0000 7f1958ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.009+0000 7f1958ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.009+0000 7f1958ff9640 10 monclient(hunting): dump: 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.009+0000 7f1958ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.009+0000 7f1958ff9640 1 -- 10.20.193.26:0/1257181397 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2668400796 0 0) 0x7f195c158f60 con 0x7f195c166f60 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.009+0000 7f1958ff9640 1 -- 10.20.193.26:0/1257181397 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f192c003610 con 0x7f195c166f60 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.009+0000 7f1958ff9640 1 -- 10.20.193.26:0/1257181397 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f1950003250 con 0x7f195c166f60 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.009+0000 7f1958ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.009+0000 7f1958ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.009+0000 7f1958ff9640 10 monclient(hunting): dump: 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.010 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.011 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.011 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.011 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.011 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.009+0000 7f1958ff9640 1 -- 10.20.193.26:0/1257181397 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1484800174 0 0) 0x7f195c1ff050 con 0x7f195c15d440 2026-02-24T19:18:11.011 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.009+0000 7f1958ff9640 1 -- 10.20.193.26:0/1257181397 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f195c158f60 con 0x7f195c15d440 2026-02-24T19:18:11.011 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.009+0000 7f1958ff9640 1 -- 10.20.193.26:0/1257181397 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f194c003090 con 0x7f195c15d440 2026-02-24T19:18:11.011 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.009+0000 7f1958ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:11.011 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.009+0000 7f1958ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:11.011 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.009+0000 7f1958ff9640 10 monclient(hunting): dump: 2026-02-24T19:18:11.011 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.011 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.011 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.011 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.011 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.011 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.011 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.011 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.011 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.011 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.011 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.010+0000 7f1958ff9640 1 -- 10.20.193.26:0/1257181397 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3155658671 0 0) 0x7f195c0ac040 con 0x7f195c15d070 2026-02-24T19:18:11.011 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.010+0000 7f1958ff9640 1 -- 10.20.193.26:0/1257181397 >> v1:10.20.193.103:6789/0 conn(0x7f195c15d440 legacy=0x7f195c0b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.011 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.010+0000 7f1958ff9640 1 -- 10.20.193.26:0/1257181397 >> v1:10.20.193.70:6789/0 conn(0x7f195c166f60 legacy=0x7f195c1fe360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.011 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.010+0000 7f1958ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.011 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.010+0000 7f1958ff9640 1 monclient: found mon.a 2026-02-24T19:18:11.011 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.010+0000 7f1958ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.012 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.010+0000 7f1958ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.012 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.010+0000 7f1958ff9640 1 -- 10.20.193.26:0/1257181397 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f195c0ac320 con 0x7f195c15d070 2026-02-24T19:18:11.012 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.010+0000 7f1958ff9640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.012 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.010+0000 7f1958ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.012 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.010+0000 7f1958ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.012 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.010+0000 7f19627d9640 5 monclient: authenticate success, global_id 4569 2026-02-24T19:18:11.012 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.010+0000 7f19627d9640 10 monclient: _renew_subs 2026-02-24T19:18:11.012 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.010+0000 7f19627d9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.012 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.010+0000 7f19627d9640 1 -- 10.20.193.26:0/1257181397 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f195c0ac600 con 0x7f195c15d070 2026-02-24T19:18:11.012 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.010+0000 7f19627d9640 10 client.4569.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:11.012 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.010+0000 7f19627d9640 10 monclient: _renew_subs 2026-02-24T19:18:11.012 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.010+0000 7f19627d9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.012 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.010+0000 7f19627d9640 1 -- 10.20.193.26:0/1257181397 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f195c0b5800 con 0x7f195c15d070 2026-02-24T19:18:11.012 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.010+0000 7f19627d9640 1 librados: init done 2026-02-24T19:18:11.012 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.011+0000 7f19627d9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.012 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.011+0000 7f19627d9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.012 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.011+0000 7f19627d9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.012 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.011+0000 7f19627d9640 1 -- 10.20.193.26:0/1257181397 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f195c0b1290 con 0x7f195c15d070 2026-02-24T19:18:11.020 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.019+0000 7f1958ff9640 1 -- 10.20.193.26:0/1257181397 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1948002fc0 con 0x7f195c15d070 2026-02-24T19:18:11.020 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.019+0000 7f1958ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.020 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.019+0000 7f1958ff9640 1 -- 10.20.193.26:0/1257181397 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f1948003b00 con 0x7f195c15d070 2026-02-24T19:18:11.020 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.019+0000 7f1958ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.020 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.019+0000 7f1958ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:11.020 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.019+0000 7f195a7fc640 4 set_mon_vals no callback set 2026-02-24T19:18:11.020 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.019+0000 7f1958ff9640 10 monclient: dump: 2026-02-24T19:18:11.020 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.020 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.020 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.020 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.020 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.020 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.020 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.020 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.020 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.020 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.021 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.020+0000 7f1958ff9640 1 -- 10.20.193.26:0/1257181397 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f1948003b00 con 0x7f195c15d070 2026-02-24T19:18:11.021 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.020+0000 7f195b7fe640 10 monclient: get_auth_request con 0x7f192c077f40 auth_method 0 2026-02-24T19:18:11.021 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.020+0000 7f1958ff9640 10 client.4569.objecter ms_handle_connect 0x7f192c077f40 2026-02-24T19:18:11.022 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.021+0000 7f1958ff9640 1 -- 10.20.193.26:0/1257181397 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f1948093140 con 0x7f195c15d070 2026-02-24T19:18:11.022 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.021+0000 7f1958ff9640 10 client.4569.objecter ms_dispatch2 0x7f195c000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:11.022 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.021+0000 7f1958ff9640 3 client.4569.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:11.022 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.021+0000 7f1958ff9640 3 client.4569.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:11.022 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.021+0000 7f1958ff9640 20 client.4569.objecter dump_active .. 0 homeless 2026-02-24T19:18:11.031 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-24T19:18:11.038 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.037+0000 7fab03e6a640 10 monclient: get_monmap_and_config 2026-02-24T19:18:11.038 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.037+0000 7fab03e6a640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.038 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.037+0000 7fab03e6a640 10 monclient: monmap: 2026-02-24T19:18:11.038 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.038 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.038 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:11.038539+0000 2026-02-24T19:18:11.038 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:11.038539+0000 2026-02-24T19:18:11.038 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.038 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.038 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.038 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.038 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.039 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.038+0000 7fab03e6a640 1 Processor -- start 2026-02-24T19:18:11.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.038+0000 7fab03e6a640 1 -- start start 2026-02-24T19:18:11.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.038+0000 7fab03e6a640 10 monclient: init 2026-02-24T19:18:11.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.038+0000 7fab03e6a640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.038+0000 7fab03e6a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:18:11.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.038+0000 7fab03e6a640 10 monclient(hunting): picked mon.noname-a con 0x7faafc157780 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.038+0000 7fab03e6a640 10 monclient(hunting): picked mon.noname-c con 0x7faafc157b50 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.038+0000 7fab03e6a640 10 monclient(hunting): picked mon.noname-b con 0x7faafc164d00 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.038+0000 7fab03e6a640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faafc05de70 con 0x7faafc157780 2026-02-24T19:18:11.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.038+0000 7fab03e6a640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faafc055b20 con 0x7faafc164d00 2026-02-24T19:18:11.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.038+0000 7fab03e6a640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faafc055e00 con 0x7faafc157b50 2026-02-24T19:18:11.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.038+0000 7fab03e6a640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.039 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.038+0000 7fab03e6a640 10 monclient(hunting): authenticate will time out at 3673.720783s 2026-02-24T19:18:11.040 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.039+0000 7fab023e0640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7faafc164d00 0x7faafc1c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:46122/0 (socket says 10.20.193.26:46122) 2026-02-24T19:18:11.040 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.039+0000 7fab023e0640 1 -- 10.20.193.26:0/3304559016 learned_addr learned my addr 10.20.193.26:0/3304559016 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.041 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.040+0000 7fab00bdd640 1 -- 10.20.193.26:0/3304559016 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4177466491 0 0) 0x7faafc055b20 con 0x7faafc164d00 2026-02-24T19:18:11.041 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.040+0000 7fab00bdd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.041 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.040+0000 7fab00bdd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.041 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.040+0000 7fab00bdd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.041 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.040+0000 7fab00bdd640 10 monclient(hunting): my global_id is 4549 2026-02-24T19:18:11.041 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.040+0000 7fab00bdd640 1 -- 10.20.193.26:0/3304559016 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faae4003610 con 0x7faafc164d00 2026-02-24T19:18:11.041 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.040+0000 7fab00bdd640 1 -- 10.20.193.26:0/3304559016 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 593961316 0 0) 0x7faafc055e00 con 0x7faafc157b50 2026-02-24T19:18:11.041 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.040+0000 7fab00bdd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.041 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.040+0000 7fab00bdd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.041 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.040+0000 7fab00bdd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.041 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.040+0000 7fab00bdd640 10 monclient(hunting): my global_id is 4571 2026-02-24T19:18:11.041 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.040+0000 7fab00bdd640 1 -- 10.20.193.26:0/3304559016 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faafc055b20 con 0x7faafc157b50 2026-02-24T19:18:11.042 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.041+0000 7fab00bdd640 1 -- 10.20.193.26:0/3304559016 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3402404566 0 0) 0x7faae4003610 con 0x7faafc164d00 2026-02-24T19:18:11.042 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.041+0000 7fab00bdd640 1 -- 10.20.193.26:0/3304559016 >> v1:10.20.193.103:6789/0 conn(0x7faafc157b50 legacy=0x7faafc1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.042 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.041+0000 7fab00bdd640 1 -- 10.20.193.26:0/3304559016 >> v1:10.20.193.26:6789/0 conn(0x7faafc157780 legacy=0x7faafc056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:11.042 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.041+0000 7fab00bdd640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.042 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.041+0000 7fab00bdd640 1 monclient: found mon.noname-b 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.041+0000 7fab00bdd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.041+0000 7fab00bdd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.041+0000 7fab00bdd640 1 -- 10.20.193.26:0/3304559016 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faafc0560e0 con 0x7faafc164d00 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.041+0000 7fab00bdd640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.041+0000 7fab00bdd640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.041+0000 7fab00bdd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.041+0000 7fab00bdd640 1 -- 10.20.193.26:0/3304559016 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7faaf8003170 con 0x7faafc164d00 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.041+0000 7fab00bdd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.041+0000 7fab00bdd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.041+0000 7fab00bdd640 10 monclient: dump: 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.042+0000 7fab03e6a640 5 monclient: authenticate success, global_id 4549 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.042+0000 7fab03e6a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.042+0000 7fab00bdd640 1 -- 10.20.193.26:0/3304559016 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faaf8003380 con 0x7faafc164d00 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.042+0000 7fab00bdd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.042+0000 7fab00bdd640 1 -- 10.20.193.26:0/3304559016 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7faaf80037c0 con 0x7faafc164d00 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.042+0000 7fab00bdd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.042+0000 7fab00bdd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.042+0000 7fab00bdd640 10 monclient: dump: 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.043 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.044 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.044 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.044 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.044 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.042+0000 7fab03e6a640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:11.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.042+0000 7fab03e6a640 4 set_mon_vals no callback set 2026-02-24T19:18:11.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.043+0000 7fab03e6a640 10 monclient: shutdown 2026-02-24T19:18:11.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.043+0000 7fab03e6a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.043+0000 7fab03e6a640 1 -- 10.20.193.26:0/3304559016 >> v1:10.20.193.70:6789/0 conn(0x7faafc164d00 legacy=0x7faafc1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.043+0000 7fab03e6a640 1 -- 10.20.193.26:0/3304559016 shutdown_connections 2026-02-24T19:18:11.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.043+0000 7fab03e6a640 1 -- 10.20.193.26:0/3304559016 >> 10.20.193.26:0/3304559016 conn(0x7faafc0b2ef0 msgr2=0x7faafc0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.043+0000 7fab03e6a640 1 -- 10.20.193.26:0/3304559016 shutdown_connections 2026-02-24T19:18:11.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.043+0000 7fab03e6a640 1 -- 10.20.193.26:0/3304559016 wait complete. 2026-02-24T19:18:11.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.043+0000 7fab03e6a640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.043+0000 7fab03e6a640 10 monclient: monmap: 2026-02-24T19:18:11.044 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.044 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:11.044 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:11.044 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:11.044 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.044 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:11.044 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.044 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.044 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.044 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.043+0000 7fab03e6a640 1 librados: starting msgr at 2026-02-24T19:18:11.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.043+0000 7fab03e6a640 1 librados: starting objecter 2026-02-24T19:18:11.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.043+0000 7fab03e6a640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:11.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.043+0000 7fab03e6a640 1 Processor -- start 2026-02-24T19:18:11.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.043+0000 7fab03e6a640 1 -- start start 2026-02-24T19:18:11.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.043+0000 7fab03e6a640 1 librados: setting wanted keys 2026-02-24T19:18:11.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.043+0000 7fab03e6a640 1 librados: calling monclient init 2026-02-24T19:18:11.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.043+0000 7fab03e6a640 10 monclient: init 2026-02-24T19:18:11.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.044+0000 7fab03e6a640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.044+0000 7fab03e6a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:18:11.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.044+0000 7fab03e6a640 10 monclient(hunting): picked mon.noname-c con 0x7faafc157780 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.044+0000 7fab03e6a640 10 monclient(hunting): picked mon.noname-b con 0x7faafc157b50 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.044+0000 7fab03e6a640 10 monclient(hunting): picked mon.noname-a con 0x7faafc164d00 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.044+0000 7fab03e6a640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faafc12e7f0 con 0x7faafc164d00 2026-02-24T19:18:11.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.044+0000 7fab03e6a640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faafc160900 con 0x7faafc157b50 2026-02-24T19:18:11.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.044+0000 7fab03e6a640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faafc160be0 con 0x7faafc157780 2026-02-24T19:18:11.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.044+0000 7fab03e6a640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.044+0000 7fab03e6a640 10 monclient(hunting): authenticate will time out at 3673.726306s 2026-02-24T19:18:11.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.044+0000 7fab01bdf640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7faafc157780 0x7faafc0ab300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58576/0 (socket says 10.20.193.26:58576) 2026-02-24T19:18:11.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.044+0000 7fab01bdf640 1 -- 10.20.193.26:0/1424000991 learned_addr learned my addr 10.20.193.26:0/1424000991 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.044+0000 7fab013de640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7faafc157b50 0x7faafc12e0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:46136/0 (socket says 10.20.193.26:46136) 2026-02-24T19:18:11.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.044+0000 7faaea7fc640 10 client.?.objecter ms_handle_connect 0x7faafc157b50 2026-02-24T19:18:11.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.044+0000 7faaea7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.044+0000 7faaea7fc640 10 client.?.objecter ms_handle_connect 0x7faafc157780 2026-02-24T19:18:11.045 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.044+0000 7faaea7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.046 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.045+0000 7faaea7fc640 1 -- 10.20.193.26:0/1424000991 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 59583136 0 0) 0x7faafc160900 con 0x7faafc157b50 2026-02-24T19:18:11.046 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.045+0000 7faaea7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.046 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.045+0000 7faaea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.046 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.045+0000 7faaea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.046 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.045+0000 7faaea7fc640 10 monclient(hunting): my global_id is 4552 2026-02-24T19:18:11.046 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.045+0000 7faaea7fc640 1 -- 10.20.193.26:0/1424000991 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faacc003610 con 0x7faafc157b50 2026-02-24T19:18:11.046 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.045+0000 7faaea7fc640 1 -- 10.20.193.26:0/1424000991 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 541204496 0 0) 0x7faafc160be0 con 0x7faafc157780 2026-02-24T19:18:11.046 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.045+0000 7faaea7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.046 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.045+0000 7faaea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.046 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.045+0000 7faaea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.046 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.045+0000 7faaea7fc640 10 monclient(hunting): my global_id is 4574 2026-02-24T19:18:11.046 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.045+0000 7faaea7fc640 1 -- 10.20.193.26:0/1424000991 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faafc160900 con 0x7faafc157780 2026-02-24T19:18:11.048 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.047+0000 7faaea7fc640 1 -- 10.20.193.26:0/1424000991 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2063677480 0 0) 0x7faacc003610 con 0x7faafc157b50 2026-02-24T19:18:11.048 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.047+0000 7faaea7fc640 1 -- 10.20.193.26:0/1424000991 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faafc160be0 con 0x7faafc157b50 2026-02-24T19:18:11.048 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.047+0000 7faaea7fc640 1 -- 10.20.193.26:0/1424000991 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7faaf00030b0 con 0x7faafc157b50 2026-02-24T19:18:11.048 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.047+0000 7faaea7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:11.048 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.047+0000 7faaea7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:11.048 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.047+0000 7faaea7fc640 10 monclient(hunting): dump: 2026-02-24T19:18:11.048 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.048 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.048 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.049 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.049 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.049 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.049 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.049 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.049 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.049 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.049 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.047+0000 7faaea7fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:11.049 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.048+0000 7faaea7fc640 1 -- 10.20.193.26:0/1424000991 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3239059815 0 0) 0x7faafc160900 con 0x7faafc157780 2026-02-24T19:18:11.049 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.048+0000 7faaea7fc640 1 -- 10.20.193.26:0/1424000991 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faacc003610 con 0x7faafc157780 2026-02-24T19:18:11.049 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.048+0000 7faaea7fc640 1 -- 10.20.193.26:0/1424000991 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7faaec002fd0 con 0x7faafc157780 2026-02-24T19:18:11.049 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.048+0000 7faaea7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:11.049 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.048+0000 7faaea7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:11.049 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.048+0000 7faaea7fc640 10 monclient(hunting): dump: 2026-02-24T19:18:11.049 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.049 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.049 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.049 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.049 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.049 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.049 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.049 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.049 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.049 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.050 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.049+0000 7faaea7fc640 1 -- 10.20.193.26:0/1424000991 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3361683033 0 0) 0x7faafc160be0 con 0x7faafc157b50 2026-02-24T19:18:11.050 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.049+0000 7faaea7fc640 1 -- 10.20.193.26:0/1424000991 >> v1:10.20.193.103:6789/0 conn(0x7faafc157780 legacy=0x7faafc0ab300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.050 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.049+0000 7faaea7fc640 1 -- 10.20.193.26:0/1424000991 >> v1:10.20.193.26:6789/0 conn(0x7faafc164d00 legacy=0x7faafc0a9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.050 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.049+0000 7faaea7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.050 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.049+0000 7faaea7fc640 1 monclient: found mon.b 2026-02-24T19:18:11.050 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.049+0000 7faaea7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.050 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.049+0000 7faaea7fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:11.050 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.049+0000 7faaea7fc640 1 -- 10.20.193.26:0/1424000991 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faafc160ec0 con 0x7faafc157b50 2026-02-24T19:18:11.050 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.049+0000 7faaea7fc640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.050 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.049+0000 7faaea7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.050 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.049+0000 7faaea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.050 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.049+0000 7fab03e6a640 5 monclient: authenticate success, global_id 4552 2026-02-24T19:18:11.050 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.049+0000 7fab03e6a640 10 monclient: _renew_subs 2026-02-24T19:18:11.050 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.049+0000 7fab03e6a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:11.050 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.049+0000 7fab03e6a640 1 -- 10.20.193.26:0/1424000991 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7faafc1611a0 con 0x7faafc157b50 2026-02-24T19:18:11.050 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.049+0000 7fab03e6a640 10 client.4552.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:11.050 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.049+0000 7fab03e6a640 10 monclient: _renew_subs 2026-02-24T19:18:11.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.049+0000 7fab03e6a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:11.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.049+0000 7fab03e6a640 1 -- 10.20.193.26:0/1424000991 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7faafc161760 con 0x7faafc157b50 2026-02-24T19:18:11.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.049+0000 7fab03e6a640 1 librados: init done 2026-02-24T19:18:11.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.050+0000 7fab03e6a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.050+0000 7fab03e6a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.050+0000 7fab03e6a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:11.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.050+0000 7fab03e6a640 1 -- 10.20.193.26:0/1424000991 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faafc0531e0 con 0x7faafc157b50 2026-02-24T19:18:11.054 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2026-02-24T19:18:11.098 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.098+0000 7f610ed4b640 10 monclient: get_monmap_and_config 2026-02-24T19:18:11.098 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.098+0000 7f610ed4b640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.098 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.098+0000 7f610ed4b640 10 monclient: monmap: 2026-02-24T19:18:11.099 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.099 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.099 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:11.098817+0000 2026-02-24T19:18:11.099 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:11.098817+0000 2026-02-24T19:18:11.099 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.099 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.099 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.099 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.099 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.099 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.099 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.098+0000 7f610ed4b640 1 Processor -- start 2026-02-24T19:18:11.099 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.098+0000 7f610ed4b640 1 -- start start 2026-02-24T19:18:11.099 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.098+0000 7f610ed4b640 10 monclient: init 2026-02-24T19:18:11.100 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.099+0000 7f610ed4b640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.100 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.099+0000 7f610ed4b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:18:11.100 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.099+0000 7f610ed4b640 10 monclient(hunting): picked mon.noname-c con 0x7f610815d610 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.100 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.099+0000 7f610ed4b640 10 monclient(hunting): picked mon.noname-b con 0x7f61081667e0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.100 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.099+0000 7f610ed4b640 10 monclient(hunting): picked mon.noname-a con 0x7f6108056ea0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.100 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.099+0000 7f610ed4b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f610815d9e0 con 0x7f6108056ea0 2026-02-24T19:18:11.100 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.099+0000 7f610ed4b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6108055b20 con 0x7f61081667e0 2026-02-24T19:18:11.100 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.099+0000 7f610ed4b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6108055e00 con 0x7f610815d610 2026-02-24T19:18:11.100 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.099+0000 7f610ed4b640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.100 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.099+0000 7f610ed4b640 10 monclient(hunting): authenticate will time out at 3673.781493s 2026-02-24T19:18:11.100 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.099+0000 7f610cac0640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f610815d610 0x7f61080b9900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58582/0 (socket says 10.20.193.26:58582) 2026-02-24T19:18:11.100 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.099+0000 7f610cac0640 1 -- 10.20.193.26:0/3061521405 learned_addr learned my addr 10.20.193.26:0/3061521405 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.101 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.101+0000 7f60ff7fe640 1 -- 10.20.193.26:0/3061521405 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3549632883 0 0) 0x7f6108055e00 con 0x7f610815d610 2026-02-24T19:18:11.101 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.101+0000 7f60ff7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.101 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.101+0000 7f60ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.101 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.101+0000 7f60ff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.102 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.101+0000 7f60ff7fe640 10 monclient(hunting): my global_id is 4577 2026-02-24T19:18:11.102 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.101+0000 7f60ff7fe640 1 -- 10.20.193.26:0/3061521405 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60f4003610 con 0x7f610815d610 2026-02-24T19:18:11.103 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.102+0000 7f60ff7fe640 1 -- 10.20.193.26:0/3061521405 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 140892240 0 0) 0x7f60f4003610 con 0x7f610815d610 2026-02-24T19:18:11.103 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.102+0000 7f60ff7fe640 1 -- 10.20.193.26:0/3061521405 >> v1:10.20.193.70:6789/0 conn(0x7f61081667e0 legacy=0x7f61080ba010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:11.103 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.102+0000 7f60ff7fe640 1 -- 10.20.193.26:0/3061521405 >> v1:10.20.193.26:6789/0 conn(0x7f6108056ea0 legacy=0x7f61081c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:11.103 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.102+0000 7f60ff7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.103 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.102+0000 7f60ff7fe640 1 monclient: found mon.noname-c 2026-02-24T19:18:11.103 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.102+0000 7f60ff7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.103 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.102+0000 7f60ff7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.103 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.102+0000 7f60ff7fe640 1 -- 10.20.193.26:0/3061521405 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61080560e0 con 0x7f610815d610 2026-02-24T19:18:11.103 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.102+0000 7f60ff7fe640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.103 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.102+0000 7f60ff7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.103 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.102+0000 7f60ff7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.103 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.102+0000 7f60ff7fe640 1 -- 10.20.193.26:0/3061521405 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f60f8002df0 con 0x7f610815d610 2026-02-24T19:18:11.103 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.102+0000 7f60ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.103 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.102+0000 7f60ff7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:11.103 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.102+0000 7f60ff7fe640 10 monclient: dump: 2026-02-24T19:18:11.103 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.103 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.103 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.103 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.103 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.103 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.104 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.104 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.104 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.104 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.102+0000 7f610ed4b640 5 monclient: authenticate success, global_id 4577 2026-02-24T19:18:11.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.102+0000 7f610ed4b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:11.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.103+0000 7f60ff7fe640 1 -- 10.20.193.26:0/3061521405 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f60f8003000 con 0x7f610815d610 2026-02-24T19:18:11.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.103+0000 7f60ff7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.103+0000 7f60ff7fe640 1 -- 10.20.193.26:0/3061521405 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f60f8003440 con 0x7f610815d610 2026-02-24T19:18:11.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.103+0000 7f60ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.103+0000 7f60ff7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:11.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.103+0000 7f60ff7fe640 10 monclient: dump: 2026-02-24T19:18:11.104 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.104 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.104 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.104 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.104 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.104 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.104 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.104 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.104 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.104 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.103+0000 7f610ed4b640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:11.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.103+0000 7f610ed4b640 4 set_mon_vals no callback set 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.103+0000 7f610ed4b640 10 monclient: shutdown 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.103+0000 7f610ed4b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.103+0000 7f610ed4b640 1 -- 10.20.193.26:0/3061521405 >> v1:10.20.193.103:6789/0 conn(0x7f610815d610 legacy=0x7f61080b9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.103+0000 7f610ed4b640 1 -- 10.20.193.26:0/3061521405 shutdown_connections 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.103+0000 7f610ed4b640 1 -- 10.20.193.26:0/3061521405 >> 10.20.193.26:0/3061521405 conn(0x7f61080b7470 msgr2=0x7f61080b7840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.103+0000 7f610ed4b640 1 -- 10.20.193.26:0/3061521405 shutdown_connections 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.103+0000 7f610ed4b640 1 -- 10.20.193.26:0/3061521405 wait complete. 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.104+0000 7f610ed4b640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.104+0000 7f610ed4b640 10 monclient: monmap: 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.104+0000 7f610ed4b640 1 librados: starting msgr at 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.104+0000 7f610ed4b640 1 librados: starting objecter 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.104+0000 7f610ed4b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.104+0000 7f610ed4b640 1 Processor -- start 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.104+0000 7f610ed4b640 1 -- start start 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.104+0000 7f610ed4b640 1 librados: setting wanted keys 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.104+0000 7f610ed4b640 1 librados: calling monclient init 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.104+0000 7f610ed4b640 10 monclient: init 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.104+0000 7f610ed4b640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.104+0000 7f610ed4b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:18:11.106 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.104+0000 7f610ed4b640 10 monclient(hunting): picked mon.noname-b con 0x7f6108056ea0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.106 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.104+0000 7f610ed4b640 10 monclient(hunting): picked mon.noname-c con 0x7f610815d610 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.106 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.104+0000 7f610ed4b640 10 monclient(hunting): picked mon.noname-a con 0x7f61081667e0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.106 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.104+0000 7f610ed4b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6108131020 con 0x7f61081667e0 2026-02-24T19:18:11.106 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.104+0000 7f610ed4b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6108131300 con 0x7f6108056ea0 2026-02-24T19:18:11.106 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.104+0000 7f610ed4b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61081315e0 con 0x7f610815d610 2026-02-24T19:18:11.106 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.104+0000 7f610ed4b640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.106 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.104+0000 7f610ed4b640 10 monclient(hunting): authenticate will time out at 3673.786780s 2026-02-24T19:18:11.106 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.105+0000 7f60fffff640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f610815d610 0x7f61080b3840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58584/0 (socket says 10.20.193.26:58584) 2026-02-24T19:18:11.106 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.105+0000 7f60fffff640 1 -- 10.20.193.26:0/2638321779 learned_addr learned my addr 10.20.193.26:0/2638321779 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.106 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.105+0000 7f60fd7fa640 10 client.?.objecter ms_handle_connect 0x7f610815d610 2026-02-24T19:18:11.106 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.105+0000 7f60fd7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.107 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.106+0000 7f60fd7fa640 1 -- 10.20.193.26:0/2638321779 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2760642820 0 0) 0x7f61081315e0 con 0x7f610815d610 2026-02-24T19:18:11.107 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.106+0000 7f60fd7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.107 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.106+0000 7f60fd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.107 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.106+0000 7f60fd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.107 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.106+0000 7f60fd7fa640 10 monclient(hunting): my global_id is 4580 2026-02-24T19:18:11.107 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.106+0000 7f60fd7fa640 1 -- 10.20.193.26:0/2638321779 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60d8003610 con 0x7f610815d610 2026-02-24T19:18:11.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.107+0000 7f1958ff9640 1 -- 10.20.193.26:0/1257181397 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f194805db70 con 0x7f195c15d070 2026-02-24T19:18:11.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.107+0000 7f1958ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.107+0000 7f1958ff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:11.109 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.108+0000 7f60fd7fa640 1 -- 10.20.193.26:0/2638321779 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3388792878 0 0) 0x7f60d8003610 con 0x7f610815d610 2026-02-24T19:18:11.109 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.108+0000 7f60fd7fa640 1 -- 10.20.193.26:0/2638321779 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f61081315e0 con 0x7f610815d610 2026-02-24T19:18:11.109 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.108+0000 7f60fd7fa640 1 -- 10.20.193.26:0/2638321779 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f60f0002fd0 con 0x7f610815d610 2026-02-24T19:18:11.109 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.108+0000 7f60fd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:11.109 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.108+0000 7f60fd7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:11.109 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.108+0000 7f60fd7fa640 10 monclient(hunting): dump: 2026-02-24T19:18:11.109 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.109 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.109 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.109 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.109 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.109 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.109 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.109 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.109 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.109 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.109 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.108+0000 7f60fd7fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:11.109 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.108+0000 7f60fd7fa640 10 client.?.objecter ms_handle_connect 0x7f61081667e0 2026-02-24T19:18:11.109 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.108+0000 7f60fd7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.110 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.109+0000 7f60fd7fa640 1 -- 10.20.193.26:0/2638321779 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3334047848 0 0) 0x7f61081315e0 con 0x7f610815d610 2026-02-24T19:18:11.110 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.109+0000 7f60fd7fa640 1 -- 10.20.193.26:0/2638321779 >> v1:10.20.193.70:6789/0 conn(0x7f6108056ea0 legacy=0x7f61081323a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.110 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.109+0000 7f60fd7fa640 1 -- 10.20.193.26:0/2638321779 >> v1:10.20.193.26:6789/0 conn(0x7f61081667e0 legacy=0x7f6108143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.110 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.109+0000 7f60fd7fa640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.111 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.109+0000 7f60fd7fa640 1 monclient: found mon.c 2026-02-24T19:18:11.111 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.109+0000 7f60fd7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.111 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.109+0000 7f60fd7fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.111 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.109+0000 7f60fd7fa640 1 -- 10.20.193.26:0/2638321779 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61081318c0 con 0x7f610815d610 2026-02-24T19:18:11.111 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.109+0000 7f60fd7fa640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.111 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.109+0000 7f60fd7fa640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.111 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.109+0000 7f60fd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.111 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.109+0000 7f610ed4b640 5 monclient: authenticate success, global_id 4580 2026-02-24T19:18:11.111 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.109+0000 7f610ed4b640 10 monclient: _renew_subs 2026-02-24T19:18:11.111 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.109+0000 7f610ed4b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.111 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.109+0000 7f610ed4b640 1 -- 10.20.193.26:0/2638321779 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6108131ba0 con 0x7f610815d610 2026-02-24T19:18:11.111 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.109+0000 7f610ed4b640 10 client.4580.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:11.111 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.109+0000 7f610ed4b640 10 monclient: _renew_subs 2026-02-24T19:18:11.111 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.109+0000 7f610ed4b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.111 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.109+0000 7f610ed4b640 1 -- 10.20.193.26:0/2638321779 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f610812bc00 con 0x7f610815d610 2026-02-24T19:18:11.111 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.110+0000 7f610ed4b640 1 librados: init done 2026-02-24T19:18:11.111 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.110+0000 7f610ed4b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.111 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.110+0000 7f610ed4b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.111 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.110+0000 7f610ed4b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.111 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.110+0000 7f610ed4b640 1 -- 10.20.193.26:0/2638321779 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61080b8f90 con 0x7f610815d610 2026-02-24T19:18:11.118 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.117+0000 7f60fd7fa640 1 -- 10.20.193.26:0/2638321779 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f60f00049f0 con 0x7f610815d610 2026-02-24T19:18:11.118 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.117+0000 7f60fd7fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.118 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.117+0000 7f60fd7fa640 1 -- 10.20.193.26:0/2638321779 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f60f0004ba0 con 0x7f610815d610 2026-02-24T19:18:11.118 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.117+0000 7f60fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.118 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.117+0000 7f60fd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:11.118 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.117+0000 7f60fd7fa640 10 monclient: dump: 2026-02-24T19:18:11.118 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.118 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.118 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.118 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.118 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.118 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.118 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.118 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.118 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.118 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.119 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.117+0000 7f60feffd640 4 set_mon_vals no callback set 2026-02-24T19:18:11.119 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.118+0000 7f60fd7fa640 1 -- 10.20.193.26:0/2638321779 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f60f001da10 con 0x7f610815d610 2026-02-24T19:18:11.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.119+0000 7f610cac0640 10 monclient: get_auth_request con 0x7f60d8077d00 auth_method 0 2026-02-24T19:18:11.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.119+0000 7f60fd7fa640 1 -- 10.20.193.26:0/2638321779 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f60f00933f0 con 0x7f610815d610 2026-02-24T19:18:11.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.119+0000 7f60fd7fa640 10 client.4580.objecter ms_dispatch2 0x7f6108000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:11.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.119+0000 7f60fd7fa640 3 client.4580.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:11.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.119+0000 7f60fd7fa640 3 client.4580.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:11.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.119+0000 7f60fd7fa640 20 client.4580.objecter dump_active .. 0 homeless 2026-02-24T19:18:11.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.119+0000 7ff930bbb640 10 monclient: get_monmap_and_config 2026-02-24T19:18:11.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.119+0000 7ff930bbb640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.119+0000 7ff930bbb640 10 monclient: monmap: 2026-02-24T19:18:11.120 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.120 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.120 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:11.120202+0000 2026-02-24T19:18:11.120 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:11.120202+0000 2026-02-24T19:18:11.120 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.120 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.120 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.120 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.120 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.120 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.119+0000 7f60fd7fa640 10 client.4580.objecter ms_handle_connect 0x7f60d8077d00 2026-02-24T19:18:11.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.119+0000 7ff930bbb640 1 Processor -- start 2026-02-24T19:18:11.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.119+0000 7ff930bbb640 1 -- start start 2026-02-24T19:18:11.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.119+0000 7ff930bbb640 10 monclient: init 2026-02-24T19:18:11.121 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.120+0000 7ff930bbb640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.121 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.120+0000 7ff930bbb640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:18:11.121 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.120+0000 7ff930bbb640 10 monclient(hunting): picked mon.noname-a con 0x7ff92c0b9f80 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.121 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.120+0000 7ff930bbb640 10 monclient(hunting): picked mon.noname-b con 0x7ff92c0ba350 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.121 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.120+0000 7ff930bbb640 10 monclient(hunting): picked mon.noname-c con 0x7ff92c0585e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.121 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.120+0000 7ff930bbb640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff92c163930 con 0x7ff92c0b9f80 2026-02-24T19:18:11.121 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.120+0000 7ff930bbb640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff92c163bb0 con 0x7ff92c0ba350 2026-02-24T19:18:11.121 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.120+0000 7ff930bbb640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff92c163e90 con 0x7ff92c0585e0 2026-02-24T19:18:11.121 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.120+0000 7ff930bbb640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.121 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.120+0000 7ff930bbb640 10 monclient(hunting): authenticate will time out at 3673.802532s 2026-02-24T19:18:11.121 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.120+0000 7ff92a575640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7ff92c0b9f80 0x7ff92c163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:37982/0 (socket says 10.20.193.26:37982) 2026-02-24T19:18:11.121 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.120+0000 7ff92a575640 1 -- 10.20.193.26:0/123271190 learned_addr learned my addr 10.20.193.26:0/123271190 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.123 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.122+0000 7ff929573640 1 -- 10.20.193.26:0/123271190 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1900863983 0 0) 0x7ff920002910 con 0x7ff92c0b9f80 2026-02-24T19:18:11.123 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.122+0000 7ff929573640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.123 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.122+0000 7ff929573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.123 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.122+0000 7ff929573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.123 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.122+0000 7ff929573640 10 monclient(hunting): my global_id is 4572 2026-02-24T19:18:11.123 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.122+0000 7ff929573640 1 -- 10.20.193.26:0/123271190 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff918003610 con 0x7ff92c0b9f80 2026-02-24T19:18:11.125 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.124+0000 7ff929573640 1 -- 10.20.193.26:0/123271190 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 444310832 0 0) 0x7ff918003610 con 0x7ff92c0b9f80 2026-02-24T19:18:11.125 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.124+0000 7ff929573640 1 -- 10.20.193.26:0/123271190 >> v1:10.20.193.103:6789/0 conn(0x7ff92c0585e0 legacy=0x7ff92c166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:11.125 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.124+0000 7ff929573640 1 -- 10.20.193.26:0/123271190 >> v1:10.20.193.70:6789/0 conn(0x7ff92c0ba350 legacy=0x7ff92c057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:11.125 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.124+0000 7ff929573640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.125 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.124+0000 7ff929573640 1 monclient: found mon.noname-a 2026-02-24T19:18:11.125 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.124+0000 7ff929573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.125 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.124+0000 7ff929573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.125 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.124+0000 7ff929573640 1 -- 10.20.193.26:0/123271190 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff92c0573f0 con 0x7ff92c0b9f80 2026-02-24T19:18:11.125 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.124+0000 7ff929573640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.125 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.124+0000 7ff929573640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.125 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.124+0000 7ff929573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.125 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.124+0000 7ff929573640 1 -- 10.20.193.26:0/123271190 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ff920002fc0 con 0x7ff92c0b9f80 2026-02-24T19:18:11.125 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.124+0000 7ff929573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.125 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.124+0000 7ff929573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:11.125 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.124+0000 7ff929573640 10 monclient: dump: 2026-02-24T19:18:11.125 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.125 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.125 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.125 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.125 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.125 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.125 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.125 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.125 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.125 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.125 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.124+0000 7ff930bbb640 5 monclient: authenticate success, global_id 4572 2026-02-24T19:18:11.125 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.124+0000 7ff930bbb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:11.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.125+0000 7ff929573640 1 -- 10.20.193.26:0/123271190 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff9200031d0 con 0x7ff92c0b9f80 2026-02-24T19:18:11.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.125+0000 7ff929573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.125+0000 7ff929573640 1 -- 10.20.193.26:0/123271190 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ff920004990 con 0x7ff92c0b9f80 2026-02-24T19:18:11.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.125+0000 7ff929573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.125+0000 7ff929573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:11.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.125+0000 7ff929573640 10 monclient: dump: 2026-02-24T19:18:11.126 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.126 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.126 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.126 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.126 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.126 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.126 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.126 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.126 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.126 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.125+0000 7ff930bbb640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:11.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.125+0000 7ff930bbb640 4 set_mon_vals no callback set 2026-02-24T19:18:11.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.125+0000 7ff930bbb640 10 monclient: shutdown 2026-02-24T19:18:11.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.125+0000 7ff930bbb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.125+0000 7ff930bbb640 1 -- 10.20.193.26:0/123271190 >> v1:10.20.193.26:6789/0 conn(0x7ff92c0b9f80 legacy=0x7ff92c163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.125+0000 7ff930bbb640 1 -- 10.20.193.26:0/123271190 shutdown_connections 2026-02-24T19:18:11.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.125+0000 7ff930bbb640 1 -- 10.20.193.26:0/123271190 >> 10.20.193.26:0/123271190 conn(0x7ff92c0b7990 msgr2=0x7ff92c0b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.125+0000 7ff930bbb640 1 -- 10.20.193.26:0/123271190 shutdown_connections 2026-02-24T19:18:11.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.125+0000 7ff930bbb640 1 -- 10.20.193.26:0/123271190 wait complete. 2026-02-24T19:18:11.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.126+0000 7ff930bbb640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.126+0000 7ff930bbb640 10 monclient: monmap: 2026-02-24T19:18:11.127 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.127 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:11.127 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:11.127 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:11.127 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.127 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:11.127 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.127 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.127 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.127 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.126+0000 7ff930bbb640 1 librados: starting msgr at 2026-02-24T19:18:11.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.126+0000 7ff930bbb640 1 librados: starting objecter 2026-02-24T19:18:11.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.126+0000 7ff930bbb640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:11.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.126+0000 7ff930bbb640 1 Processor -- start 2026-02-24T19:18:11.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.126+0000 7ff930bbb640 1 -- start start 2026-02-24T19:18:11.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.126+0000 7ff930bbb640 1 librados: setting wanted keys 2026-02-24T19:18:11.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.126+0000 7ff930bbb640 1 librados: calling monclient init 2026-02-24T19:18:11.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.126+0000 7ff930bbb640 10 monclient: init 2026-02-24T19:18:11.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.126+0000 7ff930bbb640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.126+0000 7ff930bbb640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:18:11.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.126+0000 7ff930bbb640 10 monclient(hunting): picked mon.noname-a con 0x7ff92c0585e0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.126+0000 7ff930bbb640 10 monclient(hunting): picked mon.noname-b con 0x7ff92c0b9f80 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.126+0000 7ff930bbb640 10 monclient(hunting): picked mon.noname-c con 0x7ff92c0ba350 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.128 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.126+0000 7ff930bbb640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff92c155880 con 0x7ff92c0585e0 2026-02-24T19:18:11.128 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.126+0000 7ff930bbb640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff92c1fd090 con 0x7ff92c0b9f80 2026-02-24T19:18:11.128 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.126+0000 7ff930bbb640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff92c1fd370 con 0x7ff92c0ba350 2026-02-24T19:18:11.128 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.126+0000 7ff930bbb640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.128 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.126+0000 7ff930bbb640 10 monclient(hunting): authenticate will time out at 3673.808762s 2026-02-24T19:18:11.128 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.127+0000 7ff92a575640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7ff92c0585e0 0x7ff92c1fb660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:37986/0 (socket says 10.20.193.26:37986) 2026-02-24T19:18:11.128 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.127+0000 7ff92a575640 1 -- 10.20.193.26:0/3181947649 learned_addr learned my addr 10.20.193.26:0/3181947649 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.128 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.127+0000 7ff912ffd640 10 client.?.objecter ms_handle_connect 0x7ff92c0585e0 2026-02-24T19:18:11.128 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.127+0000 7ff912ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.128+0000 7ff912ffd640 1 -- 10.20.193.26:0/3181947649 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2180384230 0 0) 0x7ff92c155880 con 0x7ff92c0585e0 2026-02-24T19:18:11.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.128+0000 7ff912ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.128+0000 7ff912ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.128+0000 7ff912ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.128+0000 7ff912ffd640 10 monclient(hunting): my global_id is 4575 2026-02-24T19:18:11.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.128+0000 7ff912ffd640 1 -- 10.20.193.26:0/3181947649 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8f8003610 con 0x7ff92c0585e0 2026-02-24T19:18:11.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.131+0000 7ff912ffd640 1 -- 10.20.193.26:0/3181947649 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 221131406 0 0) 0x7ff8f8003610 con 0x7ff92c0585e0 2026-02-24T19:18:11.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.131+0000 7ff912ffd640 1 -- 10.20.193.26:0/3181947649 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff92c155880 con 0x7ff92c0585e0 2026-02-24T19:18:11.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.131+0000 7ff912ffd640 1 -- 10.20.193.26:0/3181947649 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ff920002d30 con 0x7ff92c0585e0 2026-02-24T19:18:11.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.131+0000 7ff912ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:11.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.131+0000 7ff912ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:11.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.131+0000 7ff912ffd640 10 monclient(hunting): dump: 2026-02-24T19:18:11.132 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.132 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.132 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.132 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.132 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.132 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.132 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.132 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.132 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.132 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.131+0000 7ff912ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:11.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.133+0000 7ff912ffd640 1 -- 10.20.193.26:0/3181947649 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3736825498 0 0) 0x7ff92c155880 con 0x7ff92c0585e0 2026-02-24T19:18:11.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.133+0000 7ff912ffd640 1 -- 10.20.193.26:0/3181947649 >> v1:10.20.193.103:6789/0 conn(0x7ff92c0ba350 legacy=0x7ff92c1f8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.133+0000 7ff912ffd640 1 -- 10.20.193.26:0/3181947649 >> v1:10.20.193.70:6789/0 conn(0x7ff92c0b9f80 legacy=0x7ff92c155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.133+0000 7ff912ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.133+0000 7ff912ffd640 1 monclient: found mon.a 2026-02-24T19:18:11.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.133+0000 7ff912ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.133+0000 7ff912ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.133+0000 7ff912ffd640 1 -- 10.20.193.26:0/3181947649 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff92c1fd650 con 0x7ff92c0585e0 2026-02-24T19:18:11.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.133+0000 7ff912ffd640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.133+0000 7ff912ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.133+0000 7ff912ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.133+0000 7ff930bbb640 5 monclient: authenticate success, global_id 4575 2026-02-24T19:18:11.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.133+0000 7ff930bbb640 10 monclient: _renew_subs 2026-02-24T19:18:11.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.133+0000 7ff930bbb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.133+0000 7ff930bbb640 1 -- 10.20.193.26:0/3181947649 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff92c1fd930 con 0x7ff92c0585e0 2026-02-24T19:18:11.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.133+0000 7ff930bbb640 10 client.4575.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:11.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.133+0000 7ff930bbb640 10 monclient: _renew_subs 2026-02-24T19:18:11.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.133+0000 7ff930bbb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.133+0000 7ff930bbb640 1 -- 10.20.193.26:0/3181947649 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff92c1f9510 con 0x7ff92c0585e0 2026-02-24T19:18:11.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.133+0000 7ff930bbb640 1 librados: init done 2026-02-24T19:18:11.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.133+0000 7ff930bbb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.133+0000 7ff930bbb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.133+0000 7ff930bbb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.133+0000 7ff930bbb640 1 -- 10.20.193.26:0/3181947649 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff92c159080 con 0x7ff92c0585e0 2026-02-24T19:18:11.141 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.141+0000 7ff912ffd640 1 -- 10.20.193.26:0/3181947649 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff920002fe0 con 0x7ff92c0585e0 2026-02-24T19:18:11.141 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.141+0000 7ff912ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.141 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.141+0000 7ff912ffd640 1 -- 10.20.193.26:0/3181947649 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ff920005020 con 0x7ff92c0585e0 2026-02-24T19:18:11.141 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.141+0000 7ff912ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.141 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.141+0000 7ff912ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:11.141 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.141+0000 7ff912ffd640 10 monclient: dump: 2026-02-24T19:18:11.141 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.142 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.142 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.142 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.142 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.142 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.142 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.142 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.142 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.142 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.142 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.141+0000 7ff928d72640 4 set_mon_vals no callback set 2026-02-24T19:18:11.142 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.141+0000 7ff912ffd640 1 -- 10.20.193.26:0/3181947649 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7ff92001de90 con 0x7ff92c0585e0 2026-02-24T19:18:11.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.142+0000 7ff929d74640 10 monclient: get_auth_request con 0x7ff8f8077d10 auth_method 0 2026-02-24T19:18:11.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.142+0000 7ff912ffd640 10 client.4575.objecter ms_handle_connect 0x7ff8f8077d10 2026-02-24T19:18:11.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.142+0000 7ff912ffd640 1 -- 10.20.193.26:0/3181947649 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7ff9200934c0 con 0x7ff92c0585e0 2026-02-24T19:18:11.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.142+0000 7ff912ffd640 10 client.4575.objecter ms_dispatch2 0x7ff92c000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:11.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.142+0000 7ff912ffd640 3 client.4575.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:11.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.142+0000 7ff912ffd640 3 client.4575.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:11.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.143+0000 7ff912ffd640 20 client.4575.objecter dump_active .. 0 homeless 2026-02-24T19:18:11.146 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.145+0000 7faaea7fc640 1 -- 10.20.193.26:0/1424000991 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faaf0003460 con 0x7faafc157b50 2026-02-24T19:18:11.146 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.145+0000 7faaea7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.146 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.145+0000 7faaea7fc640 1 -- 10.20.193.26:0/1424000991 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7faaf0003b50 con 0x7faafc157b50 2026-02-24T19:18:11.146 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.145+0000 7faaea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.146 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.145+0000 7faaea7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:11.146 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.145+0000 7faaea7fc640 10 monclient: dump: 2026-02-24T19:18:11.146 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.146 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.146 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.146 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.146 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.146 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.146 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.146 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.146 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.146 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.146 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.145+0000 7faaeb7fe640 4 set_mon_vals no callback set 2026-02-24T19:18:11.146 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.146+0000 7faaea7fc640 1 -- 10.20.193.26:0/1424000991 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7faaf0003d30 con 0x7faafc157b50 2026-02-24T19:18:11.147 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.146+0000 7fab01bdf640 10 monclient: get_auth_request con 0x7faacc077bf0 auth_method 0 2026-02-24T19:18:11.147 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.147+0000 7faaea7fc640 10 client.4552.objecter ms_handle_connect 0x7faacc077bf0 2026-02-24T19:18:11.148 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.147+0000 7faaea7fc640 1 -- 10.20.193.26:0/1424000991 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7faaf0093360 con 0x7faafc157b50 2026-02-24T19:18:11.148 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.147+0000 7faaea7fc640 10 client.4552.objecter ms_dispatch2 0x7faafc000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:11.148 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.147+0000 7faaea7fc640 3 client.4552.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:11.148 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.147+0000 7faaea7fc640 3 client.4552.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:11.148 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.147+0000 7faaea7fc640 20 client.4552.objecter dump_active .. 0 homeless 2026-02-24T19:18:11.149 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.149+0000 7faaea7fc640 1 -- 10.20.193.26:0/1424000991 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7faafc0531e0 con 0x7faafc157b50 2026-02-24T19:18:11.149 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.149+0000 7faaea7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.150 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.149+0000 7faaea7fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:11.160 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-24T19:18:11.203 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-24T19:18:11.206 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.205+0000 7f60fd7fa640 1 -- 10.20.193.26:0/2638321779 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f60f005de20 con 0x7f610815d610 2026-02-24T19:18:11.206 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.205+0000 7f60fd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.206 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.205+0000 7f60fd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:11.216 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.215+0000 7f19627d9640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-24T19:18:11.216 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.215+0000 7f19627d9640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-24T19:18:11.216 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.215+0000 7f19627d9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.216 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.215+0000 7f19627d9640 1 -- 10.20.193.26:0/1257181397 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f195c0b5af0 con 0x7f195c15d070 2026-02-24T19:18:11.226 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.225+0000 7f1f6a967640 10 monclient: get_monmap_and_config 2026-02-24T19:18:11.226 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.225+0000 7f1f6a967640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.226 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.225+0000 7f1f6a967640 10 monclient: monmap: 2026-02-24T19:18:11.226 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.226 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.226 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:11.226702+0000 2026-02-24T19:18:11.226 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:11.226702+0000 2026-02-24T19:18:11.226 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.227 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.227 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.227 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.227 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.227 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.226+0000 7f1f6a967640 1 Processor -- start 2026-02-24T19:18:11.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.226+0000 7f1f6a967640 1 -- start start 2026-02-24T19:18:11.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.226+0000 7f1f6a967640 10 monclient: init 2026-02-24T19:18:11.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.226+0000 7f1f6a967640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.226+0000 7f1f6a967640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:18:11.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.226+0000 7f1f6a967640 10 monclient(hunting): picked mon.noname-b con 0x7f1f6415d3b0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.226+0000 7f1f6a967640 10 monclient(hunting): picked mon.noname-c con 0x7f1f640b4c30 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.226+0000 7f1f6a967640 10 monclient(hunting): picked mon.noname-a con 0x7f1f641a7ac0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.226+0000 7f1f6a967640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f64164640 con 0x7f1f641a7ac0 2026-02-24T19:18:11.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.226+0000 7f1f6a967640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f640b1530 con 0x7f1f6415d3b0 2026-02-24T19:18:11.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.226+0000 7f1f6a967640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f640b1810 con 0x7f1f640b4c30 2026-02-24T19:18:11.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.226+0000 7f1f6a967640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.228 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.226+0000 7f1f6a967640 10 monclient(hunting): authenticate will time out at 3673.908936s 2026-02-24T19:18:11.228 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.227+0000 7f1f637fe640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f1f640b4c30 0x7f1f640af6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58608/0 (socket says 10.20.193.26:58608) 2026-02-24T19:18:11.228 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.227+0000 7f1f637fe640 1 -- 10.20.193.26:0/3289220060 learned_addr learned my addr 10.20.193.26:0/3289220060 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.229 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-24T19:18:11.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.228+0000 7f1f62ffd640 1 -- 10.20.193.26:0/3289220060 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 270203402 0 0) 0x7f1f640b1810 con 0x7f1f640b4c30 2026-02-24T19:18:11.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.228+0000 7f1f62ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.228+0000 7f1f62ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.228+0000 7f1f62ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.228+0000 7f1f62ffd640 10 monclient(hunting): my global_id is 4583 2026-02-24T19:18:11.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.228+0000 7f1f62ffd640 1 -- 10.20.193.26:0/3289220060 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f48003610 con 0x7f1f640b4c30 2026-02-24T19:18:11.230 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.229+0000 7f1f62ffd640 1 -- 10.20.193.26:0/3289220060 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3287901871 0 0) 0x7f1f640b1530 con 0x7f1f6415d3b0 2026-02-24T19:18:11.230 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.229+0000 7f1f62ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.230 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.229+0000 7f1f62ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.230 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.229+0000 7f1f62ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.230 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.229+0000 7f1f62ffd640 10 monclient(hunting): my global_id is 4555 2026-02-24T19:18:11.230 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.229+0000 7f1f62ffd640 1 -- 10.20.193.26:0/3289220060 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f640b1810 con 0x7f1f6415d3b0 2026-02-24T19:18:11.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.230+0000 7f1f62ffd640 1 -- 10.20.193.26:0/3289220060 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3583041725 0 0) 0x7f1f48003610 con 0x7f1f640b4c30 2026-02-24T19:18:11.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.230+0000 7f1f62ffd640 1 -- 10.20.193.26:0/3289220060 >> v1:10.20.193.70:6789/0 conn(0x7f1f6415d3b0 legacy=0x7f1f64163bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.230+0000 7f1f62ffd640 1 -- 10.20.193.26:0/3289220060 >> v1:10.20.193.26:6789/0 conn(0x7f1f641a7ac0 legacy=0x7f1f641c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:11.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.230+0000 7f1f62ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.230+0000 7f1f62ffd640 1 monclient: found mon.noname-c 2026-02-24T19:18:11.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.230+0000 7f1f62ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.230+0000 7f1f62ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.230+0000 7f1f62ffd640 1 -- 10.20.193.26:0/3289220060 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f640aebd0 con 0x7f1f640b4c30 2026-02-24T19:18:11.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.230+0000 7f1f62ffd640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.230+0000 7f1f62ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.230+0000 7f1f62ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.230+0000 7f1f62ffd640 1 -- 10.20.193.26:0/3289220060 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f1f54002df0 con 0x7f1f640b4c30 2026-02-24T19:18:11.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.230+0000 7f1f6a967640 5 monclient: authenticate success, global_id 4583 2026-02-24T19:18:11.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.230+0000 7f1f6a967640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:11.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.230+0000 7f1f62ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.230+0000 7f1f62ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:11.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.230+0000 7f1f62ffd640 10 monclient: dump: 2026-02-24T19:18:11.231 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.230+0000 7f1f6a967640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.231+0000 7ff912ffd640 1 -- 10.20.193.26:0/3181947649 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7ff92c159080 con 0x7ff92c0585e0 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.231+0000 7ff912ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.231+0000 7ff912ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.231+0000 7f1f62ffd640 1 -- 10.20.193.26:0/3289220060 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1f54003000 con 0x7f1f640b4c30 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.231+0000 7f1f62ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.231+0000 7f1f62ffd640 1 -- 10.20.193.26:0/3289220060 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f1f54003440 con 0x7f1f640b4c30 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.231+0000 7f1f62ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.231+0000 7f1f62ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.231+0000 7f1f62ffd640 10 monclient: dump: 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.232 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.233 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.231+0000 7f1f6a967640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:11.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.231+0000 7f1f6a967640 4 set_mon_vals no callback set 2026-02-24T19:18:11.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.231+0000 7f1958ff9640 1 -- 10.20.193.26:0/1257181397 <== mon.0 v1:10.20.193.26:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+12 (unknown 3646472635 0 1257367751) 0x7f194805d470 con 0x7f195c15d070 2026-02-24T19:18:11.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.231+0000 7f1958ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-24T19:18:11.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.231+0000 7f1958ff9640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:11.233 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:11.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.231+0000 7f1f6a967640 10 monclient: shutdown 2026-02-24T19:18:11.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.231+0000 7f1f6a967640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.231+0000 7f1f6a967640 1 -- 10.20.193.26:0/3289220060 >> v1:10.20.193.103:6789/0 conn(0x7f1f640b4c30 legacy=0x7f1f640af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.231+0000 7f1f6a967640 1 -- 10.20.193.26:0/3289220060 shutdown_connections 2026-02-24T19:18:11.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.231+0000 7f1f6a967640 1 -- 10.20.193.26:0/3289220060 >> 10.20.193.26:0/3289220060 conn(0x7f1f640b4120 msgr2=0x7f1f640b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.231+0000 7f1f6a967640 1 -- 10.20.193.26:0/3289220060 shutdown_connections 2026-02-24T19:18:11.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.231+0000 7f1f6a967640 1 -- 10.20.193.26:0/3289220060 wait complete. 2026-02-24T19:18:11.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.232+0000 7f1f6a967640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.232+0000 7f1f6a967640 10 monclient: monmap: 2026-02-24T19:18:11.233 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.233 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:11.233 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:11.233 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:11.233 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.233 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:11.233 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.233 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.233 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.233 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.232+0000 7f1f6a967640 1 librados: starting msgr at 2026-02-24T19:18:11.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.232+0000 7f1f6a967640 1 librados: starting objecter 2026-02-24T19:18:11.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.232+0000 7f1f6a967640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:11.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.232+0000 7f1f6a967640 1 Processor -- start 2026-02-24T19:18:11.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.233+0000 7f1f6a967640 1 -- start start 2026-02-24T19:18:11.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.233+0000 7f1f6a967640 1 librados: setting wanted keys 2026-02-24T19:18:11.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.233+0000 7f1f6a967640 1 librados: calling monclient init 2026-02-24T19:18:11.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.233+0000 7f1f6a967640 10 monclient: init 2026-02-24T19:18:11.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.233+0000 7f1f6a967640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.233+0000 7f1f6a967640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:18:11.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.233+0000 7f1f6a967640 10 monclient(hunting): picked mon.noname-b con 0x7f1f640b4c30 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.233+0000 7f1f6a967640 10 monclient(hunting): picked mon.noname-a con 0x7f1f6415d3b0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.233+0000 7f1f6a967640 10 monclient(hunting): picked mon.noname-c con 0x7f1f641a7ac0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.233+0000 7f1f6a967640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f641624f0 con 0x7f1f6415d3b0 2026-02-24T19:18:11.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.233+0000 7f1f6a967640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f64161060 con 0x7f1f640b4c30 2026-02-24T19:18:11.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.233+0000 7f1f6a967640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f641280a0 con 0x7f1f641a7ac0 2026-02-24T19:18:11.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.233+0000 7f1f6a967640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.233+0000 7f1f6a967640 10 monclient(hunting): authenticate will time out at 3673.915706s 2026-02-24T19:18:11.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.234+0000 7f1f68edd640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f1f641a7ac0 0x7f1f64192420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58622/0 (socket says 10.20.193.26:58622) 2026-02-24T19:18:11.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.234+0000 7f1f68edd640 1 -- 10.20.193.26:0/1922015006 learned_addr learned my addr 10.20.193.26:0/1922015006 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.234+0000 7f1f60ff9640 10 client.?.objecter ms_handle_connect 0x7f1f640b4c30 2026-02-24T19:18:11.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.234+0000 7f1f60ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.234+0000 7f19627d9640 10 librados: watch_flush enter 2026-02-24T19:18:11.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.234+0000 7f19627d9640 10 librados: watch_flush exit 2026-02-24T19:18:11.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.234+0000 7f1f60ff9640 10 client.?.objecter ms_handle_connect 0x7f1f641a7ac0 2026-02-24T19:18:11.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.234+0000 7f1f60ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.234+0000 7f19627d9640 20 client.4569.objecter shutdown clearing up homeless session... 2026-02-24T19:18:11.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.234+0000 7f19627d9640 10 client.4569.objecter successfully canceled tick 2026-02-24T19:18:11.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.234+0000 7f19627d9640 1 -- 10.20.193.26:0/1257181397 >> v1:10.20.193.162:6800/3889602630 conn(0x7f192c077f40 legacy=0x7f192c0983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.234+0000 7f19627d9640 10 monclient: shutdown 2026-02-24T19:18:11.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.234+0000 7f19627d9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.234+0000 7f19627d9640 1 -- 10.20.193.26:0/1257181397 >> v1:10.20.193.26:6789/0 conn(0x7f195c15d070 legacy=0x7f195c1fd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.234+0000 7f19627d9640 1 -- 10.20.193.26:0/1257181397 shutdown_connections 2026-02-24T19:18:11.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.234+0000 7f19627d9640 1 -- 10.20.193.26:0/1257181397 >> 10.20.193.26:0/1257181397 conn(0x7f195c0b2ef0 msgr2=0x7f195c15bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.234+0000 7f19627d9640 1 -- 10.20.193.26:0/1257181397 shutdown_connections 2026-02-24T19:18:11.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.234+0000 7f19627d9640 1 -- 10.20.193.26:0/1257181397 wait complete. 2026-02-24T19:18:11.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.234+0000 7f19627d9640 1 librados: shutdown 2026-02-24T19:18:11.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.235+0000 7f1f60ff9640 1 -- 10.20.193.26:0/1922015006 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 99954289 0 0) 0x7f1f641280a0 con 0x7f1f641a7ac0 2026-02-24T19:18:11.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.235+0000 7f1f60ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.235+0000 7f1f60ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.235+0000 7f1f60ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.235+0000 7f1f60ff9640 10 monclient(hunting): my global_id is 4586 2026-02-24T19:18:11.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.235+0000 7f1f60ff9640 1 -- 10.20.193.26:0/1922015006 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f34003610 con 0x7f1f641a7ac0 2026-02-24T19:18:11.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.235+0000 7f1f60ff9640 1 -- 10.20.193.26:0/1922015006 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4281075447 0 0) 0x7f1f64161060 con 0x7f1f640b4c30 2026-02-24T19:18:11.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.235+0000 7f1f60ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.235+0000 7f1f60ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.235+0000 7f1f60ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.235+0000 7f1f60ff9640 10 monclient(hunting): my global_id is 4558 2026-02-24T19:18:11.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.235+0000 7f1f60ff9640 1 -- 10.20.193.26:0/1922015006 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f641280a0 con 0x7f1f640b4c30 2026-02-24T19:18:11.237 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.237+0000 7f1f60ff9640 10 client.?.objecter ms_handle_connect 0x7f1f6415d3b0 2026-02-24T19:18:11.237 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.237+0000 7f1f60ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.238 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.237+0000 7f1f60ff9640 1 -- 10.20.193.26:0/1922015006 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3219200814 0 0) 0x7f1f641280a0 con 0x7f1f640b4c30 2026-02-24T19:18:11.238 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.237+0000 7f1f60ff9640 1 -- 10.20.193.26:0/1922015006 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f64161060 con 0x7f1f640b4c30 2026-02-24T19:18:11.238 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.237+0000 7f1f60ff9640 1 -- 10.20.193.26:0/1922015006 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f1f500030b0 con 0x7f1f640b4c30 2026-02-24T19:18:11.238 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.237+0000 7f1f60ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:11.238 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.237+0000 7f1f60ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:11.238 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.237+0000 7f1f60ff9640 10 monclient(hunting): dump: 2026-02-24T19:18:11.238 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.238 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.238 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.238 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.238 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.239 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.239 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.239 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.239 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.239 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.239 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.237+0000 7f1f60ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:11.239 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.238+0000 7f1f60ff9640 1 -- 10.20.193.26:0/1922015006 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1566437016 0 0) 0x7f1f34003610 con 0x7f1f641a7ac0 2026-02-24T19:18:11.239 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.238+0000 7f1f60ff9640 1 -- 10.20.193.26:0/1922015006 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f641280a0 con 0x7f1f641a7ac0 2026-02-24T19:18:11.239 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.238+0000 7f1f60ff9640 1 -- 10.20.193.26:0/1922015006 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f1f58003230 con 0x7f1f641a7ac0 2026-02-24T19:18:11.239 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.238+0000 7f1f60ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:11.239 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.238+0000 7f1f60ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:11.239 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.238+0000 7f1f60ff9640 10 monclient(hunting): dump: 2026-02-24T19:18:11.239 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.239 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.239 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.239 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.239 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.239 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.240 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.240 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.240 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.240 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.241 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.240+0000 7f1f60ff9640 1 -- 10.20.193.26:0/1922015006 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 634909241 0 0) 0x7f1f641624f0 con 0x7f1f6415d3b0 2026-02-24T19:18:11.241 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.240+0000 7f1f60ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.241 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.240+0000 7f1f60ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.241 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.240+0000 7f1f60ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.241 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.240+0000 7f1f60ff9640 10 monclient(hunting): my global_id is 4578 2026-02-24T19:18:11.241 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.240+0000 7f1f60ff9640 1 -- 10.20.193.26:0/1922015006 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f34003610 con 0x7f1f6415d3b0 2026-02-24T19:18:11.244 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313220 for osd.10 2026-02-24T19:18:11.262 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.261+0000 7fab03e6a640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-24T19:18:11.262 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.261+0000 7fab03e6a640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-24T19:18:11.262 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.261+0000 7fab03e6a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:11.262 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.261+0000 7fab03e6a640 1 -- 10.20.193.26:0/1424000991 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7faafc1647c0 con 0x7faafc157b50 2026-02-24T19:18:11.271 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.270+0000 7f1d91d79640 10 monclient: get_monmap_and_config 2026-02-24T19:18:11.271 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.270+0000 7f1d91d79640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.271 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.270+0000 7f1d91d79640 10 monclient: monmap: 2026-02-24T19:18:11.271 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.271 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.271 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:11.271686+0000 2026-02-24T19:18:11.271 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:11.271686+0000 2026-02-24T19:18:11.271 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.271 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.272 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.272 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.272 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.272 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.272 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.271+0000 7f1d91d79640 1 Processor -- start 2026-02-24T19:18:11.272 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.271+0000 7f1d91d79640 1 -- start start 2026-02-24T19:18:11.272 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.271+0000 7f1d91d79640 10 monclient: init 2026-02-24T19:18:11.272 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.271+0000 7f1d91d79640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.272 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.271+0000 7f1d91d79640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:18:11.272 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.271+0000 7f1d91d79640 10 monclient(hunting): picked mon.noname-a con 0x7f1d8c15d3b0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.272 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.271+0000 7f1d91d79640 10 monclient(hunting): picked mon.noname-b con 0x7f1d8c0b4c30 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.273 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.271+0000 7f1d91d79640 10 monclient(hunting): picked mon.noname-c con 0x7f1d8c1a7ac0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.273 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.271+0000 7f1d91d79640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d8c164640 con 0x7f1d8c15d3b0 2026-02-24T19:18:11.273 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.271+0000 7f1d91d79640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d8c0b1530 con 0x7f1d8c0b4c30 2026-02-24T19:18:11.273 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.271+0000 7f1d91d79640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d8c0b1810 con 0x7f1d8c1a7ac0 2026-02-24T19:18:11.273 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.271+0000 7f1d91d79640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.273 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.271+0000 7f1d91d79640 10 monclient(hunting): authenticate will time out at 3673.953987s 2026-02-24T19:18:11.276 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.275+0000 7f1d8bfff640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f1d8c1a7ac0 0x7f1d8c1c7ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58638/0 (socket says 10.20.193.26:58638) 2026-02-24T19:18:11.276 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.275+0000 7f1d8bfff640 1 -- 10.20.193.26:0/1746136404 learned_addr learned my addr 10.20.193.26:0/1746136404 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.279 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.278+0000 7faaea7fc640 1 -- 10.20.193.26:0/1424000991 <== mon.1 v1:10.20.193.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 778662779) 0x7faaf005dd90 con 0x7faafc157b50 2026-02-24T19:18:11.279 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.278+0000 7faaea7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-24T19:18:11.279 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.278+0000 7faaea7fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:11.279 INFO:teuthology.orchestra.run.trial026.stdout:90194313219 2026-02-24T19:18:11.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7f1f60ff9640 1 -- 10.20.193.26:0/1922015006 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 195552655 0 0) 0x7f1f641280a0 con 0x7f1f641a7ac0 2026-02-24T19:18:11.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7f1f60ff9640 1 -- 10.20.193.26:0/1922015006 >> v1:10.20.193.70:6789/0 conn(0x7f1f640b4c30 legacy=0x7f1f64129e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7f1f60ff9640 1 -- 10.20.193.26:0/1922015006 >> v1:10.20.193.26:6789/0 conn(0x7f1f6415d3b0 legacy=0x7f1f64161de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7f1f60ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7f1f60ff9640 1 monclient: found mon.c 2026-02-24T19:18:11.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7f1f60ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7f1f60ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7f1f60ff9640 1 -- 10.20.193.26:0/1922015006 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f64127dc0 con 0x7f1f641a7ac0 2026-02-24T19:18:11.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7f1f60ff9640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7f1f60ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7f1f60ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7f1f6a967640 5 monclient: authenticate success, global_id 4586 2026-02-24T19:18:11.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7f1f6a967640 10 monclient: _renew_subs 2026-02-24T19:18:11.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7f1f6a967640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7f1f6a967640 1 -- 10.20.193.26:0/1922015006 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1f64161300 con 0x7f1f641a7ac0 2026-02-24T19:18:11.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7f1f6a967640 10 client.4586.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:11.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7f1f6a967640 10 monclient: _renew_subs 2026-02-24T19:18:11.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7f1f6a967640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7f1f6a967640 1 -- 10.20.193.26:0/1922015006 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1f641618c0 con 0x7f1f641a7ac0 2026-02-24T19:18:11.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7f1f6a967640 1 librados: init done 2026-02-24T19:18:11.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7fab03e6a640 10 librados: watch_flush enter 2026-02-24T19:18:11.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7fab03e6a640 10 librados: watch_flush exit 2026-02-24T19:18:11.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7fab03e6a640 20 client.4552.objecter shutdown clearing up homeless session... 2026-02-24T19:18:11.283 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7fab03e6a640 10 client.4552.objecter successfully canceled tick 2026-02-24T19:18:11.283 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7f1d8a7fc640 1 -- 10.20.193.26:0/1746136404 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4142296770 0 0) 0x7f1d8c0b1810 con 0x7f1d8c1a7ac0 2026-02-24T19:18:11.283 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7f1d8a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.283 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7f1d8a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.283 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7f1d8a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.283 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7f1d8a7fc640 10 monclient(hunting): my global_id is 4589 2026-02-24T19:18:11.283 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7f1d8a7fc640 1 -- 10.20.193.26:0/1746136404 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d70003610 con 0x7f1d8c1a7ac0 2026-02-24T19:18:11.283 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7fab03e6a640 1 -- 10.20.193.26:0/1424000991 >> v1:10.20.193.162:6800/3889602630 conn(0x7faacc077bf0 legacy=0x7faacc0980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.283 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7fab03e6a640 10 monclient: shutdown 2026-02-24T19:18:11.283 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7fab03e6a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.283 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7fab03e6a640 1 -- 10.20.193.26:0/1424000991 >> v1:10.20.193.70:6789/0 conn(0x7faafc157b50 legacy=0x7faafc12e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.283 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7fab03e6a640 1 -- 10.20.193.26:0/1424000991 shutdown_connections 2026-02-24T19:18:11.283 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7fab03e6a640 1 -- 10.20.193.26:0/1424000991 >> 10.20.193.26:0/1424000991 conn(0x7faafc0b2ef0 msgr2=0x7faafc0ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.283 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7fab03e6a640 1 -- 10.20.193.26:0/1424000991 shutdown_connections 2026-02-24T19:18:11.283 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7fab03e6a640 1 -- 10.20.193.26:0/1424000991 wait complete. 2026-02-24T19:18:11.283 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.281+0000 7fab03e6a640 1 librados: shutdown 2026-02-24T19:18:11.283 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.282+0000 7f1f6a967640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.283 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.282+0000 7f1f6a967640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.283 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.282+0000 7f1f6a967640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.283 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.282+0000 7f1f6a967640 1 -- 10.20.193.26:0/1922015006 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f640531e0 con 0x7f1f641a7ac0 2026-02-24T19:18:11.284 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.283+0000 7f1f60ff9640 1 -- 10.20.193.26:0/1922015006 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1f580037e0 con 0x7f1f641a7ac0 2026-02-24T19:18:11.284 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.283+0000 7f1f60ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.284 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.283+0000 7f1f60ff9640 1 -- 10.20.193.26:0/1922015006 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f1f58004e40 con 0x7f1f641a7ac0 2026-02-24T19:18:11.284 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.283+0000 7f1f60ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.284 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.283+0000 7f1f60ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:11.284 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.283+0000 7f1f627fc640 4 set_mon_vals no callback set 2026-02-24T19:18:11.284 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.283+0000 7f1f60ff9640 10 monclient: dump: 2026-02-24T19:18:11.284 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.284 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.284 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.284 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.284 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.284 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.284 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.284 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.284 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.284 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.285 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.284+0000 7f1d8a7fc640 1 -- 10.20.193.26:0/1746136404 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2627426333 0 0) 0x7f1d8c0b1530 con 0x7f1d8c0b4c30 2026-02-24T19:18:11.285 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.284+0000 7f1d8a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.285 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.284+0000 7f1d8a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.285 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.284+0000 7f1d8a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.285 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.284+0000 7f1d8a7fc640 10 monclient(hunting): my global_id is 4561 2026-02-24T19:18:11.285 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.284+0000 7f1d8a7fc640 1 -- 10.20.193.26:0/1746136404 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d8c0b1810 con 0x7f1d8c0b4c30 2026-02-24T19:18:11.287 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.287+0000 7f1d8a7fc640 1 -- 10.20.193.26:0/1746136404 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4148052315 0 0) 0x7f1d78002910 con 0x7f1d8c15d3b0 2026-02-24T19:18:11.287 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.287+0000 7f1d8a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.288 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.287+0000 7f1d8a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.288 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.287+0000 7f1d8a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.288 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.287+0000 7f1d8a7fc640 10 monclient(hunting): my global_id is 4581 2026-02-24T19:18:11.288 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.287+0000 7f1d8a7fc640 1 -- 10.20.193.26:0/1746136404 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d8c0b1530 con 0x7f1d8c15d3b0 2026-02-24T19:18:11.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.1 2026-02-24T19:18:11.293 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.292+0000 7f1d8a7fc640 1 -- 10.20.193.26:0/1746136404 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3344536829 0 0) 0x7f1d8c0b1530 con 0x7f1d8c15d3b0 2026-02-24T19:18:11.293 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.292+0000 7f1d8a7fc640 1 -- 10.20.193.26:0/1746136404 >> v1:10.20.193.103:6789/0 conn(0x7f1d8c1a7ac0 legacy=0x7f1d8c1c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.293 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.292+0000 7f1d8a7fc640 1 -- 10.20.193.26:0/1746136404 >> v1:10.20.193.70:6789/0 conn(0x7f1d8c0b4c30 legacy=0x7f1d8c0af6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.293 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.292+0000 7f1d8a7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.293 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.292+0000 7f1d8a7fc640 1 monclient: found mon.noname-a 2026-02-24T19:18:11.293 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.292+0000 7f1d8a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.293 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.292+0000 7f1d8a7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.293 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.292+0000 7f1d8a7fc640 1 -- 10.20.193.26:0/1746136404 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d8c0aebd0 con 0x7f1d8c15d3b0 2026-02-24T19:18:11.293 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.292+0000 7f1d8a7fc640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.293 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.292+0000 7f1d8a7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.293 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.292+0000 7f1d8a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.293 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.292+0000 7f1d8a7fc640 1 -- 10.20.193.26:0/1746136404 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f1d78002fa0 con 0x7f1d8c15d3b0 2026-02-24T19:18:11.293 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.292+0000 7f1d8a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.293 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.292+0000 7f1d8a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:11.293 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.292+0000 7f1d8a7fc640 10 monclient: dump: 2026-02-24T19:18:11.293 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.292+0000 7f1d91d79640 5 monclient: authenticate success, global_id 4581 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.292+0000 7f1d91d79640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.293+0000 7f1d8a7fc640 1 -- 10.20.193.26:0/1746136404 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1d78003170 con 0x7f1d8c15d3b0 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.293+0000 7f1d8a7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.293+0000 7f1d8a7fc640 1 -- 10.20.193.26:0/1746136404 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f1d780035b0 con 0x7f1d8c15d3b0 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.293+0000 7f1d8a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.293+0000 7f1d8a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.293+0000 7f1d8a7fc640 10 monclient: dump: 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.293+0000 7f1d91d79640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:11.294 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.293+0000 7f1d91d79640 4 set_mon_vals no callback set 2026-02-24T19:18:11.295 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.293+0000 7f1d91d79640 10 monclient: shutdown 2026-02-24T19:18:11.295 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.293+0000 7f1d91d79640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.295 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.293+0000 7f1d91d79640 1 -- 10.20.193.26:0/1746136404 >> v1:10.20.193.26:6789/0 conn(0x7f1d8c15d3b0 legacy=0x7f1d8c163bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.295 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.293+0000 7f1d91d79640 1 -- 10.20.193.26:0/1746136404 shutdown_connections 2026-02-24T19:18:11.295 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.293+0000 7f1d91d79640 1 -- 10.20.193.26:0/1746136404 >> 10.20.193.26:0/1746136404 conn(0x7f1d8c0b4120 msgr2=0x7f1d8c0b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.295 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.293+0000 7f1d91d79640 1 -- 10.20.193.26:0/1746136404 shutdown_connections 2026-02-24T19:18:11.295 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.293+0000 7f1d91d79640 1 -- 10.20.193.26:0/1746136404 wait complete. 2026-02-24T19:18:11.295 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.294+0000 7f1d91d79640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.295 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.294+0000 7f1d91d79640 10 monclient: monmap: 2026-02-24T19:18:11.295 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.295 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:11.295 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:11.295 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:11.295 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.295 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:11.295 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.295 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.295 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.295 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.295 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.294+0000 7f1d91d79640 1 librados: starting msgr at 2026-02-24T19:18:11.295 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.294+0000 7f1d91d79640 1 librados: starting objecter 2026-02-24T19:18:11.295 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.294+0000 7f1d91d79640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:11.295 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.294+0000 7f1d91d79640 1 Processor -- start 2026-02-24T19:18:11.295 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.294+0000 7f1d91d79640 1 -- start start 2026-02-24T19:18:11.295 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.294+0000 7f1d91d79640 1 librados: setting wanted keys 2026-02-24T19:18:11.295 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.294+0000 7f1d91d79640 1 librados: calling monclient init 2026-02-24T19:18:11.295 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.294+0000 7f1d91d79640 10 monclient: init 2026-02-24T19:18:11.296 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.295+0000 7f1d91d79640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.296 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.295+0000 7f1d91d79640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:18:11.296 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.295+0000 7f1d91d79640 10 monclient(hunting): picked mon.noname-b con 0x7f1d8c0b4c30 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.296 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.295+0000 7fcb695ed640 10 monclient: get_monmap_and_config 2026-02-24T19:18:11.296 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.295+0000 7fcb695ed640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.296 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.295+0000 7f1d91d79640 10 monclient(hunting): picked mon.noname-c con 0x7f1d8c15d3b0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.296 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.295+0000 7fcb695ed640 10 monclient: monmap: 2026-02-24T19:18:11.296 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.296 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.296 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:11.295869+0000 2026-02-24T19:18:11.296 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:11.295869+0000 2026-02-24T19:18:11.296 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.296 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.296 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.296 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.296 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.296 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.296 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.295+0000 7f1d91d79640 10 monclient(hunting): picked mon.noname-a con 0x7f1d8c1a7ac0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.296 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.295+0000 7f1d91d79640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d8c0acf60 con 0x7f1d8c1a7ac0 2026-02-24T19:18:11.297 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.295+0000 7f1d91d79640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d8c0ac9a0 con 0x7f1d8c0b4c30 2026-02-24T19:18:11.297 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.295+0000 7f1d91d79640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d8c0acc80 con 0x7f1d8c15d3b0 2026-02-24T19:18:11.297 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.295+0000 7f1d91d79640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.297 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.295+0000 7f1d91d79640 10 monclient(hunting): authenticate will time out at 3673.977163s 2026-02-24T19:18:11.297 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.295+0000 7f1d8bfff640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f1d8c1a7ac0 0x7f1d8c12a090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:37994/0 (socket says 10.20.193.26:37994) 2026-02-24T19:18:11.297 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.295+0000 7f1d8bfff640 1 -- 10.20.193.26:0/3499724182 learned_addr learned my addr 10.20.193.26:0/3499724182 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.297 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.295+0000 7fcb695ed640 1 Processor -- start 2026-02-24T19:18:11.297 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.295+0000 7fcb695ed640 1 -- start start 2026-02-24T19:18:11.297 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.295+0000 7fcb695ed640 10 monclient: init 2026-02-24T19:18:11.297 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.295+0000 7f1d67fff640 10 client.?.objecter ms_handle_connect 0x7f1d8c1a7ac0 2026-02-24T19:18:11.297 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.295+0000 7f1d67fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.297 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.295+0000 7f1d67fff640 10 client.?.objecter ms_handle_connect 0x7f1d8c0b4c30 2026-02-24T19:18:11.297 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.295+0000 7f1d67fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.297 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.296+0000 7fcb695ed640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.297 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.296+0000 7fcb695ed640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:18:11.297 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.296+0000 7fcb695ed640 10 monclient(hunting): picked mon.noname-c con 0x7fcb640b9f80 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.297 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.296+0000 7fcb695ed640 10 monclient(hunting): picked mon.noname-a con 0x7fcb640ba350 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.297 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.296+0000 7fcb695ed640 10 monclient(hunting): picked mon.noname-b con 0x7fcb640585e0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.297 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.296+0000 7fcb695ed640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb64163930 con 0x7fcb640ba350 2026-02-24T19:18:11.297 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.296+0000 7fcb695ed640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb64163bb0 con 0x7fcb640585e0 2026-02-24T19:18:11.298 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.296+0000 7fcb695ed640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb64163e90 con 0x7fcb640b9f80 2026-02-24T19:18:11.298 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.296+0000 7fcb695ed640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.298 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.296+0000 7fcb695ed640 10 monclient(hunting): authenticate will time out at 3673.978204s 2026-02-24T19:18:11.298 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.296+0000 7f1d67fff640 1 -- 10.20.193.26:0/3499724182 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1547440201 0 0) 0x7f1d8c0acf60 con 0x7f1d8c1a7ac0 2026-02-24T19:18:11.298 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.296+0000 7f1d67fff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.298 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.296+0000 7f1d67fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.298 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.296+0000 7f1d67fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.298 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.296+0000 7f1d67fff640 10 monclient(hunting): my global_id is 4584 2026-02-24T19:18:11.298 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.296+0000 7f1d67fff640 1 -- 10.20.193.26:0/3499724182 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d5c003610 con 0x7f1d8c1a7ac0 2026-02-24T19:18:11.298 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.296+0000 7fcb637fe640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7fcb640585e0 0x7fcb64166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:46220/0 (socket says 10.20.193.26:46220) 2026-02-24T19:18:11.298 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.296+0000 7fcb637fe640 1 -- 10.20.193.26:0/2699911158 learned_addr learned my addr 10.20.193.26:0/2699911158 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.300 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.300+0000 7f1d67fff640 1 -- 10.20.193.26:0/3499724182 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 623218949 0 0) 0x7f1d5c003610 con 0x7f1d8c1a7ac0 2026-02-24T19:18:11.301 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.300+0000 7f1d67fff640 1 -- 10.20.193.26:0/3499724182 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1d8c0acf60 con 0x7f1d8c1a7ac0 2026-02-24T19:18:11.301 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.300+0000 7f1d67fff640 1 -- 10.20.193.26:0/3499724182 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f1d800032a0 con 0x7f1d8c1a7ac0 2026-02-24T19:18:11.301 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.300+0000 7f1d67fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:11.301 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.300+0000 7f1d67fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:11.301 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.300+0000 7f1d67fff640 10 monclient(hunting): dump: 2026-02-24T19:18:11.301 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.301 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.301 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.301 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.301 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.301 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.301 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.301 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.301 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.301 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.301 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.300+0000 7f1d67fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:11.301 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.300+0000 7fcb61ffb640 1 -- 10.20.193.26:0/2699911158 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4130923195 0 0) 0x7fcb4c002910 con 0x7fcb640ba350 2026-02-24T19:18:11.301 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.300+0000 7fcb61ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.301 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.300+0000 7fcb61ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.301 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.300+0000 7fcb61ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.301 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.300+0000 7fcb61ffb640 10 monclient(hunting): my global_id is 4587 2026-02-24T19:18:11.301 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.300+0000 7fcb61ffb640 1 -- 10.20.193.26:0/2699911158 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb50003610 con 0x7fcb640ba350 2026-02-24T19:18:11.304 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.303+0000 7f1d67fff640 1 -- 10.20.193.26:0/3499724182 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2820656131 0 0) 0x7f1d8c0acf60 con 0x7f1d8c1a7ac0 2026-02-24T19:18:11.304 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.303+0000 7f1d67fff640 1 -- 10.20.193.26:0/3499724182 >> v1:10.20.193.103:6789/0 conn(0x7f1d8c15d3b0 legacy=0x7f1d8c128af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.304 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.303+0000 7f1d67fff640 1 -- 10.20.193.26:0/3499724182 >> v1:10.20.193.70:6789/0 conn(0x7f1d8c0b4c30 legacy=0x7f1d8c164dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.304 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.303+0000 7f1d67fff640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.304 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.303+0000 7f1d67fff640 1 monclient: found mon.a 2026-02-24T19:18:11.304 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.303+0000 7f1d67fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.304 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.303+0000 7f1d67fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.304 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.303+0000 7f1d67fff640 1 -- 10.20.193.26:0/3499724182 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d8c128010 con 0x7f1d8c1a7ac0 2026-02-24T19:18:11.304 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.303+0000 7f1d67fff640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.304 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.303+0000 7f1d67fff640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.304 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.303+0000 7f1d67fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.304 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.303+0000 7f1d91d79640 5 monclient: authenticate success, global_id 4584 2026-02-24T19:18:11.304 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.303+0000 7f1d91d79640 10 monclient: _renew_subs 2026-02-24T19:18:11.304 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.303+0000 7f1d91d79640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.304 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.303+0000 7f1d91d79640 1 -- 10.20.193.26:0/3499724182 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1d8c1282f0 con 0x7f1d8c1a7ac0 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.303+0000 7f1d91d79640 10 client.4584.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.303+0000 7f1d91d79640 10 monclient: _renew_subs 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.303+0000 7f1d91d79640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.303+0000 7f1d91d79640 1 -- 10.20.193.26:0/3499724182 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1d8c129200 con 0x7f1d8c1a7ac0 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.303+0000 7f1d91d79640 1 librados: init done 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.304+0000 7fcb61ffb640 1 -- 10.20.193.26:0/2699911158 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4131768809 0 0) 0x7fcb50003610 con 0x7fcb640ba350 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.304+0000 7fcb61ffb640 1 -- 10.20.193.26:0/2699911158 >> v1:10.20.193.103:6789/0 conn(0x7fcb640b9f80 legacy=0x7fcb64163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.304+0000 7fcb61ffb640 1 -- 10.20.193.26:0/2699911158 >> v1:10.20.193.70:6789/0 conn(0x7fcb640585e0 legacy=0x7fcb64166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.304+0000 7fcb61ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.304+0000 7fcb61ffb640 1 monclient: found mon.noname-a 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.304+0000 7fcb61ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.304+0000 7fcb61ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.304+0000 7fcb61ffb640 1 -- 10.20.193.26:0/2699911158 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb640573f0 con 0x7fcb640ba350 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.304+0000 7fcb61ffb640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.304+0000 7fcb61ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.304+0000 7fcb61ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.304+0000 7fcb61ffb640 1 -- 10.20.193.26:0/2699911158 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fcb4c002fc0 con 0x7fcb640ba350 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.304+0000 7fcb61ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.304+0000 7fcb61ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.304+0000 7fcb61ffb640 10 monclient: dump: 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.304+0000 7fcb695ed640 5 monclient: authenticate success, global_id 4587 2026-02-24T19:18:11.305 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.304+0000 7fcb695ed640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:11.306 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.304+0000 7f1d91d79640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.306 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.304+0000 7f1d91d79640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.306 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.304+0000 7f1d91d79640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.306 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.304+0000 7f1d91d79640 1 -- 10.20.193.26:0/3499724182 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d8c0531e0 con 0x7f1d8c1a7ac0 2026-02-24T19:18:11.316 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.315+0000 7f610ed4b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-24T19:18:11.316 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.315+0000 7f610ed4b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-24T19:18:11.316 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.315+0000 7f610ed4b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.316 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.315+0000 7f610ed4b640 1 -- 10.20.193.26:0/2638321779 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f61080b8cb0 con 0x7f610815d610 2026-02-24T19:18:11.343 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.342+0000 7ff930bbb640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-24T19:18:11.343 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.342+0000 7ff930bbb640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-24T19:18:11.343 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.342+0000 7ff930bbb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.343 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.342+0000 7ff930bbb640 1 -- 10.20.193.26:0/3181947649 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 12} v 0) -- 0x7ff92c1f97a0 con 0x7ff92c0585e0 2026-02-24T19:18:11.374 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.373+0000 7f1f60ff9640 1 -- 10.20.193.26:0/1922015006 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f1f5801dcb0 con 0x7f1f641a7ac0 2026-02-24T19:18:11.374 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.374+0000 7f1f63fff640 10 monclient: get_auth_request con 0x7f1f34077d60 auth_method 0 2026-02-24T19:18:11.375 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.374+0000 7f1f60ff9640 10 client.4586.objecter ms_handle_connect 0x7f1f34077d60 2026-02-24T19:18:11.375 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.374+0000 7f1f60ff9640 1 -- 10.20.193.26:0/1922015006 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f1f580934c0 con 0x7f1f641a7ac0 2026-02-24T19:18:11.375 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.374+0000 7f1f60ff9640 10 client.4586.objecter ms_dispatch2 0x7f1f64000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:11.375 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.374+0000 7f1f60ff9640 3 client.4586.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:11.375 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.374+0000 7f1f60ff9640 3 client.4586.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:11.375 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.374+0000 7f1f60ff9640 20 client.4586.objecter dump_active .. 0 homeless 2026-02-24T19:18:11.376 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.376+0000 7f1f60ff9640 1 -- 10.20.193.26:0/1922015006 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f1f5805def0 con 0x7f1f641a7ac0 2026-02-24T19:18:11.377 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.376+0000 7f1f60ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.377 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.376+0000 7f1f60ff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:11.381 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.380+0000 7f60fd7fa640 1 -- 10.20.193.26:0/2638321779 <== mon.2 v1:10.20.193.103:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+12 (unknown 3405404620 0 1257367751) 0x7f60f005d720 con 0x7f610815d610 2026-02-24T19:18:11.381 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.380+0000 7f60fd7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-24T19:18:11.381 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.380+0000 7f60fd7fa640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:11.381 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:11.384 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.383+0000 7f610ed4b640 10 librados: watch_flush enter 2026-02-24T19:18:11.384 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.383+0000 7f610ed4b640 10 librados: watch_flush exit 2026-02-24T19:18:11.384 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.383+0000 7f610ed4b640 20 client.4580.objecter shutdown clearing up homeless session... 2026-02-24T19:18:11.384 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.383+0000 7f610ed4b640 10 client.4580.objecter successfully canceled tick 2026-02-24T19:18:11.384 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.383+0000 7f610ed4b640 1 -- 10.20.193.26:0/2638321779 >> v1:10.20.193.162:6800/3889602630 conn(0x7f60d8077d00 legacy=0x7f60d80981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.384 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.383+0000 7f610ed4b640 10 monclient: shutdown 2026-02-24T19:18:11.384 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.383+0000 7f610ed4b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.384 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.383+0000 7f610ed4b640 1 -- 10.20.193.26:0/2638321779 >> v1:10.20.193.103:6789/0 conn(0x7f610815d610 legacy=0x7f61080b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.384 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.383+0000 7f610ed4b640 1 -- 10.20.193.26:0/2638321779 shutdown_connections 2026-02-24T19:18:11.384 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.383+0000 7f610ed4b640 1 -- 10.20.193.26:0/2638321779 >> 10.20.193.26:0/2638321779 conn(0x7f61080b7470 msgr2=0x7f610815b500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.384 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.383+0000 7f610ed4b640 1 -- 10.20.193.26:0/2638321779 shutdown_connections 2026-02-24T19:18:11.384 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.383+0000 7f610ed4b640 1 -- 10.20.193.26:0/2638321779 wait complete. 2026-02-24T19:18:11.384 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.383+0000 7f610ed4b640 1 librados: shutdown 2026-02-24T19:18:11.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313220 for osd.11 2026-02-24T19:18:11.395 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.395+0000 7f1d67fff640 1 -- 10.20.193.26:0/3499724182 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1d80004c50 con 0x7f1d8c1a7ac0 2026-02-24T19:18:11.395 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.395+0000 7f1d67fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.396 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.395+0000 7f1d67fff640 1 -- 10.20.193.26:0/3499724182 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f1d80004e00 con 0x7f1d8c1a7ac0 2026-02-24T19:18:11.396 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.395+0000 7f1d67fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.396 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.395+0000 7f1d67fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:11.396 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.395+0000 7f1d89ffb640 4 set_mon_vals no callback set 2026-02-24T19:18:11.396 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.395+0000 7f1d67fff640 10 monclient: dump: 2026-02-24T19:18:11.396 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.396 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.396 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.396 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.396 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.396 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.396 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.396 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.396 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.396 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.396 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.395+0000 7f1d67fff640 1 -- 10.20.193.26:0/3499724182 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f1d8001dc70 con 0x7f1d8c1a7ac0 2026-02-24T19:18:11.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.396+0000 7f1d8b7fe640 10 monclient: get_auth_request con 0x7f1d5c077cd0 auth_method 0 2026-02-24T19:18:11.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.396+0000 7f1d67fff640 10 client.4584.objecter ms_handle_connect 0x7f1d5c077cd0 2026-02-24T19:18:11.399 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.398+0000 7f1d67fff640 1 -- 10.20.193.26:0/3499724182 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f1d800936a0 con 0x7f1d8c1a7ac0 2026-02-24T19:18:11.399 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.398+0000 7f1d67fff640 10 client.4584.objecter ms_dispatch2 0x7f1d8c000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:11.399 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.398+0000 7f1d67fff640 3 client.4584.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:11.399 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.398+0000 7f1d67fff640 3 client.4584.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:11.399 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.399+0000 7f1d67fff640 20 client.4584.objecter dump_active .. 0 homeless 2026-02-24T19:18:11.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.399+0000 7f1d67fff640 1 -- 10.20.193.26:0/3499724182 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f1d8005e0d0 con 0x7f1d8c1a7ac0 2026-02-24T19:18:11.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.399+0000 7f1d67fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.399+0000 7f1d67fff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:11.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.401+0000 7fcb61ffb640 1 -- 10.20.193.26:0/2699911158 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcb4c0031d0 con 0x7fcb640ba350 2026-02-24T19:18:11.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.401+0000 7fcb61ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.401+0000 7fcb61ffb640 1 -- 10.20.193.26:0/2699911158 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fcb4c003700 con 0x7fcb640ba350 2026-02-24T19:18:11.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.401+0000 7fcb61ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.401+0000 7fcb61ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:11.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.401+0000 7fcb61ffb640 10 monclient: dump: 2026-02-24T19:18:11.402 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.402 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.402 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.402 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.402 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.402 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.402 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.403 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.403 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.403 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.403 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.401+0000 7fcb695ed640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:11.403 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.401+0000 7fcb695ed640 4 set_mon_vals no callback set 2026-02-24T19:18:11.403 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.402+0000 7ff912ffd640 1 -- 10.20.193.26:0/3181947649 <== mon.0 v1:10.20.193.26:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 12}]=0 v0) ==== 75+0+12 (unknown 4263375189 0 778662779) 0x7ff92c163930 con 0x7ff92c0585e0 2026-02-24T19:18:11.403 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.402+0000 7ff912ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-24T19:18:11.403 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.402+0000 7ff912ffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:11.403 INFO:teuthology.orchestra.run.trial026.stdout:90194313219 2026-02-24T19:18:11.404 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.403+0000 7fcb695ed640 10 monclient: shutdown 2026-02-24T19:18:11.404 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.403+0000 7fcb695ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.404 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.403+0000 7fcb695ed640 1 -- 10.20.193.26:0/2699911158 >> v1:10.20.193.26:6789/0 conn(0x7fcb640ba350 legacy=0x7fcb64057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.404 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.403+0000 7fcb695ed640 1 -- 10.20.193.26:0/2699911158 shutdown_connections 2026-02-24T19:18:11.404 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.403+0000 7fcb695ed640 1 -- 10.20.193.26:0/2699911158 >> 10.20.193.26:0/2699911158 conn(0x7fcb640b7990 msgr2=0x7fcb640b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.404 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.403+0000 7fcb695ed640 1 -- 10.20.193.26:0/2699911158 shutdown_connections 2026-02-24T19:18:11.404 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.403+0000 7fcb695ed640 1 -- 10.20.193.26:0/2699911158 wait complete. 2026-02-24T19:18:11.404 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.403+0000 7fcb695ed640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.404 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.403+0000 7fcb695ed640 10 monclient: monmap: 2026-02-24T19:18:11.404 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.404 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:11.404 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:11.404 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:11.404 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.404 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:11.404 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.404 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.404 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.404 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.405 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.404+0000 7fcb695ed640 1 librados: starting msgr at 2026-02-24T19:18:11.405 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.404+0000 7fcb695ed640 1 librados: starting objecter 2026-02-24T19:18:11.405 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.404+0000 7fcb695ed640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:11.405 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.404+0000 7fcb695ed640 1 Processor -- start 2026-02-24T19:18:11.405 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.404+0000 7fcb695ed640 1 -- start start 2026-02-24T19:18:11.405 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.404+0000 7fcb695ed640 1 librados: setting wanted keys 2026-02-24T19:18:11.405 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.404+0000 7fcb695ed640 1 librados: calling monclient init 2026-02-24T19:18:11.405 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.404+0000 7fcb695ed640 10 monclient: init 2026-02-24T19:18:11.405 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.404+0000 7fcb695ed640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.405 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.404+0000 7fcb695ed640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:18:11.405 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.404+0000 7fcb695ed640 10 monclient(hunting): picked mon.noname-b con 0x7fcb640585e0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.405 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.404+0000 7fcb695ed640 10 monclient(hunting): picked mon.noname-c con 0x7fcb640b9f80 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.405 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.404+0000 7fcb695ed640 10 monclient(hunting): picked mon.noname-a con 0x7fcb640ba350 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.405 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.404+0000 7fcb695ed640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb641fed70 con 0x7fcb640ba350 2026-02-24T19:18:11.405 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.404+0000 7fcb695ed640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb64165c30 con 0x7fcb640585e0 2026-02-24T19:18:11.405 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.404+0000 7fcb695ed640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb640ae6c0 con 0x7fcb640b9f80 2026-02-24T19:18:11.405 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.404+0000 7fcb695ed640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.405 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.404+0000 7fcb695ed640 10 monclient(hunting): authenticate will time out at 3674.086766s 2026-02-24T19:18:11.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.405+0000 7fcb627fc640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fcb640b9f80 0x7fcb640af480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58668/0 (socket says 10.20.193.26:58668) 2026-02-24T19:18:11.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.405+0000 7fcb627fc640 1 -- 10.20.193.26:0/4090791701 learned_addr learned my addr 10.20.193.26:0/4090791701 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.405+0000 7fcb437fe640 10 client.?.objecter ms_handle_connect 0x7fcb640b9f80 2026-02-24T19:18:11.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.405+0000 7fcb437fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.405+0000 7fcb437fe640 10 client.?.objecter ms_handle_connect 0x7fcb640585e0 2026-02-24T19:18:11.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.405+0000 7fcb437fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.405+0000 7ff930bbb640 10 librados: watch_flush enter 2026-02-24T19:18:11.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.405+0000 7ff930bbb640 10 librados: watch_flush exit 2026-02-24T19:18:11.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.405+0000 7ff930bbb640 20 client.4575.objecter shutdown clearing up homeless session... 2026-02-24T19:18:11.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.405+0000 7ff930bbb640 10 client.4575.objecter successfully canceled tick 2026-02-24T19:18:11.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.405+0000 7ff930bbb640 1 -- 10.20.193.26:0/3181947649 >> v1:10.20.193.162:6800/3889602630 conn(0x7ff8f8077d10 legacy=0x7ff8f80981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.405+0000 7ff930bbb640 10 monclient: shutdown 2026-02-24T19:18:11.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.405+0000 7ff930bbb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.405+0000 7ff930bbb640 1 -- 10.20.193.26:0/3181947649 >> v1:10.20.193.26:6789/0 conn(0x7ff92c0585e0 legacy=0x7ff92c1fb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.405+0000 7ff930bbb640 1 -- 10.20.193.26:0/3181947649 shutdown_connections 2026-02-24T19:18:11.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.405+0000 7ff930bbb640 1 -- 10.20.193.26:0/3181947649 >> 10.20.193.26:0/3181947649 conn(0x7ff92c0b7990 msgr2=0x7ff92c0b7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.405+0000 7ff930bbb640 1 -- 10.20.193.26:0/3181947649 shutdown_connections 2026-02-24T19:18:11.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.405+0000 7ff930bbb640 1 -- 10.20.193.26:0/3181947649 wait complete. 2026-02-24T19:18:11.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.405+0000 7ff930bbb640 1 librados: shutdown 2026-02-24T19:18:11.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.12 2026-02-24T19:18:11.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.432+0000 7fcb437fe640 10 client.?.objecter ms_handle_connect 0x7fcb640ba350 2026-02-24T19:18:11.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.432+0000 7fcb437fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.434 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.433+0000 7fcb437fe640 1 -- 10.20.193.26:0/4090791701 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3195054152 0 0) 0x7fcb641fed70 con 0x7fcb640ba350 2026-02-24T19:18:11.434 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.433+0000 7fcb437fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.434 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.433+0000 7fcb437fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.434 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.433+0000 7fcb437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.434 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.433+0000 7fcb437fe640 10 monclient(hunting): my global_id is 4590 2026-02-24T19:18:11.434 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.433+0000 7fcb437fe640 1 -- 10.20.193.26:0/4090791701 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb30003610 con 0x7fcb640ba350 2026-02-24T19:18:11.436 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.436+0000 7fcb437fe640 1 -- 10.20.193.26:0/4090791701 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 779504324 0 0) 0x7fcb30003610 con 0x7fcb640ba350 2026-02-24T19:18:11.436 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.436+0000 7fcb437fe640 1 -- 10.20.193.26:0/4090791701 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcb641fed70 con 0x7fcb640ba350 2026-02-24T19:18:11.437 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.436+0000 7fcb437fe640 1 -- 10.20.193.26:0/4090791701 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fcb540032a0 con 0x7fcb640ba350 2026-02-24T19:18:11.437 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.436+0000 7fcb437fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:11.437 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.436+0000 7fcb437fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:11.437 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.436+0000 7fcb437fe640 10 monclient(hunting): dump: 2026-02-24T19:18:11.437 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.437 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.437 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.437 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.437 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.437 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.437 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.437 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.437 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.437 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.437 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.436+0000 7fcb437fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:11.438 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.437+0000 7fcb437fe640 1 -- 10.20.193.26:0/4090791701 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4172451803 0 0) 0x7fcb641fed70 con 0x7fcb640ba350 2026-02-24T19:18:11.438 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.437+0000 7fcb437fe640 1 -- 10.20.193.26:0/4090791701 >> v1:10.20.193.103:6789/0 conn(0x7fcb640b9f80 legacy=0x7fcb640af480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.438 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.437+0000 7fcb437fe640 1 -- 10.20.193.26:0/4090791701 >> v1:10.20.193.70:6789/0 conn(0x7fcb640585e0 legacy=0x7fcb641fe660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.438 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.437+0000 7fcb437fe640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.437+0000 7fcb437fe640 1 monclient: found mon.a 2026-02-24T19:18:11.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.437+0000 7fcb437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.437+0000 7fcb437fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.437+0000 7fcb437fe640 1 -- 10.20.193.26:0/4090791701 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb640ae9a0 con 0x7fcb640ba350 2026-02-24T19:18:11.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.437+0000 7fcb437fe640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.437+0000 7fcb437fe640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.437+0000 7fcb437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.437+0000 7fcb695ed640 5 monclient: authenticate success, global_id 4590 2026-02-24T19:18:11.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.437+0000 7fcb695ed640 10 monclient: _renew_subs 2026-02-24T19:18:11.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.437+0000 7fcb695ed640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.437+0000 7fcb695ed640 1 -- 10.20.193.26:0/4090791701 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcb640aec80 con 0x7fcb640ba350 2026-02-24T19:18:11.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.437+0000 7fcb695ed640 10 client.4590.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:11.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.437+0000 7fcb695ed640 10 monclient: _renew_subs 2026-02-24T19:18:11.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.437+0000 7fcb695ed640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.437+0000 7fcb695ed640 1 -- 10.20.193.26:0/4090791701 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fcb64165f10 con 0x7fcb640ba350 2026-02-24T19:18:11.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.437+0000 7fcb695ed640 1 librados: init done 2026-02-24T19:18:11.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.438+0000 7fcb695ed640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.438+0000 7fcb695ed640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.438+0000 7fcb695ed640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.438+0000 7fcb695ed640 1 -- 10.20.193.26:0/4090791701 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb640b6c80 con 0x7fcb640ba350 2026-02-24T19:18:11.471 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-24T19:18:11.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.486+0000 7f1f6a967640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-24T19:18:11.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.486+0000 7f1f6a967640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-24T19:18:11.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.486+0000 7f1f6a967640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.486+0000 7f1f6a967640 1 -- 10.20.193.26:0/1922015006 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1f64164de0 con 0x7f1f641a7ac0 2026-02-24T19:18:11.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.489+0000 7f1f60ff9640 1 -- 10.20.193.26:0/1922015006 <== mon.2 v1:10.20.193.103:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 1257367751) 0x7f1f5805d7f0 con 0x7f1f641a7ac0 2026-02-24T19:18:11.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.489+0000 7f1f60ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-24T19:18:11.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.489+0000 7f1f60ff9640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:11.490 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:11.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.491+0000 7f1f6a967640 10 librados: watch_flush enter 2026-02-24T19:18:11.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.491+0000 7f1f6a967640 10 librados: watch_flush exit 2026-02-24T19:18:11.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.491+0000 7f1f6a967640 20 client.4586.objecter shutdown clearing up homeless session... 2026-02-24T19:18:11.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.491+0000 7f1f6a967640 10 client.4586.objecter successfully canceled tick 2026-02-24T19:18:11.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.491+0000 7f1f6a967640 1 -- 10.20.193.26:0/1922015006 >> v1:10.20.193.162:6800/3889602630 conn(0x7f1f34077d60 legacy=0x7f1f34098210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.491+0000 7f1f6a967640 10 monclient: shutdown 2026-02-24T19:18:11.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.491+0000 7f1f6a967640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.491+0000 7f1f6a967640 1 -- 10.20.193.26:0/1922015006 >> v1:10.20.193.103:6789/0 conn(0x7f1f641a7ac0 legacy=0x7f1f64192420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.491+0000 7f1f6a967640 1 -- 10.20.193.26:0/1922015006 shutdown_connections 2026-02-24T19:18:11.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.491+0000 7f1f6a967640 1 -- 10.20.193.26:0/1922015006 >> 10.20.193.26:0/1922015006 conn(0x7f1f640b4120 msgr2=0x7f1f640b44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.491+0000 7f1f6a967640 1 -- 10.20.193.26:0/1922015006 shutdown_connections 2026-02-24T19:18:11.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.491+0000 7f1f6a967640 1 -- 10.20.193.26:0/1922015006 wait complete. 2026-02-24T19:18:11.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.491+0000 7f1f6a967640 1 librados: shutdown 2026-02-24T19:18:11.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.3 2026-02-24T19:18:11.501 DEBUG:teuthology.parallel:result is None 2026-02-24T19:18:11.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.510+0000 7f1d91d79640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-24T19:18:11.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.510+0000 7f1d91d79640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-24T19:18:11.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.510+0000 7f1d91d79640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.510+0000 7f1d91d79640 1 -- 10.20.193.26:0/3499724182 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f1d8c165620 con 0x7f1d8c1a7ac0 2026-02-24T19:18:11.533 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.532+0000 7fcb437fe640 1 -- 10.20.193.26:0/4090791701 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcb54004c50 con 0x7fcb640ba350 2026-02-24T19:18:11.533 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.532+0000 7fcb437fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.533 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.532+0000 7fcb437fe640 1 -- 10.20.193.26:0/4090791701 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fcb54004ec0 con 0x7fcb640ba350 2026-02-24T19:18:11.533 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.532+0000 7fcb437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.533 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.532+0000 7fcb437fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:11.533 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.532+0000 7fcb617fa640 4 set_mon_vals no callback set 2026-02-24T19:18:11.533 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.532+0000 7fcb437fe640 10 monclient: dump: 2026-02-24T19:18:11.533 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.533 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.533 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.533 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.533 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.533 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.533 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.533 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.533 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.533 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.533 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.532+0000 7fcb437fe640 1 -- 10.20.193.26:0/4090791701 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fcb540050a0 con 0x7fcb640ba350 2026-02-24T19:18:11.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.533+0000 7fcb62ffd640 10 monclient: get_auth_request con 0x7fcb30077c30 auth_method 0 2026-02-24T19:18:11.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.533+0000 7fcb437fe640 10 client.4590.objecter ms_handle_connect 0x7fcb30077c30 2026-02-24T19:18:11.536 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-24T19:18:11.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.536+0000 7fcb437fe640 1 -- 10.20.193.26:0/4090791701 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7fcb54093610 con 0x7fcb640ba350 2026-02-24T19:18:11.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.536+0000 7fcb437fe640 10 client.4590.objecter ms_dispatch2 0x7fcb64000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:11.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.536+0000 7fcb437fe640 3 client.4590.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:11.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.536+0000 7fcb437fe640 3 client.4590.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:11.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.536+0000 7fcb437fe640 20 client.4590.objecter dump_active .. 0 homeless 2026-02-24T19:18:11.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.536+0000 7fcb437fe640 1 -- 10.20.193.26:0/4090791701 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fcb5405e040 con 0x7fcb640ba350 2026-02-24T19:18:11.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.536+0000 7fcb437fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.536+0000 7fcb437fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:11.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.538+0000 7fd476bfa640 10 monclient: get_monmap_and_config 2026-02-24T19:18:11.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.538+0000 7fd476bfa640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.538+0000 7fd476bfa640 10 monclient: monmap: 2026-02-24T19:18:11.539 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.539 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.539 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:11.539681+0000 2026-02-24T19:18:11.539 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:11.539681+0000 2026-02-24T19:18:11.539 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.539 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.540 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.540 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.540 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.540 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.539+0000 7fd476bfa640 1 Processor -- start 2026-02-24T19:18:11.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.539+0000 7fd476bfa640 1 -- start start 2026-02-24T19:18:11.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.539+0000 7fd476bfa640 10 monclient: init 2026-02-24T19:18:11.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.539+0000 7fd476bfa640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.539+0000 7fd476bfa640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:18:11.540 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.539+0000 7fd476bfa640 10 monclient(hunting): picked mon.noname-b con 0x7fd47015d0c0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.539+0000 7fd476bfa640 10 monclient(hunting): picked mon.noname-a con 0x7fd4700b0ca0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.539+0000 7fd476bfa640 10 monclient(hunting): picked mon.noname-c con 0x7fd4700b28b0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.539+0000 7fd476bfa640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4700b8540 con 0x7fd4700b0ca0 2026-02-24T19:18:11.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.539+0000 7fd476bfa640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4700b5da0 con 0x7fd47015d0c0 2026-02-24T19:18:11.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.539+0000 7fd476bfa640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4700b6080 con 0x7fd4700b28b0 2026-02-24T19:18:11.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.539+0000 7fd476bfa640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.539+0000 7fd476bfa640 10 monclient(hunting): authenticate will time out at 3674.221989s 2026-02-24T19:18:11.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.540+0000 7fd47496f640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7fd47015d0c0 0x7fd4700b0590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:46248/0 (socket says 10.20.193.26:46248) 2026-02-24T19:18:11.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.540+0000 7fd47496f640 1 -- 10.20.193.26:0/1229595702 learned_addr learned my addr 10.20.193.26:0/1229595702 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.541+0000 7fd4677fe640 1 -- 10.20.193.26:0/1229595702 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2230852847 0 0) 0x7fd4700b5da0 con 0x7fd47015d0c0 2026-02-24T19:18:11.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.541+0000 7fd4677fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.541+0000 7fd4677fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.541+0000 7fd4677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.541+0000 7fd4677fe640 10 monclient(hunting): my global_id is 4567 2026-02-24T19:18:11.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.541+0000 7fd4677fe640 1 -- 10.20.193.26:0/1229595702 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd45c003610 con 0x7fd47015d0c0 2026-02-24T19:18:11.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.541+0000 7fd4677fe640 1 -- 10.20.193.26:0/1229595702 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 29580471 0 0) 0x7fd4700b6080 con 0x7fd4700b28b0 2026-02-24T19:18:11.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.541+0000 7fd4677fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.541+0000 7fd4677fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.541+0000 7fd4677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.541+0000 7fd4677fe640 10 monclient(hunting): my global_id is 4595 2026-02-24T19:18:11.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.541+0000 7fd4677fe640 1 -- 10.20.193.26:0/1229595702 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4700b5da0 con 0x7fd4700b28b0 2026-02-24T19:18:11.544 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-24T19:18:11.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.543+0000 7fd4677fe640 1 -- 10.20.193.26:0/1229595702 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 555805546 0 0) 0x7fd45c003610 con 0x7fd47015d0c0 2026-02-24T19:18:11.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.543+0000 7fd4677fe640 1 -- 10.20.193.26:0/1229595702 >> v1:10.20.193.103:6789/0 conn(0x7fd4700b28b0 legacy=0x7fd4700b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.543+0000 7fd4677fe640 1 -- 10.20.193.26:0/1229595702 >> v1:10.20.193.26:6789/0 conn(0x7fd4700b0ca0 legacy=0x7fd4700b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:11.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.543+0000 7fd4677fe640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.543+0000 7fd4677fe640 1 monclient: found mon.noname-b 2026-02-24T19:18:11.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.543+0000 7fd4677fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.543+0000 7fd4677fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:18:11.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.543+0000 7fd4677fe640 1 -- 10.20.193.26:0/1229595702 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd470163e10 con 0x7fd47015d0c0 2026-02-24T19:18:11.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.543+0000 7fd4677fe640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.543+0000 7fd4677fe640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.543+0000 7fd4677fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.543+0000 7fd4677fe640 1 -- 10.20.193.26:0/1229595702 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd460002df0 con 0x7fd47015d0c0 2026-02-24T19:18:11.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.543+0000 7fd476bfa640 5 monclient: authenticate success, global_id 4567 2026-02-24T19:18:11.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.543+0000 7fd476bfa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:11.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.543+0000 7fd4677fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.543+0000 7fd4677fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:11.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.543+0000 7fd4677fe640 10 monclient: dump: 2026-02-24T19:18:11.547 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.547 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.547 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.547 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.547 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.547 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.547 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.547 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.547 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.547 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.543+0000 7fd476bfa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:11.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.543+0000 7f1d67fff640 1 -- 10.20.193.26:0/3499724182 <== mon.0 v1:10.20.193.26:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+12 (unknown 3207554136 0 1257367751) 0x7f1d8005d9d0 con 0x7f1d8c1a7ac0 2026-02-24T19:18:11.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.543+0000 7f1d67fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-24T19:18:11.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.543+0000 7f1d67fff640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:11.549 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:11.551 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-24T19:18:11.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.544+0000 7fd4677fe640 1 -- 10.20.193.26:0/1229595702 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd460003000 con 0x7fd47015d0c0 2026-02-24T19:18:11.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.544+0000 7fd4677fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.544+0000 7fd4677fe640 1 -- 10.20.193.26:0/1229595702 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd460003440 con 0x7fd47015d0c0 2026-02-24T19:18:11.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.544+0000 7fd4677fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.544+0000 7fd4677fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:11.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.544+0000 7fd4677fe640 10 monclient: dump: 2026-02-24T19:18:11.552 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.552 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.552 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.552 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.552 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.552 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.552 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.552 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.552 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.553 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.544+0000 7fd476bfa640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:11.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.544+0000 7fd476bfa640 4 set_mon_vals no callback set 2026-02-24T19:18:11.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.544+0000 7fd476bfa640 10 monclient: shutdown 2026-02-24T19:18:11.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.544+0000 7fd476bfa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.544+0000 7fd476bfa640 1 -- 10.20.193.26:0/1229595702 >> v1:10.20.193.70:6789/0 conn(0x7fd47015d0c0 legacy=0x7fd4700b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.545+0000 7fd476bfa640 1 -- 10.20.193.26:0/1229595702 shutdown_connections 2026-02-24T19:18:11.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.545+0000 7fd476bfa640 1 -- 10.20.193.26:0/1229595702 >> 10.20.193.26:0/1229595702 conn(0x7fd4700b5290 msgr2=0x7fd4700b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.545+0000 7fd476bfa640 1 -- 10.20.193.26:0/1229595702 shutdown_connections 2026-02-24T19:18:11.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.545+0000 7fd476bfa640 1 -- 10.20.193.26:0/1229595702 wait complete. 2026-02-24T19:18:11.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.545+0000 7fd476bfa640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.545+0000 7fd476bfa640 10 monclient: monmap: 2026-02-24T19:18:11.554 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.554 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:11.554 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:11.554 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:11.554 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.554 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:11.554 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.554 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.554 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.554 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.545+0000 7fd476bfa640 1 librados: starting msgr at 2026-02-24T19:18:11.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.545+0000 7fd476bfa640 1 librados: starting objecter 2026-02-24T19:18:11.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.545+0000 7fd476bfa640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:11.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.545+0000 7fd476bfa640 1 Processor -- start 2026-02-24T19:18:11.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.545+0000 7fd476bfa640 1 -- start start 2026-02-24T19:18:11.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.545+0000 7fd476bfa640 1 librados: setting wanted keys 2026-02-24T19:18:11.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.545+0000 7fd476bfa640 1 librados: calling monclient init 2026-02-24T19:18:11.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.545+0000 7fd476bfa640 10 monclient: init 2026-02-24T19:18:11.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.546+0000 7fd476bfa640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.546+0000 7fd476bfa640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:18:11.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.546+0000 7fd476bfa640 10 monclient(hunting): picked mon.noname-b con 0x7fd4700b0ca0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.546+0000 7fd476bfa640 10 monclient(hunting): picked mon.noname-a con 0x7fd4700b28b0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.546+0000 7fd476bfa640 10 monclient(hunting): picked mon.noname-c con 0x7fd47015d0c0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.546+0000 7fd476bfa640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4701fbb90 con 0x7fd4700b28b0 2026-02-24T19:18:11.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.546+0000 7fd476bfa640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4701fbe70 con 0x7fd4700b0ca0 2026-02-24T19:18:11.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.546+0000 7fd476bfa640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4701fc150 con 0x7fd47015d0c0 2026-02-24T19:18:11.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.546+0000 7fd476bfa640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.546+0000 7fd476bfa640 10 monclient(hunting): authenticate will time out at 3674.228422s 2026-02-24T19:18:11.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.546+0000 7f1d91d79640 10 librados: watch_flush enter 2026-02-24T19:18:11.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.546+0000 7f1d91d79640 10 librados: watch_flush exit 2026-02-24T19:18:11.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.546+0000 7f1d91d79640 20 client.4584.objecter shutdown clearing up homeless session... 2026-02-24T19:18:11.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.546+0000 7f1d91d79640 10 client.4584.objecter successfully canceled tick 2026-02-24T19:18:11.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.546+0000 7f1d91d79640 1 -- 10.20.193.26:0/3499724182 >> v1:10.20.193.162:6800/3889602630 conn(0x7f1d5c077cd0 legacy=0x7f1d5c098180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.546+0000 7f1d91d79640 10 monclient: shutdown 2026-02-24T19:18:11.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.546+0000 7f1d91d79640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.546+0000 7f1d91d79640 1 -- 10.20.193.26:0/3499724182 >> v1:10.20.193.26:6789/0 conn(0x7f1d8c1a7ac0 legacy=0x7f1d8c12a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.546+0000 7f1d91d79640 1 -- 10.20.193.26:0/3499724182 shutdown_connections 2026-02-24T19:18:11.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.546+0000 7f1d91d79640 1 -- 10.20.193.26:0/3499724182 >> 10.20.193.26:0/3499724182 conn(0x7f1d8c0b4120 msgr2=0x7f1d8c0b6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.546+0000 7f1d91d79640 1 -- 10.20.193.26:0/3499724182 shutdown_connections 2026-02-24T19:18:11.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.546+0000 7f1d91d79640 1 -- 10.20.193.26:0/3499724182 wait complete. 2026-02-24T19:18:11.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.546+0000 7f1d91d79640 1 librados: shutdown 2026-02-24T19:18:11.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.546+0000 7fd467fff640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fd4700b28b0 0x7fd470155620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:38034/0 (socket says 10.20.193.26:38034) 2026-02-24T19:18:11.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.546+0000 7fd467fff640 1 -- 10.20.193.26:0/574837392 learned_addr learned my addr 10.20.193.26:0/574837392 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.547+0000 7fd4657fa640 10 client.?.objecter ms_handle_connect 0x7fd47015d0c0 2026-02-24T19:18:11.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.547+0000 7fd4657fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.547+0000 7fd4657fa640 10 client.?.objecter ms_handle_connect 0x7fd4700b0ca0 2026-02-24T19:18:11.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.547+0000 7fd4657fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.548+0000 7fd4657fa640 1 -- 10.20.193.26:0/574837392 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 409137582 0 0) 0x7fd4701fbe70 con 0x7fd4700b0ca0 2026-02-24T19:18:11.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.548+0000 7fd4657fa640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.548+0000 7fd4657fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.548+0000 7fd4657fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.548+0000 7fd4657fa640 10 monclient(hunting): my global_id is 4570 2026-02-24T19:18:11.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.548+0000 7fd4657fa640 1 -- 10.20.193.26:0/574837392 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd440003610 con 0x7fd4700b0ca0 2026-02-24T19:18:11.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.548+0000 7fd4657fa640 10 client.?.objecter ms_handle_connect 0x7fd4700b28b0 2026-02-24T19:18:11.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.548+0000 7fd4657fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.548+0000 7fd4657fa640 1 -- 10.20.193.26:0/574837392 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2319179044 0 0) 0x7fd4701fc150 con 0x7fd47015d0c0 2026-02-24T19:18:11.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.548+0000 7fd4657fa640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.548+0000 7fd4657fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.548+0000 7fd4657fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.548+0000 7fd4657fa640 10 monclient(hunting): my global_id is 4598 2026-02-24T19:18:11.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.548+0000 7fd4657fa640 1 -- 10.20.193.26:0/574837392 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4701fbe70 con 0x7fd47015d0c0 2026-02-24T19:18:11.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.549+0000 7fd4657fa640 1 -- 10.20.193.26:0/574837392 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 45285666 0 0) 0x7fd4701fbb90 con 0x7fd4700b28b0 2026-02-24T19:18:11.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.549+0000 7fd4657fa640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.549+0000 7fd4657fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.549+0000 7fd4657fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.549+0000 7fd4657fa640 10 monclient(hunting): my global_id is 4593 2026-02-24T19:18:11.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.549+0000 7fd4657fa640 1 -- 10.20.193.26:0/574837392 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4701fc150 con 0x7fd4700b28b0 2026-02-24T19:18:11.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.550+0000 7fd4657fa640 1 -- 10.20.193.26:0/574837392 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4072624899 0 0) 0x7fd440003610 con 0x7fd4700b0ca0 2026-02-24T19:18:11.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.550+0000 7fd4657fa640 1 -- 10.20.193.26:0/574837392 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd4701fbb90 con 0x7fd4700b0ca0 2026-02-24T19:18:11.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.550+0000 7fd4657fa640 1 -- 10.20.193.26:0/574837392 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd460003350 con 0x7fd4700b0ca0 2026-02-24T19:18:11.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.550+0000 7fd4657fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:11.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.550+0000 7fd4657fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:11.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.550+0000 7fd4657fa640 10 monclient(hunting): dump: 2026-02-24T19:18:11.565 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.565 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.565 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.565 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.565 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.566 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.566 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.566 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.566 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.566 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.550+0000 7fd4657fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:11.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.550+0000 7fd4657fa640 1 -- 10.20.193.26:0/574837392 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3398649362 0 0) 0x7fd4701fbe70 con 0x7fd47015d0c0 2026-02-24T19:18:11.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.550+0000 7fd4657fa640 1 -- 10.20.193.26:0/574837392 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd440003610 con 0x7fd47015d0c0 2026-02-24T19:18:11.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.550+0000 7fd4657fa640 1 -- 10.20.193.26:0/574837392 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd46c003430 con 0x7fd47015d0c0 2026-02-24T19:18:11.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.550+0000 7fd4657fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:11.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.550+0000 7fd4657fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:11.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.550+0000 7fd4657fa640 10 monclient(hunting): dump: 2026-02-24T19:18:11.566 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.566 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.566 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.566 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.567 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.567 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.567 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.567 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.567 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.567 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.551+0000 7fd4657fa640 1 -- 10.20.193.26:0/574837392 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1433511182 0 0) 0x7fd4701fc150 con 0x7fd4700b28b0 2026-02-24T19:18:11.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.551+0000 7fd4657fa640 1 -- 10.20.193.26:0/574837392 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd4701fbe70 con 0x7fd4700b28b0 2026-02-24T19:18:11.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.551+0000 7fd4657fa640 1 -- 10.20.193.26:0/574837392 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd458002fd0 con 0x7fd4700b28b0 2026-02-24T19:18:11.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.551+0000 7fd4657fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:11.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.551+0000 7fd4657fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:11.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.551+0000 7fd4657fa640 10 monclient(hunting): dump: 2026-02-24T19:18:11.567 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.567 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.567 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.567 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.568 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.568 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.568 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.568 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.568 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.568 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.552+0000 7fd4657fa640 1 -- 10.20.193.26:0/574837392 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2842538784 0 0) 0x7fd4701fbb90 con 0x7fd4700b0ca0 2026-02-24T19:18:11.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.552+0000 7fd4657fa640 1 -- 10.20.193.26:0/574837392 >> v1:10.20.193.103:6789/0 conn(0x7fd47015d0c0 legacy=0x7fd4700b7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.552+0000 7fd4657fa640 1 -- 10.20.193.26:0/574837392 >> v1:10.20.193.26:6789/0 conn(0x7fd4700b28b0 legacy=0x7fd470155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.552+0000 7fd4657fa640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.552+0000 7fd4657fa640 1 monclient: found mon.b 2026-02-24T19:18:11.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.552+0000 7fd4657fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.552+0000 7fd4657fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:11.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.552+0000 7fd4657fa640 1 -- 10.20.193.26:0/574837392 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4701fc430 con 0x7fd4700b0ca0 2026-02-24T19:18:11.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.552+0000 7fd4657fa640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.552+0000 7fd4657fa640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.552+0000 7fd4657fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.552+0000 7fd476bfa640 5 monclient: authenticate success, global_id 4570 2026-02-24T19:18:11.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.552+0000 7fd476bfa640 10 monclient: _renew_subs 2026-02-24T19:18:11.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.552+0000 7fd476bfa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:11.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.552+0000 7fd476bfa640 1 -- 10.20.193.26:0/574837392 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd4701fb710 con 0x7fd4700b0ca0 2026-02-24T19:18:11.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.552+0000 7fd476bfa640 10 client.4570.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:11.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.552+0000 7fd476bfa640 10 monclient: _renew_subs 2026-02-24T19:18:11.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.552+0000 7fd476bfa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:11.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.552+0000 7fd476bfa640 1 -- 10.20.193.26:0/574837392 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd470155f10 con 0x7fd4700b0ca0 2026-02-24T19:18:11.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.552+0000 7fd476bfa640 1 librados: init done 2026-02-24T19:18:11.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.553+0000 7fd476bfa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.553+0000 7fd476bfa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.553+0000 7fd476bfa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:11.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.553+0000 7fd476bfa640 1 -- 10.20.193.26:0/574837392 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd470160ad0 con 0x7fd4700b0ca0 2026-02-24T19:18:11.569 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2026-02-24T19:18:11.570 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-24T19:18:11.570 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-24T19:18:11.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.8 2026-02-24T19:18:11.571 DEBUG:teuthology.parallel:result is None 2026-02-24T19:18:11.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.560+0000 7fd4657fa640 1 -- 10.20.193.26:0/574837392 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd460003000 con 0x7fd4700b0ca0 2026-02-24T19:18:11.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.560+0000 7fd4657fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.560+0000 7fd4657fa640 1 -- 10.20.193.26:0/574837392 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd460004d20 con 0x7fd4700b0ca0 2026-02-24T19:18:11.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.560+0000 7fd4657fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.560+0000 7fd4657fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:11.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.560+0000 7fd466ffd640 4 set_mon_vals no callback set 2026-02-24T19:18:11.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.560+0000 7fd4657fa640 10 monclient: dump: 2026-02-24T19:18:11.571 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.571 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.571 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.571 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.571 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.572 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.572 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.572 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.572 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.572 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.561+0000 7fd4657fa640 1 -- 10.20.193.26:0/574837392 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fd46001db90 con 0x7fd4700b0ca0 2026-02-24T19:18:11.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.562+0000 7fd467fff640 10 monclient: get_auth_request con 0x7fd440077ed0 auth_method 0 2026-02-24T19:18:11.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.562+0000 7fd4657fa640 10 client.4570.objecter ms_handle_connect 0x7fd440077ed0 2026-02-24T19:18:11.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.562+0000 7fd4657fa640 1 -- 10.20.193.26:0/574837392 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7fd460093080 con 0x7fd4700b0ca0 2026-02-24T19:18:11.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.562+0000 7fd4657fa640 10 client.4570.objecter ms_dispatch2 0x7fd470000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:11.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.562+0000 7fd4657fa640 3 client.4570.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:11.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.562+0000 7fd4657fa640 3 client.4570.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:11.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.562+0000 7fd4657fa640 20 client.4570.objecter dump_active .. 0 homeless 2026-02-24T19:18:11.604 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.603+0000 7f7c4753a640 10 monclient: get_monmap_and_config 2026-02-24T19:18:11.604 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.603+0000 7f7c4753a640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.604 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.603+0000 7f7c4753a640 10 monclient: monmap: 2026-02-24T19:18:11.604 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.604 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.604 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:11.604210+0000 2026-02-24T19:18:11.604 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:11.604210+0000 2026-02-24T19:18:11.604 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.604 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.604 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.604 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.604 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.604 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.603+0000 7f7c4753a640 1 Processor -- start 2026-02-24T19:18:11.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.603+0000 7f7c4753a640 1 -- start start 2026-02-24T19:18:11.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.603+0000 7f7c4753a640 10 monclient: init 2026-02-24T19:18:11.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.604+0000 7f7c4753a640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.604+0000 7f7c4753a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:18:11.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.604+0000 7f7c4753a640 10 monclient(hunting): picked mon.noname-c con 0x7f7c40159810 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.604+0000 7f7c4753a640 10 monclient(hunting): picked mon.noname-b con 0x7f7c4005c200 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.604+0000 7f7c4753a640 10 monclient(hunting): picked mon.noname-a con 0x7f7c4005da20 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.604+0000 7f7c4753a640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c4005c6a0 con 0x7f7c4005da20 2026-02-24T19:18:11.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.604+0000 7f7c4753a640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c4005c980 con 0x7f7c4005c200 2026-02-24T19:18:11.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.604+0000 7f7c4753a640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c4005cc60 con 0x7f7c40159810 2026-02-24T19:18:11.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.604+0000 7f7c4753a640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.604+0000 7f7c4753a640 10 monclient(hunting): authenticate will time out at 3674.286536s 2026-02-24T19:18:11.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.604+0000 7f7c46d39640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f7c4005da20 0x7f7c401c77a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:38040/0 (socket says 10.20.193.26:38040) 2026-02-24T19:18:11.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.604+0000 7f7c46d39640 1 -- 10.20.193.26:0/1654808155 learned_addr learned my addr 10.20.193.26:0/1654808155 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.606+0000 7f7c45536640 1 -- 10.20.193.26:0/1654808155 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2568693708 0 0) 0x7f7c4005cc60 con 0x7f7c40159810 2026-02-24T19:18:11.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.606+0000 7f7c45536640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.606+0000 7f7c45536640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.606+0000 7f7c45536640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.606+0000 7f7c45536640 10 monclient(hunting): my global_id is 4601 2026-02-24T19:18:11.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.606+0000 7f7c45536640 1 -- 10.20.193.26:0/1654808155 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c28003610 con 0x7f7c40159810 2026-02-24T19:18:11.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.606+0000 7f7c45536640 1 -- 10.20.193.26:0/1654808155 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1221793908 0 0) 0x7f7c4005c6a0 con 0x7f7c4005da20 2026-02-24T19:18:11.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.606+0000 7f7c45536640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.606+0000 7f7c45536640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.606+0000 7f7c45536640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.606+0000 7f7c45536640 10 monclient(hunting): my global_id is 4596 2026-02-24T19:18:11.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.606+0000 7f7c45536640 1 -- 10.20.193.26:0/1654808155 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c4005cc60 con 0x7f7c4005da20 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.608+0000 7f7c45536640 1 -- 10.20.193.26:0/1654808155 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2118709915 0 0) 0x7f7c28003610 con 0x7f7c40159810 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.608+0000 7f7c45536640 1 -- 10.20.193.26:0/1654808155 >> v1:10.20.193.70:6789/0 conn(0x7f7c4005c200 legacy=0x7f7c400b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.608+0000 7f7c45536640 1 -- 10.20.193.26:0/1654808155 >> v1:10.20.193.26:6789/0 conn(0x7f7c4005da20 legacy=0x7f7c401c77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.608+0000 7f7c45536640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.608+0000 7f7c45536640 1 monclient: found mon.noname-c 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.608+0000 7f7c45536640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.608+0000 7f7c45536640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.608+0000 7f7c45536640 1 -- 10.20.193.26:0/1654808155 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4005cf40 con 0x7f7c40159810 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.608+0000 7f7c45536640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.608+0000 7f7c45536640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.608+0000 7f7c45536640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.608+0000 7f7c45536640 1 -- 10.20.193.26:0/1654808155 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7c30002df0 con 0x7f7c40159810 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.608+0000 7f7c45536640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.608+0000 7f7c45536640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.608+0000 7f7c45536640 10 monclient: dump: 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.608+0000 7f7c4753a640 5 monclient: authenticate success, global_id 4601 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.608+0000 7f7c4753a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.609+0000 7f7c45536640 1 -- 10.20.193.26:0/1654808155 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7c30003000 con 0x7f7c40159810 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.609+0000 7f7c45536640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.609+0000 7f7c45536640 1 -- 10.20.193.26:0/1654808155 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7c30003440 con 0x7f7c40159810 2026-02-24T19:18:11.609 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.609+0000 7f7c45536640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.609+0000 7f7c45536640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.609+0000 7f7c45536640 10 monclient: dump: 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.609+0000 7f7c4753a640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.609+0000 7f7c4753a640 4 set_mon_vals no callback set 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.609+0000 7f7c4753a640 10 monclient: shutdown 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.609+0000 7f7c4753a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.609+0000 7f7c4753a640 1 -- 10.20.193.26:0/1654808155 >> v1:10.20.193.103:6789/0 conn(0x7f7c40159810 legacy=0x7f7c40057c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.609+0000 7f7c4753a640 1 -- 10.20.193.26:0/1654808155 shutdown_connections 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.609+0000 7f7c4753a640 1 -- 10.20.193.26:0/1654808155 >> 10.20.193.26:0/1654808155 conn(0x7f7c400b2d40 msgr2=0x7f7c400b3140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.609+0000 7f7c4753a640 1 -- 10.20.193.26:0/1654808155 shutdown_connections 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.609+0000 7f7c4753a640 1 -- 10.20.193.26:0/1654808155 wait complete. 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.609+0000 7f7c4753a640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.609+0000 7f7c4753a640 10 monclient: monmap: 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.610 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:11.611 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.611 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.611 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.611 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.611 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.609+0000 7f7c4753a640 1 librados: starting msgr at 2026-02-24T19:18:11.611 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.609+0000 7f7c4753a640 1 librados: starting objecter 2026-02-24T19:18:11.611 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.610+0000 7f7c4753a640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:11.611 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.610+0000 7f7c4753a640 1 Processor -- start 2026-02-24T19:18:11.611 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.610+0000 7f7c4753a640 1 -- start start 2026-02-24T19:18:11.611 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.610+0000 7f7c4753a640 1 librados: setting wanted keys 2026-02-24T19:18:11.611 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.610+0000 7f7c4753a640 1 librados: calling monclient init 2026-02-24T19:18:11.611 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.610+0000 7f7c4753a640 10 monclient: init 2026-02-24T19:18:11.611 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.610+0000 7f7c4753a640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.611 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.610+0000 7f7c4753a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:18:11.611 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.610+0000 7f7c4753a640 10 monclient(hunting): picked mon.noname-a con 0x7f7c4005c200 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.611 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.610+0000 7f7c4753a640 10 monclient(hunting): picked mon.noname-b con 0x7f7c4005da20 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.611 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.610+0000 7f7c4753a640 10 monclient(hunting): picked mon.noname-c con 0x7f7c40159810 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.611 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.610+0000 7f7c4753a640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c400b23a0 con 0x7f7c4005c200 2026-02-24T19:18:11.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.610+0000 7f7c4753a640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c401ff4c0 con 0x7f7c4005da20 2026-02-24T19:18:11.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.610+0000 7f7c4753a640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c40133e00 con 0x7f7c40159810 2026-02-24T19:18:11.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.610+0000 7f7c4753a640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.610+0000 7f7c4753a640 10 monclient(hunting): authenticate will time out at 3674.292701s 2026-02-24T19:18:11.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.610+0000 7f7c46538640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f7c4005c200 0x7f7c400b1c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:38044/0 (socket says 10.20.193.26:38044) 2026-02-24T19:18:11.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.610+0000 7f7c46538640 1 -- 10.20.193.26:0/3952457042 learned_addr learned my addr 10.20.193.26:0/3952457042 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.611+0000 7f7c26ffd640 10 client.?.objecter ms_handle_connect 0x7f7c4005c200 2026-02-24T19:18:11.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.611+0000 7f7c26ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.611+0000 7f7c26ffd640 10 client.?.objecter ms_handle_connect 0x7f7c40159810 2026-02-24T19:18:11.612 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.611+0000 7f7c26ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.612+0000 7f7c26ffd640 1 -- 10.20.193.26:0/3952457042 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1517706783 0 0) 0x7f7c40133e00 con 0x7f7c40159810 2026-02-24T19:18:11.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.612+0000 7f7c26ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.612+0000 7f7c26ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.612+0000 7f7c26ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.612+0000 7f7c26ffd640 10 monclient(hunting): my global_id is 4604 2026-02-24T19:18:11.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.612+0000 7f7c26ffd640 1 -- 10.20.193.26:0/3952457042 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c10003610 con 0x7f7c40159810 2026-02-24T19:18:11.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.612+0000 7f7c26ffd640 1 -- 10.20.193.26:0/3952457042 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3115018325 0 0) 0x7f7c400b23a0 con 0x7f7c4005c200 2026-02-24T19:18:11.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.612+0000 7f7c26ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.612+0000 7f7c26ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.612+0000 7f7c26ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.612+0000 7f7c26ffd640 10 monclient(hunting): my global_id is 4599 2026-02-24T19:18:11.613 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.612+0000 7f7c26ffd640 1 -- 10.20.193.26:0/3952457042 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c40133e00 con 0x7f7c4005c200 2026-02-24T19:18:11.614 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.613+0000 7f6d993c8640 10 monclient: get_monmap_and_config 2026-02-24T19:18:11.614 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.613+0000 7f6d993c8640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.614 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.613+0000 7f6d993c8640 10 monclient: monmap: 2026-02-24T19:18:11.614 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.614 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.614 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:11.614495+0000 2026-02-24T19:18:11.614 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:11.614495+0000 2026-02-24T19:18:11.614 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.614 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.614 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.614 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.614 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.614 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.615 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.614+0000 7f6d993c8640 1 Processor -- start 2026-02-24T19:18:11.615 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.614+0000 7f6d993c8640 1 -- start start 2026-02-24T19:18:11.615 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.614+0000 7f6d993c8640 10 monclient: init 2026-02-24T19:18:11.615 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.614+0000 7f6d993c8640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.615 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.614+0000 7f6d993c8640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:18:11.615 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.614+0000 7f6d993c8640 10 monclient(hunting): picked mon.noname-c con 0x7f6d94157780 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.615 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.614+0000 7f6d993c8640 10 monclient(hunting): picked mon.noname-b con 0x7f6d94157b50 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.615 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.614+0000 7f6d993c8640 10 monclient(hunting): picked mon.noname-a con 0x7f6d94164d00 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.615 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.614+0000 7f6d993c8640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d9405de70 con 0x7f6d94164d00 2026-02-24T19:18:11.615 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.614+0000 7f6d993c8640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d94055b20 con 0x7f6d94157b50 2026-02-24T19:18:11.615 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.614+0000 7f6d993c8640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d94055e00 con 0x7f6d94157780 2026-02-24T19:18:11.615 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.614+0000 7f6d993c8640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.615 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.614+0000 7f6d993c8640 10 monclient(hunting): authenticate will time out at 3674.296741s 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.615+0000 7f7c26ffd640 1 -- 10.20.193.26:0/3952457042 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2340443051 0 0) 0x7f7c10003610 con 0x7f7c40159810 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.615+0000 7f7c26ffd640 1 -- 10.20.193.26:0/3952457042 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7c400b23a0 con 0x7f7c40159810 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.615+0000 7f7c26ffd640 1 -- 10.20.193.26:0/3952457042 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7c3c003400 con 0x7f7c40159810 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.615+0000 7f7c26ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.615+0000 7f7c26ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.615+0000 7f7c26ffd640 10 monclient(hunting): dump: 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.615+0000 7f7c26ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.615+0000 7f7c26ffd640 1 -- 10.20.193.26:0/3952457042 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3675149840 0 0) 0x7f7c40133e00 con 0x7f7c4005c200 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.615+0000 7f7c26ffd640 1 -- 10.20.193.26:0/3952457042 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7c10003610 con 0x7f7c4005c200 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.615+0000 7f7c26ffd640 1 -- 10.20.193.26:0/3952457042 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7c30003350 con 0x7f7c4005c200 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.615+0000 7f7c26ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.615+0000 7f7c26ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.615+0000 7f7c26ffd640 10 monclient(hunting): dump: 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.616 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.617 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.615+0000 7f6d92ffd640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f6d94157780 0x7f6d94056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58702/0 (socket says 10.20.193.26:58702) 2026-02-24T19:18:11.617 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.615+0000 7f6d92ffd640 1 -- 10.20.193.26:0/2940209958 learned_addr learned my addr 10.20.193.26:0/2940209958 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.617+0000 7f7c26ffd640 1 -- 10.20.193.26:0/3952457042 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4115445494 0 0) 0x7f7c400b23a0 con 0x7f7c40159810 2026-02-24T19:18:11.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.617+0000 7f7c26ffd640 1 -- 10.20.193.26:0/3952457042 >> v1:10.20.193.70:6789/0 conn(0x7f7c4005da20 legacy=0x7f7c400af130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.617+0000 7f7c26ffd640 1 -- 10.20.193.26:0/3952457042 >> v1:10.20.193.26:6789/0 conn(0x7f7c4005c200 legacy=0x7f7c400b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.617+0000 7f7c26ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.617+0000 7f7c26ffd640 1 monclient: found mon.c 2026-02-24T19:18:11.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.617+0000 7f7c26ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.617+0000 7f7c26ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.617+0000 7f7c26ffd640 1 -- 10.20.193.26:0/3952457042 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c401340e0 con 0x7f7c40159810 2026-02-24T19:18:11.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.617+0000 7f7c26ffd640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.617+0000 7f7c26ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.617+0000 7f7c26ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.617+0000 7f7c4753a640 5 monclient: authenticate success, global_id 4604 2026-02-24T19:18:11.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.617+0000 7f7c4753a640 10 monclient: _renew_subs 2026-02-24T19:18:11.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.617+0000 7f7c4753a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.617+0000 7f7c4753a640 1 -- 10.20.193.26:0/3952457042 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7c401343c0 con 0x7f7c40159810 2026-02-24T19:18:11.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.617+0000 7f7c4753a640 10 client.4604.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:11.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.617+0000 7f7c4753a640 10 monclient: _renew_subs 2026-02-24T19:18:11.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.617+0000 7f7c4753a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.617+0000 7f7c4753a640 1 -- 10.20.193.26:0/3952457042 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7c40134980 con 0x7f7c40159810 2026-02-24T19:18:11.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.617+0000 7f7c4753a640 1 librados: init done 2026-02-24T19:18:11.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.617+0000 7f7c4753a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.617+0000 7f7c4753a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.617+0000 7f7c4753a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.618 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.617+0000 7f7c4753a640 1 -- 10.20.193.26:0/3952457042 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c400ad0c0 con 0x7f7c40159810 2026-02-24T19:18:11.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.619+0000 7f6d91ffb640 1 -- 10.20.193.26:0/2940209958 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4164439597 0 0) 0x7f6d9405de70 con 0x7f6d94164d00 2026-02-24T19:18:11.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.619+0000 7f6d91ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.619+0000 7f6d91ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.619+0000 7f6d91ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.619+0000 7f6d91ffb640 10 monclient(hunting): my global_id is 4602 2026-02-24T19:18:11.620 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.619+0000 7f6d91ffb640 1 -- 10.20.193.26:0/2940209958 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d80003610 con 0x7f6d94164d00 2026-02-24T19:18:11.622 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.621+0000 7f6d91ffb640 1 -- 10.20.193.26:0/2940209958 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 840561342 0 0) 0x7f6d80003610 con 0x7f6d94164d00 2026-02-24T19:18:11.622 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.621+0000 7f6d91ffb640 1 -- 10.20.193.26:0/2940209958 >> v1:10.20.193.103:6789/0 conn(0x7f6d94157780 legacy=0x7f6d94056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.622 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.621+0000 7f6d91ffb640 1 -- 10.20.193.26:0/2940209958 >> v1:10.20.193.70:6789/0 conn(0x7f6d94157b50 legacy=0x7f6d941645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:11.622 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.621+0000 7f6d91ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.622 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.621+0000 7f6d91ffb640 1 monclient: found mon.noname-a 2026-02-24T19:18:11.622 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.621+0000 7f6d91ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.622 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.621+0000 7f6d91ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.622 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.621+0000 7f6d91ffb640 1 -- 10.20.193.26:0/2940209958 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d940560e0 con 0x7f6d94164d00 2026-02-24T19:18:11.622 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.621+0000 7f6d91ffb640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.622 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.621+0000 7f6d91ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.622 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.621+0000 7f6d91ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.622 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.621+0000 7f6d91ffb640 1 -- 10.20.193.26:0/2940209958 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6d84003170 con 0x7f6d94164d00 2026-02-24T19:18:11.622 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.621+0000 7f6d91ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.622 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.621+0000 7f6d91ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:11.622 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.621+0000 7f6d91ffb640 10 monclient: dump: 2026-02-24T19:18:11.622 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.622 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.622 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.622 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.622 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.622 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.622 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.622 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.622 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.622 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.622 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.621+0000 7f6d993c8640 5 monclient: authenticate success, global_id 4602 2026-02-24T19:18:11.622 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.621+0000 7f6d993c8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:11.623 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.622+0000 7f6d91ffb640 1 -- 10.20.193.26:0/2940209958 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6d84003380 con 0x7f6d94164d00 2026-02-24T19:18:11.623 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.622+0000 7f6d91ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.623 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.622+0000 7f6d91ffb640 1 -- 10.20.193.26:0/2940209958 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6d840037c0 con 0x7f6d94164d00 2026-02-24T19:18:11.623 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.622+0000 7f6d91ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.623 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.622+0000 7f6d91ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:11.623 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.622+0000 7f6d91ffb640 10 monclient: dump: 2026-02-24T19:18:11.623 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.623 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.623 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.623 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.623 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.623 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.623 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.623 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.623 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.623 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.623 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.622+0000 7f6d993c8640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:11.623 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.622+0000 7f6d993c8640 4 set_mon_vals no callback set 2026-02-24T19:18:11.623 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.622+0000 7f6d993c8640 10 monclient: shutdown 2026-02-24T19:18:11.623 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.622+0000 7f6d993c8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.623 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.622+0000 7f6d993c8640 1 -- 10.20.193.26:0/2940209958 >> v1:10.20.193.26:6789/0 conn(0x7f6d94164d00 legacy=0x7f6d941c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.623 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.622+0000 7f6d993c8640 1 -- 10.20.193.26:0/2940209958 shutdown_connections 2026-02-24T19:18:11.623 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.622+0000 7f6d993c8640 1 -- 10.20.193.26:0/2940209958 >> 10.20.193.26:0/2940209958 conn(0x7f6d940b2ef0 msgr2=0x7f6d940b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.623 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.622+0000 7f6d993c8640 1 -- 10.20.193.26:0/2940209958 shutdown_connections 2026-02-24T19:18:11.623 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.622+0000 7f6d993c8640 1 -- 10.20.193.26:0/2940209958 wait complete. 2026-02-24T19:18:11.623 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.623+0000 7f6d993c8640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.623 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.623+0000 7f6d993c8640 10 monclient: monmap: 2026-02-24T19:18:11.624 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.624 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:11.624 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:11.624 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:11.624 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.624 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:11.624 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.624 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.624 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.624 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.624 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.623+0000 7f6d993c8640 1 librados: starting msgr at 2026-02-24T19:18:11.624 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.623+0000 7f6d993c8640 1 librados: starting objecter 2026-02-24T19:18:11.624 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.623+0000 7f6d993c8640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:11.624 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.623+0000 7f6d993c8640 1 Processor -- start 2026-02-24T19:18:11.624 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.623+0000 7f6d993c8640 1 -- start start 2026-02-24T19:18:11.624 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.623+0000 7f6d993c8640 1 librados: setting wanted keys 2026-02-24T19:18:11.624 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.623+0000 7f6d993c8640 1 librados: calling monclient init 2026-02-24T19:18:11.624 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.623+0000 7f6d993c8640 10 monclient: init 2026-02-24T19:18:11.624 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.623+0000 7f6d993c8640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.624 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.623+0000 7f6d993c8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:18:11.624 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.623+0000 7f6d993c8640 10 monclient(hunting): picked mon.noname-a con 0x7f6d94157780 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.624 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.623+0000 7f6d993c8640 10 monclient(hunting): picked mon.noname-b con 0x7f6d94157b50 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.624 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.623+0000 7f6d993c8640 10 monclient(hunting): picked mon.noname-c con 0x7f6d94164d00 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.624 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.624+0000 7f6d993c8640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d9412e730 con 0x7f6d94157780 2026-02-24T19:18:11.625 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.624+0000 7f6d993c8640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d940a80a0 con 0x7f6d94157b50 2026-02-24T19:18:11.625 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.624+0000 7f6d993c8640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d940a8380 con 0x7f6d94164d00 2026-02-24T19:18:11.625 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.624+0000 7f6d993c8640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.625 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.624+0000 7f6d993c8640 10 monclient(hunting): authenticate will time out at 3674.306015s 2026-02-24T19:18:11.625 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.624+0000 7f6d92ffd640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f6d94157780 0x7f6d9412e020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:38062/0 (socket says 10.20.193.26:38062) 2026-02-24T19:18:11.625 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.624+0000 7f6d92ffd640 1 -- 10.20.193.26:0/3304562167 learned_addr learned my addr 10.20.193.26:0/3304562167 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.625 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.624+0000 7f6d737fe640 10 client.?.objecter ms_handle_connect 0x7f6d94157780 2026-02-24T19:18:11.625 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.624+0000 7f6d737fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.626 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.625+0000 7f6d737fe640 1 -- 10.20.193.26:0/3304562167 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 962046513 0 0) 0x7f6d9412e730 con 0x7f6d94157780 2026-02-24T19:18:11.626 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.625+0000 7f6d737fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.626 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.625+0000 7f6d737fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.626 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.625+0000 7f6d737fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.626 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.625+0000 7f6d737fe640 10 monclient(hunting): my global_id is 4605 2026-02-24T19:18:11.626 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.625+0000 7f6d737fe640 1 -- 10.20.193.26:0/3304562167 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d60003610 con 0x7f6d94157780 2026-02-24T19:18:11.627 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.626+0000 7f7c26ffd640 1 -- 10.20.193.26:0/3952457042 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7c3c004c50 con 0x7f7c40159810 2026-02-24T19:18:11.627 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.626+0000 7f7c26ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.627 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.626+0000 7f7c26ffd640 1 -- 10.20.193.26:0/3952457042 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7c3c004fa0 con 0x7f7c40159810 2026-02-24T19:18:11.627 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.626+0000 7f7c26ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.627 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.626+0000 7f7c26ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:11.627 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.626+0000 7f7c44d35640 4 set_mon_vals no callback set 2026-02-24T19:18:11.627 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.626+0000 7f7c26ffd640 10 monclient: dump: 2026-02-24T19:18:11.627 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.627 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.627 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.627 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.627 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.627 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.627 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.627 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.627 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.627 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.628 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.627+0000 7f7c26ffd640 1 -- 10.20.193.26:0/3952457042 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f7c3c01de10 con 0x7f7c40159810 2026-02-24T19:18:11.628 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.627+0000 7f7c46538640 10 monclient: get_auth_request con 0x7f7c10077c10 auth_method 0 2026-02-24T19:18:11.628 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.628+0000 7f7c26ffd640 10 client.4604.objecter ms_handle_connect 0x7f7c10077c10 2026-02-24T19:18:11.629 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.628+0000 7f6d737fe640 1 -- 10.20.193.26:0/3304562167 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 304224945 0 0) 0x7f6d60003610 con 0x7f6d94157780 2026-02-24T19:18:11.629 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.628+0000 7f6d737fe640 1 -- 10.20.193.26:0/3304562167 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6d9412e730 con 0x7f6d94157780 2026-02-24T19:18:11.629 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.628+0000 7f6d737fe640 1 -- 10.20.193.26:0/3304562167 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6d88003010 con 0x7f6d94157780 2026-02-24T19:18:11.629 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.628+0000 7f6d737fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:11.629 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.628+0000 7f6d737fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:11.629 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.628+0000 7f6d737fe640 10 monclient(hunting): dump: 2026-02-24T19:18:11.629 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.629 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.629 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.629 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.629 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.629 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.629 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.629 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.629 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.629 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.629 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.628+0000 7f6d737fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:11.629 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.628+0000 7f7c26ffd640 1 -- 10.20.193.26:0/3952457042 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f7c3c093590 con 0x7f7c40159810 2026-02-24T19:18:11.629 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.628+0000 7f7c26ffd640 10 client.4604.objecter ms_dispatch2 0x7f7c40000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:11.629 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.628+0000 7f7c26ffd640 3 client.4604.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:11.629 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.628+0000 7f7c26ffd640 3 client.4604.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:11.629 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.628+0000 7f7c26ffd640 20 client.4604.objecter dump_active .. 0 homeless 2026-02-24T19:18:11.630 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.629+0000 7f6d737fe640 10 client.?.objecter ms_handle_connect 0x7f6d94164d00 2026-02-24T19:18:11.630 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.629+0000 7f6d737fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.631 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.630+0000 7f6d737fe640 1 -- 10.20.193.26:0/3304562167 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2912090991 0 0) 0x7f6d9412e730 con 0x7f6d94157780 2026-02-24T19:18:11.631 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.630+0000 7f6d737fe640 1 -- 10.20.193.26:0/3304562167 >> v1:10.20.193.103:6789/0 conn(0x7f6d94164d00 legacy=0x7f6d940abd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.631 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.630+0000 7f6d737fe640 1 -- 10.20.193.26:0/3304562167 >> v1:10.20.193.70:6789/0 conn(0x7f6d94157b50 legacy=0x7f6d940a9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.631 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.630+0000 7f6d737fe640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.631 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.630+0000 7f6d737fe640 1 monclient: found mon.a 2026-02-24T19:18:11.631 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.630+0000 7f6d737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.631 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.630+0000 7f6d737fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.631 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.630+0000 7f6d737fe640 1 -- 10.20.193.26:0/3304562167 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d940a8660 con 0x7f6d94157780 2026-02-24T19:18:11.631 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.630+0000 7f6d737fe640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.631 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.630+0000 7f6d737fe640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.631 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.630+0000 7f6d737fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.631 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.630+0000 7f6d993c8640 5 monclient: authenticate success, global_id 4605 2026-02-24T19:18:11.631 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.630+0000 7f6d993c8640 10 monclient: _renew_subs 2026-02-24T19:18:11.631 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.630+0000 7f6d993c8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.631 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.630+0000 7f6d993c8640 1 -- 10.20.193.26:0/3304562167 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6d940a8940 con 0x7f6d94157780 2026-02-24T19:18:11.631 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.630+0000 7f6d993c8640 10 client.4605.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:11.631 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.630+0000 7f6d993c8640 10 monclient: _renew_subs 2026-02-24T19:18:11.631 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.630+0000 7f6d993c8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.631 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.630+0000 7f6d993c8640 1 -- 10.20.193.26:0/3304562167 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6d940a9850 con 0x7f6d94157780 2026-02-24T19:18:11.631 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.630+0000 7f6d993c8640 1 librados: init done 2026-02-24T19:18:11.631 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.630+0000 7f6d993c8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.631 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.630+0000 7f6d993c8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.631 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.630+0000 7f6d993c8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.631 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.630+0000 7f6d993c8640 1 -- 10.20.193.26:0/3304562167 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d94057480 con 0x7f6d94157780 2026-02-24T19:18:11.632 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.631+0000 7f75b688b640 10 monclient: get_monmap_and_config 2026-02-24T19:18:11.632 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.631+0000 7f75b688b640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.632 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.631+0000 7f75b688b640 10 monclient: monmap: 2026-02-24T19:18:11.632 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.632 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.632 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:11.632761+0000 2026-02-24T19:18:11.632 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:11.632761+0000 2026-02-24T19:18:11.633 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.633 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.633 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.633 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.633 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.633 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.633 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.632+0000 7f75b688b640 1 Processor -- start 2026-02-24T19:18:11.633 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.632+0000 7f75b688b640 1 -- start start 2026-02-24T19:18:11.633 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.632+0000 7f75b688b640 10 monclient: init 2026-02-24T19:18:11.634 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.632+0000 7f75b688b640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.634 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.633+0000 7f75b688b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:18:11.634 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.633+0000 7f75b688b640 10 monclient(hunting): picked mon.noname-a con 0x7f75b015d0c0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.634 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.633+0000 7f75b688b640 10 monclient(hunting): picked mon.noname-c con 0x7f75b00b0ca0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.634 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.633+0000 7f75b688b640 10 monclient(hunting): picked mon.noname-b con 0x7f75b00b28b0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.634 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.633+0000 7f75b688b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75b00b8540 con 0x7f75b015d0c0 2026-02-24T19:18:11.634 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.633+0000 7f75b688b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75b00b5da0 con 0x7f75b00b28b0 2026-02-24T19:18:11.634 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.633+0000 7f75b688b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75b00b6080 con 0x7f75b00b0ca0 2026-02-24T19:18:11.634 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.633+0000 7f75b688b640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.634 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.633+0000 7f75b688b640 10 monclient(hunting): authenticate will time out at 3674.315079s 2026-02-24T19:18:11.647 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.646+0000 7fcb695ed640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-24T19:18:11.647 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.646+0000 7fcb695ed640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-24T19:18:11.647 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.646+0000 7fcb695ed640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.647 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.646+0000 7fcb695ed640 1 -- 10.20.193.26:0/4090791701 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fcb640b9580 con 0x7fcb640ba350 2026-02-24T19:18:11.648 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2026-02-24T19:18:11.651 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.650+0000 7fd4657fa640 1 -- 10.20.193.26:0/574837392 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fd46005dab0 con 0x7fd4700b0ca0 2026-02-24T19:18:11.651 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.650+0000 7fd4657fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.651 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.650+0000 7fd4657fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:11.652 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.651+0000 7f75b4e01640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f75b00b28b0 0x7f75b00b7e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:46294/0 (socket says 10.20.193.26:46294) 2026-02-24T19:18:11.652 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.651+0000 7f75b4e01640 1 -- 10.20.193.26:0/202369586 learned_addr learned my addr 10.20.193.26:0/202369586 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.654+0000 7f75aeffd640 1 -- 10.20.193.26:0/202369586 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1086790772 0 0) 0x7f75b00b5da0 con 0x7f75b00b28b0 2026-02-24T19:18:11.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.654+0000 7f75aeffd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.654+0000 7f75aeffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.654+0000 7f75aeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.654+0000 7f75aeffd640 10 monclient(hunting): my global_id is 4573 2026-02-24T19:18:11.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.654+0000 7f75aeffd640 1 -- 10.20.193.26:0/202369586 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7594003610 con 0x7f75b00b28b0 2026-02-24T19:18:11.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.656+0000 7f75aeffd640 1 -- 10.20.193.26:0/202369586 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3985381600 0 0) 0x7f7594003610 con 0x7f75b00b28b0 2026-02-24T19:18:11.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.656+0000 7f75aeffd640 1 -- 10.20.193.26:0/202369586 >> v1:10.20.193.103:6789/0 conn(0x7f75b00b0ca0 legacy=0x7f75b00b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:11.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.656+0000 7f75aeffd640 1 -- 10.20.193.26:0/202369586 >> v1:10.20.193.26:6789/0 conn(0x7f75b015d0c0 legacy=0x7f75b00b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:11.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.656+0000 7f75aeffd640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.656+0000 7f75aeffd640 1 monclient: found mon.noname-b 2026-02-24T19:18:11.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.656+0000 7f75aeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.656+0000 7f75aeffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:18:11.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.656+0000 7f75aeffd640 1 -- 10.20.193.26:0/202369586 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b0163e10 con 0x7f75b00b28b0 2026-02-24T19:18:11.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.656+0000 7f75aeffd640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.656+0000 7f75aeffd640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.656+0000 7f75aeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.656+0000 7f75aeffd640 1 -- 10.20.193.26:0/202369586 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f75a4003170 con 0x7f75b00b28b0 2026-02-24T19:18:11.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.656+0000 7f75aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.656+0000 7f75aeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:11.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.656+0000 7f75aeffd640 10 monclient: dump: 2026-02-24T19:18:11.657 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.657 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.657 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.657 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.657 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.657 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.657 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.657 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.656+0000 7f75b688b640 5 monclient: authenticate success, global_id 4573 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.656+0000 7f75b688b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.657+0000 7f75aeffd640 1 -- 10.20.193.26:0/202369586 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f75a4003380 con 0x7f75b00b28b0 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.657+0000 7f75aeffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.657+0000 7f75aeffd640 1 -- 10.20.193.26:0/202369586 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f75a40037c0 con 0x7f75b00b28b0 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.657+0000 7f75b688b640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.657+0000 7f75b688b640 4 set_mon_vals no callback set 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.657+0000 7f75aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.657+0000 7f75aeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.657+0000 7f75aeffd640 10 monclient: dump: 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.657+0000 7f75b688b640 10 monclient: shutdown 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.657+0000 7f75b688b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.657+0000 7f75b688b640 1 -- 10.20.193.26:0/202369586 >> v1:10.20.193.70:6789/0 conn(0x7f75b00b28b0 legacy=0x7f75b00b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.657+0000 7f75b688b640 1 -- 10.20.193.26:0/202369586 shutdown_connections 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.657+0000 7f75b688b640 1 -- 10.20.193.26:0/202369586 >> 10.20.193.26:0/202369586 conn(0x7f75b00b5290 msgr2=0x7f75b00b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.658+0000 7f75b688b640 1 -- 10.20.193.26:0/202369586 shutdown_connections 2026-02-24T19:18:11.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.658+0000 7f75b688b640 1 -- 10.20.193.26:0/202369586 wait complete. 2026-02-24T19:18:11.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.658+0000 7f75b688b640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.658+0000 7f75b688b640 10 monclient: monmap: 2026-02-24T19:18:11.659 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.659 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:11.659 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:11.659 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:11.659 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.659 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:11.659 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.659 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.659 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.659 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.658+0000 7f75b688b640 1 librados: starting msgr at 2026-02-24T19:18:11.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.658+0000 7f75b688b640 1 librados: starting objecter 2026-02-24T19:18:11.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.658+0000 7f75b688b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:11.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.658+0000 7f75b688b640 1 Processor -- start 2026-02-24T19:18:11.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.658+0000 7f75b688b640 1 -- start start 2026-02-24T19:18:11.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.658+0000 7f75b688b640 1 librados: setting wanted keys 2026-02-24T19:18:11.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.658+0000 7f75b688b640 1 librados: calling monclient init 2026-02-24T19:18:11.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.658+0000 7f75b688b640 10 monclient: init 2026-02-24T19:18:11.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.659+0000 7f75b688b640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.659+0000 7f75b688b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:18:11.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.659+0000 7f75b688b640 10 monclient(hunting): picked mon.noname-a con 0x7f75b00b0ca0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.659+0000 7f75b688b640 10 monclient(hunting): picked mon.noname-b con 0x7f75b00b28b0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.659+0000 7f75b688b640 10 monclient(hunting): picked mon.noname-c con 0x7f75b015d0c0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.659+0000 7f75b688b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75b01339b0 con 0x7f75b00b0ca0 2026-02-24T19:18:11.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.659+0000 7f75b688b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75b0133c90 con 0x7f75b00b28b0 2026-02-24T19:18:11.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.659+0000 7f75b688b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75b0133f70 con 0x7f75b015d0c0 2026-02-24T19:18:11.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.659+0000 7f75b688b640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.659+0000 7f75b688b640 10 monclient(hunting): authenticate will time out at 3674.341318s 2026-02-24T19:18:11.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.659+0000 7f75af7fe640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f75b00b28b0 0x7f75b00b7770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:46302/0 (socket says 10.20.193.26:46302) 2026-02-24T19:18:11.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.659+0000 7f75af7fe640 1 -- 10.20.193.26:0/3647229437 learned_addr learned my addr 10.20.193.26:0/3647229437 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.659+0000 7f75acff9640 10 client.?.objecter ms_handle_connect 0x7f75b00b28b0 2026-02-24T19:18:11.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.659+0000 7f75acff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.660+0000 7f75acff9640 1 -- 10.20.193.26:0/3647229437 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1526252533 0 0) 0x7f75b0133c90 con 0x7f75b00b28b0 2026-02-24T19:18:11.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.660+0000 7f75acff9640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.660+0000 7f75acff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.660+0000 7f75acff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.660+0000 7f75acff9640 10 monclient(hunting): my global_id is 4576 2026-02-24T19:18:11.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.660+0000 7f75acff9640 1 -- 10.20.193.26:0/3647229437 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7580003610 con 0x7f75b00b28b0 2026-02-24T19:18:11.664 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.663+0000 7f75acff9640 1 -- 10.20.193.26:0/3647229437 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1587335042 0 0) 0x7f7580003610 con 0x7f75b00b28b0 2026-02-24T19:18:11.664 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.663+0000 7f75acff9640 1 -- 10.20.193.26:0/3647229437 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f75b0133c90 con 0x7f75b00b28b0 2026-02-24T19:18:11.664 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.663+0000 7f75acff9640 1 -- 10.20.193.26:0/3647229437 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f75a0002fd0 con 0x7f75b00b28b0 2026-02-24T19:18:11.664 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.663+0000 7f75acff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:11.664 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.663+0000 7f75acff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:11.664 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.663+0000 7f75acff9640 10 monclient(hunting): dump: 2026-02-24T19:18:11.664 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.664 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.664 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.664 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.664 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.664 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.664 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.664 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.664 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.664 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.664 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.663+0000 7f75acff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:11.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.665+0000 7f75acff9640 1 -- 10.20.193.26:0/3647229437 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2278565351 0 0) 0x7f75b0133c90 con 0x7f75b00b28b0 2026-02-24T19:18:11.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.665+0000 7f75acff9640 1 -- 10.20.193.26:0/3647229437 >> v1:10.20.193.103:6789/0 conn(0x7f75b015d0c0 legacy=0x7f75b0153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.665+0000 7f75acff9640 1 -- 10.20.193.26:0/3647229437 >> v1:10.20.193.26:6789/0 conn(0x7f75b00b0ca0 legacy=0x7f75b015ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.665+0000 7f75acff9640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.665+0000 7f75acff9640 1 monclient: found mon.b 2026-02-24T19:18:11.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.665+0000 7f75acff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.665+0000 7f75acff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:11.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.665+0000 7f75acff9640 1 -- 10.20.193.26:0/3647229437 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b0134250 con 0x7f75b00b28b0 2026-02-24T19:18:11.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.665+0000 7f75acff9640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.665+0000 7f75acff9640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.665+0000 7f75acff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.665+0000 7f75b688b640 5 monclient: authenticate success, global_id 4576 2026-02-24T19:18:11.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.665+0000 7f75b688b640 10 monclient: _renew_subs 2026-02-24T19:18:11.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.665+0000 7f75b688b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:11.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.665+0000 7f75b688b640 1 -- 10.20.193.26:0/3647229437 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f75b0134530 con 0x7f75b00b28b0 2026-02-24T19:18:11.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.665+0000 7f75b688b640 10 client.4576.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:11.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.665+0000 7f75b688b640 10 monclient: _renew_subs 2026-02-24T19:18:11.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.665+0000 7f75b688b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:11.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.665+0000 7f75b688b640 1 -- 10.20.193.26:0/3647229437 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f75b015b230 con 0x7f75b00b28b0 2026-02-24T19:18:11.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.665+0000 7f75b688b640 1 librados: init done 2026-02-24T19:18:11.666 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2026-02-24T19:18:11.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.666+0000 7f75b688b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.666+0000 7f75b688b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.666+0000 7f75b688b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:11.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.666+0000 7f75b688b640 1 -- 10.20.193.26:0/3647229437 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75b0134bf0 con 0x7f75b00b28b0 2026-02-24T19:18:11.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.670+0000 7f3264ffa640 10 monclient: get_monmap_and_config 2026-02-24T19:18:11.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.670+0000 7f3264ffa640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.670+0000 7f3264ffa640 10 monclient: monmap: 2026-02-24T19:18:11.671 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.671 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.671 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:11.671566+0000 2026-02-24T19:18:11.671 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:11.671566+0000 2026-02-24T19:18:11.671 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.671 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.671 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.671 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.671 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.671 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.670+0000 7f8f8a32e640 10 monclient: get_monmap_and_config 2026-02-24T19:18:11.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.670+0000 7f8f8a32e640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.670+0000 7f8f8a32e640 10 monclient: monmap: 2026-02-24T19:18:11.672 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.672 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.672 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:11.671732+0000 2026-02-24T19:18:11.672 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:11.671732+0000 2026-02-24T19:18:11.672 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.672 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.672 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.672 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.672 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.672 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f3264ffa640 1 Processor -- start 2026-02-24T19:18:11.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f3264ffa640 1 -- start start 2026-02-24T19:18:11.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f3264ffa640 10 monclient: init 2026-02-24T19:18:11.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f8f8a32e640 1 Processor -- start 2026-02-24T19:18:11.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f8f8a32e640 1 -- start start 2026-02-24T19:18:11.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f8f8a32e640 10 monclient: init 2026-02-24T19:18:11.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f2f2aa24640 10 monclient: get_monmap_and_config 2026-02-24T19:18:11.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f2f2aa24640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f2f2aa24640 10 monclient: monmap: 2026-02-24T19:18:11.672 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.673 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.673 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:11.672477+0000 2026-02-24T19:18:11.673 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:11.672477+0000 2026-02-24T19:18:11.673 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.673 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.673 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.673 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.673 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.673 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f3264ffa640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f3264ffa640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:18:11.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f3264ffa640 10 monclient(hunting): picked mon.noname-b con 0x7f326015d0c0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f3264ffa640 10 monclient(hunting): picked mon.noname-c con 0x7f32600b0ca0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f3264ffa640 10 monclient(hunting): picked mon.noname-a con 0x7f32600b28b0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f3264ffa640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32600b8540 con 0x7f32600b28b0 2026-02-24T19:18:11.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f3264ffa640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32600b5da0 con 0x7f326015d0c0 2026-02-24T19:18:11.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f3264ffa640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32600b6080 con 0x7f32600b0ca0 2026-02-24T19:18:11.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f3264ffa640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f3264ffa640 10 monclient(hunting): authenticate will time out at 3674.353827s 2026-02-24T19:18:11.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f8f8a32e640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f8f8a32e640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:18:11.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f8f8a32e640 10 monclient(hunting): picked mon.noname-c con 0x7f8f84157780 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f8f8a32e640 10 monclient(hunting): picked mon.noname-a con 0x7f8f84157b50 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f8f8a32e640 10 monclient(hunting): picked mon.noname-b con 0x7f8f84164d00 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f8f8a32e640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f8405de70 con 0x7f8f84157b50 2026-02-24T19:18:11.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f8f8a32e640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f84055b20 con 0x7f8f84164d00 2026-02-24T19:18:11.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f8f8a32e640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f84055e00 con 0x7f8f84157780 2026-02-24T19:18:11.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f8f8a32e640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.671+0000 7f8f8a32e640 10 monclient(hunting): authenticate will time out at 3674.354005s 2026-02-24T19:18:11.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.672+0000 7f2f2aa24640 1 Processor -- start 2026-02-24T19:18:11.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.672+0000 7f2f2aa24640 1 -- start start 2026-02-24T19:18:11.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.672+0000 7f2f2aa24640 10 monclient: init 2026-02-24T19:18:11.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.672+0000 7f2f2aa24640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.672+0000 7f2f2aa24640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:18:11.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.672+0000 7f2f2aa24640 10 monclient(hunting): picked mon.noname-a con 0x7f2f240b9f80 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.672+0000 7f2f2aa24640 10 monclient(hunting): picked mon.noname-c con 0x7f2f240ba350 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.672+0000 7f2f2aa24640 10 monclient(hunting): picked mon.noname-b con 0x7f2f240585e0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.672+0000 7f2f2aa24640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f24163930 con 0x7f2f240b9f80 2026-02-24T19:18:11.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.672+0000 7f2f2aa24640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f24163bb0 con 0x7f2f240585e0 2026-02-24T19:18:11.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.672+0000 7f2f2aa24640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f24163e90 con 0x7f2f240ba350 2026-02-24T19:18:11.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.672+0000 7f2f2aa24640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.672+0000 7f2f2aa24640 10 monclient(hunting): authenticate will time out at 3674.354848s 2026-02-24T19:18:11.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.673+0000 7f75acff9640 1 -- 10.20.193.26:0/3647229437 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f75a00049c0 con 0x7f75b00b28b0 2026-02-24T19:18:11.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.673+0000 7f75acff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.673+0000 7f75acff9640 1 -- 10.20.193.26:0/3647229437 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f75a0004b70 con 0x7f75b00b28b0 2026-02-24T19:18:11.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.673+0000 7f75acff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.673+0000 7f75acff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:11.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.673+0000 7f75acff9640 10 monclient: dump: 2026-02-24T19:18:11.675 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.675 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.675 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.675 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.675 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.675 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.675 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.675 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.675 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.675 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.673+0000 7f75ae7fc640 4 set_mon_vals no callback set 2026-02-24T19:18:11.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.674+0000 7f75acff9640 1 -- 10.20.193.26:0/3647229437 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f75a001d9e0 con 0x7f75b00b28b0 2026-02-24T19:18:11.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.675+0000 7f75affff640 10 monclient: get_auth_request con 0x7f7580077bf0 auth_method 0 2026-02-24T19:18:11.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.675+0000 7f75acff9640 10 client.4576.objecter ms_handle_connect 0x7f7580077bf0 2026-02-24T19:18:11.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.675+0000 7f75acff9640 1 -- 10.20.193.26:0/3647229437 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f75a0093400 con 0x7f75b00b28b0 2026-02-24T19:18:11.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.675+0000 7f75acff9640 10 client.4576.objecter ms_dispatch2 0x7f75b0000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:11.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.675+0000 7f75acff9640 3 client.4576.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:11.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.675+0000 7f75acff9640 3 client.4576.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:11.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.675+0000 7f75acff9640 20 client.4576.objecter dump_active .. 0 homeless 2026-02-24T19:18:11.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.676+0000 7f325e575640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f326015d0c0 0x7f32600b0590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:46310/0 (socket says 10.20.193.26:46310) 2026-02-24T19:18:11.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.676+0000 7f325e575640 1 -- 10.20.193.26:0/266960534 learned_addr learned my addr 10.20.193.26:0/266960534 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.676+0000 7f2f28f9a640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f2f240585e0 0x7f2f24166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:46330/0 (socket says 10.20.193.26:46330) 2026-02-24T19:18:11.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.676+0000 7f2f28f9a640 1 -- 10.20.193.26:0/3088444773 learned_addr learned my addr 10.20.193.26:0/3088444773 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.713+0000 7fe886c5b640 10 monclient: get_monmap_and_config 2026-02-24T19:18:11.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.713+0000 7fe886c5b640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.713+0000 7fe886c5b640 10 monclient: monmap: 2026-02-24T19:18:11.714 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.714 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.714 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:11.713952+0000 2026-02-24T19:18:11.714 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:11.713952+0000 2026-02-24T19:18:11.714 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.714 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.714 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.714 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.714 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.714 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.713+0000 7fe886c5b640 1 Processor -- start 2026-02-24T19:18:11.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.713+0000 7f7c26ffd640 1 -- 10.20.193.26:0/3952457042 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f7c3c05dfc0 con 0x7f7c40159810 2026-02-24T19:18:11.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.713+0000 7f7c26ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.713+0000 7f7c26ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:11.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.713+0000 7fe886c5b640 1 -- start start 2026-02-24T19:18:11.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.713+0000 7fe886c5b640 10 monclient: init 2026-02-24T19:18:11.715 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.714+0000 7fe886c5b640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.715 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.714+0000 7fe886c5b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:18:11.715 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.714+0000 7fe886c5b640 10 monclient(hunting): picked mon.noname-a con 0x7fe8800b9f80 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.715 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.714+0000 7fe886c5b640 10 monclient(hunting): picked mon.noname-b con 0x7fe8800ba350 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.715 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.714+0000 7fe886c5b640 10 monclient(hunting): picked mon.noname-c con 0x7fe8800585e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.715 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.714+0000 7fe886c5b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe880163930 con 0x7fe8800b9f80 2026-02-24T19:18:11.715 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.714+0000 7fe886c5b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe880163bb0 con 0x7fe8800ba350 2026-02-24T19:18:11.715 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.714+0000 7fe886c5b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe880163e90 con 0x7fe8800585e0 2026-02-24T19:18:11.715 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.714+0000 7fe886c5b640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.715 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.714+0000 7fe886c5b640 10 monclient(hunting): authenticate will time out at 3674.396381s 2026-02-24T19:18:11.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.716+0000 7f8f83fff640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f8f84157780 0x7f8f84056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58730/0 (socket says 10.20.193.26:58730) 2026-02-24T19:18:11.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.716+0000 7f8f83fff640 1 -- 10.20.193.26:0/937546686 learned_addr learned my addr 10.20.193.26:0/937546686 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.719 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.718+0000 7fe8851d1640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fe8800585e0 0x7fe880166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58752/0 (socket says 10.20.193.26:58752) 2026-02-24T19:18:11.719 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.718+0000 7fe8851d1640 1 -- 10.20.193.26:0/139507449 learned_addr learned my addr 10.20.193.26:0/139507449 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.721 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.720+0000 7f8f82ffd640 1 -- 10.20.193.26:0/937546686 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2511009659 0 0) 0x7f8f84055e00 con 0x7f8f84157780 2026-02-24T19:18:11.721 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.720+0000 7f8f82ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.721 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.720+0000 7f8f82ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.721 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.720+0000 7f8f82ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.721 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.720+0000 7f8f82ffd640 10 monclient(hunting): my global_id is 4613 2026-02-24T19:18:11.721 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.720+0000 7f8f82ffd640 1 -- 10.20.193.26:0/937546686 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f68003610 con 0x7f8f84157780 2026-02-24T19:18:11.721 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.720+0000 7f2f22ffd640 1 -- 10.20.193.26:0/3088444773 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1916271454 0 0) 0x7f2f24163e90 con 0x7f2f240ba350 2026-02-24T19:18:11.721 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.720+0000 7f2f22ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.721 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.720+0000 7f2f22ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.721 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.720+0000 7f2f22ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.721 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.720+0000 7f2f22ffd640 10 monclient(hunting): my global_id is 4616 2026-02-24T19:18:11.721 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.720+0000 7f2f22ffd640 1 -- 10.20.193.26:0/3088444773 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f08003610 con 0x7f2f240ba350 2026-02-24T19:18:11.721 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.720+0000 7f325d573640 1 -- 10.20.193.26:0/266960534 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1536041722 0 0) 0x7f32600b6080 con 0x7f32600b0ca0 2026-02-24T19:18:11.721 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.720+0000 7f325d573640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.722 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.720+0000 7f325d573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.722 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.720+0000 7f325d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.722 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.720+0000 7f325d573640 10 monclient(hunting): my global_id is 4610 2026-02-24T19:18:11.722 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.720+0000 7f325d573640 1 -- 10.20.193.26:0/266960534 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f324c003610 con 0x7f32600b0ca0 2026-02-24T19:18:11.724 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.723+0000 7f8f82ffd640 1 -- 10.20.193.26:0/937546686 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 861364570 0 0) 0x7f8f68003610 con 0x7f8f84157780 2026-02-24T19:18:11.724 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.723+0000 7f8f82ffd640 1 -- 10.20.193.26:0/937546686 >> v1:10.20.193.70:6789/0 conn(0x7f8f84164d00 legacy=0x7f8f841c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:11.724 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.723+0000 7f8f82ffd640 1 -- 10.20.193.26:0/937546686 >> v1:10.20.193.26:6789/0 conn(0x7f8f84157b50 legacy=0x7f8f841645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:11.724 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.723+0000 7f8f82ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.724 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.723+0000 7f8f82ffd640 1 monclient: found mon.noname-c 2026-02-24T19:18:11.724 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.723+0000 7f8f82ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.724 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.723+0000 7f8f82ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.724 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.723+0000 7f8f82ffd640 1 -- 10.20.193.26:0/937546686 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f840560e0 con 0x7f8f84157780 2026-02-24T19:18:11.724 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.723+0000 7f8f82ffd640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.724 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.723+0000 7f8f82ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.724 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.723+0000 7f8f82ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.724 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.723+0000 7f8f82ffd640 1 -- 10.20.193.26:0/937546686 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f8f70002df0 con 0x7f8f84157780 2026-02-24T19:18:11.724 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.723+0000 7f8f82ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.724 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.723+0000 7f8f82ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:11.724 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.723+0000 7f8f82ffd640 10 monclient: dump: 2026-02-24T19:18:11.724 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.724 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.724 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.724 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.724 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.724 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.724 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.724 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.724 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.724 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.724 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.723+0000 7f8f8a32e640 5 monclient: authenticate success, global_id 4613 2026-02-24T19:18:11.724 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.723+0000 7f8f8a32e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:11.725 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.724+0000 7fe8777fe640 1 -- 10.20.193.26:0/139507449 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2104048869 0 0) 0x7fe880163e90 con 0x7fe8800585e0 2026-02-24T19:18:11.725 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.724+0000 7fe8777fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.725 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.724+0000 7fe8777fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.725 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.724+0000 7fe8777fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.725 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.724+0000 7fe8777fe640 10 monclient(hunting): my global_id is 4619 2026-02-24T19:18:11.725 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.724+0000 7fe8777fe640 1 -- 10.20.193.26:0/139507449 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe86c003610 con 0x7fe8800585e0 2026-02-24T19:18:11.726 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.725+0000 7f6d737fe640 1 -- 10.20.193.26:0/3304562167 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6d880048d0 con 0x7f6d94157780 2026-02-24T19:18:11.726 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.725+0000 7f6d737fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.726 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.725+0000 7f6d737fe640 1 -- 10.20.193.26:0/3304562167 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6d88004b40 con 0x7f6d94157780 2026-02-24T19:18:11.726 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.725+0000 7f6d737fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.726 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.725+0000 7f6d737fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:11.726 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.725+0000 7f6d737fe640 10 monclient: dump: 2026-02-24T19:18:11.726 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.726 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.726 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.726 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.725+0000 7f6d917fa640 4 set_mon_vals no callback set 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.726+0000 7f2f22ffd640 1 -- 10.20.193.26:0/3088444773 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3216113164 0 0) 0x7f2f08003610 con 0x7f2f240ba350 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.726+0000 7f2f22ffd640 1 -- 10.20.193.26:0/3088444773 >> v1:10.20.193.70:6789/0 conn(0x7f2f240585e0 legacy=0x7f2f24166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.726+0000 7f2f22ffd640 1 -- 10.20.193.26:0/3088444773 >> v1:10.20.193.26:6789/0 conn(0x7f2f240b9f80 legacy=0x7f2f24163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.726+0000 7f2f22ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.726+0000 7f2f22ffd640 1 monclient: found mon.noname-c 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.726+0000 7f2f22ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.726+0000 7f2f22ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.726+0000 7f2f22ffd640 1 -- 10.20.193.26:0/3088444773 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f240573f0 con 0x7f2f240ba350 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.726+0000 7f2f22ffd640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.726+0000 7f2f22ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.726+0000 7f2f22ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.726+0000 7f2f22ffd640 1 -- 10.20.193.26:0/3088444773 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2f14002df0 con 0x7f2f240ba350 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.726+0000 7f2f2aa24640 5 monclient: authenticate success, global_id 4616 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.726+0000 7f2f2aa24640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.726+0000 7f2f22ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.726+0000 7f2f22ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.726+0000 7f2f22ffd640 10 monclient: dump: 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.726+0000 7f2f2aa24640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:11.728 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.726+0000 7f6d737fe640 1 -- 10.20.193.26:0/3304562167 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f6d88004d20 con 0x7f6d94157780 2026-02-24T19:18:11.728 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.727+0000 7f6d927fc640 10 monclient: get_auth_request con 0x7f6d60077d40 auth_method 0 2026-02-24T19:18:11.728 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.727+0000 7f6d737fe640 10 client.4605.objecter ms_handle_connect 0x7f6d60077d40 2026-02-24T19:18:11.729 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7f325d573640 1 -- 10.20.193.26:0/266960534 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2621693338 0 0) 0x7f324c003610 con 0x7f32600b0ca0 2026-02-24T19:18:11.729 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7f325d573640 1 -- 10.20.193.26:0/266960534 >> v1:10.20.193.70:6789/0 conn(0x7f326015d0c0 legacy=0x7f32600b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:11.729 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7f325d573640 1 -- 10.20.193.26:0/266960534 >> v1:10.20.193.26:6789/0 conn(0x7f32600b28b0 legacy=0x7f32600b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:11.729 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7f325d573640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.729 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7f325d573640 1 monclient: found mon.noname-c 2026-02-24T19:18:11.729 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7f325d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.729 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7f325d573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.729 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7f325d573640 1 -- 10.20.193.26:0/266960534 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3260163e10 con 0x7f32600b0ca0 2026-02-24T19:18:11.729 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7f325d573640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.729 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7f325d573640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.729 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7f325d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.729 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7f325d573640 1 -- 10.20.193.26:0/266960534 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f3248002df0 con 0x7f32600b0ca0 2026-02-24T19:18:11.729 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7f325d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.729 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7f325d573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:11.729 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7f325d573640 10 monclient: dump: 2026-02-24T19:18:11.729 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.729 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.729 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.729 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.729 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.729 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.729 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.729 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.729 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.729 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.729 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7f3264ffa640 5 monclient: authenticate success, global_id 4610 2026-02-24T19:18:11.729 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7f3264ffa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7f8f82ffd640 1 -- 10.20.193.26:0/937546686 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8f70003000 con 0x7f8f84157780 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7f8f82ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7f8f82ffd640 1 -- 10.20.193.26:0/937546686 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f8f70003440 con 0x7f8f84157780 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7f8f82ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7f8f82ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7f8f82ffd640 10 monclient: dump: 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7f8f8a32e640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7f8f8a32e640 4 set_mon_vals no callback set 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7fe8777fe640 1 -- 10.20.193.26:0/139507449 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 312983436 0 0) 0x7fe86c003610 con 0x7fe8800585e0 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7fe8777fe640 1 -- 10.20.193.26:0/139507449 >> v1:10.20.193.70:6789/0 conn(0x7fe8800ba350 legacy=0x7fe880057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7fe8777fe640 1 -- 10.20.193.26:0/139507449 >> v1:10.20.193.26:6789/0 conn(0x7fe8800b9f80 legacy=0x7fe880163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7fe8777fe640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7fe8777fe640 1 monclient: found mon.noname-c 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7fe8777fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7fe8777fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7fe8777fe640 1 -- 10.20.193.26:0/139507449 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8800573f0 con 0x7fe8800585e0 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7fe8777fe640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7fe8777fe640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7fe8777fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7fe8777fe640 1 -- 10.20.193.26:0/139507449 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fe87c003170 con 0x7fe8800585e0 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7fe8777fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7fe8777fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7fe8777fe640 10 monclient: dump: 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.730 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.731 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.731 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.731 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.731 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.731 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.731 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.731 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.731 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7fe886c5b640 5 monclient: authenticate success, global_id 4619 2026-02-24T19:18:11.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.728+0000 7fe886c5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:11.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.729+0000 7f8f8a32e640 10 monclient: shutdown 2026-02-24T19:18:11.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.729+0000 7f8f8a32e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.729+0000 7f8f8a32e640 1 -- 10.20.193.26:0/937546686 >> v1:10.20.193.103:6789/0 conn(0x7f8f84157780 legacy=0x7f8f84056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.729+0000 7f8f8a32e640 1 -- 10.20.193.26:0/937546686 shutdown_connections 2026-02-24T19:18:11.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.729+0000 7f8f8a32e640 1 -- 10.20.193.26:0/937546686 >> 10.20.193.26:0/937546686 conn(0x7f8f840b2ef0 msgr2=0x7f8f840b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.729+0000 7f8f8a32e640 1 -- 10.20.193.26:0/937546686 shutdown_connections 2026-02-24T19:18:11.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.729+0000 7f8f8a32e640 1 -- 10.20.193.26:0/937546686 wait complete. 2026-02-24T19:18:11.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.729+0000 7f2f22ffd640 1 -- 10.20.193.26:0/3088444773 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2f14003000 con 0x7f2f240ba350 2026-02-24T19:18:11.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.729+0000 7f2f22ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.729+0000 7f2f22ffd640 1 -- 10.20.193.26:0/3088444773 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2f14003440 con 0x7f2f240ba350 2026-02-24T19:18:11.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.729+0000 7f2f22ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.729+0000 7f2f22ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:11.731 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.729+0000 7f2f22ffd640 10 monclient: dump: 2026-02-24T19:18:11.731 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.731 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.731 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.731 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.729+0000 7f2f2aa24640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.729+0000 7f2f2aa24640 4 set_mon_vals no callback set 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.729+0000 7f8f8a32e640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.729+0000 7f8f8a32e640 10 monclient: monmap: 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f8f8a32e640 1 librados: starting msgr at 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f8f8a32e640 1 librados: starting objecter 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f8f8a32e640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f8f8a32e640 1 Processor -- start 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f2f2aa24640 10 monclient: shutdown 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f2f2aa24640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f2f2aa24640 1 -- 10.20.193.26:0/3088444773 >> v1:10.20.193.103:6789/0 conn(0x7f2f240ba350 legacy=0x7f2f24057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f8f8a32e640 1 -- start start 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f8f8a32e640 1 librados: setting wanted keys 2026-02-24T19:18:11.732 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f8f8a32e640 1 librados: calling monclient init 2026-02-24T19:18:11.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f8f8a32e640 10 monclient: init 2026-02-24T19:18:11.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f2f2aa24640 1 -- 10.20.193.26:0/3088444773 shutdown_connections 2026-02-24T19:18:11.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f2f2aa24640 1 -- 10.20.193.26:0/3088444773 >> 10.20.193.26:0/3088444773 conn(0x7f2f240b7990 msgr2=0x7f2f240b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f2f2aa24640 1 -- 10.20.193.26:0/3088444773 shutdown_connections 2026-02-24T19:18:11.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f6d737fe640 1 -- 10.20.193.26:0/3304562167 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f6d880933f0 con 0x7f6d94157780 2026-02-24T19:18:11.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f6d737fe640 10 client.4605.objecter ms_dispatch2 0x7f6d94000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:11.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f2f2aa24640 1 -- 10.20.193.26:0/3088444773 wait complete. 2026-02-24T19:18:11.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f6d737fe640 3 client.4605.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:11.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f6d737fe640 3 client.4605.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:11.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f6d737fe640 20 client.4605.objecter dump_active .. 0 homeless 2026-02-24T19:18:11.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f6d737fe640 1 -- 10.20.193.26:0/3304562167 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f6d8805de20 con 0x7f6d94157780 2026-02-24T19:18:11.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f6d737fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f6d737fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:11.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f8f8a32e640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f2f2aa24640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.733 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f2f2aa24640 10 monclient: monmap: 2026-02-24T19:18:11.733 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.733 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:11.733 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:11.733 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:11.733 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.734 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:11.734 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.734 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.734 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.734 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.734 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f8f8a32e640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:18:11.734 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f8f8a32e640 10 monclient(hunting): picked mon.noname-c con 0x7f8f84157780 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.734 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f8f8a32e640 10 monclient(hunting): picked mon.noname-b con 0x7f8f84157b50 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.734 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f8f8a32e640 10 monclient(hunting): picked mon.noname-a con 0x7f8f84164d00 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.734 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f8f8a32e640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f8415f660 con 0x7f8f84164d00 2026-02-24T19:18:11.734 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f8f8a32e640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f841fb2a0 con 0x7f8f84157b50 2026-02-24T19:18:11.734 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f8f8a32e640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f841fb580 con 0x7f8f84157780 2026-02-24T19:18:11.734 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f8f8a32e640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.734 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f8f8a32e640 10 monclient(hunting): authenticate will time out at 3674.412749s 2026-02-24T19:18:11.734 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f2f2aa24640 1 librados: starting msgr at 2026-02-24T19:18:11.734 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f2f2aa24640 1 librados: starting objecter 2026-02-24T19:18:11.734 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f2f2aa24640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:11.734 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f2f2aa24640 1 Processor -- start 2026-02-24T19:18:11.734 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f2f2aa24640 1 -- start start 2026-02-24T19:18:11.734 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f2f2aa24640 1 librados: setting wanted keys 2026-02-24T19:18:11.734 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f2f2aa24640 1 librados: calling monclient init 2026-02-24T19:18:11.734 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.730+0000 7f2f2aa24640 10 monclient: init 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7f325d573640 1 -- 10.20.193.26:0/266960534 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3248003000 con 0x7f32600b0ca0 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7f325d573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7f325d573640 1 -- 10.20.193.26:0/266960534 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f3248003440 con 0x7f32600b0ca0 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7f325d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7f325d573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7f325d573640 10 monclient: dump: 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7f3264ffa640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7f3264ffa640 4 set_mon_vals no callback set 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7f2f2aa24640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7f2f2aa24640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7f2f2aa24640 10 monclient(hunting): picked mon.noname-b con 0x7f2f240585e0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7f2f2aa24640 10 monclient(hunting): picked mon.noname-a con 0x7f2f240b9f80 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7f2f2aa24640 10 monclient(hunting): picked mon.noname-c con 0x7f2f240ba350 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7f2f2aa24640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f24166030 con 0x7f2f240b9f80 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7f2f2aa24640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f241fd6a0 con 0x7f2f240585e0 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7f2f2aa24640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f241fd980 con 0x7f2f240ba350 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7f2f2aa24640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.735 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7f2f2aa24640 10 monclient(hunting): authenticate will time out at 3674.413392s 2026-02-24T19:18:11.736 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7fe8777fe640 1 -- 10.20.193.26:0/139507449 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe87c003380 con 0x7fe8800585e0 2026-02-24T19:18:11.736 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7fe8777fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.736 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7fe8777fe640 1 -- 10.20.193.26:0/139507449 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fe87c0037c0 con 0x7fe8800585e0 2026-02-24T19:18:11.736 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7fe8777fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.736 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7fe8777fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:11.736 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7fe8777fe640 10 monclient: dump: 2026-02-24T19:18:11.736 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.736 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.736 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.736 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.736 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.736 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.736 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.736 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.736 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.736 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.736 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7fe886c5b640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:11.736 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7fe886c5b640 4 set_mon_vals no callback set 2026-02-24T19:18:11.736 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7f3264ffa640 10 monclient: shutdown 2026-02-24T19:18:11.736 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7f3264ffa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.736 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7f3264ffa640 1 -- 10.20.193.26:0/266960534 >> v1:10.20.193.103:6789/0 conn(0x7f32600b0ca0 legacy=0x7f32600b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.736 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7f3264ffa640 1 -- 10.20.193.26:0/266960534 shutdown_connections 2026-02-24T19:18:11.736 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7f3264ffa640 1 -- 10.20.193.26:0/266960534 >> 10.20.193.26:0/266960534 conn(0x7f32600b5290 msgr2=0x7f32600b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.736 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7fe886c5b640 10 monclient: shutdown 2026-02-24T19:18:11.736 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7fe886c5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.736 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7fe886c5b640 1 -- 10.20.193.26:0/139507449 >> v1:10.20.193.103:6789/0 conn(0x7fe8800585e0 legacy=0x7fe880166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.737 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7f3264ffa640 1 -- 10.20.193.26:0/266960534 shutdown_connections 2026-02-24T19:18:11.737 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7f3264ffa640 1 -- 10.20.193.26:0/266960534 wait complete. 2026-02-24T19:18:11.737 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7fe886c5b640 1 -- 10.20.193.26:0/139507449 shutdown_connections 2026-02-24T19:18:11.737 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7fe886c5b640 1 -- 10.20.193.26:0/139507449 >> 10.20.193.26:0/139507449 conn(0x7fe8800b7990 msgr2=0x7fe8800b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.737 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7fe886c5b640 1 -- 10.20.193.26:0/139507449 shutdown_connections 2026-02-24T19:18:11.737 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.731+0000 7fe886c5b640 1 -- 10.20.193.26:0/139507449 wait complete. 2026-02-24T19:18:11.737 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7f3264ffa640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.737 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7f3264ffa640 10 monclient: monmap: 2026-02-24T19:18:11.737 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.737 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:11.737 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:11.737 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:11.737 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.737 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:11.737 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.737 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.737 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.737 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.737 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7fe886c5b640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.737 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7fe886c5b640 10 monclient: monmap: 2026-02-24T19:18:11.737 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.737 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:11.738 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:11.738 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:11.738 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.738 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:11.738 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.738 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.738 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.738 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7f3264ffa640 1 librados: starting msgr at 2026-02-24T19:18:11.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7f3264ffa640 1 librados: starting objecter 2026-02-24T19:18:11.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7f8f83fff640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f8f84157780 0x7f8f841faa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58760/0 (socket says 10.20.193.26:58760) 2026-02-24T19:18:11.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7f8f83fff640 1 -- 10.20.193.26:0/2607654424 learned_addr learned my addr 10.20.193.26:0/2607654424 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7fe886c5b640 1 librados: starting msgr at 2026-02-24T19:18:11.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7fe886c5b640 1 librados: starting objecter 2026-02-24T19:18:11.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7f3264ffa640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:11.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7fe886c5b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:11.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7fe886c5b640 1 Processor -- start 2026-02-24T19:18:11.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7f3264ffa640 1 Processor -- start 2026-02-24T19:18:11.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7fe886c5b640 1 -- start start 2026-02-24T19:18:11.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7fe886c5b640 1 librados: setting wanted keys 2026-02-24T19:18:11.739 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7fe886c5b640 1 librados: calling monclient init 2026-02-24T19:18:11.739 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7fe886c5b640 10 monclient: init 2026-02-24T19:18:11.739 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7f3264ffa640 1 -- start start 2026-02-24T19:18:11.739 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7f3264ffa640 1 librados: setting wanted keys 2026-02-24T19:18:11.739 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7f3264ffa640 1 librados: calling monclient init 2026-02-24T19:18:11.739 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7f3264ffa640 10 monclient: init 2026-02-24T19:18:11.739 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7f2f28f9a640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f2f240ba350 0x7f2f24158440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58776/0 (socket says 10.20.193.26:58776) 2026-02-24T19:18:11.739 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7f2f28f9a640 1 -- 10.20.193.26:0/3639010046 learned_addr learned my addr 10.20.193.26:0/3639010046 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.739 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7fcb437fe640 1 -- 10.20.193.26:0/4090791701 <== mon.0 v1:10.20.193.26:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 1257367751) 0x7fcb5405d940 con 0x7fcb640ba350 2026-02-24T19:18:11.739 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7fcb437fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-24T19:18:11.739 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7fcb437fe640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:11.739 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:11.739 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7fc5ab4d0640 10 monclient: get_monmap_and_config 2026-02-24T19:18:11.739 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7fc5ab4d0640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.739 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7fc5ab4d0640 10 monclient: monmap: 2026-02-24T19:18:11.739 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.739 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.739 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:11.733637+0000 2026-02-24T19:18:11.739 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:11.733637+0000 2026-02-24T19:18:11.739 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.739 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.740 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.740 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.740 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.740 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.732+0000 7fe886c5b640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7f3264ffa640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7fe886c5b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:18:11.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7fe886c5b640 10 monclient(hunting): picked mon.noname-b con 0x7fe8800585e0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7fe886c5b640 10 monclient(hunting): picked mon.noname-a con 0x7fe8800b9f80 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7f3264ffa640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:18:11.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7fe886c5b640 10 monclient(hunting): picked mon.noname-c con 0x7fe8800ba350 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7fe886c5b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8800b3130 con 0x7fe8800b9f80 2026-02-24T19:18:11.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7f3264ffa640 10 monclient(hunting): picked mon.noname-a con 0x7f32600b0ca0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7f3264ffa640 10 monclient(hunting): picked mon.noname-b con 0x7f32600b28b0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7fe886c5b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8800b3410 con 0x7fe8800585e0 2026-02-24T19:18:11.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7fe886c5b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8800b36f0 con 0x7fe8800ba350 2026-02-24T19:18:11.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7fe886c5b640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.740 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7fe886c5b640 10 monclient(hunting): authenticate will time out at 3674.415057s 2026-02-24T19:18:11.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7f3264ffa640 10 monclient(hunting): picked mon.noname-c con 0x7f326015d0c0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7f3264ffa640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32600b6790 con 0x7f32600b0ca0 2026-02-24T19:18:11.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7f3264ffa640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32600b6a70 con 0x7f32600b28b0 2026-02-24T19:18:11.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7f3264ffa640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32600b6d50 con 0x7f326015d0c0 2026-02-24T19:18:11.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7f3264ffa640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7f3264ffa640 10 monclient(hunting): authenticate will time out at 3674.415100s 2026-02-24T19:18:11.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7f8f80ff9640 10 client.?.objecter ms_handle_connect 0x7f8f84157780 2026-02-24T19:18:11.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7f8f80ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7fc5ab4d0640 1 Processor -- start 2026-02-24T19:18:11.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7f2f20ff9640 10 client.?.objecter ms_handle_connect 0x7f2f240ba350 2026-02-24T19:18:11.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7f2f20ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7fc5ab4d0640 1 -- start start 2026-02-24T19:18:11.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7fc5ab4d0640 10 monclient: init 2026-02-24T19:18:11.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7fc5ab4d0640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7fc5ab4d0640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:18:11.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7fc5ab4d0640 10 monclient(hunting): picked mon.noname-a con 0x7fc5a40b9f80 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7fc5ab4d0640 10 monclient(hunting): picked mon.noname-b con 0x7fc5a40ba350 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.733+0000 7fc5ab4d0640 10 monclient(hunting): picked mon.noname-c con 0x7fc5a40585e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.741 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.734+0000 7fc5ab4d0640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5a4163930 con 0x7fc5a40b9f80 2026-02-24T19:18:11.742 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.734+0000 7fc5ab4d0640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5a4163bb0 con 0x7fc5a40ba350 2026-02-24T19:18:11.742 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.734+0000 7fc5ab4d0640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5a4163e90 con 0x7fc5a40585e0 2026-02-24T19:18:11.742 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.734+0000 7fc5ab4d0640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.742 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.734+0000 7fc5ab4d0640 10 monclient(hunting): authenticate will time out at 3674.416044s 2026-02-24T19:18:11.742 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.734+0000 7f8f80ff9640 1 -- 10.20.193.26:0/2607654424 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 378912657 0 0) 0x7f8f841fb580 con 0x7f8f84157780 2026-02-24T19:18:11.742 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.734+0000 7f8f80ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.742 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.734+0000 7f8f80ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.742 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.734+0000 7f8f80ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.742 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.734+0000 7f8f80ff9640 10 monclient(hunting): my global_id is 4622 2026-02-24T19:18:11.742 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.734+0000 7f8f80ff9640 1 -- 10.20.193.26:0/2607654424 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f54003610 con 0x7f8f84157780 2026-02-24T19:18:11.742 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.735+0000 7fcb695ed640 10 librados: watch_flush enter 2026-02-24T19:18:11.742 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.735+0000 7fcb695ed640 10 librados: watch_flush exit 2026-02-24T19:18:11.742 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.735+0000 7fcb695ed640 20 client.4590.objecter shutdown clearing up homeless session... 2026-02-24T19:18:11.742 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.735+0000 7fcb695ed640 10 client.4590.objecter successfully canceled tick 2026-02-24T19:18:11.742 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.735+0000 7fcb695ed640 1 -- 10.20.193.26:0/4090791701 >> v1:10.20.193.162:6800/3889602630 conn(0x7fcb30077c30 legacy=0x7fcb300980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.742 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.735+0000 7fcb695ed640 10 monclient: shutdown 2026-02-24T19:18:11.742 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.735+0000 7fcb695ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.742 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.735+0000 7fcb695ed640 1 -- 10.20.193.26:0/4090791701 >> v1:10.20.193.26:6789/0 conn(0x7fcb640ba350 legacy=0x7fcb64155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.742 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.735+0000 7fcb695ed640 1 -- 10.20.193.26:0/4090791701 shutdown_connections 2026-02-24T19:18:11.742 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.735+0000 7fcb695ed640 1 -- 10.20.193.26:0/4090791701 >> 10.20.193.26:0/4090791701 conn(0x7fcb640b7990 msgr2=0x7fcb64159790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.742 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.735+0000 7fcb695ed640 1 -- 10.20.193.26:0/4090791701 shutdown_connections 2026-02-24T19:18:11.742 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.735+0000 7fcb695ed640 1 -- 10.20.193.26:0/4090791701 wait complete. 2026-02-24T19:18:11.742 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.735+0000 7fcb695ed640 1 librados: shutdown 2026-02-24T19:18:11.743 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.735+0000 7f325ed76640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f326015d0c0 0x7f32601241e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58788/0 (socket says 10.20.193.26:58788) 2026-02-24T19:18:11.743 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.735+0000 7f325ed76640 1 -- 10.20.193.26:0/3185918553 learned_addr learned my addr 10.20.193.26:0/3185918553 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.743 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.735+0000 7f2f20ff9640 1 -- 10.20.193.26:0/3639010046 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4034406891 0 0) 0x7f2f241fd980 con 0x7f2f240ba350 2026-02-24T19:18:11.743 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.735+0000 7f2f20ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.743 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.735+0000 7f2f20ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.743 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.735+0000 7fe8851d1640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fe8800ba350 0x7fe8800b42f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58786/0 (socket says 10.20.193.26:58786) 2026-02-24T19:18:11.743 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.735+0000 7fe8851d1640 1 -- 10.20.193.26:0/273552875 learned_addr learned my addr 10.20.193.26:0/273552875 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.743 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.735+0000 7f2f20ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.743 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.735+0000 7f2f20ff9640 10 monclient(hunting): my global_id is 4625 2026-02-24T19:18:11.743 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.735+0000 7f2f20ff9640 1 -- 10.20.193.26:0/3639010046 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ef4003610 con 0x7f2f240ba350 2026-02-24T19:18:11.743 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.735+0000 7fc5a9a46640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fc5a40585e0 0x7fc5a4166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58802/0 (socket says 10.20.193.26:58802) 2026-02-24T19:18:11.743 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.735+0000 7fc5a9a46640 1 -- 10.20.193.26:0/3072259249 learned_addr learned my addr 10.20.193.26:0/3072259249 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.743 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.736+0000 7f8f80ff9640 10 client.?.objecter ms_handle_connect 0x7f8f84164d00 2026-02-24T19:18:11.743 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.736+0000 7f8f80ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.743 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.737+0000 7fe8757fa640 10 client.?.objecter ms_handle_connect 0x7fe8800ba350 2026-02-24T19:18:11.743 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.737+0000 7fe8757fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.743 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.737+0000 7f3246ffd640 10 client.?.objecter ms_handle_connect 0x7f326015d0c0 2026-02-24T19:18:11.743 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.737+0000 7f3246ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.744 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.737+0000 7f2f20ff9640 10 client.?.objecter ms_handle_connect 0x7f2f240b9f80 2026-02-24T19:18:11.744 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.737+0000 7f2f20ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.744 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.739+0000 7fe8757fa640 1 -- 10.20.193.26:0/273552875 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3253150165 0 0) 0x7fe8800b36f0 con 0x7fe8800ba350 2026-02-24T19:18:11.744 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.739+0000 7fe8757fa640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.744 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.739+0000 7fe8757fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.744 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.739+0000 7fe8757fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.744 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.739+0000 7fe8757fa640 10 monclient(hunting): my global_id is 4628 2026-02-24T19:18:11.744 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.739+0000 7fe8757fa640 1 -- 10.20.193.26:0/273552875 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe850003610 con 0x7fe8800ba350 2026-02-24T19:18:11.744 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.741+0000 7f8f80ff9640 1 -- 10.20.193.26:0/2607654424 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4188994535 0 0) 0x7f8f8415f660 con 0x7f8f84164d00 2026-02-24T19:18:11.744 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.741+0000 7f8f80ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.744 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.741+0000 7f8f80ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.744 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.741+0000 7f8f80ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.744 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.741+0000 7f8f80ff9640 10 monclient(hunting): my global_id is 4608 2026-02-24T19:18:11.744 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.741+0000 7f8f80ff9640 1 -- 10.20.193.26:0/2607654424 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f841fb580 con 0x7f8f84164d00 2026-02-24T19:18:11.744 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.741+0000 7f3246ffd640 10 client.?.objecter ms_handle_connect 0x7f32600b0ca0 2026-02-24T19:18:11.744 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.741+0000 7f3246ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.744 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.741+0000 7f8f80ff9640 1 -- 10.20.193.26:0/2607654424 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3190481548 0 0) 0x7f8f54003610 con 0x7f8f84157780 2026-02-24T19:18:11.744 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.741+0000 7f8f80ff9640 1 -- 10.20.193.26:0/2607654424 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8f8415f660 con 0x7f8f84157780 2026-02-24T19:18:11.744 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.741+0000 7f8f80ff9640 1 -- 10.20.193.26:0/2607654424 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f8f70003350 con 0x7f8f84157780 2026-02-24T19:18:11.744 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.741+0000 7f8f80ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:11.745 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.741+0000 7f8f80ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:11.745 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.741+0000 7f8f80ff9640 10 monclient(hunting): dump: 2026-02-24T19:18:11.745 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.745 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.745 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.745 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.745 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.745 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.745 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.745 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.745 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.745 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.745 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.741+0000 7f8f80ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:11.745 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.741+0000 7fe8757fa640 10 client.?.objecter ms_handle_connect 0x7fe8800b9f80 2026-02-24T19:18:11.745 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.741+0000 7fe8757fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.0 2026-02-24T19:18:11.745 DEBUG:teuthology.parallel:result is None 2026-02-24T19:18:11.746 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.745+0000 7fc593fff640 1 -- 10.20.193.26:0/3072259249 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2310772029 0 0) 0x7fc5a4163e90 con 0x7fc5a40585e0 2026-02-24T19:18:11.746 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.745+0000 7fc593fff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.746 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.745+0000 7fc593fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.746 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.745+0000 7fc593fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.746 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.745+0000 7fc593fff640 10 monclient(hunting): my global_id is 4634 2026-02-24T19:18:11.746 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.745+0000 7fc593fff640 1 -- 10.20.193.26:0/3072259249 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc58c003610 con 0x7fc5a40585e0 2026-02-24T19:18:11.746 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.745+0000 7f3246ffd640 1 -- 10.20.193.26:0/3185918553 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1322449035 0 0) 0x7f32600b6d50 con 0x7f326015d0c0 2026-02-24T19:18:11.746 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.745+0000 7f3246ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.746 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.745+0000 7f3246ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.746 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.745+0000 7f3246ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.746 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.745+0000 7f3246ffd640 10 monclient(hunting): my global_id is 4631 2026-02-24T19:18:11.746 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.745+0000 7f3246ffd640 1 -- 10.20.193.26:0/3185918553 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f322c003610 con 0x7f326015d0c0 2026-02-24T19:18:11.746 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.745+0000 7fe8757fa640 1 -- 10.20.193.26:0/273552875 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2117905668 0 0) 0x7fe850003610 con 0x7fe8800ba350 2026-02-24T19:18:11.746 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.745+0000 7fe8757fa640 1 -- 10.20.193.26:0/273552875 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe8800b36f0 con 0x7fe8800ba350 2026-02-24T19:18:11.746 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.745+0000 7fe8757fa640 1 -- 10.20.193.26:0/273552875 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fe87c0036d0 con 0x7fe8800ba350 2026-02-24T19:18:11.746 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.745+0000 7fe8757fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:11.746 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.745+0000 7fe8757fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:11.746 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.745+0000 7fe8757fa640 10 monclient(hunting): dump: 2026-02-24T19:18:11.746 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.746 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.746 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.746 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.746 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.746 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.746 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.747 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.747 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.747 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.747 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.745+0000 7fe8757fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:11.747 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.746+0000 7f8f80ff9640 1 -- 10.20.193.26:0/2607654424 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1088007210 0 0) 0x7f8f841fb580 con 0x7f8f84164d00 2026-02-24T19:18:11.747 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.746+0000 7f8f80ff9640 1 -- 10.20.193.26:0/2607654424 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8f54003610 con 0x7f8f84164d00 2026-02-24T19:18:11.747 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.746+0000 7f8f80ff9640 1 -- 10.20.193.26:0/2607654424 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f8f780031d0 con 0x7f8f84164d00 2026-02-24T19:18:11.747 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.746+0000 7f8f80ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:11.747 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.746+0000 7f8f80ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:11.747 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.746+0000 7f8f80ff9640 10 monclient(hunting): dump: 2026-02-24T19:18:11.747 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.747 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.747 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.747 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.747 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.747 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.747 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.747 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.747 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.747 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.748 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.747+0000 7fe8757fa640 1 -- 10.20.193.26:0/273552875 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1289705557 0 0) 0x7fe8800b3130 con 0x7fe8800b9f80 2026-02-24T19:18:11.748 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.747+0000 7fe8757fa640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.748 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.747+0000 7fe8757fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.748 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.747+0000 7fe8757fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.748 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.747+0000 7fe8757fa640 10 monclient(hunting): my global_id is 4614 2026-02-24T19:18:11.748 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.747+0000 7fe8757fa640 1 -- 10.20.193.26:0/273552875 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe850003610 con 0x7fe8800b9f80 2026-02-24T19:18:11.750 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.749+0000 7f2f20ff9640 1 -- 10.20.193.26:0/3639010046 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 146371390 0 0) 0x7f2ef4003610 con 0x7f2f240ba350 2026-02-24T19:18:11.750 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.749+0000 7f2f20ff9640 1 -- 10.20.193.26:0/3639010046 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2f241fd980 con 0x7f2f240ba350 2026-02-24T19:18:11.750 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.749+0000 7f2f20ff9640 1 -- 10.20.193.26:0/3639010046 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2f18003040 con 0x7f2f240ba350 2026-02-24T19:18:11.750 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.749+0000 7f2f20ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:11.750 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.749+0000 7f2f20ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:11.750 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.749+0000 7f2f20ff9640 10 monclient(hunting): dump: 2026-02-24T19:18:11.750 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.750 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.750 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.750 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.750 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.750 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.750 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.750 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.750 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.750 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.750 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.749+0000 7f2f20ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:11.750 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.749+0000 7f8f80ff9640 1 -- 10.20.193.26:0/2607654424 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 108830707 0 0) 0x7f8f54003610 con 0x7f8f84164d00 2026-02-24T19:18:11.750 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.749+0000 7f8f80ff9640 1 -- 10.20.193.26:0/2607654424 >> v1:10.20.193.103:6789/0 conn(0x7f8f84157780 legacy=0x7f8f841faa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.750 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.749+0000 7f8f80ff9640 1 -- 10.20.193.26:0/2607654424 >> v1:10.20.193.70:6789/0 conn(0x7f8f84157b50 legacy=0x7f8f8415ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.750 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.749+0000 7f8f80ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.750 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.749+0000 7f8f80ff9640 1 monclient: found mon.a 2026-02-24T19:18:11.750 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.749+0000 7f8f80ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.750 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.749+0000 7f8f80ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.751 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.749+0000 7f8f80ff9640 1 -- 10.20.193.26:0/2607654424 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f841fb860 con 0x7f8f84164d00 2026-02-24T19:18:11.751 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.749+0000 7f8f80ff9640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.751 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.749+0000 7f8f80ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.751 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.749+0000 7f8f80ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.751 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.749+0000 7f8f8a32e640 5 monclient: authenticate success, global_id 4608 2026-02-24T19:18:11.751 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.749+0000 7f8f8a32e640 10 monclient: _renew_subs 2026-02-24T19:18:11.751 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.749+0000 7f8f8a32e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.751 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.749+0000 7f8f8a32e640 1 -- 10.20.193.26:0/2607654424 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8f840aace0 con 0x7f8f84164d00 2026-02-24T19:18:11.751 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.749+0000 7f8f8a32e640 10 client.4608.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:11.751 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.749+0000 7f8f8a32e640 10 monclient: _renew_subs 2026-02-24T19:18:11.751 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.749+0000 7f8f8a32e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.751 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.749+0000 7f8f8a32e640 1 -- 10.20.193.26:0/2607654424 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8f841fed60 con 0x7f8f84164d00 2026-02-24T19:18:11.751 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.749+0000 7f8f8a32e640 1 librados: init done 2026-02-24T19:18:11.751 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.750+0000 7f8f8a32e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.751 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.750+0000 7f8f8a32e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.751 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.750+0000 7f8f8a32e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.751 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.750+0000 7f8f8a32e640 1 -- 10.20.193.26:0/2607654424 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f84164770 con 0x7f8f84164d00 2026-02-24T19:18:11.752 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.751+0000 7fe8757fa640 1 -- 10.20.193.26:0/273552875 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2432323698 0 0) 0x7fe8800b36f0 con 0x7fe8800ba350 2026-02-24T19:18:11.752 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.751+0000 7fe8757fa640 1 -- 10.20.193.26:0/273552875 >> v1:10.20.193.70:6789/0 conn(0x7fe8800585e0 legacy=0x7fe8801579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.752 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.751+0000 7fe8757fa640 1 -- 10.20.193.26:0/273552875 >> v1:10.20.193.26:6789/0 conn(0x7fe8800b9f80 legacy=0x7fe8801fcb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.752 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.751+0000 7fe8757fa640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.752 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.751+0000 7fe8757fa640 1 monclient: found mon.c 2026-02-24T19:18:11.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.751+0000 7fe8757fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.751+0000 7fe8757fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.751+0000 7fe8757fa640 1 -- 10.20.193.26:0/273552875 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8801fc050 con 0x7fe8800ba350 2026-02-24T19:18:11.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.751+0000 7fe8757fa640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.751+0000 7fe8757fa640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.751+0000 7fe8757fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.751+0000 7fe886c5b640 5 monclient: authenticate success, global_id 4628 2026-02-24T19:18:11.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.751+0000 7fe886c5b640 10 monclient: _renew_subs 2026-02-24T19:18:11.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.751+0000 7fe886c5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.751+0000 7fe886c5b640 1 -- 10.20.193.26:0/273552875 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe8801fc330 con 0x7fe8800ba350 2026-02-24T19:18:11.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.751+0000 7fe886c5b640 10 client.4628.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:11.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.751+0000 7fe886c5b640 10 monclient: _renew_subs 2026-02-24T19:18:11.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.751+0000 7fe886c5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.751+0000 7fe886c5b640 1 -- 10.20.193.26:0/273552875 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe8800b2e00 con 0x7fe8800ba350 2026-02-24T19:18:11.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.751+0000 7fe886c5b640 1 librados: init done 2026-02-24T19:18:11.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.752+0000 7fe886c5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.752+0000 7fe886c5b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.752+0000 7fe886c5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.752+0000 7fe886c5b640 1 -- 10.20.193.26:0/273552875 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8801678f0 con 0x7fe8800ba350 2026-02-24T19:18:11.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.752+0000 7f2f20ff9640 1 -- 10.20.193.26:0/3639010046 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3917054452 0 0) 0x7f2f24166030 con 0x7f2f240b9f80 2026-02-24T19:18:11.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.752+0000 7f2f20ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.752+0000 7f2f20ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.752+0000 7f2f20ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.752+0000 7f2f20ff9640 10 monclient(hunting): my global_id is 4611 2026-02-24T19:18:11.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.752+0000 7f2f20ff9640 1 -- 10.20.193.26:0/3639010046 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ef4003610 con 0x7f2f240b9f80 2026-02-24T19:18:11.754 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.753+0000 7fc593fff640 1 -- 10.20.193.26:0/3072259249 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1753404046 0 0) 0x7fc58c003610 con 0x7fc5a40585e0 2026-02-24T19:18:11.754 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.753+0000 7fc593fff640 1 -- 10.20.193.26:0/3072259249 >> v1:10.20.193.70:6789/0 conn(0x7fc5a40ba350 legacy=0x7fc5a4057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:11.754 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.753+0000 7fc593fff640 1 -- 10.20.193.26:0/3072259249 >> v1:10.20.193.26:6789/0 conn(0x7fc5a40b9f80 legacy=0x7fc5a4163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.754 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.753+0000 7fc593fff640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.754 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.753+0000 7fc593fff640 1 monclient: found mon.noname-c 2026-02-24T19:18:11.754 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.753+0000 7fc593fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.754 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.753+0000 7fc593fff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.754 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.753+0000 7fc593fff640 1 -- 10.20.193.26:0/3072259249 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a40573f0 con 0x7fc5a40585e0 2026-02-24T19:18:11.754 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.753+0000 7fc593fff640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.754 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.753+0000 7fc593fff640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.754 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.753+0000 7fc593fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.754 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.753+0000 7fc593fff640 1 -- 10.20.193.26:0/3072259249 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc5a0003170 con 0x7fc5a40585e0 2026-02-24T19:18:11.754 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.753+0000 7fc593fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.754 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.753+0000 7fc593fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:11.754 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.753+0000 7fc593fff640 10 monclient: dump: 2026-02-24T19:18:11.754 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.754 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.754 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.754 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.754 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.754 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.754 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.754 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.754 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.754 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.754 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.753+0000 7fc5ab4d0640 5 monclient: authenticate success, global_id 4634 2026-02-24T19:18:11.754 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.753+0000 7fc5ab4d0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:11.755 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.753+0000 7f3246ffd640 1 -- 10.20.193.26:0/3185918553 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4213084486 0 0) 0x7f32600b6790 con 0x7f32600b0ca0 2026-02-24T19:18:11.755 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.753+0000 7f3246ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.755 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.753+0000 7f3246ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.755 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.753+0000 7f3246ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.755 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.753+0000 7f3246ffd640 10 monclient(hunting): my global_id is 4617 2026-02-24T19:18:11.755 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.753+0000 7f3246ffd640 1 -- 10.20.193.26:0/3185918553 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32600b6d50 con 0x7f32600b0ca0 2026-02-24T19:18:11.755 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.754+0000 7f3246ffd640 1 -- 10.20.193.26:0/3185918553 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3652199190 0 0) 0x7f322c003610 con 0x7f326015d0c0 2026-02-24T19:18:11.755 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.754+0000 7f3246ffd640 1 -- 10.20.193.26:0/3185918553 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f32600b6790 con 0x7f326015d0c0 2026-02-24T19:18:11.755 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.754+0000 7f3246ffd640 1 -- 10.20.193.26:0/3185918553 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f32500032d0 con 0x7f326015d0c0 2026-02-24T19:18:11.755 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.754+0000 7f3246ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:11.755 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.754+0000 7f3246ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:11.755 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.754+0000 7f3246ffd640 10 monclient(hunting): dump: 2026-02-24T19:18:11.756 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.756 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.756 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.756 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.756 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.756 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.756 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.756 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.756 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.756 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.756 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.754+0000 7f3246ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:11.763 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.762+0000 7f75acff9640 1 -- 10.20.193.26:0/3647229437 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f75a005de30 con 0x7f75b00b28b0 2026-02-24T19:18:11.763 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.762+0000 7f75acff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.763 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.762+0000 7f75acff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:11.764 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.764+0000 7f2f20ff9640 10 client.?.objecter ms_handle_connect 0x7f2f240585e0 2026-02-24T19:18:11.764 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.764+0000 7f2f20ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.765 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.764+0000 7fd476bfa640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-24T19:18:11.765 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.764+0000 7fd476bfa640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-24T19:18:11.765 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.764+0000 7fd476bfa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:11.765 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.764+0000 7fd476bfa640 1 -- 10.20.193.26:0/574837392 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd47005e210 con 0x7fd4700b0ca0 2026-02-24T19:18:11.766 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.766+0000 7f3246ffd640 10 client.?.objecter ms_handle_connect 0x7f32600b28b0 2026-02-24T19:18:11.766 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.766+0000 7f3246ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.767 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.767+0000 7f2f20ff9640 1 -- 10.20.193.26:0/3639010046 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1677795321 0 0) 0x7f2f241fd6a0 con 0x7f2f240585e0 2026-02-24T19:18:11.767 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.767+0000 7f2f20ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.767 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.767+0000 7f2f20ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.768 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.767+0000 7f2f20ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.768 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.767+0000 7f2f20ff9640 10 monclient(hunting): my global_id is 4579 2026-02-24T19:18:11.768 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.767+0000 7f2f20ff9640 1 -- 10.20.193.26:0/3639010046 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f24166030 con 0x7f2f240585e0 2026-02-24T19:18:11.771 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.770+0000 7f3246ffd640 1 -- 10.20.193.26:0/3185918553 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1168528167 0 0) 0x7f32600b6a70 con 0x7f32600b28b0 2026-02-24T19:18:11.771 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.770+0000 7f3246ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.771 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.770+0000 7f3246ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.771 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.770+0000 7f3246ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.771 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.770+0000 7f3246ffd640 10 monclient(hunting): my global_id is 4582 2026-02-24T19:18:11.771 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.770+0000 7f3246ffd640 1 -- 10.20.193.26:0/3185918553 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f322c003610 con 0x7f32600b28b0 2026-02-24T19:18:11.772 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.771+0000 7f2f20ff9640 1 -- 10.20.193.26:0/3639010046 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2164981961 0 0) 0x7f2f24166030 con 0x7f2f240585e0 2026-02-24T19:18:11.772 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.771+0000 7f2f20ff9640 1 -- 10.20.193.26:0/3639010046 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2f241fd6a0 con 0x7f2f240585e0 2026-02-24T19:18:11.772 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.771+0000 7f2f20ff9640 1 -- 10.20.193.26:0/3639010046 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2f10002f00 con 0x7f2f240585e0 2026-02-24T19:18:11.772 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.771+0000 7f2f20ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:11.772 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.771+0000 7f2f20ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:11.772 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.771+0000 7f2f20ff9640 10 monclient(hunting): dump: 2026-02-24T19:18:11.772 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.772 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.772 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.772 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.772 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.772 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.772 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.772 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.772 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.772 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.773 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.772+0000 7fd4657fa640 1 -- 10.20.193.26:0/574837392 <== mon.1 v1:10.20.193.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (unknown 1274345170 0 1257367751) 0x7fd46005d3b0 con 0x7fd4700b0ca0 2026-02-24T19:18:11.773 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.772+0000 7fd4657fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-24T19:18:11.773 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.772+0000 7fd4657fa640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:11.773 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:11.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.775+0000 7fd476bfa640 10 librados: watch_flush enter 2026-02-24T19:18:11.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.775+0000 7fd476bfa640 10 librados: watch_flush exit 2026-02-24T19:18:11.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.775+0000 7fd476bfa640 20 client.4570.objecter shutdown clearing up homeless session... 2026-02-24T19:18:11.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.775+0000 7fd476bfa640 10 client.4570.objecter successfully canceled tick 2026-02-24T19:18:11.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.775+0000 7fd476bfa640 1 -- 10.20.193.26:0/574837392 >> v1:10.20.193.162:6800/3889602630 conn(0x7fd440077ed0 legacy=0x7fd440098380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.775+0000 7fd476bfa640 10 monclient: shutdown 2026-02-24T19:18:11.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.775+0000 7fd476bfa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.775+0000 7fd476bfa640 1 -- 10.20.193.26:0/574837392 >> v1:10.20.193.70:6789/0 conn(0x7fd4700b0ca0 legacy=0x7fd4701629c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.775+0000 7fd476bfa640 1 -- 10.20.193.26:0/574837392 shutdown_connections 2026-02-24T19:18:11.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.775+0000 7fd476bfa640 1 -- 10.20.193.26:0/574837392 >> 10.20.193.26:0/574837392 conn(0x7fd4700b5290 msgr2=0x7fd470136b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.775+0000 7fd476bfa640 1 -- 10.20.193.26:0/574837392 shutdown_connections 2026-02-24T19:18:11.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.775+0000 7fd476bfa640 1 -- 10.20.193.26:0/574837392 wait complete. 2026-02-24T19:18:11.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.775+0000 7fd476bfa640 1 librados: shutdown 2026-02-24T19:18:11.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.776+0000 7f3246ffd640 1 -- 10.20.193.26:0/3185918553 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3347655153 0 0) 0x7f322c003610 con 0x7f32600b28b0 2026-02-24T19:18:11.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.776+0000 7f3246ffd640 1 -- 10.20.193.26:0/3185918553 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f32600b6a70 con 0x7f32600b28b0 2026-02-24T19:18:11.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.776+0000 7f3246ffd640 1 -- 10.20.193.26:0/3185918553 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f3248003350 con 0x7f32600b28b0 2026-02-24T19:18:11.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.776+0000 7f3246ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:11.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.776+0000 7f3246ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:11.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.776+0000 7f3246ffd640 10 monclient(hunting): dump: 2026-02-24T19:18:11.777 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.777 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.777 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.777 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.777 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.777 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.777 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.777 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.777 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.777 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.776+0000 7f2f20ff9640 1 -- 10.20.193.26:0/3639010046 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3535151492 0 0) 0x7f2f241fd6a0 con 0x7f2f240585e0 2026-02-24T19:18:11.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.776+0000 7f2f20ff9640 1 -- 10.20.193.26:0/3639010046 >> v1:10.20.193.103:6789/0 conn(0x7f2f240ba350 legacy=0x7f2f24158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.776+0000 7f2f20ff9640 1 -- 10.20.193.26:0/3639010046 >> v1:10.20.193.26:6789/0 conn(0x7f2f240b9f80 legacy=0x7f2f240b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.776+0000 7f2f20ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.776+0000 7f2f20ff9640 1 monclient: found mon.b 2026-02-24T19:18:11.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.776+0000 7f2f20ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.776+0000 7f2f20ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:11.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.776+0000 7f2f20ff9640 1 -- 10.20.193.26:0/3639010046 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f241fdc60 con 0x7f2f240585e0 2026-02-24T19:18:11.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.776+0000 7f2f20ff9640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.776+0000 7f2f20ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.776+0000 7f2f20ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.776+0000 7f2f2aa24640 5 monclient: authenticate success, global_id 4579 2026-02-24T19:18:11.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.776+0000 7f2f2aa24640 10 monclient: _renew_subs 2026-02-24T19:18:11.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.776+0000 7f2f2aa24640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:11.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.776+0000 7f2f2aa24640 1 -- 10.20.193.26:0/3639010046 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2f240b3420 con 0x7f2f240585e0 2026-02-24T19:18:11.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.776+0000 7f2f2aa24640 10 client.4579.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:11.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.776+0000 7f2f2aa24640 10 monclient: _renew_subs 2026-02-24T19:18:11.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.776+0000 7f2f2aa24640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:11.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.776+0000 7f2f2aa24640 1 -- 10.20.193.26:0/3639010046 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2f240b4510 con 0x7f2f240585e0 2026-02-24T19:18:11.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.776+0000 7f2f2aa24640 1 librados: init done 2026-02-24T19:18:11.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.777+0000 7f2f2aa24640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.777+0000 7f2f2aa24640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.777+0000 7f2f2aa24640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:11.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.777+0000 7f2f2aa24640 1 -- 10.20.193.26:0/3639010046 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f2415ae20 con 0x7f2f240585e0 2026-02-24T19:18:11.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.781+0000 7f2f20ff9640 1 -- 10.20.193.26:0/3639010046 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2f100030a0 con 0x7f2f240585e0 2026-02-24T19:18:11.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.781+0000 7f2f20ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.781+0000 7f2f227fc640 4 set_mon_vals no callback set 2026-02-24T19:18:11.785 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.6 2026-02-24T19:18:11.785 DEBUG:teuthology.parallel:result is None 2026-02-24T19:18:11.787 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.786+0000 7f2f20ff9640 1 -- 10.20.193.26:0/3639010046 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2f10003470 con 0x7f2f240585e0 2026-02-24T19:18:11.787 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.786+0000 7f2f20ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.787 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.786+0000 7f2f20ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:11.787 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.786+0000 7f2f20ff9640 10 monclient: dump: 2026-02-24T19:18:11.787 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.787 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.787 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.787 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.787 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.787 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.787 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.787 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.787 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.787 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.788 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.787+0000 7f2f20ff9640 1 -- 10.20.193.26:0/3639010046 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f2f10003690 con 0x7f2f240585e0 2026-02-24T19:18:11.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.788+0000 7f2f237fe640 10 monclient: get_auth_request con 0x7f2ef4077d70 auth_method 0 2026-02-24T19:18:11.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.788+0000 7f3246ffd640 1 -- 10.20.193.26:0/3185918553 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2425606440 0 0) 0x7f32600b6a70 con 0x7f32600b28b0 2026-02-24T19:18:11.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.788+0000 7f3246ffd640 1 -- 10.20.193.26:0/3185918553 >> v1:10.20.193.103:6789/0 conn(0x7f326015d0c0 legacy=0x7f32601241e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.788+0000 7f3246ffd640 1 -- 10.20.193.26:0/3185918553 >> v1:10.20.193.26:6789/0 conn(0x7f32600b0ca0 legacy=0x7f3260134000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.788+0000 7f3246ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.788+0000 7f3246ffd640 1 monclient: found mon.b 2026-02-24T19:18:11.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.788+0000 7f3246ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.788+0000 7f3246ffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:11.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.788+0000 7f3246ffd640 1 -- 10.20.193.26:0/3185918553 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32600b7030 con 0x7f32600b28b0 2026-02-24T19:18:11.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.788+0000 7f3246ffd640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.788+0000 7f3246ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.788+0000 7f3246ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.788+0000 7f3264ffa640 5 monclient: authenticate success, global_id 4582 2026-02-24T19:18:11.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.788+0000 7f3264ffa640 10 monclient: _renew_subs 2026-02-24T19:18:11.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.788+0000 7f3264ffa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:11.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.788+0000 7f3264ffa640 1 -- 10.20.193.26:0/3185918553 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f32600b7310 con 0x7f32600b28b0 2026-02-24T19:18:11.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.788+0000 7f2f20ff9640 1 -- 10.20.193.26:0/3639010046 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f2f100582f0 con 0x7f2f240585e0 2026-02-24T19:18:11.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.788+0000 7f2f20ff9640 10 client.4579.objecter ms_dispatch2 0x7f2f24000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:11.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.788+0000 7f2f20ff9640 3 client.4579.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:11.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.788+0000 7f2f20ff9640 3 client.4579.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:11.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.788+0000 7f3264ffa640 10 client.4582.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:11.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.788+0000 7f3264ffa640 10 monclient: _renew_subs 2026-02-24T19:18:11.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.788+0000 7f3264ffa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:11.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.788+0000 7f3264ffa640 1 -- 10.20.193.26:0/3185918553 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3260134710 con 0x7f32600b28b0 2026-02-24T19:18:11.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.788+0000 7f3264ffa640 1 librados: init done 2026-02-24T19:18:11.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.788+0000 7f2f20ff9640 20 client.4579.objecter dump_active .. 0 homeless 2026-02-24T19:18:11.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.788+0000 7f2f20ff9640 10 client.4579.objecter ms_handle_connect 0x7f2ef4077d70 2026-02-24T19:18:11.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.789+0000 7f3264ffa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.789+0000 7f3264ffa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.789+0000 7f3264ffa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:11.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.789+0000 7f3264ffa640 1 -- 10.20.193.26:0/3185918553 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f326005e210 con 0x7f32600b28b0 2026-02-24T19:18:11.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.823+0000 7f7c4753a640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-24T19:18:11.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.823+0000 7f7c4753a640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-24T19:18:11.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.823+0000 7f7c4753a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.823+0000 7f7c4753a640 1 -- 10.20.193.26:0/3952457042 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f7c400b5880 con 0x7f7c40159810 2026-02-24T19:18:11.842 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.841+0000 7f6d993c8640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-24T19:18:11.842 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.841+0000 7f6d993c8640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-24T19:18:11.842 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.841+0000 7f6d993c8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.842 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.841+0000 7f6d993c8640 1 -- 10.20.193.26:0/3304562167 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6d940b3600 con 0x7f6d94157780 2026-02-24T19:18:11.848 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.847+0000 7fe8757fa640 1 -- 10.20.193.26:0/273552875 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe87c003300 con 0x7fe8800ba350 2026-02-24T19:18:11.848 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.847+0000 7fe8757fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.848 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.847+0000 7fe8757fa640 1 -- 10.20.193.26:0/273552875 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fe87c005200 con 0x7fe8800ba350 2026-02-24T19:18:11.848 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.847+0000 7fe8757fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.848 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.847+0000 7fe8757fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:11.848 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.847+0000 7fe8757fa640 10 monclient: dump: 2026-02-24T19:18:11.848 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.848 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.848 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.848 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.848 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.848 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.848 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.848 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.848 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.848 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.848 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.847+0000 7fe876ffd640 4 set_mon_vals no callback set 2026-02-24T19:18:11.848 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.848+0000 7f8f80ff9640 1 -- 10.20.193.26:0/2607654424 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8f78003780 con 0x7f8f84164d00 2026-02-24T19:18:11.848 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.848+0000 7f8f80ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.849 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.848+0000 7f8f80ff9640 1 -- 10.20.193.26:0/2607654424 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f8f78003ad0 con 0x7f8f84164d00 2026-02-24T19:18:11.849 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.848+0000 7f8f80ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.849 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.848+0000 7f8f80ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:11.849 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.848+0000 7f8f827fc640 4 set_mon_vals no callback set 2026-02-24T19:18:11.849 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.848+0000 7f8f80ff9640 10 monclient: dump: 2026-02-24T19:18:11.849 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.849 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.849 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.849 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.849 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.849 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.849 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.849 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.849 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.849 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.849 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.848+0000 7fe8757fa640 1 -- 10.20.193.26:0/273552875 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fe87c01e070 con 0x7fe8800ba350 2026-02-24T19:18:11.849 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.848+0000 7f8f80ff9640 1 -- 10.20.193.26:0/2607654424 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f8f7801c940 con 0x7f8f84164d00 2026-02-24T19:18:11.849 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.848+0000 7fe8849d0640 10 monclient: get_auth_request con 0x7fe850077d20 auth_method 0 2026-02-24T19:18:11.850 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.849+0000 7fe8757fa640 10 client.4628.objecter ms_handle_connect 0x7fe850077d20 2026-02-24T19:18:11.850 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.849+0000 7f8f83fff640 10 monclient: get_auth_request con 0x7f8f54077c10 auth_method 0 2026-02-24T19:18:11.850 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.849+0000 7f8f80ff9640 10 client.4608.objecter ms_handle_connect 0x7f8f54077c10 2026-02-24T19:18:11.850 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.850+0000 7fe8757fa640 1 -- 10.20.193.26:0/273552875 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7fe87c0936c0 con 0x7fe8800ba350 2026-02-24T19:18:11.850 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.850+0000 7fe8757fa640 10 client.4628.objecter ms_dispatch2 0x7fe880000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:11.851 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.850+0000 7fe8757fa640 3 client.4628.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:11.851 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.850+0000 7fe8757fa640 3 client.4628.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:11.851 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.850+0000 7fe8757fa640 20 client.4628.objecter dump_active .. 0 homeless 2026-02-24T19:18:11.853 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.852+0000 7fc593fff640 1 -- 10.20.193.26:0/3072259249 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc5a0003380 con 0x7fc5a40585e0 2026-02-24T19:18:11.853 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.852+0000 7fc593fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.853 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.852+0000 7fc593fff640 1 -- 10.20.193.26:0/3072259249 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc5a00037c0 con 0x7fc5a40585e0 2026-02-24T19:18:11.853 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.852+0000 7fc593fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.853 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.852+0000 7fc593fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:11.853 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.852+0000 7fc593fff640 10 monclient: dump: 2026-02-24T19:18:11.853 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.853 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.853 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.853 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.853 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.853 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.853 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.853 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.853 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.853 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.853 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.852+0000 7fc5ab4d0640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:11.853 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.852+0000 7fc5ab4d0640 4 set_mon_vals no callback set 2026-02-24T19:18:11.854 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.852+0000 7f8f80ff9640 1 -- 10.20.193.26:0/2607654424 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f8f780922f0 con 0x7f8f84164d00 2026-02-24T19:18:11.854 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.852+0000 7f8f80ff9640 10 client.4608.objecter ms_dispatch2 0x7f8f84000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:11.854 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.852+0000 7f8f80ff9640 3 client.4608.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:11.854 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.852+0000 7f8f80ff9640 3 client.4608.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:11.854 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.852+0000 7fc5ab4d0640 10 monclient: shutdown 2026-02-24T19:18:11.854 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.852+0000 7fc5ab4d0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.854 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.852+0000 7fc5ab4d0640 1 -- 10.20.193.26:0/3072259249 >> v1:10.20.193.103:6789/0 conn(0x7fc5a40585e0 legacy=0x7fc5a4166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.854 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.852+0000 7f8f80ff9640 20 client.4608.objecter dump_active .. 0 homeless 2026-02-24T19:18:11.854 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.852+0000 7fc5ab4d0640 1 -- 10.20.193.26:0/3072259249 shutdown_connections 2026-02-24T19:18:11.854 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.852+0000 7fc5ab4d0640 1 -- 10.20.193.26:0/3072259249 >> 10.20.193.26:0/3072259249 conn(0x7fc5a40b7990 msgr2=0x7fc5a40b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.854 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.852+0000 7f8f80ff9640 1 -- 10.20.193.26:0/2607654424 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f8f7805cd20 con 0x7f8f84164d00 2026-02-24T19:18:11.854 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.852+0000 7f8f80ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.854 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.852+0000 7f8f80ff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:11.855 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.852+0000 7fc5ab4d0640 1 -- 10.20.193.26:0/3072259249 shutdown_connections 2026-02-24T19:18:11.855 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.852+0000 7fc5ab4d0640 1 -- 10.20.193.26:0/3072259249 wait complete. 2026-02-24T19:18:11.855 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.853+0000 7fe8757fa640 1 -- 10.20.193.26:0/273552875 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fe8801678f0 con 0x7fe8800ba350 2026-02-24T19:18:11.855 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.853+0000 7fe8757fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.855 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.853+0000 7fe8757fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.853+0000 7fc5ab4d0640 10 monclient: build_initial_monmap 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.853+0000 7fc5ab4d0640 10 monclient: monmap: 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.853+0000 7fc5ab4d0640 1 librados: starting msgr at 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.853+0000 7fc5ab4d0640 1 librados: starting objecter 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.853+0000 7fc5ab4d0640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.853+0000 7fc5ab4d0640 1 Processor -- start 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.853+0000 7fc5ab4d0640 1 -- start start 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.853+0000 7fc5ab4d0640 1 librados: setting wanted keys 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.853+0000 7fc5ab4d0640 1 librados: calling monclient init 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.853+0000 7fc5ab4d0640 10 monclient: init 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.854+0000 7fc5ab4d0640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.854+0000 7fc5ab4d0640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.854+0000 7fc5ab4d0640 10 monclient(hunting): picked mon.noname-c con 0x7fc5a40585e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.854+0000 7fc5ab4d0640 10 monclient(hunting): picked mon.noname-b con 0x7fc5a40b9f80 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.854+0000 7fc5ab4d0640 10 monclient(hunting): picked mon.noname-a con 0x7fc5a40ba350 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.854+0000 7fc5ab4d0640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5a42030d0 con 0x7fc5a40ba350 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.854+0000 7fc5ab4d0640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5a40b44c0 con 0x7fc5a40b9f80 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.854+0000 7fc5ab4d0640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5a40b47a0 con 0x7fc5a40585e0 2026-02-24T19:18:11.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.854+0000 7fc5ab4d0640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:11.857 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.854+0000 7fc5ab4d0640 10 monclient(hunting): authenticate will time out at 3674.536237s 2026-02-24T19:18:11.857 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.856+0000 7f7c26ffd640 1 -- 10.20.193.26:0/3952457042 <== mon.2 v1:10.20.193.103:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 1257367751) 0x7f7c3c05d8c0 con 0x7f7c40159810 2026-02-24T19:18:11.857 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.856+0000 7f7c26ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-24T19:18:11.857 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.856+0000 7f7c26ffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:11.857 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:11.857 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.857+0000 7f6d737fe640 1 -- 10.20.193.26:0/3304562167 <== mon.0 v1:10.20.193.26:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 1257367751) 0x7f6d8805d720 con 0x7f6d94157780 2026-02-24T19:18:11.858 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.857+0000 7f6d737fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-24T19:18:11.858 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.857+0000 7f6d737fe640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:11.858 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:11.858 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.857+0000 7fc5a9245640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fc5a40585e0 0x7fc5a42029c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58810/0 (socket says 10.20.193.26:58810) 2026-02-24T19:18:11.858 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.857+0000 7fc5a9245640 1 -- 10.20.193.26:0/897816878 learned_addr learned my addr 10.20.193.26:0/897816878 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:11.858 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.857+0000 7fc591ffb640 10 client.?.objecter ms_handle_connect 0x7fc5a40585e0 2026-02-24T19:18:11.858 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.858+0000 7fc591ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.860 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.859+0000 7fc591ffb640 10 client.?.objecter ms_handle_connect 0x7fc5a40ba350 2026-02-24T19:18:11.860 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.859+0000 7fc591ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:11.860 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.859+0000 7f7c4753a640 10 librados: watch_flush enter 2026-02-24T19:18:11.860 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.859+0000 7f7c4753a640 10 librados: watch_flush exit 2026-02-24T19:18:11.860 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.859+0000 7f7c4753a640 20 client.4604.objecter shutdown clearing up homeless session... 2026-02-24T19:18:11.860 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.859+0000 7f7c4753a640 10 client.4604.objecter successfully canceled tick 2026-02-24T19:18:11.860 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.859+0000 7f7c4753a640 1 -- 10.20.193.26:0/3952457042 >> v1:10.20.193.162:6800/3889602630 conn(0x7f7c10077c10 legacy=0x7f7c100980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.860 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.859+0000 7f7c4753a640 10 monclient: shutdown 2026-02-24T19:18:11.860 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.859+0000 7f7c4753a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.860 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.859+0000 7f7c4753a640 1 -- 10.20.193.26:0/3952457042 >> v1:10.20.193.103:6789/0 conn(0x7f7c40159810 legacy=0x7f7c40130e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.860 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.859+0000 7f7c4753a640 1 -- 10.20.193.26:0/3952457042 shutdown_connections 2026-02-24T19:18:11.860 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.859+0000 7f7c4753a640 1 -- 10.20.193.26:0/3952457042 >> 10.20.193.26:0/3952457042 conn(0x7f7c400b2d40 msgr2=0x7f7c401579f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.861 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.859+0000 7f7c4753a640 1 -- 10.20.193.26:0/3952457042 shutdown_connections 2026-02-24T19:18:11.861 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.859+0000 7f7c4753a640 1 -- 10.20.193.26:0/3952457042 wait complete. 2026-02-24T19:18:11.861 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.859+0000 7f7c4753a640 1 librados: shutdown 2026-02-24T19:18:11.861 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.859+0000 7fc591ffb640 1 -- 10.20.193.26:0/897816878 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 298274427 0 0) 0x7fc5a40b47a0 con 0x7fc5a40585e0 2026-02-24T19:18:11.861 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.859+0000 7fc591ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.861 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.859+0000 7fc591ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.861 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.859+0000 7fc591ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.861 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.859+0000 7fc591ffb640 10 monclient(hunting): my global_id is 4637 2026-02-24T19:18:11.861 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.859+0000 7fc591ffb640 1 -- 10.20.193.26:0/897816878 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc574003610 con 0x7fc5a40585e0 2026-02-24T19:18:11.861 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.859+0000 7f6d993c8640 10 librados: watch_flush enter 2026-02-24T19:18:11.861 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.859+0000 7f6d993c8640 10 librados: watch_flush exit 2026-02-24T19:18:11.861 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.859+0000 7f6d993c8640 20 client.4605.objecter shutdown clearing up homeless session... 2026-02-24T19:18:11.862 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.859+0000 7f6d993c8640 10 client.4605.objecter successfully canceled tick 2026-02-24T19:18:11.862 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.859+0000 7f6d993c8640 1 -- 10.20.193.26:0/3304562167 >> v1:10.20.193.162:6800/3889602630 conn(0x7f6d60077d40 legacy=0x7f6d600981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.862 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.860+0000 7f6d993c8640 10 monclient: shutdown 2026-02-24T19:18:11.862 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.860+0000 7f6d993c8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.862 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.860+0000 7f6d993c8640 1 -- 10.20.193.26:0/3304562167 >> v1:10.20.193.26:6789/0 conn(0x7f6d94157780 legacy=0x7f6d9412e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.862 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.860+0000 7f6d993c8640 1 -- 10.20.193.26:0/3304562167 shutdown_connections 2026-02-24T19:18:11.862 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.860+0000 7f6d993c8640 1 -- 10.20.193.26:0/3304562167 >> 10.20.193.26:0/3304562167 conn(0x7f6d940b2ef0 msgr2=0x7f6d940ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.862 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.860+0000 7f6d993c8640 1 -- 10.20.193.26:0/3304562167 shutdown_connections 2026-02-24T19:18:11.862 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.860+0000 7f6d993c8640 1 -- 10.20.193.26:0/3304562167 wait complete. 2026-02-24T19:18:11.862 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.860+0000 7f6d993c8640 1 librados: shutdown 2026-02-24T19:18:11.863 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.862+0000 7fc591ffb640 1 -- 10.20.193.26:0/897816878 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2684381824 0 0) 0x7fc574003610 con 0x7fc5a40585e0 2026-02-24T19:18:11.863 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.862+0000 7fc591ffb640 1 -- 10.20.193.26:0/897816878 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc5a40b47a0 con 0x7fc5a40585e0 2026-02-24T19:18:11.863 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.862+0000 7fc591ffb640 1 -- 10.20.193.26:0/897816878 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc5940032f0 con 0x7fc5a40585e0 2026-02-24T19:18:11.863 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.862+0000 7fc591ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:11.863 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.862+0000 7fc591ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:11.863 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.862+0000 7fc591ffb640 10 monclient(hunting): dump: 2026-02-24T19:18:11.863 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.863 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.863 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.864 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.864 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.864 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.864 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.864 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.864 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.864 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.864 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.862+0000 7fc591ffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:11.864 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.864+0000 7fc591ffb640 1 -- 10.20.193.26:0/897816878 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1544029881 0 0) 0x7fc5a42030d0 con 0x7fc5a40ba350 2026-02-24T19:18:11.865 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.864+0000 7fc591ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:11.865 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.864+0000 7fc591ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:11.865 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.864+0000 7fc591ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:11.865 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.864+0000 7fc591ffb640 10 monclient(hunting): my global_id is 4623 2026-02-24T19:18:11.865 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.864+0000 7fc591ffb640 1 -- 10.20.193.26:0/897816878 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc574003610 con 0x7fc5a40ba350 2026-02-24T19:18:11.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.865+0000 7fc591ffb640 1 -- 10.20.193.26:0/897816878 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1265053936 0 0) 0x7fc5a40b47a0 con 0x7fc5a40585e0 2026-02-24T19:18:11.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.865+0000 7fc591ffb640 1 -- 10.20.193.26:0/897816878 >> v1:10.20.193.70:6789/0 conn(0x7fc5a40b9f80 legacy=0x7fc5a40b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.865+0000 7fc591ffb640 1 -- 10.20.193.26:0/897816878 >> v1:10.20.193.26:6789/0 conn(0x7fc5a40ba350 legacy=0x7fc5a40b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.865+0000 7fc591ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:18:11.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.865+0000 7fc591ffb640 1 monclient: found mon.c 2026-02-24T19:18:11.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.865+0000 7fc591ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:11.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.865+0000 7fc591ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.865+0000 7fc591ffb640 1 -- 10.20.193.26:0/897816878 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a40b4a80 con 0x7fc5a40585e0 2026-02-24T19:18:11.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.865+0000 7fc591ffb640 10 monclient: _finish_auth 0 2026-02-24T19:18:11.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.865+0000 7fc591ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:18:11.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.865+0000 7fc591ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:11.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.865+0000 7fc5ab4d0640 5 monclient: authenticate success, global_id 4637 2026-02-24T19:18:11.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.865+0000 7fc5ab4d0640 10 monclient: _renew_subs 2026-02-24T19:18:11.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.865+0000 7fc5ab4d0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.865+0000 7fc5ab4d0640 1 -- 10.20.193.26:0/897816878 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc5a40b4d60 con 0x7fc5a40585e0 2026-02-24T19:18:11.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.865+0000 7fc5ab4d0640 10 client.4637.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:11.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.865+0000 7fc5ab4d0640 10 monclient: _renew_subs 2026-02-24T19:18:11.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.865+0000 7fc5ab4d0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.865+0000 7fc5ab4d0640 1 -- 10.20.193.26:0/897816878 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc5a4156fa0 con 0x7fc5a40585e0 2026-02-24T19:18:11.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.865+0000 7fc5ab4d0640 1 librados: init done 2026-02-24T19:18:11.867 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.865+0000 7fc5ab4d0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.867 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.865+0000 7fc5ab4d0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.867 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.865+0000 7fc5ab4d0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.867 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.865+0000 7fc5ab4d0640 1 -- 10.20.193.26:0/897816878 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5a415afb0 con 0x7fc5a40585e0 2026-02-24T19:18:11.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.5 2026-02-24T19:18:11.869 DEBUG:teuthology.parallel:result is None 2026-02-24T19:18:11.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.2 2026-02-24T19:18:11.870 DEBUG:teuthology.parallel:result is None 2026-02-24T19:18:11.873 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.872+0000 7f75b688b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-24T19:18:11.873 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.872+0000 7f75b688b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-24T19:18:11.873 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.872+0000 7f75b688b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:11.873 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.872+0000 7f75b688b640 1 -- 10.20.193.26:0/3647229437 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f75b005e210 con 0x7f75b00b28b0 2026-02-24T19:18:11.874 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.873+0000 7fc591ffb640 1 -- 10.20.193.26:0/897816878 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc594003500 con 0x7fc5a40585e0 2026-02-24T19:18:11.874 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.873+0000 7fc591ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.874 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.873+0000 7fc591ffb640 1 -- 10.20.193.26:0/897816878 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc594003c10 con 0x7fc5a40585e0 2026-02-24T19:18:11.874 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.873+0000 7fc591ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.874 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.873+0000 7fc591ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:11.874 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.873+0000 7fc591ffb640 10 monclient: dump: 2026-02-24T19:18:11.874 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.874 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.874 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.874 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.874 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.874 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.874 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.874 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.874 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.874 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.874 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.873+0000 7fc5937fe640 4 set_mon_vals no callback set 2026-02-24T19:18:11.874 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.874+0000 7fc591ffb640 1 -- 10.20.193.26:0/897816878 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fc594003df0 con 0x7fc5a40585e0 2026-02-24T19:18:11.875 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.874+0000 7fc5a8a44640 10 monclient: get_auth_request con 0x7fc574077d80 auth_method 0 2026-02-24T19:18:11.875 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.874+0000 7fc591ffb640 10 client.4637.objecter ms_handle_connect 0x7fc574077d80 2026-02-24T19:18:11.875 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.875+0000 7fc591ffb640 1 -- 10.20.193.26:0/897816878 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7fc5940934f0 con 0x7fc5a40585e0 2026-02-24T19:18:11.875 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.875+0000 7fc591ffb640 10 client.4637.objecter ms_dispatch2 0x7fc5a4000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:11.875 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.875+0000 7fc591ffb640 3 client.4637.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:11.876 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.875+0000 7fc591ffb640 3 client.4637.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:11.876 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.875+0000 7fc591ffb640 20 client.4637.objecter dump_active .. 0 homeless 2026-02-24T19:18:11.960 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.959+0000 7fc591ffb640 1 -- 10.20.193.26:0/897816878 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fc5a4163930 con 0x7fc5a40585e0 2026-02-24T19:18:11.960 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.959+0000 7fc591ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.960 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.959+0000 7fc591ffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:11.962 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.961+0000 7f2f20ff9640 1 -- 10.20.193.26:0/3639010046 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f2f1005ca60 con 0x7f2f240585e0 2026-02-24T19:18:11.962 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.962+0000 7f2f20ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.962 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.962+0000 7f2f20ff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:11.963 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.962+0000 7f8f8a32e640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-24T19:18:11.963 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.962+0000 7f8f8a32e640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-24T19:18:11.963 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.962+0000 7f8f8a32e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:11.963 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.962+0000 7f8f8a32e640 1 -- 10.20.193.26:0/2607654424 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 13} v 0) -- 0x7f8f84059a40 con 0x7f8f84164d00 2026-02-24T19:18:11.963 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.962+0000 7fe886c5b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-24T19:18:11.963 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.962+0000 7fe886c5b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-24T19:18:11.963 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.962+0000 7fe886c5b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:11.963 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.962+0000 7fe886c5b640 1 -- 10.20.193.26:0/273552875 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 15} v 0) -- 0x7fe88015af20 con 0x7fe8800ba350 2026-02-24T19:18:11.965 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.964+0000 7fe8757fa640 1 -- 10.20.193.26:0/273552875 <== mon.2 v1:10.20.193.103:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 15}]=0 v0) ==== 75+0+12 (unknown 2221946896 0 1498640560) 0x7fe87c05e0f0 con 0x7fe8800ba350 2026-02-24T19:18:11.965 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.964+0000 7fe8757fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-24T19:18:11.965 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.964+0000 7fe8757fa640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:11.965 INFO:teuthology.orchestra.run.trial026.stdout:90194313221 2026-02-24T19:18:11.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.965+0000 7f3246ffd640 1 -- 10.20.193.26:0/3185918553 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3248002f70 con 0x7f32600b28b0 2026-02-24T19:18:11.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.965+0000 7f3246ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:11.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.965+0000 7f3246ffd640 1 -- 10.20.193.26:0/3185918553 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f3248003bf0 con 0x7f32600b28b0 2026-02-24T19:18:11.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.965+0000 7f3246ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:11.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.965+0000 7f3246ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:11.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.965+0000 7f3246ffd640 10 monclient: dump: 2026-02-24T19:18:11.966 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:11.966 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:11.966 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.966 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:11.966 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:11.966 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:11.966 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:11.966 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:11.967 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:11.967 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:11.967 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.965+0000 7f325cd72640 4 set_mon_vals no callback set 2026-02-24T19:18:11.967 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.966+0000 7f8f80ff9640 1 -- 10.20.193.26:0/2607654424 <== mon.0 v1:10.20.193.26:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 13}]=0 v0) ==== 75+0+12 (unknown 3988744482 0 1257367751) 0x7f8f7805c620 con 0x7f8f84164d00 2026-02-24T19:18:11.967 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.966+0000 7f8f80ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-24T19:18:11.967 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.966+0000 7f8f80ff9640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:11.967 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:11.967 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.966+0000 7f3246ffd640 1 -- 10.20.193.26:0/3185918553 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f324801ca60 con 0x7f32600b28b0 2026-02-24T19:18:11.968 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.967+0000 7fe886c5b640 10 librados: watch_flush enter 2026-02-24T19:18:11.968 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.967+0000 7fe886c5b640 10 librados: watch_flush exit 2026-02-24T19:18:11.968 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.967+0000 7fe886c5b640 20 client.4628.objecter shutdown clearing up homeless session... 2026-02-24T19:18:11.968 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.967+0000 7fe886c5b640 10 client.4628.objecter successfully canceled tick 2026-02-24T19:18:11.968 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.967+0000 7fe886c5b640 1 -- 10.20.193.26:0/273552875 >> v1:10.20.193.162:6800/3889602630 conn(0x7fe850077d20 legacy=0x7fe8500981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.968 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.967+0000 7fe886c5b640 10 monclient: shutdown 2026-02-24T19:18:11.968 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.967+0000 7fe886c5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.968 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.967+0000 7fe886c5b640 1 -- 10.20.193.26:0/273552875 >> v1:10.20.193.103:6789/0 conn(0x7fe8800ba350 legacy=0x7fe8800b42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.968 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.967+0000 7f325e575640 10 monclient: get_auth_request con 0x7f322c077da0 auth_method 0 2026-02-24T19:18:11.968 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.967+0000 7fe886c5b640 1 -- 10.20.193.26:0/273552875 shutdown_connections 2026-02-24T19:18:11.968 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.967+0000 7fe886c5b640 1 -- 10.20.193.26:0/273552875 >> 10.20.193.26:0/273552875 conn(0x7fe8800b7990 msgr2=0x7fe880158460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.968 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.967+0000 7fe886c5b640 1 -- 10.20.193.26:0/273552875 shutdown_connections 2026-02-24T19:18:11.968 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.967+0000 7fe886c5b640 1 -- 10.20.193.26:0/273552875 wait complete. 2026-02-24T19:18:11.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.967+0000 7fe886c5b640 1 librados: shutdown 2026-02-24T19:18:11.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.967+0000 7f3246ffd640 10 client.4582.objecter ms_handle_connect 0x7f322c077da0 2026-02-24T19:18:11.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.967+0000 7f3246ffd640 1 -- 10.20.193.26:0/3185918553 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f3248092040 con 0x7f32600b28b0 2026-02-24T19:18:11.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.967+0000 7f3246ffd640 10 client.4582.objecter ms_dispatch2 0x7f3260000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:11.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.967+0000 7f3246ffd640 3 client.4582.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:11.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.967+0000 7f3246ffd640 3 client.4582.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:11.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.967+0000 7f3246ffd640 20 client.4582.objecter dump_active .. 0 homeless 2026-02-24T19:18:11.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.968+0000 7f8f8a32e640 10 librados: watch_flush enter 2026-02-24T19:18:11.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.968+0000 7f8f8a32e640 10 librados: watch_flush exit 2026-02-24T19:18:11.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.968+0000 7f8f8a32e640 20 client.4608.objecter shutdown clearing up homeless session... 2026-02-24T19:18:11.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.968+0000 7f8f8a32e640 10 client.4608.objecter successfully canceled tick 2026-02-24T19:18:11.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.968+0000 7f8f8a32e640 1 -- 10.20.193.26:0/2607654424 >> v1:10.20.193.162:6800/3889602630 conn(0x7f8f54077c10 legacy=0x7f8f540980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.968+0000 7f8f8a32e640 10 monclient: shutdown 2026-02-24T19:18:11.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.968+0000 7f8f8a32e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.968+0000 7f8f8a32e640 1 -- 10.20.193.26:0/2607654424 >> v1:10.20.193.26:6789/0 conn(0x7f8f84164d00 legacy=0x7f8f840aa1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.968+0000 7f8f8a32e640 1 -- 10.20.193.26:0/2607654424 shutdown_connections 2026-02-24T19:18:11.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.968+0000 7f8f8a32e640 1 -- 10.20.193.26:0/2607654424 >> 10.20.193.26:0/2607654424 conn(0x7f8f840b2ef0 msgr2=0x7f8f840b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.968+0000 7f8f8a32e640 1 -- 10.20.193.26:0/2607654424 shutdown_connections 2026-02-24T19:18:11.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.968+0000 7f8f8a32e640 1 -- 10.20.193.26:0/2607654424 wait complete. 2026-02-24T19:18:11.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.968+0000 7f8f8a32e640 1 librados: shutdown 2026-02-24T19:18:11.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.969+0000 7f3246ffd640 1 -- 10.20.193.26:0/3185918553 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f324805ca70 con 0x7f32600b28b0 2026-02-24T19:18:11.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.969+0000 7f3246ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:11.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.969+0000 7f3246ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:11.973 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.972+0000 7f75acff9640 1 -- 10.20.193.26:0/3647229437 <== mon.1 v1:10.20.193.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+12 (unknown 2894986287 0 1257367751) 0x7f75a005d730 con 0x7f75b00b28b0 2026-02-24T19:18:11.973 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.972+0000 7f75acff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-24T19:18:11.973 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.972+0000 7f75acff9640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:11.973 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:11.976 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.975+0000 7f75b688b640 10 librados: watch_flush enter 2026-02-24T19:18:11.976 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.975+0000 7f75b688b640 10 librados: watch_flush exit 2026-02-24T19:18:11.976 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.975+0000 7f75b688b640 20 client.4576.objecter shutdown clearing up homeless session... 2026-02-24T19:18:11.976 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.975+0000 7f75b688b640 10 client.4576.objecter successfully canceled tick 2026-02-24T19:18:11.976 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.975+0000 7f75b688b640 1 -- 10.20.193.26:0/3647229437 >> v1:10.20.193.162:6800/3889602630 conn(0x7f7580077bf0 legacy=0x7f75800980a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.976 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.975+0000 7f75b688b640 10 monclient: shutdown 2026-02-24T19:18:11.976 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.975+0000 7f75b688b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:11.976 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.975+0000 7f75b688b640 1 -- 10.20.193.26:0/3647229437 >> v1:10.20.193.70:6789/0 conn(0x7f75b00b28b0 legacy=0x7f75b00b7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:11.976 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.975+0000 7f75b688b640 1 -- 10.20.193.26:0/3647229437 shutdown_connections 2026-02-24T19:18:11.976 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.975+0000 7f75b688b640 1 -- 10.20.193.26:0/3647229437 >> 10.20.193.26:0/3647229437 conn(0x7f75b00b5290 msgr2=0x7f75b0157c50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:11.976 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.975+0000 7f75b688b640 1 -- 10.20.193.26:0/3647229437 shutdown_connections 2026-02-24T19:18:11.976 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.975+0000 7f75b688b640 1 -- 10.20.193.26:0/3647229437 wait complete. 2026-02-24T19:18:11.976 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:11.975+0000 7f75b688b640 1 librados: shutdown 2026-02-24T19:18:11.977 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313221 for osd.15 2026-02-24T19:18:11.977 DEBUG:teuthology.parallel:result is None 2026-02-24T19:18:11.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.13 2026-02-24T19:18:11.978 DEBUG:teuthology.parallel:result is None 2026-02-24T19:18:11.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.9 2026-02-24T19:18:11.984 DEBUG:teuthology.parallel:result is None 2026-02-24T19:18:12.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.068+0000 7fc5ab4d0640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-24T19:18:12.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.068+0000 7fc5ab4d0640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-24T19:18:12.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.068+0000 7fc5ab4d0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:12.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.068+0000 7fc5ab4d0640 1 -- 10.20.193.26:0/897816878 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 14} v 0) -- 0x7fc5a415acd0 con 0x7fc5a40585e0 2026-02-24T19:18:12.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.069+0000 7f2f2aa24640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-24T19:18:12.070 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.069+0000 7f2f2aa24640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-24T19:18:12.070 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.069+0000 7f2f2aa24640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:12.070 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.069+0000 7f2f2aa24640 1 -- 10.20.193.26:0/3639010046 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f2f2415ab40 con 0x7f2f240585e0 2026-02-24T19:18:12.071 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.070+0000 7fc591ffb640 1 -- 10.20.193.26:0/897816878 <== mon.2 v1:10.20.193.103:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 14}]=0 v0) ==== 75+0+12 (unknown 2547163239 0 1257367751) 0x7fc59405df20 con 0x7fc5a40585e0 2026-02-24T19:18:12.071 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.070+0000 7fc591ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-24T19:18:12.071 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.070+0000 7fc591ffb640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:12.071 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:12.072 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.071+0000 7f2f20ff9640 1 -- 10.20.193.26:0/3639010046 <== mon.1 v1:10.20.193.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (unknown 1482059429 0 1257367751) 0x7f2f1005c360 con 0x7f2f240585e0 2026-02-24T19:18:12.072 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.071+0000 7f2f20ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-24T19:18:12.072 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.071+0000 7f2f20ff9640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:12.072 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:12.073 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.072+0000 7fc5ab4d0640 10 librados: watch_flush enter 2026-02-24T19:18:12.073 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.072+0000 7fc5ab4d0640 10 librados: watch_flush exit 2026-02-24T19:18:12.073 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.072+0000 7fc5ab4d0640 20 client.4637.objecter shutdown clearing up homeless session... 2026-02-24T19:18:12.073 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.072+0000 7fc5ab4d0640 10 client.4637.objecter successfully canceled tick 2026-02-24T19:18:12.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.072+0000 7fc5ab4d0640 1 -- 10.20.193.26:0/897816878 >> v1:10.20.193.162:6800/3889602630 conn(0x7fc574077d80 legacy=0x7fc574098230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.072+0000 7fc5ab4d0640 10 monclient: shutdown 2026-02-24T19:18:12.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.072+0000 7fc5ab4d0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:12.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.072+0000 7fc5ab4d0640 1 -- 10.20.193.26:0/897816878 >> v1:10.20.193.103:6789/0 conn(0x7fc5a40585e0 legacy=0x7fc5a42029c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.072+0000 7fc5ab4d0640 1 -- 10.20.193.26:0/897816878 shutdown_connections 2026-02-24T19:18:12.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.072+0000 7fc5ab4d0640 1 -- 10.20.193.26:0/897816878 >> 10.20.193.26:0/897816878 conn(0x7fc5a40b7990 msgr2=0x7fc5a40b66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:12.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.072+0000 7fc5ab4d0640 1 -- 10.20.193.26:0/897816878 shutdown_connections 2026-02-24T19:18:12.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.072+0000 7fc5ab4d0640 1 -- 10.20.193.26:0/897816878 wait complete. 2026-02-24T19:18:12.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.072+0000 7fc5ab4d0640 1 librados: shutdown 2026-02-24T19:18:12.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.073+0000 7f2f2aa24640 10 librados: watch_flush enter 2026-02-24T19:18:12.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.073+0000 7f2f2aa24640 10 librados: watch_flush exit 2026-02-24T19:18:12.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.073+0000 7f2f2aa24640 20 client.4579.objecter shutdown clearing up homeless session... 2026-02-24T19:18:12.075 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.073+0000 7f2f2aa24640 10 client.4579.objecter successfully canceled tick 2026-02-24T19:18:12.075 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.073+0000 7f2f2aa24640 1 -- 10.20.193.26:0/3639010046 >> v1:10.20.193.162:6800/3889602630 conn(0x7f2ef4077d70 legacy=0x7f2ef4098220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.075 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.073+0000 7f2f2aa24640 10 monclient: shutdown 2026-02-24T19:18:12.075 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.073+0000 7f2f2aa24640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:12.075 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.073+0000 7f2f2aa24640 1 -- 10.20.193.26:0/3639010046 >> v1:10.20.193.70:6789/0 conn(0x7f2f240585e0 legacy=0x7f2f24165920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.075 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.073+0000 7f2f2aa24640 1 -- 10.20.193.26:0/3639010046 shutdown_connections 2026-02-24T19:18:12.075 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.073+0000 7f2f2aa24640 1 -- 10.20.193.26:0/3639010046 >> 10.20.193.26:0/3639010046 conn(0x7f2f240b7990 msgr2=0x7f2f240b5370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:12.075 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.073+0000 7f2f2aa24640 1 -- 10.20.193.26:0/3639010046 shutdown_connections 2026-02-24T19:18:12.075 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.073+0000 7f2f2aa24640 1 -- 10.20.193.26:0/3639010046 wait complete. 2026-02-24T19:18:12.075 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.073+0000 7f2f2aa24640 1 librados: shutdown 2026-02-24T19:18:12.078 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.077+0000 7f3264ffa640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-24T19:18:12.078 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.077+0000 7f3264ffa640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-24T19:18:12.078 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.077+0000 7f3264ffa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:12.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.077+0000 7f3264ffa640 1 -- 10.20.193.26:0/3185918553 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f32600b4c40 con 0x7f32600b28b0 2026-02-24T19:18:12.081 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.080+0000 7f3246ffd640 1 -- 10.20.193.26:0/3185918553 <== mon.1 v1:10.20.193.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 1257367751) 0x7f324805c370 con 0x7f32600b28b0 2026-02-24T19:18:12.081 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.080+0000 7f3246ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-24T19:18:12.081 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.080+0000 7f3246ffd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:12.081 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:12.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.7 2026-02-24T19:18:12.082 DEBUG:teuthology.parallel:result is None 2026-02-24T19:18:12.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.14 2026-02-24T19:18:12.083 DEBUG:teuthology.parallel:result is None 2026-02-24T19:18:12.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.082+0000 7f3264ffa640 10 librados: watch_flush enter 2026-02-24T19:18:12.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.082+0000 7f3264ffa640 10 librados: watch_flush exit 2026-02-24T19:18:12.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.082+0000 7f3264ffa640 20 client.4582.objecter shutdown clearing up homeless session... 2026-02-24T19:18:12.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.082+0000 7f3264ffa640 10 client.4582.objecter successfully canceled tick 2026-02-24T19:18:12.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.082+0000 7f3264ffa640 1 -- 10.20.193.26:0/3185918553 >> v1:10.20.193.162:6800/3889602630 conn(0x7f322c077da0 legacy=0x7f322c098250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.082+0000 7f3264ffa640 10 monclient: shutdown 2026-02-24T19:18:12.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.082+0000 7f3264ffa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:12.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.082+0000 7f3264ffa640 1 -- 10.20.193.26:0/3185918553 >> v1:10.20.193.70:6789/0 conn(0x7f32600b28b0 legacy=0x7f3260119310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.082+0000 7f3264ffa640 1 -- 10.20.193.26:0/3185918553 shutdown_connections 2026-02-24T19:18:12.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.082+0000 7f3264ffa640 1 -- 10.20.193.26:0/3185918553 >> 10.20.193.26:0/3185918553 conn(0x7f32600b5290 msgr2=0x7f3260135e40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:12.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.082+0000 7f3264ffa640 1 -- 10.20.193.26:0/3185918553 shutdown_connections 2026-02-24T19:18:12.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.082+0000 7f3264ffa640 1 -- 10.20.193.26:0/3185918553 wait complete. 2026-02-24T19:18:12.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.082+0000 7f3264ffa640 1 librados: shutdown 2026-02-24T19:18:12.091 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.4 2026-02-24T19:18:12.092 DEBUG:teuthology.parallel:result is None 2026-02-24T19:18:12.245 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-24T19:18:12.292 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-24T19:18:12.314 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.313+0000 7fe2b9632640 10 monclient: get_monmap_and_config 2026-02-24T19:18:12.314 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.313+0000 7fe2b9632640 10 monclient: build_initial_monmap 2026-02-24T19:18:12.314 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.313+0000 7fe2b9632640 10 monclient: monmap: 2026-02-24T19:18:12.314 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:12.314 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.314 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:12.314425+0000 2026-02-24T19:18:12.314 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:12.314425+0000 2026-02-24T19:18:12.314 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:12.314 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.314 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:12.314 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:12.315 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:12.315 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.315 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.314+0000 7fe2b9632640 1 Processor -- start 2026-02-24T19:18:12.315 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.314+0000 7fe2b9632640 1 -- start start 2026-02-24T19:18:12.315 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.314+0000 7fe2b9632640 10 monclient: init 2026-02-24T19:18:12.315 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.314+0000 7fe2b9632640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:12.315 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.314+0000 7fe2b9632640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:18:12.316 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.314+0000 7fe2b9632640 10 monclient(hunting): picked mon.noname-c con 0x7fe2b415d0c0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:12.316 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.314+0000 7fe2b9632640 10 monclient(hunting): picked mon.noname-b con 0x7fe2b40b0ca0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:12.316 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.314+0000 7fe2b9632640 10 monclient(hunting): picked mon.noname-a con 0x7fe2b40b28b0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:12.316 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.314+0000 7fe2b9632640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2b40b8540 con 0x7fe2b40b28b0 2026-02-24T19:18:12.316 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.314+0000 7fe2b9632640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2b40b5da0 con 0x7fe2b40b0ca0 2026-02-24T19:18:12.316 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.314+0000 7fe2b9632640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2b40b6080 con 0x7fe2b415d0c0 2026-02-24T19:18:12.316 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.314+0000 7fe2b9632640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:12.316 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.314+0000 7fe2b9632640 10 monclient(hunting): authenticate will time out at 3674.996795s 2026-02-24T19:18:12.316 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.315+0000 7fe2b37fe640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fe2b40b28b0 0x7fe2b40b7e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:38174/0 (socket says 10.20.193.26:38174) 2026-02-24T19:18:12.316 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.315+0000 7fe2b37fe640 1 -- 10.20.193.26:0/127256969 learned_addr learned my addr 10.20.193.26:0/127256969 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:12.317 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.316+0000 7fe2b1ffb640 1 -- 10.20.193.26:0/127256969 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2746181620 0 0) 0x7fe2b40b5da0 con 0x7fe2b40b0ca0 2026-02-24T19:18:12.317 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.316+0000 7fe2b1ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:12.317 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.316+0000 7fe2b1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:12.318 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.316+0000 7fe2b1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:12.318 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.316+0000 7fe2b1ffb640 10 monclient(hunting): my global_id is 4585 2026-02-24T19:18:12.318 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.316+0000 7fe2b1ffb640 1 -- 10.20.193.26:0/127256969 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2a0003610 con 0x7fe2b40b0ca0 2026-02-24T19:18:12.318 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.316+0000 7fe2b1ffb640 1 -- 10.20.193.26:0/127256969 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2914589947 0 0) 0x7fe2b40b8540 con 0x7fe2b40b28b0 2026-02-24T19:18:12.318 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.316+0000 7fe2b1ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:12.318 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.316+0000 7fe2b1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:12.318 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.316+0000 7fe2b1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:12.318 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.316+0000 7fe2b1ffb640 10 monclient(hunting): my global_id is 4626 2026-02-24T19:18:12.318 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.316+0000 7fe2b1ffb640 1 -- 10.20.193.26:0/127256969 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2b40b5da0 con 0x7fe2b40b28b0 2026-02-24T19:18:12.318 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.316+0000 7fe2b1ffb640 1 -- 10.20.193.26:0/127256969 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1928106245 0 0) 0x7fe2b40b6080 con 0x7fe2b415d0c0 2026-02-24T19:18:12.318 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.316+0000 7fe2b1ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:18:12.318 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.316+0000 7fe2b1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:12.318 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.316+0000 7fe2b1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:12.318 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.316+0000 7fe2b1ffb640 10 monclient(hunting): my global_id is 4640 2026-02-24T19:18:12.318 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.316+0000 7fe2b1ffb640 1 -- 10.20.193.26:0/127256969 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2b40b8540 con 0x7fe2b415d0c0 2026-02-24T19:18:12.319 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.318+0000 7fe2b1ffb640 1 -- 10.20.193.26:0/127256969 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3313669112 0 0) 0x7fe2b40b8540 con 0x7fe2b415d0c0 2026-02-24T19:18:12.319 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.318+0000 7fe2b1ffb640 1 -- 10.20.193.26:0/127256969 >> v1:10.20.193.70:6789/0 conn(0x7fe2b40b0ca0 legacy=0x7fe2b40b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.319 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.318+0000 7fe2b1ffb640 1 -- 10.20.193.26:0/127256969 >> v1:10.20.193.26:6789/0 conn(0x7fe2b40b28b0 legacy=0x7fe2b40b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.319 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.318+0000 7fe2b1ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:18:12.319 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.318+0000 7fe2b1ffb640 1 monclient: found mon.noname-c 2026-02-24T19:18:12.319 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.318+0000 7fe2b1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:12.319 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.318+0000 7fe2b1ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:12.319 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.318+0000 7fe2b1ffb640 1 -- 10.20.193.26:0/127256969 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b4163e10 con 0x7fe2b415d0c0 2026-02-24T19:18:12.319 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.318+0000 7fe2b1ffb640 10 monclient: _finish_auth 0 2026-02-24T19:18:12.319 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.318+0000 7fe2b1ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:18:12.319 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.318+0000 7fe2b1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:12.319 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.318+0000 7fe2b1ffb640 1 -- 10.20.193.26:0/127256969 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fe2a8002dd0 con 0x7fe2b415d0c0 2026-02-24T19:18:12.320 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.318+0000 7fe2b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:12.320 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.318+0000 7fe2b1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:12.320 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.318+0000 7fe2b1ffb640 10 monclient: dump: 2026-02-24T19:18:12.320 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.320 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.320 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.320 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.320 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.320 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.320 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.320 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.320 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.320 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.320 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.318+0000 7fe2b9632640 5 monclient: authenticate success, global_id 4640 2026-02-24T19:18:12.320 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.318+0000 7fe2b9632640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:12.320 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.319+0000 7fe2b1ffb640 1 -- 10.20.193.26:0/127256969 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe2a8002fa0 con 0x7fe2b415d0c0 2026-02-24T19:18:12.320 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.319+0000 7fe2b1ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:12.320 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.319+0000 7fe2b1ffb640 1 -- 10.20.193.26:0/127256969 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fe2a80033e0 con 0x7fe2b415d0c0 2026-02-24T19:18:12.321 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.319+0000 7fe2b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:12.321 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.319+0000 7fe2b1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:12.321 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.319+0000 7fe2b1ffb640 10 monclient: dump: 2026-02-24T19:18:12.321 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.321 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.321 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.321 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.321 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.321 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.321 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.321 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.321 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.321 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.321 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.319+0000 7fe2b9632640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:12.321 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.319+0000 7fe2b9632640 4 set_mon_vals no callback set 2026-02-24T19:18:12.321 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.319+0000 7fe2b9632640 10 monclient: shutdown 2026-02-24T19:18:12.321 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.319+0000 7fe2b9632640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:12.321 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.319+0000 7fe2b9632640 1 -- 10.20.193.26:0/127256969 >> v1:10.20.193.103:6789/0 conn(0x7fe2b415d0c0 legacy=0x7fe2b40b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.321 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.319+0000 7fe2b9632640 1 -- 10.20.193.26:0/127256969 shutdown_connections 2026-02-24T19:18:12.321 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.319+0000 7fe2b9632640 1 -- 10.20.193.26:0/127256969 >> 10.20.193.26:0/127256969 conn(0x7fe2b40b5290 msgr2=0x7fe2b40b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:12.321 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.319+0000 7fe2b9632640 1 -- 10.20.193.26:0/127256969 shutdown_connections 2026-02-24T19:18:12.321 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.319+0000 7fe2b9632640 1 -- 10.20.193.26:0/127256969 wait complete. 2026-02-24T19:18:12.322 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.320+0000 7fe2b9632640 10 monclient: build_initial_monmap 2026-02-24T19:18:12.322 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.320+0000 7fe2b9632640 10 monclient: monmap: 2026-02-24T19:18:12.322 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:12.322 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:12.322 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:12.322 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:12.322 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:12.322 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:12.322 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:12.322 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:12.322 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:12.322 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.323 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.320+0000 7fe2b9632640 1 librados: starting msgr at 2026-02-24T19:18:12.323 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.320+0000 7fe2b9632640 1 librados: starting objecter 2026-02-24T19:18:12.323 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.320+0000 7fe2b9632640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:12.323 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.320+0000 7fe2b9632640 1 Processor -- start 2026-02-24T19:18:12.323 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.320+0000 7fe2b9632640 1 -- start start 2026-02-24T19:18:12.323 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.320+0000 7fe2b9632640 1 librados: setting wanted keys 2026-02-24T19:18:12.323 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.320+0000 7fe2b9632640 1 librados: calling monclient init 2026-02-24T19:18:12.323 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.320+0000 7fe2b9632640 10 monclient: init 2026-02-24T19:18:12.323 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.321+0000 7fe2b9632640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:12.323 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.321+0000 7fe2b9632640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:18:12.323 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.321+0000 7fe2b9632640 10 monclient(hunting): picked mon.noname-b con 0x7fe2b40b0ca0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:12.323 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.321+0000 7fe2b9632640 10 monclient(hunting): picked mon.noname-a con 0x7fe2b40b28b0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:12.323 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.321+0000 7fe2b9632640 10 monclient(hunting): picked mon.noname-c con 0x7fe2b415d0c0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:12.323 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.321+0000 7fe2b9632640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2b40b65f0 con 0x7fe2b40b28b0 2026-02-24T19:18:12.323 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.321+0000 7fe2b9632640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2b415c710 con 0x7fe2b40b0ca0 2026-02-24T19:18:12.323 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.321+0000 7fe2b9632640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2b4122e70 con 0x7fe2b415d0c0 2026-02-24T19:18:12.323 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.321+0000 7fe2b9632640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:12.323 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.321+0000 7fe2b9632640 10 monclient(hunting): authenticate will time out at 3675.003102s 2026-02-24T19:18:12.323 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.321+0000 7fe2b27fc640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fe2b40b28b0 0x7fe2b415b8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:38176/0 (socket says 10.20.193.26:38176) 2026-02-24T19:18:12.323 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.321+0000 7fe2b27fc640 1 -- 10.20.193.26:0/3235732021 learned_addr learned my addr 10.20.193.26:0/3235732021 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:12.323 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.321+0000 7fe2937fe640 10 client.?.objecter ms_handle_connect 0x7fe2b40b28b0 2026-02-24T19:18:12.323 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.321+0000 7fe2937fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:12.323 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.321+0000 7fe2937fe640 10 client.?.objecter ms_handle_connect 0x7fe2b40b0ca0 2026-02-24T19:18:12.323 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.321+0000 7fe2937fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:12.323 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.321+0000 7fe2937fe640 10 client.?.objecter ms_handle_connect 0x7fe2b415d0c0 2026-02-24T19:18:12.323 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.321+0000 7fe2937fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:12.324 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.322+0000 7fe2937fe640 1 -- 10.20.193.26:0/3235732021 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3563396696 0 0) 0x7fe2b40b65f0 con 0x7fe2b40b28b0 2026-02-24T19:18:12.324 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.322+0000 7fe2937fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:12.324 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.322+0000 7fe2937fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:12.324 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.322+0000 7fe2937fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:12.324 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.322+0000 7fe2937fe640 10 monclient(hunting): my global_id is 4629 2026-02-24T19:18:12.324 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.322+0000 7fe2937fe640 1 -- 10.20.193.26:0/3235732021 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe280003610 con 0x7fe2b40b28b0 2026-02-24T19:18:12.324 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.322+0000 7fe2937fe640 1 -- 10.20.193.26:0/3235732021 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4289717056 0 0) 0x7fe2b4163e10 con 0x7fe2b40b0ca0 2026-02-24T19:18:12.324 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.322+0000 7fe2937fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:12.324 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.322+0000 7fe2937fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:12.324 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.322+0000 7fe2937fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:12.324 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.322+0000 7fe2937fe640 10 monclient(hunting): my global_id is 4588 2026-02-24T19:18:12.324 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.322+0000 7fe2937fe640 1 -- 10.20.193.26:0/3235732021 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2b40b65f0 con 0x7fe2b40b0ca0 2026-02-24T19:18:12.324 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.322+0000 7fe2937fe640 1 -- 10.20.193.26:0/3235732021 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1247308596 0 0) 0x7fe2b4122e70 con 0x7fe2b415d0c0 2026-02-24T19:18:12.324 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.322+0000 7fe2937fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:12.324 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.322+0000 7fe2937fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:12.324 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.322+0000 7fe2937fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:12.324 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.322+0000 7fe2937fe640 10 monclient(hunting): my global_id is 4643 2026-02-24T19:18:12.324 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.322+0000 7fe2937fe640 1 -- 10.20.193.26:0/3235732021 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2b4163e10 con 0x7fe2b415d0c0 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.324+0000 7fe2937fe640 1 -- 10.20.193.26:0/3235732021 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3483672532 0 0) 0x7fe2b40b65f0 con 0x7fe2b40b0ca0 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.324+0000 7fe2937fe640 1 -- 10.20.193.26:0/3235732021 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe2b4122e70 con 0x7fe2b40b0ca0 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.324+0000 7fe2937fe640 1 -- 10.20.193.26:0/3235732021 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fe2a80032f0 con 0x7fe2b40b0ca0 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.324+0000 7fe2937fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.324+0000 7fe2937fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.324+0000 7fe2937fe640 10 monclient(hunting): dump: 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.324+0000 7fe2937fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.324+0000 7fe2937fe640 1 -- 10.20.193.26:0/3235732021 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 584648733 0 0) 0x7fe280003610 con 0x7fe2b40b28b0 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.325+0000 7fe2937fe640 1 -- 10.20.193.26:0/3235732021 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe2b40b65f0 con 0x7fe2b40b28b0 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.325+0000 7fe2937fe640 1 -- 10.20.193.26:0/3235732021 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fe29c0030d0 con 0x7fe2b40b28b0 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.325+0000 7fe2937fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.325+0000 7fe2937fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.325+0000 7fe2937fe640 10 monclient(hunting): dump: 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.326 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.327 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.327 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.327 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.327 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.327 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.327 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.325+0000 7fe2937fe640 1 -- 10.20.193.26:0/3235732021 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3917608052 0 0) 0x7fe2b4163e10 con 0x7fe2b415d0c0 2026-02-24T19:18:12.327 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.325+0000 7fe2937fe640 1 -- 10.20.193.26:0/3235732021 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe280003610 con 0x7fe2b415d0c0 2026-02-24T19:18:12.327 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.325+0000 7fe2937fe640 1 -- 10.20.193.26:0/3235732021 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fe2a4003430 con 0x7fe2b415d0c0 2026-02-24T19:18:12.327 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.325+0000 7fe2937fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:12.327 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.325+0000 7fe2937fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:12.327 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.325+0000 7fe2937fe640 10 monclient(hunting): dump: 2026-02-24T19:18:12.327 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.327 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.327 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.327 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.327 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.327 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.327 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.327 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.327 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.327 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.326+0000 7fe2937fe640 1 -- 10.20.193.26:0/3235732021 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3932428458 0 0) 0x7fe2b4122e70 con 0x7fe2b40b0ca0 2026-02-24T19:18:12.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.326+0000 7fe2937fe640 1 -- 10.20.193.26:0/3235732021 >> v1:10.20.193.103:6789/0 conn(0x7fe2b415d0c0 legacy=0x7fe2b415c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.326+0000 7fe2937fe640 1 -- 10.20.193.26:0/3235732021 >> v1:10.20.193.26:6789/0 conn(0x7fe2b40b28b0 legacy=0x7fe2b415b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.326+0000 7fe2937fe640 10 monclient: _finish_hunting 0 2026-02-24T19:18:12.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.326+0000 7fe2937fe640 1 monclient: found mon.b 2026-02-24T19:18:12.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.326+0000 7fe2937fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:12.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.326+0000 7fe2937fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:12.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.326+0000 7fe2937fe640 1 -- 10.20.193.26:0/3235732021 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b4123150 con 0x7fe2b40b0ca0 2026-02-24T19:18:12.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.326+0000 7fe2937fe640 10 monclient: _finish_auth 0 2026-02-24T19:18:12.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.326+0000 7fe2937fe640 10 monclient: _check_auth_tickets 2026-02-24T19:18:12.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.326+0000 7fe2937fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:12.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.326+0000 7fe2b9632640 5 monclient: authenticate success, global_id 4588 2026-02-24T19:18:12.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.326+0000 7fe2b9632640 10 monclient: _renew_subs 2026-02-24T19:18:12.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.326+0000 7fe2b9632640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:12.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.326+0000 7fe2b9632640 1 -- 10.20.193.26:0/3235732021 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe2b4123430 con 0x7fe2b40b0ca0 2026-02-24T19:18:12.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.326+0000 7fe2b9632640 10 client.4588.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:12.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.326+0000 7fe2b9632640 10 monclient: _renew_subs 2026-02-24T19:18:12.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.326+0000 7fe2b9632640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:12.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.326+0000 7fe2b9632640 1 -- 10.20.193.26:0/3235732021 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe2b41239f0 con 0x7fe2b40b0ca0 2026-02-24T19:18:12.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.326+0000 7fe2b9632640 1 librados: init done 2026-02-24T19:18:12.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.327+0000 7fe2b9632640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:12.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.327+0000 7fe2b9632640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:12.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.327+0000 7fe2b9632640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:12.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.327+0000 7fe2b9632640 1 -- 10.20.193.26:0/3235732021 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2b405e210 con 0x7fe2b40b0ca0 2026-02-24T19:18:12.336 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.335+0000 7fe2937fe640 1 -- 10.20.193.26:0/3235732021 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe2a8002f50 con 0x7fe2b40b0ca0 2026-02-24T19:18:12.336 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.335+0000 7fe2937fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:12.336 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.335+0000 7fe2937fe640 1 -- 10.20.193.26:0/3235732021 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fe2a80038e0 con 0x7fe2b40b0ca0 2026-02-24T19:18:12.336 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.335+0000 7fe2937fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:12.336 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.335+0000 7fe2937fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:12.337 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.335+0000 7fe2b17fa640 4 set_mon_vals no callback set 2026-02-24T19:18:12.337 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.335+0000 7fe2937fe640 10 monclient: dump: 2026-02-24T19:18:12.337 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.337 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.337 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.337 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.337 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.337 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.337 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.337 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.337 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.337 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.337 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.336+0000 7fe2937fe640 1 -- 10.20.193.26:0/3235732021 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fe2a8003ac0 con 0x7fe2b40b0ca0 2026-02-24T19:18:12.338 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.337+0000 7fe2b27fc640 10 monclient: get_auth_request con 0x7fe280077ea0 auth_method 0 2026-02-24T19:18:12.338 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.337+0000 7fe2937fe640 10 client.4588.objecter ms_handle_connect 0x7fe280077ea0 2026-02-24T19:18:12.338 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.337+0000 7fe2937fe640 1 -- 10.20.193.26:0/3235732021 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7fe2a8091db0 con 0x7fe2b40b0ca0 2026-02-24T19:18:12.338 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.337+0000 7fe2937fe640 10 client.4588.objecter ms_dispatch2 0x7fe2b4000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:12.338 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.337+0000 7fe2937fe640 3 client.4588.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:12.338 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.337+0000 7fe2937fe640 3 client.4588.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:12.338 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.337+0000 7fe2937fe640 20 client.4588.objecter dump_active .. 0 homeless 2026-02-24T19:18:12.360 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.358+0000 7f7fd7c04640 10 monclient: get_monmap_and_config 2026-02-24T19:18:12.360 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.358+0000 7f7fd7c04640 10 monclient: build_initial_monmap 2026-02-24T19:18:12.360 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.358+0000 7f7fd7c04640 10 monclient: monmap: 2026-02-24T19:18:12.360 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:12.360 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.360 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:12.359758+0000 2026-02-24T19:18:12.360 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:12.359758+0000 2026-02-24T19:18:12.360 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:12.360 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.360 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:12.360 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:12.360 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:12.360 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.360 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.359+0000 7f7fd7c04640 1 Processor -- start 2026-02-24T19:18:12.360 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.359+0000 7f7fd7c04640 1 -- start start 2026-02-24T19:18:12.360 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.359+0000 7f7fd7c04640 10 monclient: init 2026-02-24T19:18:12.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.359+0000 7f7fd7c04640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:12.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.360+0000 7f7fd7c04640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:18:12.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.360+0000 7f7fd7c04640 10 monclient(hunting): picked mon.noname-c con 0x7f7fd0157b50 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:12.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.360+0000 7f7fd7c04640 10 monclient(hunting): picked mon.noname-a con 0x7f7fd0164e60 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:12.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.360+0000 7f7fd7c04640 10 monclient(hunting): picked mon.noname-b con 0x7f7fd00b5cd0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:12.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.360+0000 7f7fd7c04640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fd01652c0 con 0x7f7fd0164e60 2026-02-24T19:18:12.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.360+0000 7f7fd7c04640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fd0161110 con 0x7f7fd00b5cd0 2026-02-24T19:18:12.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.360+0000 7f7fd7c04640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fd01613f0 con 0x7f7fd0157b50 2026-02-24T19:18:12.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.360+0000 7f7fd7c04640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:12.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.360+0000 7f7fd7c04640 10 monclient(hunting): authenticate will time out at 3675.042075s 2026-02-24T19:18:12.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.360+0000 7f7fd5178640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f7fd0164e60 0x7f7fd00b55c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:38182/0 (socket says 10.20.193.26:38182) 2026-02-24T19:18:12.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.360+0000 7f7fd5178640 1 -- 10.20.193.26:0/3349560933 learned_addr learned my addr 10.20.193.26:0/3349560933 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:12.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.361+0000 7f7fd4977640 1 -- 10.20.193.26:0/3349560933 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3452392577 0 0) 0x7f7fd01652c0 con 0x7f7fd0164e60 2026-02-24T19:18:12.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.361+0000 7f7fd4977640 10 monclient(hunting): _negotiate 2026-02-24T19:18:12.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.361+0000 7f7fd4977640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:12.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.361+0000 7f7fd4977640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:12.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.361+0000 7f7fd4977640 10 monclient(hunting): my global_id is 4632 2026-02-24T19:18:12.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.361+0000 7f7fd4977640 1 -- 10.20.193.26:0/3349560933 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fb8003610 con 0x7f7fd0164e60 2026-02-24T19:18:12.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.361+0000 7f7fd4977640 1 -- 10.20.193.26:0/3349560933 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 601675831 0 0) 0x7f7fd01613f0 con 0x7f7fd0157b50 2026-02-24T19:18:12.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.361+0000 7f7fd4977640 10 monclient(hunting): _negotiate 2026-02-24T19:18:12.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.361+0000 7f7fd4977640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:12.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.361+0000 7f7fd4977640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:12.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.361+0000 7f7fd4977640 10 monclient(hunting): my global_id is 4646 2026-02-24T19:18:12.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.361+0000 7f7fd4977640 1 -- 10.20.193.26:0/3349560933 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fd01652c0 con 0x7f7fd0157b50 2026-02-24T19:18:12.364 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.363+0000 7f7fd4977640 1 -- 10.20.193.26:0/3349560933 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4178323478 0 0) 0x7f7fd01652c0 con 0x7f7fd0157b50 2026-02-24T19:18:12.364 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.363+0000 7f7fd4977640 1 -- 10.20.193.26:0/3349560933 >> v1:10.20.193.70:6789/0 conn(0x7f7fd00b5cd0 legacy=0x7f7fd0057c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:12.364 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.363+0000 7f7fd4977640 1 -- 10.20.193.26:0/3349560933 >> v1:10.20.193.26:6789/0 conn(0x7f7fd0164e60 legacy=0x7f7fd00b55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.364 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.363+0000 7f7fd4977640 10 monclient: _finish_hunting 0 2026-02-24T19:18:12.364 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.363+0000 7f7fd4977640 1 monclient: found mon.noname-c 2026-02-24T19:18:12.364 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.363+0000 7f7fd4977640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:12.364 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.363+0000 7f7fd4977640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:12.364 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.363+0000 7f7fd4977640 1 -- 10.20.193.26:0/3349560933 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd01616d0 con 0x7f7fd0157b50 2026-02-24T19:18:12.364 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.363+0000 7f7fd4977640 10 monclient: _finish_auth 0 2026-02-24T19:18:12.364 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.363+0000 7f7fd4977640 10 monclient: _check_auth_tickets 2026-02-24T19:18:12.365 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.363+0000 7f7fd4977640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:12.365 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.363+0000 7f7fd4977640 1 -- 10.20.193.26:0/3349560933 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7fc0002df0 con 0x7f7fd0157b50 2026-02-24T19:18:12.365 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.363+0000 7f7fd7c04640 5 monclient: authenticate success, global_id 4646 2026-02-24T19:18:12.365 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.363+0000 7f7fd7c04640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:12.365 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.363+0000 7f7fd4977640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:12.365 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.363+0000 7f7fd4977640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:12.365 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.363+0000 7f7fd4977640 10 monclient: dump: 2026-02-24T19:18:12.365 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.365 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.365 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.365 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.365 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.365 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.365 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.365 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.365 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.365 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.365 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.363+0000 7f7fd7c04640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:12.366 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.364+0000 7f7fd4977640 1 -- 10.20.193.26:0/3349560933 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7fc0003070 con 0x7f7fd0157b50 2026-02-24T19:18:12.366 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.364+0000 7f7fd4977640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:12.366 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.364+0000 7f7fd4977640 1 -- 10.20.193.26:0/3349560933 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7fc00034b0 con 0x7f7fd0157b50 2026-02-24T19:18:12.366 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.364+0000 7f7fd4977640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:12.366 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.364+0000 7f7fd4977640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:12.366 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.364+0000 7f7fd4977640 10 monclient: dump: 2026-02-24T19:18:12.366 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.366 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.366 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.366 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.366 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.366 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.366 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.366 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.366 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.366 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.366 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.364+0000 7f7fd7c04640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:12.366 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.364+0000 7f7fd7c04640 4 set_mon_vals no callback set 2026-02-24T19:18:12.366 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.364+0000 7f7fd7c04640 10 monclient: shutdown 2026-02-24T19:18:12.366 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.364+0000 7f7fd7c04640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:12.366 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.364+0000 7f7fd7c04640 1 -- 10.20.193.26:0/3349560933 >> v1:10.20.193.103:6789/0 conn(0x7f7fd0157b50 legacy=0x7f7fd00b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.366 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.364+0000 7f7fd7c04640 1 -- 10.20.193.26:0/3349560933 shutdown_connections 2026-02-24T19:18:12.366 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.364+0000 7f7fd7c04640 1 -- 10.20.193.26:0/3349560933 >> 10.20.193.26:0/3349560933 conn(0x7f7fd00b2ef0 msgr2=0x7f7fd00b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:12.366 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.364+0000 7f7fd7c04640 1 -- 10.20.193.26:0/3349560933 shutdown_connections 2026-02-24T19:18:12.366 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.364+0000 7f7fd7c04640 1 -- 10.20.193.26:0/3349560933 wait complete. 2026-02-24T19:18:12.367 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.365+0000 7f7fd7c04640 10 monclient: build_initial_monmap 2026-02-24T19:18:12.367 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.365+0000 7f7fd7c04640 10 monclient: monmap: 2026-02-24T19:18:12.367 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:12.367 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:12.367 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:12.367 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:12.367 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:12.367 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:12.367 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:12.367 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:12.368 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:12.368 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.365+0000 7f7fd7c04640 1 librados: starting msgr at 2026-02-24T19:18:12.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.365+0000 7f7fd7c04640 1 librados: starting objecter 2026-02-24T19:18:12.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.365+0000 7f7fd7c04640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:12.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.365+0000 7f7fd7c04640 1 Processor -- start 2026-02-24T19:18:12.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.365+0000 7f7fd7c04640 1 -- start start 2026-02-24T19:18:12.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.365+0000 7f7fd7c04640 1 librados: setting wanted keys 2026-02-24T19:18:12.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.365+0000 7f7fd7c04640 1 librados: calling monclient init 2026-02-24T19:18:12.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.365+0000 7f7fd7c04640 10 monclient: init 2026-02-24T19:18:12.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.365+0000 7f7fd7c04640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:12.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.365+0000 7f7fd7c04640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:18:12.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.366+0000 7f7fd7c04640 10 monclient(hunting): picked mon.noname-c con 0x7f7fd00b5cd0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:12.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.366+0000 7f7fd7c04640 10 monclient(hunting): picked mon.noname-a con 0x7f7fd0157b50 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:12.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.366+0000 7f7fd7c04640 10 monclient(hunting): picked mon.noname-b con 0x7f7fd0164e60 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:12.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.366+0000 7f7fd7c04640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fd015e7f0 con 0x7f7fd0157b50 2026-02-24T19:18:12.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.366+0000 7f7fd7c04640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fd01fc710 con 0x7f7fd0164e60 2026-02-24T19:18:12.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.366+0000 7f7fd7c04640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fd0164630 con 0x7f7fd00b5cd0 2026-02-24T19:18:12.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.366+0000 7f7fd7c04640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:12.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.366+0000 7f7fd7c04640 10 monclient(hunting): authenticate will time out at 3675.048055s 2026-02-24T19:18:12.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.366+0000 7f7fd5979640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f7fd00b5cd0 0x7f7fd015e0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58842/0 (socket says 10.20.193.26:58842) 2026-02-24T19:18:12.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.366+0000 7f7fd5979640 1 -- 10.20.193.26:0/1507799491 learned_addr learned my addr 10.20.193.26:0/1507799491 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:12.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.366+0000 7f7fbe7fc640 10 client.?.objecter ms_handle_connect 0x7f7fd00b5cd0 2026-02-24T19:18:12.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.366+0000 7f7fbe7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:12.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.366+0000 7f7fbe7fc640 10 client.?.objecter ms_handle_connect 0x7f7fd0157b50 2026-02-24T19:18:12.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.366+0000 7f7fbe7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:12.369 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.367+0000 7f7fbe7fc640 1 -- 10.20.193.26:0/1507799491 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2630928166 0 0) 0x7f7fd0164630 con 0x7f7fd00b5cd0 2026-02-24T19:18:12.369 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.367+0000 7f7fbe7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:12.369 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.367+0000 7f7fbe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:12.369 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.367+0000 7f7fbe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:12.369 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.367+0000 7f7fbe7fc640 10 monclient(hunting): my global_id is 4649 2026-02-24T19:18:12.369 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.367+0000 7f7fbe7fc640 1 -- 10.20.193.26:0/1507799491 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fa0003610 con 0x7f7fd00b5cd0 2026-02-24T19:18:12.369 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.367+0000 7f7fbe7fc640 1 -- 10.20.193.26:0/1507799491 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 747992612 0 0) 0x7f7fd015e7f0 con 0x7f7fd0157b50 2026-02-24T19:18:12.369 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.367+0000 7f7fbe7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:12.369 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.367+0000 7f7fbe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:12.369 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.367+0000 7f7fbe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:12.369 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.367+0000 7f7fbe7fc640 10 monclient(hunting): my global_id is 4635 2026-02-24T19:18:12.369 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.367+0000 7f7fbe7fc640 1 -- 10.20.193.26:0/1507799491 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fd0164630 con 0x7f7fd0157b50 2026-02-24T19:18:12.370 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.369+0000 7f7fbe7fc640 1 -- 10.20.193.26:0/1507799491 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2613997376 0 0) 0x7f7fa0003610 con 0x7f7fd00b5cd0 2026-02-24T19:18:12.370 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.369+0000 7f7fbe7fc640 1 -- 10.20.193.26:0/1507799491 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7fd015e7f0 con 0x7f7fd00b5cd0 2026-02-24T19:18:12.370 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.369+0000 7f7fbe7fc640 1 -- 10.20.193.26:0/1507799491 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7fc0002d00 con 0x7f7fd00b5cd0 2026-02-24T19:18:12.370 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.369+0000 7f7fbe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:12.370 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.369+0000 7f7fbe7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.369+0000 7f7fbe7fc640 10 monclient(hunting): dump: 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.369+0000 7f7fbe7fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.369+0000 7f7fbe7fc640 1 -- 10.20.193.26:0/1507799491 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2795394122 0 0) 0x7f7fd0164630 con 0x7f7fd0157b50 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.369+0000 7f7fbe7fc640 1 -- 10.20.193.26:0/1507799491 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7fa0003610 con 0x7f7fd0157b50 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.369+0000 7f7fbe7fc640 1 -- 10.20.193.26:0/1507799491 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7fc4002fb0 con 0x7f7fd0157b50 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.369+0000 7f7fbe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.369+0000 7f7fbe7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.369+0000 7f7fbe7fc640 10 monclient(hunting): dump: 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.371 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.371+0000 7f7fbe7fc640 1 -- 10.20.193.26:0/1507799491 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2152837453 0 0) 0x7f7fd015e7f0 con 0x7f7fd00b5cd0 2026-02-24T19:18:12.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.371+0000 7f7fbe7fc640 1 -- 10.20.193.26:0/1507799491 >> v1:10.20.193.70:6789/0 conn(0x7f7fd0164e60 legacy=0x7f7fd0163b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.371+0000 7f7fbe7fc640 1 -- 10.20.193.26:0/1507799491 >> v1:10.20.193.26:6789/0 conn(0x7f7fd0157b50 legacy=0x7f7fd01fc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.371+0000 7f7fbe7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:18:12.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.371+0000 7f7fbe7fc640 1 monclient: found mon.c 2026-02-24T19:18:12.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.371+0000 7f7fbe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:12.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.371+0000 7f7fbe7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:12.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.371+0000 7f7fbe7fc640 1 -- 10.20.193.26:0/1507799491 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd0164910 con 0x7f7fd00b5cd0 2026-02-24T19:18:12.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.371+0000 7f7fbe7fc640 10 monclient: _finish_auth 0 2026-02-24T19:18:12.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.371+0000 7f7fbe7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:18:12.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.371+0000 7f7fbe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:12.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.371+0000 7f7fd7c04640 5 monclient: authenticate success, global_id 4649 2026-02-24T19:18:12.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.371+0000 7f7fd7c04640 10 monclient: _renew_subs 2026-02-24T19:18:12.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.371+0000 7f7fd7c04640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:12.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.371+0000 7f7fd7c04640 1 -- 10.20.193.26:0/1507799491 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7fd01f9e30 con 0x7f7fd00b5cd0 2026-02-24T19:18:12.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.371+0000 7f7fd7c04640 10 client.4649.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:12.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.371+0000 7f7fd7c04640 10 monclient: _renew_subs 2026-02-24T19:18:12.373 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.371+0000 7f7fd7c04640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:12.373 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.371+0000 7f7fd7c04640 1 -- 10.20.193.26:0/1507799491 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7fd0164250 con 0x7f7fd00b5cd0 2026-02-24T19:18:12.373 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.371+0000 7f7fd7c04640 1 librados: init done 2026-02-24T19:18:12.373 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.371+0000 7f7fd7c04640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:12.373 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.371+0000 7f7fd7c04640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:12.373 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.371+0000 7f7fd7c04640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:12.373 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.371+0000 7f7fd7c04640 1 -- 10.20.193.26:0/1507799491 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fd00b5940 con 0x7f7fd00b5cd0 2026-02-24T19:18:12.393 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-24T19:18:12.415 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2026-02-24T19:18:12.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.423+0000 7fe2937fe640 1 -- 10.20.193.26:0/3235732021 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fe2b415c710 con 0x7fe2b40b0ca0 2026-02-24T19:18:12.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.423+0000 7fe2937fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:12.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.423+0000 7fe2937fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:12.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.462+0000 7fa7f6e16640 10 monclient: get_monmap_and_config 2026-02-24T19:18:12.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.462+0000 7fa7f6e16640 10 monclient: build_initial_monmap 2026-02-24T19:18:12.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.462+0000 7fa7f6e16640 10 monclient: monmap: 2026-02-24T19:18:12.463 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:12.463 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.463 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:12.462813+0000 2026-02-24T19:18:12.463 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:12.462813+0000 2026-02-24T19:18:12.463 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:12.463 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.463 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:12.463 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:12.463 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:12.463 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.462+0000 7fa7f6e16640 1 Processor -- start 2026-02-24T19:18:12.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.462+0000 7fa7f6e16640 1 -- start start 2026-02-24T19:18:12.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.462+0000 7fa7f6e16640 10 monclient: init 2026-02-24T19:18:12.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.463+0000 7fa7f6e16640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:12.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.463+0000 7fa7f6e16640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:18:12.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.463+0000 7fa7f6e16640 10 monclient(hunting): picked mon.noname-c con 0x7fa7f0157780 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:12.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.463+0000 7fa7f6e16640 10 monclient(hunting): picked mon.noname-a con 0x7fa7f0157b50 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:12.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.463+0000 7fa7f6e16640 10 monclient(hunting): picked mon.noname-b con 0x7fa7f0164d00 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:12.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.463+0000 7fa7f6e16640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f005de70 con 0x7fa7f0157b50 2026-02-24T19:18:12.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.463+0000 7fa7f6e16640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f0055b20 con 0x7fa7f0164d00 2026-02-24T19:18:12.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.463+0000 7fa7f6e16640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f0055e00 con 0x7fa7f0157780 2026-02-24T19:18:12.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.463+0000 7fa7f6e16640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:12.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.463+0000 7fa7f6e16640 10 monclient(hunting): authenticate will time out at 3675.145115s 2026-02-24T19:18:12.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.463+0000 7fa7e7fff640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fa7f0157b50 0x7fa7f01645f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:38202/0 (socket says 10.20.193.26:38202) 2026-02-24T19:18:12.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.463+0000 7fa7e7fff640 1 -- 10.20.193.26:0/1741442542 learned_addr learned my addr 10.20.193.26:0/1741442542 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:12.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.463+0000 7f7fbe7fc640 1 -- 10.20.193.26:0/1507799491 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7fc0002f10 con 0x7f7fd00b5cd0 2026-02-24T19:18:12.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.463+0000 7f7fbe7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:12.464 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.463+0000 7f7fbe7fc640 1 -- 10.20.193.26:0/1507799491 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7fc0003bf0 con 0x7f7fd00b5cd0 2026-02-24T19:18:12.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.463+0000 7f7fbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:12.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.463+0000 7f7fbe7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:12.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.463+0000 7f7fbe7fc640 10 monclient: dump: 2026-02-24T19:18:12.465 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.465 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.465 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.465 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.465 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.465 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.465 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.465 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.465 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.465 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.463+0000 7f7fbffff640 4 set_mon_vals no callback set 2026-02-24T19:18:12.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.464+0000 7f7fbe7fc640 1 -- 10.20.193.26:0/1507799491 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f7fc0003dd0 con 0x7f7fd00b5cd0 2026-02-24T19:18:12.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.465+0000 7fa7e77fe640 1 -- 10.20.193.26:0/1741442542 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2015641216 0 0) 0x7fa7f005de70 con 0x7fa7f0157b50 2026-02-24T19:18:12.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.465+0000 7fa7e77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:12.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.465+0000 7fa7e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:12.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.465+0000 7fa7e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:12.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.465+0000 7fa7e77fe640 10 monclient(hunting): my global_id is 4638 2026-02-24T19:18:12.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.465+0000 7fa7e77fe640 1 -- 10.20.193.26:0/1741442542 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7dc003610 con 0x7fa7f0157b50 2026-02-24T19:18:12.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.465+0000 7fa7e77fe640 1 -- 10.20.193.26:0/1741442542 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3349048066 0 0) 0x7fa7f0055b20 con 0x7fa7f0164d00 2026-02-24T19:18:12.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.465+0000 7fa7e77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:12.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.465+0000 7fa7e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:12.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.465+0000 7fa7e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:12.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.465+0000 7fa7e77fe640 10 monclient(hunting): my global_id is 4591 2026-02-24T19:18:12.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.465+0000 7fa7e77fe640 1 -- 10.20.193.26:0/1741442542 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7f005de70 con 0x7fa7f0164d00 2026-02-24T19:18:12.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.465+0000 7f7fd5178640 10 monclient: get_auth_request con 0x7f7fa0077cd0 auth_method 0 2026-02-24T19:18:12.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.465+0000 7f7fbe7fc640 10 client.4649.objecter ms_handle_connect 0x7f7fa0077cd0 2026-02-24T19:18:12.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.465+0000 7f7fbe7fc640 1 -- 10.20.193.26:0/1507799491 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f7fc0093260 con 0x7f7fd00b5cd0 2026-02-24T19:18:12.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.465+0000 7f7fbe7fc640 10 client.4649.objecter ms_dispatch2 0x7f7fd0000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:12.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.465+0000 7f7fbe7fc640 3 client.4649.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:12.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.465+0000 7f7fbe7fc640 3 client.4649.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:12.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.465+0000 7f7fbe7fc640 20 client.4649.objecter dump_active .. 0 homeless 2026-02-24T19:18:12.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.466+0000 7fa7e77fe640 1 -- 10.20.193.26:0/1741442542 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 730989812 0 0) 0x7fa7f005de70 con 0x7fa7f0164d00 2026-02-24T19:18:12.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.466+0000 7fa7e77fe640 1 -- 10.20.193.26:0/1741442542 >> v1:10.20.193.103:6789/0 conn(0x7fa7f0157780 legacy=0x7fa7f0056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:12.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.466+0000 7fa7e77fe640 1 -- 10.20.193.26:0/1741442542 >> v1:10.20.193.26:6789/0 conn(0x7fa7f0157b50 legacy=0x7fa7f01645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.466+0000 7fa7e77fe640 10 monclient: _finish_hunting 0 2026-02-24T19:18:12.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.466+0000 7fa7e77fe640 1 monclient: found mon.noname-b 2026-02-24T19:18:12.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.466+0000 7fa7e77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:12.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.466+0000 7fa7e77fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:18:12.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.466+0000 7fa7e77fe640 1 -- 10.20.193.26:0/1741442542 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f00560e0 con 0x7fa7f0164d00 2026-02-24T19:18:12.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.466+0000 7fa7e77fe640 10 monclient: _finish_auth 0 2026-02-24T19:18:12.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.466+0000 7fa7e77fe640 10 monclient: _check_auth_tickets 2026-02-24T19:18:12.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.466+0000 7fa7e77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:12.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.466+0000 7fa7e77fe640 1 -- 10.20.193.26:0/1741442542 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa7ec003170 con 0x7fa7f0164d00 2026-02-24T19:18:12.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.466+0000 7fa7e77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:12.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.466+0000 7fa7e77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:12.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.466+0000 7fa7e77fe640 10 monclient: dump: 2026-02-24T19:18:12.468 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.468 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.468 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.468 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.468 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.468 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.468 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.468 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.468 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.468 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.466+0000 7fa7f6e16640 5 monclient: authenticate success, global_id 4591 2026-02-24T19:18:12.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.466+0000 7fa7f6e16640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:12.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.467+0000 7f7fbe7fc640 1 -- 10.20.193.26:0/1507799491 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f7fc005dc90 con 0x7f7fd00b5cd0 2026-02-24T19:18:12.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.467+0000 7f7fbe7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:12.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.467+0000 7f7fbe7fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:12.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.467+0000 7fa7e77fe640 1 -- 10.20.193.26:0/1741442542 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa7ec003380 con 0x7fa7f0164d00 2026-02-24T19:18:12.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.467+0000 7fa7e77fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:12.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.467+0000 7fa7e77fe640 1 -- 10.20.193.26:0/1741442542 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa7ec0037c0 con 0x7fa7f0164d00 2026-02-24T19:18:12.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.467+0000 7fa7e77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:12.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.467+0000 7fa7e77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:12.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.467+0000 7fa7e77fe640 10 monclient: dump: 2026-02-24T19:18:12.469 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.469 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.467+0000 7fa7f6e16640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.467+0000 7fa7f6e16640 4 set_mon_vals no callback set 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.468+0000 7fa7f6e16640 10 monclient: shutdown 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.468+0000 7fa7f6e16640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.468+0000 7fa7f6e16640 1 -- 10.20.193.26:0/1741442542 >> v1:10.20.193.70:6789/0 conn(0x7fa7f0164d00 legacy=0x7fa7f01c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.468+0000 7fa7f6e16640 1 -- 10.20.193.26:0/1741442542 shutdown_connections 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.468+0000 7fa7f6e16640 1 -- 10.20.193.26:0/1741442542 >> 10.20.193.26:0/1741442542 conn(0x7fa7f00b2ef0 msgr2=0x7fa7f00b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.468+0000 7fa7f6e16640 1 -- 10.20.193.26:0/1741442542 shutdown_connections 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.468+0000 7fa7f6e16640 1 -- 10.20.193.26:0/1741442542 wait complete. 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.468+0000 7fa7f6e16640 10 monclient: build_initial_monmap 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.468+0000 7fa7f6e16640 10 monclient: monmap: 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.468+0000 7fa7f6e16640 1 librados: starting msgr at 2026-02-24T19:18:12.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.468+0000 7fa7f6e16640 1 librados: starting objecter 2026-02-24T19:18:12.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.468+0000 7fa7f6e16640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:12.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.468+0000 7fa7f6e16640 1 Processor -- start 2026-02-24T19:18:12.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.468+0000 7fa7f6e16640 1 -- start start 2026-02-24T19:18:12.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.468+0000 7fa7f6e16640 1 librados: setting wanted keys 2026-02-24T19:18:12.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.468+0000 7fa7f6e16640 1 librados: calling monclient init 2026-02-24T19:18:12.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.468+0000 7fa7f6e16640 10 monclient: init 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.469+0000 7fa7f6e16640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.469+0000 7fa7f6e16640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.469+0000 7fa7f6e16640 10 monclient(hunting): picked mon.noname-a con 0x7fa7f0157780 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.469+0000 7fa7f6e16640 10 monclient(hunting): picked mon.noname-c con 0x7fa7f0157b50 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.469+0000 7fa7f6e16640 10 monclient(hunting): picked mon.noname-b con 0x7fa7f0164d00 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.469+0000 7fa7f6e16640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f00b1ec0 con 0x7fa7f0157780 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.469+0000 7fa7f6e16640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f012b270 con 0x7fa7f0164d00 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.469+0000 7fa7f6e16640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f012b550 con 0x7fa7f0157b50 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.469+0000 7fa7f6e16640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.469+0000 7fa7f6e16640 10 monclient(hunting): authenticate will time out at 3675.151205s 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.469+0000 7fa7f4b8b640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fa7f0157780 0x7fa7f00b17b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:38204/0 (socket says 10.20.193.26:38204) 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.469+0000 7fa7f4b8b640 1 -- 10.20.193.26:0/898636731 learned_addr learned my addr 10.20.193.26:0/898636731 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.469+0000 7fa7e57fa640 10 client.?.objecter ms_handle_connect 0x7fa7f0157780 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.469+0000 7fa7e57fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.469+0000 7fa7e57fa640 10 client.?.objecter ms_handle_connect 0x7fa7f0164d00 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.469+0000 7fa7e57fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.469+0000 7fa7e57fa640 10 client.?.objecter ms_handle_connect 0x7fa7f0157b50 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.469+0000 7fa7e57fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.470+0000 7fa7e57fa640 1 -- 10.20.193.26:0/898636731 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3776034486 0 0) 0x7fa7f012b270 con 0x7fa7f0164d00 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.470+0000 7fa7e57fa640 10 monclient(hunting): _negotiate 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.470+0000 7fa7e57fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.470+0000 7fa7e57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.470+0000 7fa7e57fa640 10 monclient(hunting): my global_id is 4594 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.470+0000 7fa7e57fa640 1 -- 10.20.193.26:0/898636731 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7c0003610 con 0x7fa7f0164d00 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.470+0000 7fa7e57fa640 1 -- 10.20.193.26:0/898636731 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3843501420 0 0) 0x7fa7f00b1ec0 con 0x7fa7f0157780 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.470+0000 7fa7e57fa640 10 monclient(hunting): _negotiate 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.470+0000 7fa7e57fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:12.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.470+0000 7fa7e57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:12.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.470+0000 7fa7e57fa640 10 monclient(hunting): my global_id is 4641 2026-02-24T19:18:12.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.470+0000 7fa7e57fa640 1 -- 10.20.193.26:0/898636731 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7f012b270 con 0x7fa7f0157780 2026-02-24T19:18:12.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.470+0000 7fa7e57fa640 1 -- 10.20.193.26:0/898636731 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2019771853 0 0) 0x7fa7f012b550 con 0x7fa7f0157b50 2026-02-24T19:18:12.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.470+0000 7fa7e57fa640 10 monclient(hunting): _negotiate 2026-02-24T19:18:12.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.470+0000 7fa7e57fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:12.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.470+0000 7fa7e57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:12.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.470+0000 7fa7e57fa640 10 monclient(hunting): my global_id is 4652 2026-02-24T19:18:12.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.470+0000 7fa7e57fa640 1 -- 10.20.193.26:0/898636731 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7f00b1ec0 con 0x7fa7f0157b50 2026-02-24T19:18:12.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.473+0000 7fa7e57fa640 1 -- 10.20.193.26:0/898636731 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2105480997 0 0) 0x7fa7f012b270 con 0x7fa7f0157780 2026-02-24T19:18:12.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.473+0000 7fa7e57fa640 1 -- 10.20.193.26:0/898636731 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa7f012b550 con 0x7fa7f0157780 2026-02-24T19:18:12.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.473+0000 7fa7e57fa640 1 -- 10.20.193.26:0/898636731 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa7e0002fd0 con 0x7fa7f0157780 2026-02-24T19:18:12.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.473+0000 7fa7e57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:12.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.473+0000 7fa7e57fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:12.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.473+0000 7fa7e57fa640 10 monclient(hunting): dump: 2026-02-24T19:18:12.474 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.474 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.474 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.474 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.474 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.474 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.474 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.474 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.474 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.474 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.473+0000 7fa7e57fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:12.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.473+0000 7fa7e57fa640 1 -- 10.20.193.26:0/898636731 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4034613665 0 0) 0x7fa7f00b1ec0 con 0x7fa7f0157b50 2026-02-24T19:18:12.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.473+0000 7fa7e57fa640 1 -- 10.20.193.26:0/898636731 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa7f012b270 con 0x7fa7f0157b50 2026-02-24T19:18:12.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.473+0000 7fa7e57fa640 1 -- 10.20.193.26:0/898636731 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4216893678 0 0) 0x7fa7c0003610 con 0x7fa7f0164d00 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.473+0000 7fa7e57fa640 1 -- 10.20.193.26:0/898636731 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa7f00b1ec0 con 0x7fa7f0164d00 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.473+0000 7fa7e57fa640 1 -- 10.20.193.26:0/898636731 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa7ec0036d0 con 0x7fa7f0164d00 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.473+0000 7fa7e57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.473+0000 7fa7e57fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.473+0000 7fa7e57fa640 10 monclient(hunting): dump: 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.473+0000 7fa7e57fa640 1 -- 10.20.193.26:0/898636731 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa7d8003170 con 0x7fa7f0157b50 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.473+0000 7fa7e57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.473+0000 7fa7e57fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.473+0000 7fa7e57fa640 10 monclient(hunting): dump: 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.475 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.474+0000 7fa7e57fa640 1 -- 10.20.193.26:0/898636731 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3454050596 0 0) 0x7fa7f012b550 con 0x7fa7f0157780 2026-02-24T19:18:12.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.474+0000 7fa7e57fa640 1 -- 10.20.193.26:0/898636731 >> v1:10.20.193.103:6789/0 conn(0x7fa7f0157b50 legacy=0x7fa7f012c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.474+0000 7fa7e57fa640 1 -- 10.20.193.26:0/898636731 >> v1:10.20.193.70:6789/0 conn(0x7fa7f0164d00 legacy=0x7fa7f0147550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.474+0000 7fa7e57fa640 10 monclient: _finish_hunting 0 2026-02-24T19:18:12.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.474+0000 7fa7e57fa640 1 monclient: found mon.a 2026-02-24T19:18:12.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.474+0000 7fa7e57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:12.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.474+0000 7fa7e57fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:12.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.474+0000 7fa7e57fa640 1 -- 10.20.193.26:0/898636731 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f012b830 con 0x7fa7f0157780 2026-02-24T19:18:12.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.474+0000 7fa7e57fa640 10 monclient: _finish_auth 0 2026-02-24T19:18:12.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.474+0000 7fa7e57fa640 10 monclient: _check_auth_tickets 2026-02-24T19:18:12.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.474+0000 7fa7e57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:12.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.474+0000 7fa7f6e16640 5 monclient: authenticate success, global_id 4641 2026-02-24T19:18:12.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.474+0000 7fa7f6e16640 10 monclient: _renew_subs 2026-02-24T19:18:12.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.474+0000 7fa7f6e16640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:12.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.474+0000 7fa7f6e16640 1 -- 10.20.193.26:0/898636731 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa7f012bb10 con 0x7fa7f0157780 2026-02-24T19:18:12.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.474+0000 7fa7f6e16640 10 client.4641.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:12.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.474+0000 7fa7f6e16640 10 monclient: _renew_subs 2026-02-24T19:18:12.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.474+0000 7fa7f6e16640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:12.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.474+0000 7fa7f6e16640 1 -- 10.20.193.26:0/898636731 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa7f0129c50 con 0x7fa7f0157780 2026-02-24T19:18:12.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.474+0000 7fa7f6e16640 1 librados: init done 2026-02-24T19:18:12.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.475+0000 7fa7f6e16640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:12.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.475+0000 7fa7f6e16640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:12.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.475+0000 7fa7f6e16640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:12.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.475+0000 7fa7f6e16640 1 -- 10.20.193.26:0/898636731 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7f0165740 con 0x7fa7f0157780 2026-02-24T19:18:12.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.482+0000 7fa7e57fa640 1 -- 10.20.193.26:0/898636731 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa7e0003170 con 0x7fa7f0157780 2026-02-24T19:18:12.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.482+0000 7fa7e57fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:12.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.482+0000 7fa7e57fa640 1 -- 10.20.193.26:0/898636731 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa7e0004b90 con 0x7fa7f0157780 2026-02-24T19:18:12.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.482+0000 7fa7e57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:12.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.482+0000 7fa7e57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:12.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.482+0000 7fa7e6ffd640 4 set_mon_vals no callback set 2026-02-24T19:18:12.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.482+0000 7fa7e57fa640 10 monclient: dump: 2026-02-24T19:18:12.483 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.483 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.483 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.483 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.483 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.483 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.483 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.483 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.483 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.483 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.483+0000 7fa7e57fa640 1 -- 10.20.193.26:0/898636731 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fa7e001da00 con 0x7fa7f0157780 2026-02-24T19:18:12.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.483+0000 7fa7e7fff640 10 monclient: get_auth_request con 0x7fa7c0077f60 auth_method 0 2026-02-24T19:18:12.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.484+0000 7fa7e57fa640 10 client.4641.objecter ms_handle_connect 0x7fa7c0077f60 2026-02-24T19:18:12.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.484+0000 7fa7e57fa640 1 -- 10.20.193.26:0/898636731 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7fa7e0093180 con 0x7fa7f0157780 2026-02-24T19:18:12.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.484+0000 7fa7e57fa640 10 client.4641.objecter ms_dispatch2 0x7fa7f0000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:12.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.484+0000 7fa7e57fa640 3 client.4641.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:12.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.484+0000 7fa7e57fa640 3 client.4641.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:12.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.484+0000 7fa7e57fa640 20 client.4641.objecter dump_active .. 0 homeless 2026-02-24T19:18:12.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.489+0000 7f7c11282640 10 monclient: get_monmap_and_config 2026-02-24T19:18:12.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.489+0000 7f7c11282640 10 monclient: build_initial_monmap 2026-02-24T19:18:12.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.489+0000 7f7c11282640 10 monclient: monmap: 2026-02-24T19:18:12.490 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:12.490 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.490 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:12.490527+0000 2026-02-24T19:18:12.490 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:12.490527+0000 2026-02-24T19:18:12.490 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:12.490 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.491 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:12.491 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:12.491 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:12.491 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.490+0000 7f7c11282640 1 Processor -- start 2026-02-24T19:18:12.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.490+0000 7f7c11282640 1 -- start start 2026-02-24T19:18:12.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.490+0000 7f7c11282640 10 monclient: init 2026-02-24T19:18:12.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.491+0000 7f7c11282640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:12.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.491+0000 7f7c11282640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:18:12.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.491+0000 7f7c11282640 10 monclient(hunting): picked mon.noname-a con 0x7f7c0c1566e0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:12.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.491+0000 7f7c11282640 10 monclient(hunting): picked mon.noname-b con 0x7f7c0c160c00 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:12.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.491+0000 7f7c11282640 10 monclient(hunting): picked mon.noname-c con 0x7f7c0c156ab0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:12.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.491+0000 7f7c11282640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c0c058480 con 0x7f7c0c1566e0 2026-02-24T19:18:12.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.491+0000 7f7c11282640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c0c058760 con 0x7f7c0c160c00 2026-02-24T19:18:12.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.491+0000 7f7c11282640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c0c0b0f90 con 0x7f7c0c156ab0 2026-02-24T19:18:12.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.491+0000 7f7c11282640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:12.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.491+0000 7f7c11282640 10 monclient(hunting): authenticate will time out at 3675.173127s 2026-02-24T19:18:12.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.491+0000 7f7c0b577640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f7c0c156ab0 0x7f7c0c055980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58862/0 (socket says 10.20.193.26:58862) 2026-02-24T19:18:12.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.491+0000 7f7c0b577640 1 -- 10.20.193.26:0/1819230693 learned_addr learned my addr 10.20.193.26:0/1819230693 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:12.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.492+0000 7f7c09d74640 1 -- 10.20.193.26:0/1819230693 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1625316824 0 0) 0x7f7c0c0b0f90 con 0x7f7c0c156ab0 2026-02-24T19:18:12.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.493+0000 7f7c09d74640 10 monclient(hunting): _negotiate 2026-02-24T19:18:12.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.493+0000 7f7c09d74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:12.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.493+0000 7f7c09d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:12.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.493+0000 7f7c09d74640 10 monclient(hunting): my global_id is 4655 2026-02-24T19:18:12.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.493+0000 7f7c09d74640 1 -- 10.20.193.26:0/1819230693 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bf8003610 con 0x7f7c0c156ab0 2026-02-24T19:18:12.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.493+0000 7f7c09d74640 1 -- 10.20.193.26:0/1819230693 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3485749077 0 0) 0x7f7c0c058760 con 0x7f7c0c160c00 2026-02-24T19:18:12.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.493+0000 7f7c09d74640 10 monclient(hunting): _negotiate 2026-02-24T19:18:12.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.493+0000 7f7c09d74640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:12.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.493+0000 7f7c09d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:12.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.493+0000 7f7c09d74640 10 monclient(hunting): my global_id is 4597 2026-02-24T19:18:12.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.493+0000 7f7c09d74640 1 -- 10.20.193.26:0/1819230693 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c0c0b0f90 con 0x7f7c0c160c00 2026-02-24T19:18:12.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.494+0000 7f7c09d74640 1 -- 10.20.193.26:0/1819230693 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3492348253 0 0) 0x7f7bf8003610 con 0x7f7c0c156ab0 2026-02-24T19:18:12.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.494+0000 7f7c09d74640 1 -- 10.20.193.26:0/1819230693 >> v1:10.20.193.70:6789/0 conn(0x7f7c0c160c00 legacy=0x7f7c0c057920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.494+0000 7f7c09d74640 1 -- 10.20.193.26:0/1819230693 >> v1:10.20.193.26:6789/0 conn(0x7f7c0c1566e0 legacy=0x7f7c0c0b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-24T19:18:12.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.494+0000 7f7c09d74640 10 monclient: _finish_hunting 0 2026-02-24T19:18:12.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.494+0000 7f7c09d74640 1 monclient: found mon.noname-c 2026-02-24T19:18:12.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.494+0000 7f7c09d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:12.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.494+0000 7f7c09d74640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:12.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.494+0000 7f7c09d74640 1 -- 10.20.193.26:0/1819230693 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0c0b1270 con 0x7f7c0c156ab0 2026-02-24T19:18:12.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.494+0000 7f7c09d74640 10 monclient: _finish_auth 0 2026-02-24T19:18:12.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.494+0000 7f7c09d74640 10 monclient: _check_auth_tickets 2026-02-24T19:18:12.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.494+0000 7f7c09d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:12.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.494+0000 7f7c09d74640 1 -- 10.20.193.26:0/1819230693 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7bfc003170 con 0x7f7c0c156ab0 2026-02-24T19:18:12.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.494+0000 7f7c09d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:12.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.494+0000 7f7c09d74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:12.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.494+0000 7f7c09d74640 10 monclient: dump: 2026-02-24T19:18:12.496 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.496 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.496 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.496 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.496 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.496 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.496 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.496 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.496 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.496 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.494+0000 7f7c11282640 5 monclient: authenticate success, global_id 4655 2026-02-24T19:18:12.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.494+0000 7f7c11282640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:12.497 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.495+0000 7f7c09d74640 1 -- 10.20.193.26:0/1819230693 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7bfc003380 con 0x7f7c0c156ab0 2026-02-24T19:18:12.497 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.495+0000 7f7c09d74640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:12.497 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.495+0000 7f7c09d74640 1 -- 10.20.193.26:0/1819230693 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7bfc0037c0 con 0x7f7c0c156ab0 2026-02-24T19:18:12.497 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.495+0000 7f7c09d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:12.497 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.495+0000 7f7c09d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:12.497 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.495+0000 7f7c09d74640 10 monclient: dump: 2026-02-24T19:18:12.497 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.497 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.497 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.497 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.497 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.497 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.497 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.497 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.497 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.497 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.497 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.495+0000 7f7c11282640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:12.497 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.495+0000 7f7c11282640 4 set_mon_vals no callback set 2026-02-24T19:18:12.497 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.495+0000 7f7c11282640 10 monclient: shutdown 2026-02-24T19:18:12.497 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.495+0000 7f7c11282640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:12.497 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.495+0000 7f7c11282640 1 -- 10.20.193.26:0/1819230693 >> v1:10.20.193.103:6789/0 conn(0x7f7c0c156ab0 legacy=0x7f7c0c055980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.497 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.495+0000 7f7c11282640 1 -- 10.20.193.26:0/1819230693 shutdown_connections 2026-02-24T19:18:12.497 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.495+0000 7f7c11282640 1 -- 10.20.193.26:0/1819230693 >> 10.20.193.26:0/1819230693 conn(0x7f7c0c0b2ef0 msgr2=0x7f7c0c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:12.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.495+0000 7f7c11282640 1 -- 10.20.193.26:0/1819230693 shutdown_connections 2026-02-24T19:18:12.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.495+0000 7f7c11282640 1 -- 10.20.193.26:0/1819230693 wait complete. 2026-02-24T19:18:12.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.496+0000 7f7c11282640 10 monclient: build_initial_monmap 2026-02-24T19:18:12.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.496+0000 7f7c11282640 10 monclient: monmap: 2026-02-24T19:18:12.498 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:12.498 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:12.498 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:12.498 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:12.498 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:12.498 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:12.498 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:12.498 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:12.498 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:12.498 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.496+0000 7f7c11282640 1 librados: starting msgr at 2026-02-24T19:18:12.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.496+0000 7f7c11282640 1 librados: starting objecter 2026-02-24T19:18:12.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.496+0000 7f7c11282640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:12.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.496+0000 7f7c11282640 1 Processor -- start 2026-02-24T19:18:12.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.496+0000 7f7c11282640 1 -- start start 2026-02-24T19:18:12.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.496+0000 7f7c11282640 1 librados: setting wanted keys 2026-02-24T19:18:12.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.496+0000 7f7c11282640 1 librados: calling monclient init 2026-02-24T19:18:12.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.496+0000 7f7c11282640 10 monclient: init 2026-02-24T19:18:12.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.496+0000 7f7c11282640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:12.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.496+0000 7f7c11282640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:18:12.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.496+0000 7f7c11282640 10 monclient(hunting): picked mon.noname-c con 0x7f7c0c1566e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:12.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.496+0000 7f7c11282640 10 monclient(hunting): picked mon.noname-b con 0x7f7c0c156ab0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:12.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.496+0000 7f7c11282640 10 monclient(hunting): picked mon.noname-a con 0x7f7c0c160c00 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:12.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.496+0000 7f7c11282640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c0c155140 con 0x7f7c0c160c00 2026-02-24T19:18:12.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.496+0000 7f7c11282640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c0c1553b0 con 0x7f7c0c156ab0 2026-02-24T19:18:12.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.496+0000 7f7c11282640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c0c155690 con 0x7f7c0c1566e0 2026-02-24T19:18:12.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.496+0000 7f7c11282640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:12.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.496+0000 7f7c11282640 10 monclient(hunting): authenticate will time out at 3675.178819s 2026-02-24T19:18:12.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.497+0000 7f7c0a575640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f7c0c156ab0 0x7f7c0c0a9510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:46466/0 (socket says 10.20.193.26:46466) 2026-02-24T19:18:12.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.497+0000 7f7c0a575640 1 -- 10.20.193.26:0/232979205 learned_addr learned my addr 10.20.193.26:0/232979205 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:12.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.497+0000 7f7beb7fe640 10 client.?.objecter ms_handle_connect 0x7f7c0c1566e0 2026-02-24T19:18:12.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.497+0000 7f7beb7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:12.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.497+0000 7f7beb7fe640 10 client.?.objecter ms_handle_connect 0x7f7c0c156ab0 2026-02-24T19:18:12.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.497+0000 7f7beb7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:12.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.498+0000 7f7beb7fe640 1 -- 10.20.193.26:0/232979205 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 713021760 0 0) 0x7f7c0c155690 con 0x7f7c0c1566e0 2026-02-24T19:18:12.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.498+0000 7f7beb7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:12.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.498+0000 7f7beb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:12.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.498+0000 7f7beb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:12.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.498+0000 7f7beb7fe640 10 monclient(hunting): my global_id is 4658 2026-02-24T19:18:12.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.498+0000 7f7beb7fe640 1 -- 10.20.193.26:0/232979205 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bd8003610 con 0x7f7c0c1566e0 2026-02-24T19:18:12.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.498+0000 7f7beb7fe640 1 -- 10.20.193.26:0/232979205 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2058707114 0 0) 0x7f7c0c1553b0 con 0x7f7c0c156ab0 2026-02-24T19:18:12.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.498+0000 7f7beb7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:12.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.498+0000 7f7beb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:12.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.498+0000 7f7beb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:12.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.498+0000 7f7beb7fe640 10 monclient(hunting): my global_id is 4600 2026-02-24T19:18:12.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.498+0000 7f7beb7fe640 1 -- 10.20.193.26:0/232979205 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c0c155690 con 0x7f7c0c156ab0 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.500+0000 7f7beb7fe640 1 -- 10.20.193.26:0/232979205 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2186878021 0 0) 0x7f7bd8003610 con 0x7f7c0c1566e0 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.500+0000 7f7beb7fe640 1 -- 10.20.193.26:0/232979205 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7c0c1553b0 con 0x7f7c0c1566e0 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.500+0000 7f7beb7fe640 1 -- 10.20.193.26:0/232979205 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7c00002f70 con 0x7f7c0c1566e0 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.501+0000 7f7beb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.501+0000 7f7beb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.501+0000 7f7beb7fe640 10 monclient(hunting): dump: 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.501+0000 7f7beb7fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.501+0000 7f7beb7fe640 1 -- 10.20.193.26:0/232979205 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2722876267 0 0) 0x7f7c0c155690 con 0x7f7c0c156ab0 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.501+0000 7f7beb7fe640 1 -- 10.20.193.26:0/232979205 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7bd8003610 con 0x7f7c0c156ab0 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.501+0000 7f7beb7fe640 1 -- 10.20.193.26:0/232979205 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7bf40030b0 con 0x7f7c0c156ab0 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.501+0000 7f7beb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.501+0000 7f7beb7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.501+0000 7f7beb7fe640 10 monclient(hunting): dump: 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.502 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.503 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.503 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.503 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.503 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.502+0000 7f7beb7fe640 1 -- 10.20.193.26:0/232979205 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3773742485 0 0) 0x7f7c0c1553b0 con 0x7f7c0c1566e0 2026-02-24T19:18:12.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.502+0000 7f7beb7fe640 1 -- 10.20.193.26:0/232979205 >> v1:10.20.193.70:6789/0 conn(0x7f7c0c156ab0 legacy=0x7f7c0c0a9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.502+0000 7f7beb7fe640 1 -- 10.20.193.26:0/232979205 >> v1:10.20.193.26:6789/0 conn(0x7f7c0c160c00 legacy=0x7f7c0c0ac3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.502+0000 7f7beb7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:18:12.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.502+0000 7f7beb7fe640 1 monclient: found mon.c 2026-02-24T19:18:12.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.502+0000 7f7beb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:12.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.502+0000 7f7beb7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:12.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.502+0000 7f7beb7fe640 1 -- 10.20.193.26:0/232979205 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0c155970 con 0x7f7c0c1566e0 2026-02-24T19:18:12.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.502+0000 7f7beb7fe640 10 monclient: _finish_auth 0 2026-02-24T19:18:12.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.502+0000 7f7beb7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:18:12.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.502+0000 7f7beb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:12.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.502+0000 7f7c11282640 5 monclient: authenticate success, global_id 4658 2026-02-24T19:18:12.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.502+0000 7f7c11282640 10 monclient: _renew_subs 2026-02-24T19:18:12.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.502+0000 7f7c11282640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:12.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.502+0000 7f7c11282640 1 -- 10.20.193.26:0/232979205 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7c0c155c50 con 0x7f7c0c1566e0 2026-02-24T19:18:12.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.502+0000 7f7c11282640 10 client.4658.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:12.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.502+0000 7f7c11282640 10 monclient: _renew_subs 2026-02-24T19:18:12.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.502+0000 7f7c11282640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:12.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.502+0000 7f7c11282640 1 -- 10.20.193.26:0/232979205 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7c0c0a9c20 con 0x7f7c0c1566e0 2026-02-24T19:18:12.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.502+0000 7f7c11282640 1 librados: init done 2026-02-24T19:18:12.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.503+0000 7f7c11282640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:12.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.503+0000 7f7c11282640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:12.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.503+0000 7f7c11282640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:12.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.503+0000 7f7c11282640 1 -- 10.20.193.26:0/232979205 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c0c0b0ac0 con 0x7f7c0c1566e0 2026-02-24T19:18:12.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.510+0000 7f7beb7fe640 1 -- 10.20.193.26:0/232979205 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7c000035f0 con 0x7f7c0c1566e0 2026-02-24T19:18:12.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.510+0000 7f7beb7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:12.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.510+0000 7f7beb7fe640 1 -- 10.20.193.26:0/232979205 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7c00003940 con 0x7f7c0c1566e0 2026-02-24T19:18:12.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.510+0000 7f7beb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:12.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.510+0000 7f7beb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:12.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.510+0000 7f7c09573640 4 set_mon_vals no callback set 2026-02-24T19:18:12.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.510+0000 7f7beb7fe640 10 monclient: dump: 2026-02-24T19:18:12.511 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.511 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.511 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.511 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.511 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.511 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.511 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.511 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.511 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.511 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.511+0000 7f7beb7fe640 1 -- 10.20.193.26:0/232979205 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f7c0001c7b0 con 0x7f7c0c1566e0 2026-02-24T19:18:12.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.511+0000 7f7c0a575640 10 monclient: get_auth_request con 0x7f7bd8077c70 auth_method 0 2026-02-24T19:18:12.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.512+0000 7f7beb7fe640 1 -- 10.20.193.26:0/232979205 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f7c00092130 con 0x7f7c0c1566e0 2026-02-24T19:18:12.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.512+0000 7f7beb7fe640 10 client.4658.objecter ms_dispatch2 0x7f7c0c000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:12.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.512+0000 7f7beb7fe640 3 client.4658.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:12.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.512+0000 7f7beb7fe640 3 client.4658.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:12.513 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.512+0000 7f7beb7fe640 20 client.4658.objecter dump_active .. 0 homeless 2026-02-24T19:18:12.513 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.512+0000 7f7beb7fe640 10 client.4658.objecter ms_handle_connect 0x7f7bd8077c70 2026-02-24T19:18:12.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.534+0000 7fe2b9632640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-24T19:18:12.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.534+0000 7fe2b9632640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-24T19:18:12.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.534+0000 7fe2b9632640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:18:12.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.534+0000 7fe2b9632640 1 -- 10.20.193.26:0/3235732021 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fe2b40b4c40 con 0x7fe2b40b0ca0 2026-02-24T19:18:12.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.537+0000 7fe2937fe640 1 -- 10.20.193.26:0/3235732021 <== mon.1 v1:10.20.193.70:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+12 (unknown 3646472635 0 1498640560) 0x7fe2a80038e0 con 0x7fe2b40b0ca0 2026-02-24T19:18:12.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.537+0000 7fe2937fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-24T19:18:12.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.537+0000 7fe2937fe640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:12.538 INFO:teuthology.orchestra.run.trial026.stdout:90194313221 2026-02-24T19:18:12.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.540+0000 7fe2b9632640 10 librados: watch_flush enter 2026-02-24T19:18:12.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.540+0000 7fe2b9632640 10 librados: watch_flush exit 2026-02-24T19:18:12.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.540+0000 7fe2b9632640 20 client.4588.objecter shutdown clearing up homeless session... 2026-02-24T19:18:12.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.540+0000 7fe2b9632640 10 client.4588.objecter successfully canceled tick 2026-02-24T19:18:12.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.540+0000 7fe2b9632640 1 -- 10.20.193.26:0/3235732021 >> v1:10.20.193.162:6800/3889602630 conn(0x7fe280077ea0 legacy=0x7fe280098350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.540+0000 7fe2b9632640 10 monclient: shutdown 2026-02-24T19:18:12.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.540+0000 7fe2b9632640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:12.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.540+0000 7fe2b9632640 1 -- 10.20.193.26:0/3235732021 >> v1:10.20.193.70:6789/0 conn(0x7fe2b40b0ca0 legacy=0x7fe2b4114ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.540+0000 7fe2b9632640 1 -- 10.20.193.26:0/3235732021 shutdown_connections 2026-02-24T19:18:12.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.540+0000 7fe2b9632640 1 -- 10.20.193.26:0/3235732021 >> 10.20.193.26:0/3235732021 conn(0x7fe2b40b5290 msgr2=0x7fe2b4158a00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:12.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.540+0000 7fe2b9632640 1 -- 10.20.193.26:0/3235732021 shutdown_connections 2026-02-24T19:18:12.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.540+0000 7fe2b9632640 1 -- 10.20.193.26:0/3235732021 wait complete. 2026-02-24T19:18:12.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.540+0000 7fe2b9632640 1 librados: shutdown 2026-02-24T19:18:12.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313221 for osd.10 2026-02-24T19:18:12.550 DEBUG:teuthology.parallel:result is None 2026-02-24T19:18:12.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.574+0000 7fa7e57fa640 1 -- 10.20.193.26:0/898636731 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fa7f0165740 con 0x7fa7f0157780 2026-02-24T19:18:12.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.574+0000 7fa7e57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:12.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.574+0000 7fa7e57fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:12.578 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.577+0000 7f7fd7c04640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-24T19:18:12.578 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.577+0000 7f7fd7c04640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-24T19:18:12.578 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.577+0000 7f7fd7c04640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:12.578 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.577+0000 7f7fd7c04640 1 -- 10.20.193.26:0/1507799491 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7fd015b440 con 0x7f7fd00b5cd0 2026-02-24T19:18:12.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.597+0000 7f7beb7fe640 1 -- 10.20.193.26:0/232979205 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f7c0c0b0ac0 con 0x7f7c0c1566e0 2026-02-24T19:18:12.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.597+0000 7f7beb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:12.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.597+0000 7f7beb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:12.599 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.598+0000 7f7fbe7fc640 1 -- 10.20.193.26:0/1507799491 <== mon.2 v1:10.20.193.103:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 1257367751) 0x7f7fd015b440 con 0x7f7fd00b5cd0 2026-02-24T19:18:12.599 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.598+0000 7f7fbe7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-24T19:18:12.599 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.598+0000 7f7fbe7fc640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:12.599 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:12.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.601+0000 7f7fd7c04640 10 librados: watch_flush enter 2026-02-24T19:18:12.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.601+0000 7f7fd7c04640 10 librados: watch_flush exit 2026-02-24T19:18:12.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.601+0000 7f7fd7c04640 20 client.4649.objecter shutdown clearing up homeless session... 2026-02-24T19:18:12.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.601+0000 7f7fd7c04640 10 client.4649.objecter successfully canceled tick 2026-02-24T19:18:12.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.601+0000 7f7fd7c04640 1 -- 10.20.193.26:0/1507799491 >> v1:10.20.193.162:6800/3889602630 conn(0x7f7fa0077cd0 legacy=0x7f7fa0098180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.601+0000 7f7fd7c04640 10 monclient: shutdown 2026-02-24T19:18:12.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.601+0000 7f7fd7c04640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:12.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.601+0000 7f7fd7c04640 1 -- 10.20.193.26:0/1507799491 >> v1:10.20.193.103:6789/0 conn(0x7f7fd00b5cd0 legacy=0x7f7fd015e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.601+0000 7f7fd7c04640 1 -- 10.20.193.26:0/1507799491 shutdown_connections 2026-02-24T19:18:12.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.601+0000 7f7fd7c04640 1 -- 10.20.193.26:0/1507799491 >> 10.20.193.26:0/1507799491 conn(0x7f7fd00b2ef0 msgr2=0x7f7fd00ae290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:12.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.601+0000 7f7fd7c04640 1 -- 10.20.193.26:0/1507799491 shutdown_connections 2026-02-24T19:18:12.602 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.601+0000 7f7fd7c04640 1 -- 10.20.193.26:0/1507799491 wait complete. 2026-02-24T19:18:12.603 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.601+0000 7f7fd7c04640 1 librados: shutdown 2026-02-24T19:18:12.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.1 2026-02-24T19:18:12.611 DEBUG:teuthology.parallel:result is None 2026-02-24T19:18:12.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.681+0000 7fa7f6e16640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-24T19:18:12.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.681+0000 7fa7f6e16640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-24T19:18:12.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.681+0000 7fa7f6e16640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:12.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.681+0000 7fa7f6e16640 1 -- 10.20.193.26:0/898636731 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fa7f00b0ac0 con 0x7fa7f0157780 2026-02-24T19:18:12.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.683+0000 7fa7e57fa640 1 -- 10.20.193.26:0/898636731 <== mon.0 v1:10.20.193.26:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+12 (unknown 3405404620 0 1498640560) 0x7fa7e005dbb0 con 0x7fa7f0157780 2026-02-24T19:18:12.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.683+0000 7fa7e57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-24T19:18:12.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.683+0000 7fa7e57fa640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:12.684 INFO:teuthology.orchestra.run.trial026.stdout:90194313221 2026-02-24T19:18:12.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.685+0000 7fa7f6e16640 10 librados: watch_flush enter 2026-02-24T19:18:12.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.685+0000 7fa7f6e16640 10 librados: watch_flush exit 2026-02-24T19:18:12.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.685+0000 7fa7f6e16640 20 client.4641.objecter shutdown clearing up homeless session... 2026-02-24T19:18:12.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.685+0000 7fa7f6e16640 10 client.4641.objecter successfully canceled tick 2026-02-24T19:18:12.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.685+0000 7fa7f6e16640 1 -- 10.20.193.26:0/898636731 >> v1:10.20.193.162:6800/3889602630 conn(0x7fa7c0077f60 legacy=0x7fa7c0098410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.685+0000 7fa7f6e16640 10 monclient: shutdown 2026-02-24T19:18:12.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.685+0000 7fa7f6e16640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:12.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.685+0000 7fa7f6e16640 1 -- 10.20.193.26:0/898636731 >> v1:10.20.193.26:6789/0 conn(0x7fa7f0157780 legacy=0x7fa7f00b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.685+0000 7fa7f6e16640 1 -- 10.20.193.26:0/898636731 shutdown_connections 2026-02-24T19:18:12.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.685+0000 7fa7f6e16640 1 -- 10.20.193.26:0/898636731 >> 10.20.193.26:0/898636731 conn(0x7fa7f00b2ef0 msgr2=0x7fa7f00b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:12.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.685+0000 7fa7f6e16640 1 -- 10.20.193.26:0/898636731 shutdown_connections 2026-02-24T19:18:12.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.685+0000 7fa7f6e16640 1 -- 10.20.193.26:0/898636731 wait complete. 2026-02-24T19:18:12.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.685+0000 7fa7f6e16640 1 librados: shutdown 2026-02-24T19:18:12.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313221 for osd.11 2026-02-24T19:18:12.695 DEBUG:teuthology.parallel:result is None 2026-02-24T19:18:12.705 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.704+0000 7f7c11282640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-24T19:18:12.705 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.704+0000 7f7c11282640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-24T19:18:12.705 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.704+0000 7f7c11282640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:12.705 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.704+0000 7f7c11282640 1 -- 10.20.193.26:0/232979205 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 12} v 0) -- 0x7f7c0c05e250 con 0x7f7c0c1566e0 2026-02-24T19:18:12.708 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.707+0000 7f7beb7fe640 1 -- 10.20.193.26:0/232979205 <== mon.2 v1:10.20.193.103:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 12}]=0 v0) ==== 75+0+12 (unknown 4263375189 0 1257367751) 0x7f7c0c05e250 con 0x7f7c0c1566e0 2026-02-24T19:18:12.708 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.707+0000 7f7beb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-24T19:18:12.708 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.707+0000 7f7beb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:12.708 INFO:teuthology.orchestra.run.trial026.stdout:90194313220 2026-02-24T19:18:12.710 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.709+0000 7f7c11282640 10 librados: watch_flush enter 2026-02-24T19:18:12.710 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.709+0000 7f7c11282640 10 librados: watch_flush exit 2026-02-24T19:18:12.710 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.709+0000 7f7c11282640 20 client.4658.objecter shutdown clearing up homeless session... 2026-02-24T19:18:12.710 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.709+0000 7f7c11282640 10 client.4658.objecter successfully canceled tick 2026-02-24T19:18:12.710 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.709+0000 7f7c11282640 1 -- 10.20.193.26:0/232979205 >> v1:10.20.193.162:6800/3889602630 conn(0x7f7bd8077c70 legacy=0x7f7bd8098120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.710 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.709+0000 7f7c11282640 10 monclient: shutdown 2026-02-24T19:18:12.710 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.709+0000 7f7c11282640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:12.710 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.709+0000 7f7c11282640 1 -- 10.20.193.26:0/232979205 >> v1:10.20.193.103:6789/0 conn(0x7f7c0c1566e0 legacy=0x7f7c0c0a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.710 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.709+0000 7f7c11282640 1 -- 10.20.193.26:0/232979205 shutdown_connections 2026-02-24T19:18:12.710 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.709+0000 7f7c11282640 1 -- 10.20.193.26:0/232979205 >> 10.20.193.26:0/232979205 conn(0x7f7c0c0b2ef0 msgr2=0x7f7c0c057850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:12.710 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.709+0000 7f7c11282640 1 -- 10.20.193.26:0/232979205 shutdown_connections 2026-02-24T19:18:12.710 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.709+0000 7f7c11282640 1 -- 10.20.193.26:0/232979205 wait complete. 2026-02-24T19:18:12.710 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.709+0000 7f7c11282640 1 librados: shutdown 2026-02-24T19:18:12.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.12 2026-02-24T19:18:12.719 DEBUG:teuthology.parallel:result is None 2026-02-24T19:18:12.719 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-24T19:18:12.719 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T19:18:12.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.823+0000 7f998eecd640 10 monclient: get_monmap_and_config 2026-02-24T19:18:12.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.823+0000 7f998eecd640 10 monclient: build_initial_monmap 2026-02-24T19:18:12.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.823+0000 7f998eecd640 10 monclient: monmap: 2026-02-24T19:18:12.824 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:12.824 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.824 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:12.824527+0000 2026-02-24T19:18:12.824 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:12.824527+0000 2026-02-24T19:18:12.825 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:12.825 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.825 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:12.825 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:12.825 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:12.825 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.824+0000 7f998eecd640 1 Processor -- start 2026-02-24T19:18:12.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.824+0000 7f998eecd640 1 -- start start 2026-02-24T19:18:12.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.824+0000 7f998eecd640 10 monclient: init 2026-02-24T19:18:12.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.824+0000 7f998eecd640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:12.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.824+0000 7f998eecd640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:18:12.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.824+0000 7f998eecd640 10 monclient(hunting): picked mon.noname-b con 0x7f9988058da0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:12.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.824+0000 7f998eecd640 10 monclient(hunting): picked mon.noname-a con 0x7f99880b0410 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:12.826 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.824+0000 7f998eecd640 10 monclient(hunting): picked mon.noname-c con 0x7f99881626a0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:12.826 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.824+0000 7f998eecd640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99881655c0 con 0x7f99880b0410 2026-02-24T19:18:12.826 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.824+0000 7f998eecd640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99880b12b0 con 0x7f9988058da0 2026-02-24T19:18:12.826 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.824+0000 7f998eecd640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99880b1590 con 0x7f99881626a0 2026-02-24T19:18:12.826 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.824+0000 7f998eecd640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:12.826 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.824+0000 7f998eecd640 10 monclient(hunting): authenticate will time out at 3675.506760s 2026-02-24T19:18:12.826 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.825+0000 7f997ffff640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f99880b0410 0x7f9988164eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:38212/0 (socket says 10.20.193.26:38212) 2026-02-24T19:18:12.826 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.825+0000 7f997ffff640 1 -- 10.20.193.26:0/1099203103 learned_addr learned my addr 10.20.193.26:0/1099203103 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:12.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.826+0000 7f997f7fe640 1 -- 10.20.193.26:0/1099203103 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 979407525 0 0) 0x7f99881655c0 con 0x7f99880b0410 2026-02-24T19:18:12.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.826+0000 7f997f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:12.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.826+0000 7f997f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:12.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.826+0000 7f997f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:12.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.826+0000 7f997f7fe640 10 monclient(hunting): my global_id is 4644 2026-02-24T19:18:12.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.826+0000 7f997f7fe640 1 -- 10.20.193.26:0/1099203103 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9974003610 con 0x7f99880b0410 2026-02-24T19:18:12.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.826+0000 7f997f7fe640 1 -- 10.20.193.26:0/1099203103 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 186272017 0 0) 0x7f99880b12b0 con 0x7f9988058da0 2026-02-24T19:18:12.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.826+0000 7f997f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:12.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.826+0000 7f997f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:12.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.826+0000 7f997f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:12.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.826+0000 7f997f7fe640 10 monclient(hunting): my global_id is 4603 2026-02-24T19:18:12.828 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.826+0000 7f997f7fe640 1 -- 10.20.193.26:0/1099203103 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99881655c0 con 0x7f9988058da0 2026-02-24T19:18:12.828 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.826+0000 7f997f7fe640 1 -- 10.20.193.26:0/1099203103 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 470709639 0 0) 0x7f99880b1590 con 0x7f99881626a0 2026-02-24T19:18:12.828 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.826+0000 7f997f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:18:12.828 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.826+0000 7f997f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:12.828 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.826+0000 7f997f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:12.828 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.826+0000 7f997f7fe640 10 monclient(hunting): my global_id is 4661 2026-02-24T19:18:12.828 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.826+0000 7f997f7fe640 1 -- 10.20.193.26:0/1099203103 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99880b12b0 con 0x7f99881626a0 2026-02-24T19:18:12.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.828+0000 7f997f7fe640 1 -- 10.20.193.26:0/1099203103 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 143391930 0 0) 0x7f99880b12b0 con 0x7f99881626a0 2026-02-24T19:18:12.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.828+0000 7f997f7fe640 1 -- 10.20.193.26:0/1099203103 >> v1:10.20.193.70:6789/0 conn(0x7f9988058da0 legacy=0x7f99881647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.828+0000 7f997f7fe640 1 -- 10.20.193.26:0/1099203103 >> v1:10.20.193.26:6789/0 conn(0x7f99880b0410 legacy=0x7f9988164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.828+0000 7f997f7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:18:12.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.828+0000 7f997f7fe640 1 monclient: found mon.noname-c 2026-02-24T19:18:12.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.828+0000 7f997f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:12.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.828+0000 7f997f7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:12.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.828+0000 7f997f7fe640 1 -- 10.20.193.26:0/1099203103 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99880b1870 con 0x7f99881626a0 2026-02-24T19:18:12.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.828+0000 7f997f7fe640 10 monclient: _finish_auth 0 2026-02-24T19:18:12.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.828+0000 7f997f7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:18:12.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.828+0000 7f997f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:12.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.828+0000 7f997f7fe640 1 -- 10.20.193.26:0/1099203103 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9984003150 con 0x7f99881626a0 2026-02-24T19:18:12.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.828+0000 7f998eecd640 5 monclient: authenticate success, global_id 4661 2026-02-24T19:18:12.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.828+0000 7f998eecd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:12.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.828+0000 7f997f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:12.830 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.828+0000 7f997f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:12.830 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.828+0000 7f997f7fe640 10 monclient: dump: 2026-02-24T19:18:12.830 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.830 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.830 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.830 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.830 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.830 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.830 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.830 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.830 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.830 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.830 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.828+0000 7f998eecd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:12.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.829+0000 7f997f7fe640 1 -- 10.20.193.26:0/1099203103 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f99840032f0 con 0x7f99881626a0 2026-02-24T19:18:12.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.829+0000 7f997f7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:12.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.829+0000 7f997f7fe640 1 -- 10.20.193.26:0/1099203103 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f99840036f0 con 0x7f99881626a0 2026-02-24T19:18:12.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.829+0000 7f997f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:12.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.829+0000 7f997f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:12.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.829+0000 7f997f7fe640 10 monclient: dump: 2026-02-24T19:18:12.831 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.831 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.831 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.831 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.831 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.831 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.831 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.831 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.831 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.831 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.829+0000 7f998eecd640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:12.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.829+0000 7f998eecd640 4 set_mon_vals no callback set 2026-02-24T19:18:12.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.829+0000 7f998eecd640 10 monclient: shutdown 2026-02-24T19:18:12.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.829+0000 7f998eecd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:12.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.829+0000 7f998eecd640 1 -- 10.20.193.26:0/1099203103 >> v1:10.20.193.103:6789/0 conn(0x7f99881626a0 legacy=0x7f99881c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.829+0000 7f998eecd640 1 -- 10.20.193.26:0/1099203103 shutdown_connections 2026-02-24T19:18:12.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.829+0000 7f998eecd640 1 -- 10.20.193.26:0/1099203103 >> 10.20.193.26:0/1099203103 conn(0x7f99880b65f0 msgr2=0x7f99880b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:12.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.829+0000 7f998eecd640 1 -- 10.20.193.26:0/1099203103 shutdown_connections 2026-02-24T19:18:12.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.829+0000 7f998eecd640 1 -- 10.20.193.26:0/1099203103 wait complete. 2026-02-24T19:18:12.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.829+0000 7f998eecd640 10 monclient: build_initial_monmap 2026-02-24T19:18:12.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.829+0000 7f998eecd640 10 monclient: monmap: 2026-02-24T19:18:12.832 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:12.832 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:12.832 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:12.832 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:12.832 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:12.832 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:12.832 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:12.832 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:12.832 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:12.832 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.832 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.830+0000 7f998eecd640 1 librados: starting msgr at 2026-02-24T19:18:12.832 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.830+0000 7f998eecd640 1 librados: starting objecter 2026-02-24T19:18:12.832 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.830+0000 7f998eecd640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:12.832 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.830+0000 7f998eecd640 1 Processor -- start 2026-02-24T19:18:12.832 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.830+0000 7f998eecd640 1 -- start start 2026-02-24T19:18:12.832 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.830+0000 7f998eecd640 1 librados: setting wanted keys 2026-02-24T19:18:12.832 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.830+0000 7f998eecd640 1 librados: calling monclient init 2026-02-24T19:18:12.832 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.830+0000 7f998eecd640 10 monclient: init 2026-02-24T19:18:12.833 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.830+0000 7f998eecd640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:12.833 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.830+0000 7f998eecd640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:18:12.833 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.830+0000 7f998eecd640 10 monclient(hunting): picked mon.noname-c con 0x7f9988058da0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:12.833 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.830+0000 7f998eecd640 10 monclient(hunting): picked mon.noname-a con 0x7f99880b0410 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:12.833 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.830+0000 7f998eecd640 10 monclient(hunting): picked mon.noname-b con 0x7f99881626a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:12.833 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.830+0000 7f998eecd640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99880a79e0 con 0x7f99880b0410 2026-02-24T19:18:12.833 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.830+0000 7f998eecd640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99881212e0 con 0x7f99881626a0 2026-02-24T19:18:12.833 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.830+0000 7f998eecd640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99881215c0 con 0x7f9988058da0 2026-02-24T19:18:12.833 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.830+0000 7f998eecd640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:12.833 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.830+0000 7f998eecd640 10 monclient(hunting): authenticate will time out at 3675.512641s 2026-02-24T19:18:12.833 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.830+0000 7f997ffff640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f99880b0410 0x7f99880574a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:38228/0 (socket says 10.20.193.26:38228) 2026-02-24T19:18:12.833 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.830+0000 7f997ffff640 1 -- 10.20.193.26:0/1000760597 learned_addr learned my addr 10.20.193.26:0/1000760597 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:12.833 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.831+0000 7f997d7fa640 10 client.?.objecter ms_handle_connect 0x7f99880b0410 2026-02-24T19:18:12.833 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.831+0000 7f997d7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:12.833 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.831+0000 7f997d7fa640 10 client.?.objecter ms_handle_connect 0x7f99881626a0 2026-02-24T19:18:12.833 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.831+0000 7f997d7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:12.833 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.831+0000 7f997d7fa640 10 client.?.objecter ms_handle_connect 0x7f9988058da0 2026-02-24T19:18:12.833 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.831+0000 7f997d7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:12.833 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.832+0000 7f997d7fa640 1 -- 10.20.193.26:0/1000760597 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3862995555 0 0) 0x7f99880a79e0 con 0x7f99880b0410 2026-02-24T19:18:12.833 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.832+0000 7f997d7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:18:12.834 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.832+0000 7f997d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:12.834 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.832+0000 7f997d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:12.834 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.832+0000 7f997d7fa640 10 monclient(hunting): my global_id is 4647 2026-02-24T19:18:12.834 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.832+0000 7f997d7fa640 1 -- 10.20.193.26:0/1000760597 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9958003610 con 0x7f99880b0410 2026-02-24T19:18:12.834 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.832+0000 7f997d7fa640 1 -- 10.20.193.26:0/1000760597 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3110864894 0 0) 0x7f99881212e0 con 0x7f99881626a0 2026-02-24T19:18:12.834 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.832+0000 7f997d7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:18:12.834 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.832+0000 7f997d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:12.834 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.832+0000 7f997d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:12.834 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.832+0000 7f997d7fa640 10 monclient(hunting): my global_id is 4606 2026-02-24T19:18:12.834 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.832+0000 7f997d7fa640 1 -- 10.20.193.26:0/1000760597 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99880a79e0 con 0x7f99881626a0 2026-02-24T19:18:12.834 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.832+0000 7f997d7fa640 1 -- 10.20.193.26:0/1000760597 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 625774333 0 0) 0x7f99881215c0 con 0x7f9988058da0 2026-02-24T19:18:12.834 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.832+0000 7f997d7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:18:12.834 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.832+0000 7f997d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:12.834 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.832+0000 7f997d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:12.834 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.832+0000 7f997d7fa640 10 monclient(hunting): my global_id is 4664 2026-02-24T19:18:12.834 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.832+0000 7f997d7fa640 1 -- 10.20.193.26:0/1000760597 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99881212e0 con 0x7f9988058da0 2026-02-24T19:18:12.835 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.834+0000 7f997d7fa640 1 -- 10.20.193.26:0/1000760597 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1839138539 0 0) 0x7f9958003610 con 0x7f99880b0410 2026-02-24T19:18:12.835 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.834+0000 7f997d7fa640 1 -- 10.20.193.26:0/1000760597 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f99881215c0 con 0x7f99880b0410 2026-02-24T19:18:12.835 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.834+0000 7f997d7fa640 1 -- 10.20.193.26:0/1000760597 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f99700030b0 con 0x7f99880b0410 2026-02-24T19:18:12.835 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.834+0000 7f997d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:12.835 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.834+0000 7f997d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:12.835 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.834+0000 7f997d7fa640 10 monclient(hunting): dump: 2026-02-24T19:18:12.835 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.835 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.835 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.835 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.835 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.835 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.835 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.835 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.835 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.835 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.835 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.834+0000 7f997d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:12.836 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.834+0000 7f997d7fa640 1 -- 10.20.193.26:0/1000760597 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2365742478 0 0) 0x7f99880a79e0 con 0x7f99881626a0 2026-02-24T19:18:12.836 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.834+0000 7f997d7fa640 1 -- 10.20.193.26:0/1000760597 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9958003610 con 0x7f99881626a0 2026-02-24T19:18:12.836 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.834+0000 7f997d7fa640 1 -- 10.20.193.26:0/1000760597 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9984003640 con 0x7f99881626a0 2026-02-24T19:18:12.836 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.834+0000 7f997d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:12.836 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.834+0000 7f997d7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:12.836 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.834+0000 7f997d7fa640 10 monclient(hunting): dump: 2026-02-24T19:18:12.836 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.836 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.836 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.836 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.836 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.836 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.836 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.836 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.836 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.836 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.836 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.835+0000 7f997d7fa640 1 -- 10.20.193.26:0/1000760597 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 19812469 0 0) 0x7f99881212e0 con 0x7f9988058da0 2026-02-24T19:18:12.836 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.835+0000 7f997d7fa640 1 -- 10.20.193.26:0/1000760597 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f99880a79e0 con 0x7f9988058da0 2026-02-24T19:18:12.836 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.835+0000 7f997d7fa640 1 -- 10.20.193.26:0/1000760597 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f99780031c0 con 0x7f9988058da0 2026-02-24T19:18:12.836 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.835+0000 7f997d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:12.837 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.835+0000 7f997d7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:12.837 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.835+0000 7f997d7fa640 10 monclient(hunting): dump: 2026-02-24T19:18:12.837 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.837 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.837 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.837 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.837 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.837 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.837 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.837 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.837 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.837 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.837 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.836+0000 7f997d7fa640 1 -- 10.20.193.26:0/1000760597 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2736501147 0 0) 0x7f99881215c0 con 0x7f99880b0410 2026-02-24T19:18:12.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.836+0000 7f997d7fa640 1 -- 10.20.193.26:0/1000760597 >> v1:10.20.193.103:6789/0 conn(0x7f9988058da0 legacy=0x7f99880a81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.836+0000 7f997d7fa640 1 -- 10.20.193.26:0/1000760597 >> v1:10.20.193.70:6789/0 conn(0x7f99881626a0 legacy=0x7f99881164c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:12.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.836+0000 7f997d7fa640 10 monclient: _finish_hunting 0 2026-02-24T19:18:12.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.836+0000 7f997d7fa640 1 monclient: found mon.a 2026-02-24T19:18:12.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.836+0000 7f997d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:12.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.836+0000 7f997d7fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:12.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.836+0000 7f997d7fa640 1 -- 10.20.193.26:0/1000760597 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99881218a0 con 0x7f99880b0410 2026-02-24T19:18:12.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.836+0000 7f997d7fa640 10 monclient: _finish_auth 0 2026-02-24T19:18:12.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.836+0000 7f997d7fa640 10 monclient: _check_auth_tickets 2026-02-24T19:18:12.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.836+0000 7f997d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:12.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.836+0000 7f998eecd640 5 monclient: authenticate success, global_id 4647 2026-02-24T19:18:12.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.836+0000 7f998eecd640 10 monclient: _renew_subs 2026-02-24T19:18:12.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.836+0000 7f998eecd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:12.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.836+0000 7f998eecd640 1 -- 10.20.193.26:0/1000760597 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9988121b80 con 0x7f99880b0410 2026-02-24T19:18:12.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.836+0000 7f998eecd640 10 client.4647.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:12.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.836+0000 7f998eecd640 10 monclient: _renew_subs 2026-02-24T19:18:12.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.836+0000 7f998eecd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:12.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.836+0000 7f998eecd640 1 -- 10.20.193.26:0/1000760597 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f99881150d0 con 0x7f99880b0410 2026-02-24T19:18:12.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.836+0000 7f998eecd640 1 librados: init done 2026-02-24T19:18:12.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.836+0000 7f998eecd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:12.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.836+0000 7f998eecd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:12.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.836+0000 7f998eecd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:12.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.836+0000 7f998eecd640 1 -- 10.20.193.26:0/1000760597 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9988055260 con 0x7f99880b0410 2026-02-24T19:18:12.845 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.844+0000 7f997d7fa640 1 -- 10.20.193.26:0/1000760597 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f99700048d0 con 0x7f99880b0410 2026-02-24T19:18:12.845 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.844+0000 7f997d7fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:12.845 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.844+0000 7f997d7fa640 1 -- 10.20.193.26:0/1000760597 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9970004c20 con 0x7f99880b0410 2026-02-24T19:18:12.845 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.844+0000 7f997d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:12.845 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.844+0000 7f997d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:12.845 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.844+0000 7f997d7fa640 10 monclient: dump: 2026-02-24T19:18:12.845 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:12.845 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:12.845 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.845 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:12.846 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:12.846 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:12.846 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:12.846 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:12.846 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:12.846 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:12.846 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.844+0000 7f997effd640 4 set_mon_vals no callback set 2026-02-24T19:18:12.846 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.845+0000 7f997d7fa640 1 -- 10.20.193.26:0/1000760597 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f997001da90 con 0x7f99880b0410 2026-02-24T19:18:12.846 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.846+0000 7f998cc42640 10 monclient: get_auth_request con 0x7f9958077ea0 auth_method 0 2026-02-24T19:18:12.847 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.846+0000 7f997d7fa640 10 client.4647.objecter ms_handle_connect 0x7f9958077ea0 2026-02-24T19:18:12.848 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.847+0000 7f997d7fa640 1 -- 10.20.193.26:0/1000760597 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f9970093200 con 0x7f99880b0410 2026-02-24T19:18:12.848 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.847+0000 7f997d7fa640 10 client.4647.objecter ms_dispatch2 0x7f9988000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:12.848 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.847+0000 7f997d7fa640 3 client.4647.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:12.848 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.847+0000 7f997d7fa640 3 client.4647.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:12.848 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.847+0000 7f997d7fa640 20 client.4647.objecter dump_active .. 0 homeless 2026-02-24T19:18:12.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.929+0000 7f997d7fa640 1 -- 10.20.193.26:0/1000760597 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f9988055260 con 0x7f99880b0410 2026-02-24T19:18:12.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.929+0000 7f997d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:12.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:12.929+0000 7f997d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:13.034 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.033+0000 7f998eecd640 1 -- 10.20.193.26:0/1000760597 --> v1:10.20.193.162:6800/3889602630 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9988121dc0 con 0x7f9958077ea0 2026-02-24T19:18:13.035 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.034+0000 7f997d7fa640 1 -- 10.20.193.26:0/1000760597 <== mgr.4107 v1:10.20.193.162:6800/3889602630 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+42812 (unknown 2965378022 0 2553229814) 0x7f9988121dc0 con 0x7f9958077ea0 2026-02-24T19:18:13.035 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:18:13.035 INFO:teuthology.orchestra.run.trial026.stderr:dumped all 2026-02-24T19:18:13.036 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.035+0000 7f998eecd640 10 librados: watch_flush enter 2026-02-24T19:18:13.036 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.035+0000 7f998eecd640 10 librados: watch_flush exit 2026-02-24T19:18:13.036 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.035+0000 7f998eecd640 20 client.4647.objecter shutdown clearing up homeless session... 2026-02-24T19:18:13.036 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.035+0000 7f998eecd640 10 client.4647.objecter successfully canceled tick 2026-02-24T19:18:13.036 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.035+0000 7f998eecd640 1 -- 10.20.193.26:0/1000760597 >> v1:10.20.193.162:6800/3889602630 conn(0x7f9958077ea0 legacy=0x7f9958098350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:13.036 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.035+0000 7f998eecd640 10 monclient: shutdown 2026-02-24T19:18:13.036 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.035+0000 7f998eecd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:13.036 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.035+0000 7f998eecd640 1 -- 10.20.193.26:0/1000760597 >> v1:10.20.193.26:6789/0 conn(0x7f99880b0410 legacy=0x7f99880574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:13.036 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.035+0000 7f998eecd640 1 -- 10.20.193.26:0/1000760597 shutdown_connections 2026-02-24T19:18:13.036 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.035+0000 7f998eecd640 1 -- 10.20.193.26:0/1000760597 >> 10.20.193.26:0/1000760597 conn(0x7f99880b65f0 msgr2=0x7f9988164430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:13.036 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.035+0000 7f998eecd640 1 -- 10.20.193.26:0/1000760597 shutdown_connections 2026-02-24T19:18:13.036 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.035+0000 7f998eecd640 1 -- 10.20.193.26:0/1000760597 wait complete. 2026-02-24T19:18:13.036 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.035+0000 7f998eecd640 1 librados: shutdown 2026-02-24T19:18:13.044 INFO:teuthology.orchestra.run.trial026.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2026-02-24T19:18:12.598077+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":436632,"kb_used_data":5272,"kb_used_omap":144,"kb_used_meta":430959,"kb_avail":1509512808,"statfs":{"total":1546188226560,"available":1545741115392,"internally_reserved":0,"allocated":5398528,"data_stored":2813014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":148202,"internal_metadata":441302294},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":131107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":18,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.999091"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:18:07.812429+0000","last_change":"2026-02-24T19:18:07.814826+0000","last_active":"2026-02-24T19:18:07.812429+0000","last_peered":"2026-02-24T19:18:07.812429+0000","last_clean":"2026-02-24T19:18:07.812429+0000","last_became_active":"2026-02-24T19:18:06.131387+0000","last_became_peered":"2026-02-24T19:18:06.131387+0000","last_unstale":"2026-02-24T19:18:07.812429+0000","last_undegraded":"2026-02-24T19:18:07.812429+0000","last_fullsized":"2026-02-24T19:18:07.812429+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:38:29.559020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060150395000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:18:08.267309+0000","last_change":"2026-02-24T19:18:08.286588+0000","last_active":"2026-02-24T19:18:08.267309+0000","last_peered":"2026-02-24T19:18:08.267309+0000","last_clean":"2026-02-24T19:18:08.267309+0000","last_became_active":"2026-02-24T19:18:05.714006+0000","last_became_peered":"2026-02-24T19:18:05.714006+0000","last_unstale":"2026-02-24T19:18:08.267309+0000","last_undegraded":"2026-02-24T19:18:08.267309+0000","last_fullsized":"2026-02-24T19:18:08.267309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:57:02.402866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030292255000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,10],"acting":[15,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:18:07.725160+0000","last_change":"2026-02-24T19:18:07.750038+0000","last_active":"2026-02-24T19:18:07.725160+0000","last_peered":"2026-02-24T19:18:07.725160+0000","last_clean":"2026-02-24T19:18:07.725160+0000","last_became_active":"2026-02-24T19:18:06.025485+0000","last_became_peered":"2026-02-24T19:18:06.025485+0000","last_unstale":"2026-02-24T19:18:07.725160+0000","last_undegraded":"2026-02-24T19:18:07.725160+0000","last_fullsized":"2026-02-24T19:18:07.725160+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:00:12.835602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.040704530000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:18:07.726929+0000","last_change":"2026-02-24T19:18:07.747179+0000","last_active":"2026-02-24T19:18:07.726929+0000","last_peered":"2026-02-24T19:18:07.726929+0000","last_clean":"2026-02-24T19:18:07.726929+0000","last_became_active":"2026-02-24T19:18:05.911513+0000","last_became_peered":"2026-02-24T19:18:05.911513+0000","last_unstale":"2026-02-24T19:18:07.726929+0000","last_undegraded":"2026-02-24T19:18:07.726929+0000","last_fullsized":"2026-02-24T19:18:07.726929+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:16:20.335977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027602962000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:18:07.812765+0000","last_change":"2026-02-24T19:18:07.812765+0000","last_active":"2026-02-24T19:18:07.812765+0000","last_peered":"2026-02-24T19:18:07.812765+0000","last_clean":"2026-02-24T19:18:07.812765+0000","last_became_active":"2026-02-24T19:18:06.102285+0000","last_became_peered":"2026-02-24T19:18:06.102285+0000","last_unstale":"2026-02-24T19:18:07.812765+0000","last_undegraded":"2026-02-24T19:18:07.812765+0000","last_fullsized":"2026-02-24T19:18:07.812765+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T07:17:19.620766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071463911000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:18:08.271789+0000","last_change":"2026-02-24T19:18:08.293695+0000","last_active":"2026-02-24T19:18:08.271789+0000","last_peered":"2026-02-24T19:18:08.271789+0000","last_clean":"2026-02-24T19:18:08.271789+0000","last_became_active":"2026-02-24T19:18:06.040390+0000","last_became_peered":"2026-02-24T19:18:06.040390+0000","last_unstale":"2026-02-24T19:18:08.271789+0000","last_undegraded":"2026-02-24T19:18:08.271789+0000","last_fullsized":"2026-02-24T19:18:08.271789+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:59:15.837152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.035880255999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:18:08.353680+0000","last_change":"2026-02-24T19:18:08.371822+0000","last_active":"2026-02-24T19:18:08.353680+0000","last_peered":"2026-02-24T19:18:08.353680+0000","last_clean":"2026-02-24T19:18:08.353680+0000","last_became_active":"2026-02-24T19:18:05.913043+0000","last_became_peered":"2026-02-24T19:18:05.913043+0000","last_unstale":"2026-02-24T19:18:08.353680+0000","last_undegraded":"2026-02-24T19:18:08.353680+0000","last_fullsized":"2026-02-24T19:18:08.353680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:07:35.933859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030508101999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"27'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:18:07.751853+0000","last_change":"2026-02-24T19:18:07.773906+0000","last_active":"2026-02-24T19:18:07.751853+0000","last_peered":"2026-02-24T19:18:07.751853+0000","last_clean":"2026-02-24T19:18:07.751853+0000","last_became_active":"2026-02-24T19:18:05.910166+0000","last_became_peered":"2026-02-24T19:18:05.910166+0000","last_unstale":"2026-02-24T19:18:07.751853+0000","last_undegraded":"2026-02-24T19:18:07.751853+0000","last_fullsized":"2026-02-24T19:18:07.751853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:39:15.323606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036726662,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"26'32","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:18:07.721037+0000","last_change":"2026-02-24T19:17:58.600915+0000","last_active":"2026-02-24T19:18:07.721037+0000","last_peered":"2026-02-24T19:18:07.721037+0000","last_clean":"2026-02-24T19:18:07.721037+0000","last_became_active":"2026-02-24T19:17:58.584752+0000","last_became_peered":"2026-02-24T19:17:58.584752+0000","last_unstale":"2026-02-24T19:18:07.721037+0000","last_undegraded":"2026-02-24T19:18:07.721037+0000","last_fullsized":"2026-02-24T19:18:07.721037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:57.017986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:57.017986+0000","last_clean_scrub_stamp":"2026-02-24T19:17:57.017986+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:48:59.744548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,10],"acting":[12,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":21,"seq":90194313222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":126081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9424,"internal_metadata":27581232},"hb_peers":[0,2,4,5,6,7,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":126081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,3,4,5,6,7,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":126081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,2,3,5,6,7,8,9,10,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313221,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":126081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[1,2,4,5,7,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":126081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,2,3,5,6,7,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":126081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[1,3,4,5,6,7,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313221,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":126100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9423,"internal_metadata":27581233},"hb_peers":[0,1,2,4,5,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":126081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,3,5,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":126081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,3,4,6,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":126081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9424,"internal_metadata":27581232},"hb_peers":[1,2,5,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":126081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9420,"internal_metadata":27581236},"hb_peers":[0,2,3,4,5,6,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":126081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,3,4,5,6,7,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313221,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":126081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9430,"internal_metadata":27581226},"hb_peers":[0,1,2,3,4,5,6,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313222,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":672,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":688128,"data_stored":523921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9430,"internal_metadata":27581226},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313222,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":126100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9426,"internal_metadata":27581230},"hb_peers":[0,1,2,4,5,6,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":672,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":688128,"data_stored":523921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,5,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T19:18:13.045 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T19:18:13.111 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.110+0000 7f6159b79640 10 monclient: get_monmap_and_config 2026-02-24T19:18:13.112 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.110+0000 7f6159b79640 10 monclient: build_initial_monmap 2026-02-24T19:18:13.112 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.110+0000 7f6159b79640 10 monclient: monmap: 2026-02-24T19:18:13.112 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:13.112 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:13.112 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:13.111323+0000 2026-02-24T19:18:13.112 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:13.111323+0000 2026-02-24T19:18:13.112 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:13.112 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:13.112 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:13.113 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:13.113 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:13.113 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:13.116 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.111+0000 7f6159b79640 1 Processor -- start 2026-02-24T19:18:13.116 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.111+0000 7f6159b79640 1 -- start start 2026-02-24T19:18:13.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.111+0000 7f6159b79640 10 monclient: init 2026-02-24T19:18:13.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.111+0000 7f6159b79640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:13.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.111+0000 7f6159b79640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:18:13.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.111+0000 7f6159b79640 10 monclient(hunting): picked mon.noname-b con 0x7f6154058da0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:13.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.111+0000 7f6159b79640 10 monclient(hunting): picked mon.noname-c con 0x7f61540b0410 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:13.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.111+0000 7f6159b79640 10 monclient(hunting): picked mon.noname-a con 0x7f61541626a0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:13.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.111+0000 7f6159b79640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61541655c0 con 0x7f61541626a0 2026-02-24T19:18:13.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.111+0000 7f6159b79640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61540b12b0 con 0x7f6154058da0 2026-02-24T19:18:13.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.111+0000 7f6159b79640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61540b1590 con 0x7f61540b0410 2026-02-24T19:18:13.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.111+0000 7f6159b79640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:13.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.111+0000 7f6159b79640 10 monclient(hunting): authenticate will time out at 3675.793654s 2026-02-24T19:18:13.118 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.111+0000 7f61537fe640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f6154058da0 0x7f61541647a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:46488/0 (socket says 10.20.193.26:46488) 2026-02-24T19:18:13.118 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.111+0000 7f61537fe640 1 -- 10.20.193.26:0/406486367 learned_addr learned my addr 10.20.193.26:0/406486367 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:13.118 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.113+0000 7f61527fc640 1 -- 10.20.193.26:0/406486367 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3123046976 0 0) 0x7f61540b12b0 con 0x7f6154058da0 2026-02-24T19:18:13.118 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.113+0000 7f61527fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:13.118 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.113+0000 7f61527fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:13.118 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.113+0000 7f61527fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:13.118 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.113+0000 7f61527fc640 10 monclient(hunting): my global_id is 4609 2026-02-24T19:18:13.118 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.113+0000 7f61527fc640 1 -- 10.20.193.26:0/406486367 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6138003610 con 0x7f6154058da0 2026-02-24T19:18:13.118 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.113+0000 7f61527fc640 1 -- 10.20.193.26:0/406486367 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 18813104 0 0) 0x7f61541655c0 con 0x7f61541626a0 2026-02-24T19:18:13.118 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.113+0000 7f61527fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:13.118 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.113+0000 7f61527fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:13.119 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.113+0000 7f61527fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:13.119 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.113+0000 7f61527fc640 10 monclient(hunting): my global_id is 4650 2026-02-24T19:18:13.119 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.113+0000 7f61527fc640 1 -- 10.20.193.26:0/406486367 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61540b12b0 con 0x7f61541626a0 2026-02-24T19:18:13.119 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.113+0000 7f61527fc640 1 -- 10.20.193.26:0/406486367 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 855262621 0 0) 0x7f61540b1590 con 0x7f61540b0410 2026-02-24T19:18:13.119 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.113+0000 7f61527fc640 10 monclient(hunting): _negotiate 2026-02-24T19:18:13.119 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.113+0000 7f61527fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:13.119 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.113+0000 7f61527fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:13.119 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.113+0000 7f61527fc640 10 monclient(hunting): my global_id is 4667 2026-02-24T19:18:13.119 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.113+0000 7f61527fc640 1 -- 10.20.193.26:0/406486367 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61541655c0 con 0x7f61540b0410 2026-02-24T19:18:13.119 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.114+0000 7f61527fc640 1 -- 10.20.193.26:0/406486367 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 7838623 0 0) 0x7f6138003610 con 0x7f6154058da0 2026-02-24T19:18:13.119 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.114+0000 7f61527fc640 1 -- 10.20.193.26:0/406486367 >> v1:10.20.193.103:6789/0 conn(0x7f61540b0410 legacy=0x7f6154164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:13.119 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.114+0000 7f61527fc640 1 -- 10.20.193.26:0/406486367 >> v1:10.20.193.26:6789/0 conn(0x7f61541626a0 legacy=0x7f61541c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:13.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.114+0000 7f61527fc640 10 monclient: _finish_hunting 0 2026-02-24T19:18:13.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.114+0000 7f61527fc640 1 monclient: found mon.noname-b 2026-02-24T19:18:13.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.114+0000 7f61527fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:13.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.114+0000 7f61527fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:18:13.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.114+0000 7f61527fc640 1 -- 10.20.193.26:0/406486367 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61540b1870 con 0x7f6154058da0 2026-02-24T19:18:13.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.114+0000 7f61527fc640 10 monclient: _finish_auth 0 2026-02-24T19:18:13.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.114+0000 7f61527fc640 10 monclient: _check_auth_tickets 2026-02-24T19:18:13.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.114+0000 7f61527fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:13.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.114+0000 7f61527fc640 1 -- 10.20.193.26:0/406486367 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6140002df0 con 0x7f6154058da0 2026-02-24T19:18:13.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.114+0000 7f61527fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:13.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.114+0000 7f61527fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:18:13.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.114+0000 7f61527fc640 10 monclient: dump: 2026-02-24T19:18:13.121 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:13.121 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:13.121 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:13.121 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:13.121 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:13.121 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:13.121 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:13.121 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:13.121 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:13.121 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:13.122 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.114+0000 7f6159b79640 5 monclient: authenticate success, global_id 4609 2026-02-24T19:18:13.122 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.114+0000 7f6159b79640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:13.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.115+0000 7f61527fc640 1 -- 10.20.193.26:0/406486367 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6140002fc0 con 0x7f6154058da0 2026-02-24T19:18:13.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.115+0000 7f61527fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:13.128 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.115+0000 7f61527fc640 1 -- 10.20.193.26:0/406486367 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6140003400 con 0x7f6154058da0 2026-02-24T19:18:13.128 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.115+0000 7f61527fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:13.128 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.115+0000 7f61527fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:13.128 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.115+0000 7f61527fc640 10 monclient: dump: 2026-02-24T19:18:13.128 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:13.128 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:13.128 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:13.128 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:13.128 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:13.128 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:13.128 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:13.129 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:13.129 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:13.129 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:13.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.115+0000 7f6159b79640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:13.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.115+0000 7f6159b79640 4 set_mon_vals no callback set 2026-02-24T19:18:13.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.116+0000 7f6159b79640 10 monclient: shutdown 2026-02-24T19:18:13.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.116+0000 7f6159b79640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:13.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.116+0000 7f6159b79640 1 -- 10.20.193.26:0/406486367 >> v1:10.20.193.70:6789/0 conn(0x7f6154058da0 legacy=0x7f61541647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:13.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.116+0000 7f6159b79640 1 -- 10.20.193.26:0/406486367 shutdown_connections 2026-02-24T19:18:13.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.116+0000 7f6159b79640 1 -- 10.20.193.26:0/406486367 >> 10.20.193.26:0/406486367 conn(0x7f61540b65f0 msgr2=0x7f61540b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:13.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.116+0000 7f6159b79640 1 -- 10.20.193.26:0/406486367 shutdown_connections 2026-02-24T19:18:13.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.116+0000 7f6159b79640 1 -- 10.20.193.26:0/406486367 wait complete. 2026-02-24T19:18:13.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.116+0000 7f6159b79640 10 monclient: build_initial_monmap 2026-02-24T19:18:13.130 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.116+0000 7f6159b79640 10 monclient: monmap: 2026-02-24T19:18:13.130 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:13.130 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:13.130 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:13.130 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:13.130 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:13.130 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:13.130 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:13.130 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:13.130 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:13.130 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:13.131 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.116+0000 7f6159b79640 1 librados: starting msgr at 2026-02-24T19:18:13.131 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.116+0000 7f6159b79640 1 librados: starting objecter 2026-02-24T19:18:13.131 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.117+0000 7f6159b79640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:13.131 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.117+0000 7f6159b79640 1 Processor -- start 2026-02-24T19:18:13.131 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.117+0000 7f6159b79640 1 -- start start 2026-02-24T19:18:13.131 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.117+0000 7f6159b79640 1 librados: setting wanted keys 2026-02-24T19:18:13.131 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.117+0000 7f6159b79640 1 librados: calling monclient init 2026-02-24T19:18:13.131 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.117+0000 7f6159b79640 10 monclient: init 2026-02-24T19:18:13.131 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.117+0000 7f6159b79640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:13.131 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.117+0000 7f6159b79640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:18:13.131 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.117+0000 7f6159b79640 10 monclient(hunting): picked mon.noname-c con 0x7f6154058da0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:13.131 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.117+0000 7f6159b79640 10 monclient(hunting): picked mon.noname-a con 0x7f61540b0410 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:13.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.117+0000 7f6159b79640 10 monclient(hunting): picked mon.noname-b con 0x7f61541626a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:13.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.117+0000 7f6159b79640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f615413b580 con 0x7f61540b0410 2026-02-24T19:18:13.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.117+0000 7f6159b79640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f615413ec90 con 0x7f61541626a0 2026-02-24T19:18:13.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.117+0000 7f6159b79640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f615413ef70 con 0x7f6154058da0 2026-02-24T19:18:13.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.117+0000 7f6159b79640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:13.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.117+0000 7f6159b79640 10 monclient(hunting): authenticate will time out at 3675.799520s 2026-02-24T19:18:13.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.117+0000 7f6152ffd640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f61540b0410 0x7f6154139190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:38250/0 (socket says 10.20.193.26:38250) 2026-02-24T19:18:13.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.117+0000 7f6152ffd640 1 -- 10.20.193.26:0/1279246839 learned_addr learned my addr 10.20.193.26:0/1279246839 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:13.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.117+0000 7f612ffff640 10 client.?.objecter ms_handle_connect 0x7f61540b0410 2026-02-24T19:18:13.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.117+0000 7f612ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:13.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.118+0000 7f612ffff640 10 client.?.objecter ms_handle_connect 0x7f6154058da0 2026-02-24T19:18:13.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.118+0000 7f612ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:13.133 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.118+0000 7f612ffff640 10 client.?.objecter ms_handle_connect 0x7f61541626a0 2026-02-24T19:18:13.133 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.118+0000 7f612ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:13.133 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.118+0000 7f612ffff640 1 -- 10.20.193.26:0/1279246839 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1747991897 0 0) 0x7f61541655c0 con 0x7f61540b0410 2026-02-24T19:18:13.133 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.118+0000 7f612ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:13.133 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.118+0000 7f612ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:13.133 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.118+0000 7f612ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:13.133 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.118+0000 7f612ffff640 10 monclient(hunting): my global_id is 4653 2026-02-24T19:18:13.133 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.118+0000 7f612ffff640 1 -- 10.20.193.26:0/1279246839 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6124003610 con 0x7f61540b0410 2026-02-24T19:18:13.133 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.119+0000 7f612ffff640 1 -- 10.20.193.26:0/1279246839 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 563107822 0 0) 0x7f615413ef70 con 0x7f6154058da0 2026-02-24T19:18:13.133 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.119+0000 7f612ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:13.133 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.119+0000 7f612ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:13.133 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.119+0000 7f612ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:13.133 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.119+0000 7f612ffff640 10 monclient(hunting): my global_id is 4670 2026-02-24T19:18:13.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.119+0000 7f612ffff640 1 -- 10.20.193.26:0/1279246839 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61541655c0 con 0x7f6154058da0 2026-02-24T19:18:13.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.119+0000 7f612ffff640 1 -- 10.20.193.26:0/1279246839 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 270122512 0 0) 0x7f615413ec90 con 0x7f61541626a0 2026-02-24T19:18:13.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.119+0000 7f612ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:13.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.119+0000 7f612ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:13.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.119+0000 7f612ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:13.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.119+0000 7f612ffff640 10 monclient(hunting): my global_id is 4612 2026-02-24T19:18:13.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.119+0000 7f612ffff640 1 -- 10.20.193.26:0/1279246839 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f615413ef70 con 0x7f61541626a0 2026-02-24T19:18:13.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.120+0000 7f612ffff640 1 -- 10.20.193.26:0/1279246839 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1666208842 0 0) 0x7f6124003610 con 0x7f61540b0410 2026-02-24T19:18:13.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.120+0000 7f612ffff640 1 -- 10.20.193.26:0/1279246839 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f615413ec90 con 0x7f61540b0410 2026-02-24T19:18:13.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.121+0000 7f612ffff640 1 -- 10.20.193.26:0/1279246839 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6144003170 con 0x7f61540b0410 2026-02-24T19:18:13.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.121+0000 7f612ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:13.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.121+0000 7f612ffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:13.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.121+0000 7f612ffff640 10 monclient(hunting): dump: 2026-02-24T19:18:13.135 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:13.135 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:13.135 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:13.135 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:13.135 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:13.135 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:13.135 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:13.135 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:13.135 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:13.135 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:13.135 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.121+0000 7f612ffff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:13.135 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.121+0000 7f612ffff640 1 -- 10.20.193.26:0/1279246839 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1770996670 0 0) 0x7f615413ef70 con 0x7f61541626a0 2026-02-24T19:18:13.136 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.121+0000 7f612ffff640 1 -- 10.20.193.26:0/1279246839 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6124003610 con 0x7f61541626a0 2026-02-24T19:18:13.136 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.121+0000 7f612ffff640 1 -- 10.20.193.26:0/1279246839 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f61480032f0 con 0x7f61541626a0 2026-02-24T19:18:13.136 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.121+0000 7f612ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:13.136 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.121+0000 7f612ffff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:13.136 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.121+0000 7f612ffff640 10 monclient(hunting): dump: 2026-02-24T19:18:13.136 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:13.136 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:13.136 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:13.136 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:13.136 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:13.136 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:13.136 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:13.136 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:13.137 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:13.137 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:13.137 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.121+0000 7f612ffff640 1 -- 10.20.193.26:0/1279246839 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3075037094 0 0) 0x7f61541655c0 con 0x7f6154058da0 2026-02-24T19:18:13.137 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.121+0000 7f612ffff640 1 -- 10.20.193.26:0/1279246839 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f615413ef70 con 0x7f6154058da0 2026-02-24T19:18:13.137 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.121+0000 7f612ffff640 1 -- 10.20.193.26:0/1279246839 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6140003310 con 0x7f6154058da0 2026-02-24T19:18:13.137 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.121+0000 7f612ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:13.137 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.121+0000 7f612ffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:13.137 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.121+0000 7f612ffff640 10 monclient(hunting): dump: 2026-02-24T19:18:13.137 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:13.137 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:13.137 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:13.137 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:13.137 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:13.138 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:13.138 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:13.138 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:13.138 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:13.138 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:13.138 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.122+0000 7f612ffff640 1 -- 10.20.193.26:0/1279246839 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 354803186 0 0) 0x7f615413ec90 con 0x7f61540b0410 2026-02-24T19:18:13.138 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.122+0000 7f612ffff640 1 -- 10.20.193.26:0/1279246839 >> v1:10.20.193.103:6789/0 conn(0x7f6154058da0 legacy=0x7f61541fa240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:13.138 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.122+0000 7f612ffff640 1 -- 10.20.193.26:0/1279246839 >> v1:10.20.193.70:6789/0 conn(0x7f61541626a0 legacy=0x7f61541fc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:13.138 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.122+0000 7f612ffff640 10 monclient: _finish_hunting 0 2026-02-24T19:18:13.138 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.122+0000 7f612ffff640 1 monclient: found mon.a 2026-02-24T19:18:13.138 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.122+0000 7f612ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:13.138 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.122+0000 7f612ffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:13.138 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.122+0000 7f612ffff640 1 -- 10.20.193.26:0/1279246839 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f615413f250 con 0x7f61540b0410 2026-02-24T19:18:13.139 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.122+0000 7f612ffff640 10 monclient: _finish_auth 0 2026-02-24T19:18:13.139 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.122+0000 7f612ffff640 10 monclient: _check_auth_tickets 2026-02-24T19:18:13.139 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.122+0000 7f612ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:13.139 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.122+0000 7f6159b79640 5 monclient: authenticate success, global_id 4653 2026-02-24T19:18:13.139 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.122+0000 7f6159b79640 10 monclient: _renew_subs 2026-02-24T19:18:13.139 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.122+0000 7f6159b79640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:13.139 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.122+0000 7f6159b79640 1 -- 10.20.193.26:0/1279246839 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f615413f530 con 0x7f61540b0410 2026-02-24T19:18:13.139 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.122+0000 7f6159b79640 10 client.4653.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:13.139 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.122+0000 7f6159b79640 10 monclient: _renew_subs 2026-02-24T19:18:13.139 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.122+0000 7f6159b79640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:13.139 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.122+0000 7f6159b79640 1 -- 10.20.193.26:0/1279246839 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6154140010 con 0x7f61540b0410 2026-02-24T19:18:13.139 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.122+0000 7f6159b79640 1 librados: init done 2026-02-24T19:18:13.139 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.123+0000 7f6159b79640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:13.140 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.123+0000 7f6159b79640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:13.140 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.123+0000 7f6159b79640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:13.140 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.123+0000 7f6159b79640 1 -- 10.20.193.26:0/1279246839 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6154164050 con 0x7f61540b0410 2026-02-24T19:18:13.141 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.130+0000 7f612ffff640 1 -- 10.20.193.26:0/1279246839 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6144003520 con 0x7f61540b0410 2026-02-24T19:18:13.141 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.130+0000 7f612ffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:13.141 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.130+0000 7f612ffff640 1 -- 10.20.193.26:0/1279246839 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6144003b50 con 0x7f61540b0410 2026-02-24T19:18:13.141 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.130+0000 7f612ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:13.141 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.130+0000 7f612ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:13.142 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.130+0000 7f612ffff640 10 monclient: dump: 2026-02-24T19:18:13.142 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:13.142 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:13.142 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:13.142 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:13.142 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:13.142 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:13.142 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:13.142 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:13.142 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:13.142 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:13.142 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.130+0000 7f6151ffb640 4 set_mon_vals no callback set 2026-02-24T19:18:13.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.131+0000 7f612ffff640 1 -- 10.20.193.26:0/1279246839 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f6144003d30 con 0x7f61540b0410 2026-02-24T19:18:13.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.131+0000 7f61537fe640 10 monclient: get_auth_request con 0x7f6124077f60 auth_method 0 2026-02-24T19:18:13.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.131+0000 7f612ffff640 1 -- 10.20.193.26:0/1279246839 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f6144093290 con 0x7f61540b0410 2026-02-24T19:18:13.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.131+0000 7f612ffff640 10 client.4653.objecter ms_dispatch2 0x7f6154000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:13.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.131+0000 7f612ffff640 3 client.4653.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:13.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.131+0000 7f612ffff640 3 client.4653.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:13.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.131+0000 7f612ffff640 20 client.4653.objecter dump_active .. 0 homeless 2026-02-24T19:18:13.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.131+0000 7f612ffff640 10 client.4653.objecter ms_handle_connect 0x7f6124077f60 2026-02-24T19:18:13.218 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.216+0000 7f612ffff640 1 -- 10.20.193.26:0/1279246839 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f615413b580 con 0x7f61540b0410 2026-02-24T19:18:13.218 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.216+0000 7f612ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:13.218 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.216+0000 7f612ffff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:13.324 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.323+0000 7f6159b79640 1 -- 10.20.193.26:0/1279246839 --> v1:10.20.193.162:6800/3889602630 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f61540b6ca0 con 0x7f6124077f60 2026-02-24T19:18:13.325 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.324+0000 7f612ffff640 1 -- 10.20.193.26:0/1279246839 <== mgr.4107 v1:10.20.193.162:6800/3889602630 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+42812 (unknown 2965378022 0 2553229814) 0x7f61540b6ca0 con 0x7f6124077f60 2026-02-24T19:18:13.326 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:18:13.326 INFO:teuthology.orchestra.run.trial026.stderr:dumped all 2026-02-24T19:18:13.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.326+0000 7f6159b79640 10 librados: watch_flush enter 2026-02-24T19:18:13.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.326+0000 7f6159b79640 10 librados: watch_flush exit 2026-02-24T19:18:13.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.326+0000 7f6159b79640 20 client.4653.objecter shutdown clearing up homeless session... 2026-02-24T19:18:13.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.326+0000 7f6159b79640 10 client.4653.objecter successfully canceled tick 2026-02-24T19:18:13.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.326+0000 7f6159b79640 1 -- 10.20.193.26:0/1279246839 >> v1:10.20.193.162:6800/3889602630 conn(0x7f6124077f60 legacy=0x7f6124098410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:13.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.326+0000 7f6159b79640 10 monclient: shutdown 2026-02-24T19:18:13.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.326+0000 7f6159b79640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:13.328 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.326+0000 7f6159b79640 1 -- 10.20.193.26:0/1279246839 >> v1:10.20.193.26:6789/0 conn(0x7f61540b0410 legacy=0x7f6154139190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:13.329 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.326+0000 7f6159b79640 1 -- 10.20.193.26:0/1279246839 shutdown_connections 2026-02-24T19:18:13.329 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.326+0000 7f6159b79640 1 -- 10.20.193.26:0/1279246839 >> 10.20.193.26:0/1279246839 conn(0x7f61540b65f0 msgr2=0x7f6154059bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:13.329 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.326+0000 7f6159b79640 1 -- 10.20.193.26:0/1279246839 shutdown_connections 2026-02-24T19:18:13.329 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.326+0000 7f6159b79640 1 -- 10.20.193.26:0/1279246839 wait complete. 2026-02-24T19:18:13.329 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.326+0000 7f6159b79640 1 librados: shutdown 2026-02-24T19:18:13.337 INFO:teuthology.orchestra.run.trial026.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2026-02-24T19:18:12.598077+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":436632,"kb_used_data":5272,"kb_used_omap":144,"kb_used_meta":430959,"kb_avail":1509512808,"statfs":{"total":1546188226560,"available":1545741115392,"internally_reserved":0,"allocated":5398528,"data_stored":2813014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":148202,"internal_metadata":441302294},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":131107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":18,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.999091"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:18:07.812429+0000","last_change":"2026-02-24T19:18:07.814826+0000","last_active":"2026-02-24T19:18:07.812429+0000","last_peered":"2026-02-24T19:18:07.812429+0000","last_clean":"2026-02-24T19:18:07.812429+0000","last_became_active":"2026-02-24T19:18:06.131387+0000","last_became_peered":"2026-02-24T19:18:06.131387+0000","last_unstale":"2026-02-24T19:18:07.812429+0000","last_undegraded":"2026-02-24T19:18:07.812429+0000","last_fullsized":"2026-02-24T19:18:07.812429+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:38:29.559020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060150395000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:18:08.267309+0000","last_change":"2026-02-24T19:18:08.286588+0000","last_active":"2026-02-24T19:18:08.267309+0000","last_peered":"2026-02-24T19:18:08.267309+0000","last_clean":"2026-02-24T19:18:08.267309+0000","last_became_active":"2026-02-24T19:18:05.714006+0000","last_became_peered":"2026-02-24T19:18:05.714006+0000","last_unstale":"2026-02-24T19:18:08.267309+0000","last_undegraded":"2026-02-24T19:18:08.267309+0000","last_fullsized":"2026-02-24T19:18:08.267309+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:57:02.402866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030292255000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,10],"acting":[15,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:18:07.725160+0000","last_change":"2026-02-24T19:18:07.750038+0000","last_active":"2026-02-24T19:18:07.725160+0000","last_peered":"2026-02-24T19:18:07.725160+0000","last_clean":"2026-02-24T19:18:07.725160+0000","last_became_active":"2026-02-24T19:18:06.025485+0000","last_became_peered":"2026-02-24T19:18:06.025485+0000","last_unstale":"2026-02-24T19:18:07.725160+0000","last_undegraded":"2026-02-24T19:18:07.725160+0000","last_fullsized":"2026-02-24T19:18:07.725160+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:00:12.835602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.040704530000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:18:07.726929+0000","last_change":"2026-02-24T19:18:07.747179+0000","last_active":"2026-02-24T19:18:07.726929+0000","last_peered":"2026-02-24T19:18:07.726929+0000","last_clean":"2026-02-24T19:18:07.726929+0000","last_became_active":"2026-02-24T19:18:05.911513+0000","last_became_peered":"2026-02-24T19:18:05.911513+0000","last_unstale":"2026-02-24T19:18:07.726929+0000","last_undegraded":"2026-02-24T19:18:07.726929+0000","last_fullsized":"2026-02-24T19:18:07.726929+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:16:20.335977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027602962000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"29'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:18:07.812765+0000","last_change":"2026-02-24T19:18:07.812765+0000","last_active":"2026-02-24T19:18:07.812765+0000","last_peered":"2026-02-24T19:18:07.812765+0000","last_clean":"2026-02-24T19:18:07.812765+0000","last_became_active":"2026-02-24T19:18:06.102285+0000","last_became_peered":"2026-02-24T19:18:06.102285+0000","last_unstale":"2026-02-24T19:18:07.812765+0000","last_undegraded":"2026-02-24T19:18:07.812765+0000","last_fullsized":"2026-02-24T19:18:07.812765+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T07:17:19.620766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071463911000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:18:08.271789+0000","last_change":"2026-02-24T19:18:08.293695+0000","last_active":"2026-02-24T19:18:08.271789+0000","last_peered":"2026-02-24T19:18:08.271789+0000","last_clean":"2026-02-24T19:18:08.271789+0000","last_became_active":"2026-02-24T19:18:06.040390+0000","last_became_peered":"2026-02-24T19:18:06.040390+0000","last_unstale":"2026-02-24T19:18:08.271789+0000","last_undegraded":"2026-02-24T19:18:08.271789+0000","last_fullsized":"2026-02-24T19:18:08.271789+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:59:15.837152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.035880255999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:18:08.353680+0000","last_change":"2026-02-24T19:18:08.371822+0000","last_active":"2026-02-24T19:18:08.353680+0000","last_peered":"2026-02-24T19:18:08.353680+0000","last_clean":"2026-02-24T19:18:08.353680+0000","last_became_active":"2026-02-24T19:18:05.913043+0000","last_became_peered":"2026-02-24T19:18:05.913043+0000","last_unstale":"2026-02-24T19:18:08.353680+0000","last_undegraded":"2026-02-24T19:18:08.353680+0000","last_fullsized":"2026-02-24T19:18:08.353680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:07:35.933859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030508101999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"27'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:18:07.751853+0000","last_change":"2026-02-24T19:18:07.773906+0000","last_active":"2026-02-24T19:18:07.751853+0000","last_peered":"2026-02-24T19:18:07.751853+0000","last_clean":"2026-02-24T19:18:07.751853+0000","last_became_active":"2026-02-24T19:18:05.910166+0000","last_became_peered":"2026-02-24T19:18:05.910166+0000","last_unstale":"2026-02-24T19:18:07.751853+0000","last_undegraded":"2026-02-24T19:18:07.751853+0000","last_fullsized":"2026-02-24T19:18:07.751853+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:39:15.323606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036726662,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"26'32","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2026-02-24T19:18:07.721037+0000","last_change":"2026-02-24T19:17:58.600915+0000","last_active":"2026-02-24T19:18:07.721037+0000","last_peered":"2026-02-24T19:18:07.721037+0000","last_clean":"2026-02-24T19:18:07.721037+0000","last_became_active":"2026-02-24T19:17:58.584752+0000","last_became_peered":"2026-02-24T19:17:58.584752+0000","last_unstale":"2026-02-24T19:18:07.721037+0000","last_undegraded":"2026-02-24T19:18:07.721037+0000","last_fullsized":"2026-02-24T19:18:07.721037+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:57.017986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:57.017986+0000","last_clean_scrub_stamp":"2026-02-24T19:17:57.017986+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:48:59.744548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,10],"acting":[12,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":21,"seq":90194313222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":126081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9424,"internal_metadata":27581232},"hb_peers":[0,2,4,5,6,7,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":126081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,3,4,5,6,7,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":126081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,1,2,3,5,6,7,8,9,10,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313221,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":126081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[1,2,4,5,7,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":126081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,2,3,5,6,7,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":126081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[1,3,4,5,6,7,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313221,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":126100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9423,"internal_metadata":27581233},"hb_peers":[0,1,2,4,5,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":126081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9425,"internal_metadata":27581231},"hb_peers":[0,3,5,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":126081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,3,4,6,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":126081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9424,"internal_metadata":27581232},"hb_peers":[1,2,5,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":126081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9420,"internal_metadata":27581236},"hb_peers":[0,2,3,4,5,6,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":126081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,3,4,5,6,7,9,11,12,13],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313221,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":280,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":286720,"data_stored":126081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9430,"internal_metadata":27581226},"hb_peers":[0,1,2,3,4,5,6,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313222,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":672,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":688128,"data_stored":523921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9430,"internal_metadata":27581226},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11,12],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313222,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":284,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":290816,"data_stored":126100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9426,"internal_metadata":27581230},"hb_peers":[0,1,2,4,5,6,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":672,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":688128,"data_stored":523921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,5,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T19:18:13.339 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-24T19:18:13.339 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-24T19:18:13.339 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-24T19:18:13.339 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-24T19:18:13.407 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.405+0000 7f9c9042b640 10 monclient: get_monmap_and_config 2026-02-24T19:18:13.407 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.405+0000 7f9c9042b640 10 monclient: build_initial_monmap 2026-02-24T19:18:13.407 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.405+0000 7f9c9042b640 10 monclient: monmap: 2026-02-24T19:18:13.407 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:13.407 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:13.408 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:18:13.406481+0000 2026-02-24T19:18:13.408 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:18:13.406481+0000 2026-02-24T19:18:13.408 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:13.408 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:13.408 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:13.408 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:13.408 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:13.408 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:13.408 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.406+0000 7f9c9042b640 1 Processor -- start 2026-02-24T19:18:13.408 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.406+0000 7f9c9042b640 1 -- start start 2026-02-24T19:18:13.408 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.406+0000 7f9c9042b640 10 monclient: init 2026-02-24T19:18:13.410 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.406+0000 7f9c9042b640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:13.410 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.406+0000 7f9c9042b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:18:13.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.406+0000 7f9c9042b640 10 monclient(hunting): picked mon.noname-c con 0x7f9c88058da0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:13.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.406+0000 7f9c9042b640 10 monclient(hunting): picked mon.noname-a con 0x7f9c880b0410 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:13.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.406+0000 7f9c9042b640 10 monclient(hunting): picked mon.noname-b con 0x7f9c881626a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:13.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.406+0000 7f9c9042b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c881655c0 con 0x7f9c880b0410 2026-02-24T19:18:13.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.406+0000 7f9c9042b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c880b12b0 con 0x7f9c881626a0 2026-02-24T19:18:13.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.406+0000 7f9c9042b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c880b1590 con 0x7f9c88058da0 2026-02-24T19:18:13.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.406+0000 7f9c9042b640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:13.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.406+0000 7f9c9042b640 10 monclient(hunting): authenticate will time out at 3676.088709s 2026-02-24T19:18:13.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.407+0000 7f9c8d99f640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f9c880b0410 0x7f9c88164eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:38252/0 (socket says 10.20.193.26:38252) 2026-02-24T19:18:13.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.407+0000 7f9c8d99f640 1 -- 10.20.193.26:0/579316884 learned_addr learned my addr 10.20.193.26:0/579316884 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:13.412 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.408+0000 7f9c8d19e640 1 -- 10.20.193.26:0/579316884 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3784494928 0 0) 0x7f9c880b1590 con 0x7f9c88058da0 2026-02-24T19:18:13.412 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.408+0000 7f9c8d19e640 10 monclient(hunting): _negotiate 2026-02-24T19:18:13.412 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.408+0000 7f9c8d19e640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:13.412 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.408+0000 7f9c8d19e640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:13.412 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.408+0000 7f9c8d19e640 10 monclient(hunting): my global_id is 4673 2026-02-24T19:18:13.412 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.408+0000 7f9c8d19e640 1 -- 10.20.193.26:0/579316884 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c70003610 con 0x7f9c88058da0 2026-02-24T19:18:13.412 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.408+0000 7f9c8d19e640 1 -- 10.20.193.26:0/579316884 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1324553982 0 0) 0x7f9c881655c0 con 0x7f9c880b0410 2026-02-24T19:18:13.412 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.408+0000 7f9c8d19e640 10 monclient(hunting): _negotiate 2026-02-24T19:18:13.412 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.408+0000 7f9c8d19e640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:13.412 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.408+0000 7f9c8d19e640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:13.412 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.408+0000 7f9c8d19e640 10 monclient(hunting): my global_id is 4656 2026-02-24T19:18:13.412 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.408+0000 7f9c8d19e640 1 -- 10.20.193.26:0/579316884 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c880b1590 con 0x7f9c880b0410 2026-02-24T19:18:13.413 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.408+0000 7f9c8d19e640 1 -- 10.20.193.26:0/579316884 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3080187432 0 0) 0x7f9c880b12b0 con 0x7f9c881626a0 2026-02-24T19:18:13.413 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.408+0000 7f9c8d19e640 10 monclient(hunting): _negotiate 2026-02-24T19:18:13.413 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.408+0000 7f9c8d19e640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:13.413 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.408+0000 7f9c8d19e640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:13.413 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.408+0000 7f9c8d19e640 10 monclient(hunting): my global_id is 4615 2026-02-24T19:18:13.413 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.408+0000 7f9c8d19e640 1 -- 10.20.193.26:0/579316884 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c881655c0 con 0x7f9c881626a0 2026-02-24T19:18:13.419 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.410+0000 7f9c8d19e640 1 -- 10.20.193.26:0/579316884 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2604885700 0 0) 0x7f9c70003610 con 0x7f9c88058da0 2026-02-24T19:18:13.419 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.410+0000 7f9c8d19e640 1 -- 10.20.193.26:0/579316884 >> v1:10.20.193.70:6789/0 conn(0x7f9c881626a0 legacy=0x7f9c881c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:13.419 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.410+0000 7f9c8d19e640 1 -- 10.20.193.26:0/579316884 >> v1:10.20.193.26:6789/0 conn(0x7f9c880b0410 legacy=0x7f9c88164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:13.419 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.410+0000 7f9c8d19e640 10 monclient: _finish_hunting 0 2026-02-24T19:18:13.420 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.410+0000 7f9c8d19e640 1 monclient: found mon.noname-c 2026-02-24T19:18:13.420 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.410+0000 7f9c8d19e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:13.420 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.410+0000 7f9c8d19e640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:13.420 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.410+0000 7f9c8d19e640 1 -- 10.20.193.26:0/579316884 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c880b1870 con 0x7f9c88058da0 2026-02-24T19:18:13.420 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.410+0000 7f9c8d19e640 10 monclient: _finish_auth 0 2026-02-24T19:18:13.420 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.410+0000 7f9c8d19e640 10 monclient: _check_auth_tickets 2026-02-24T19:18:13.420 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.410+0000 7f9c8d19e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:13.420 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.410+0000 7f9c8d19e640 1 -- 10.20.193.26:0/579316884 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9c78002df0 con 0x7f9c88058da0 2026-02-24T19:18:13.420 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.410+0000 7f9c8d19e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:13.420 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.410+0000 7f9c8d19e640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:13.420 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.410+0000 7f9c8d19e640 10 monclient: dump: 2026-02-24T19:18:13.420 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:13.420 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:13.420 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:13.420 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:13.420 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:13.420 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:13.421 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:13.421 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:13.421 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:13.421 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:13.421 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.410+0000 7f9c9042b640 5 monclient: authenticate success, global_id 4673 2026-02-24T19:18:13.421 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.410+0000 7f9c9042b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:13.421 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.411+0000 7f9c8d19e640 1 -- 10.20.193.26:0/579316884 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9c78002fc0 con 0x7f9c88058da0 2026-02-24T19:18:13.421 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.411+0000 7f9c8d19e640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:13.421 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.411+0000 7f9c8d19e640 1 -- 10.20.193.26:0/579316884 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9c78003400 con 0x7f9c88058da0 2026-02-24T19:18:13.421 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.411+0000 7f9c8d19e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:13.421 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.411+0000 7f9c8d19e640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:13.421 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.411+0000 7f9c8d19e640 10 monclient: dump: 2026-02-24T19:18:13.421 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:13.421 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:13.421 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:13.421 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:13.422 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:13.422 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:13.422 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:13.422 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:13.422 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:13.422 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:13.422 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.411+0000 7f9c9042b640 10 monclient: get_monmap_and_config success 2026-02-24T19:18:13.422 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.411+0000 7f9c9042b640 4 set_mon_vals no callback set 2026-02-24T19:18:13.422 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.411+0000 7f9c9042b640 10 monclient: shutdown 2026-02-24T19:18:13.422 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.411+0000 7f9c9042b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:13.422 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.411+0000 7f9c9042b640 1 -- 10.20.193.26:0/579316884 >> v1:10.20.193.103:6789/0 conn(0x7f9c88058da0 legacy=0x7f9c881647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:13.422 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.411+0000 7f9c9042b640 1 -- 10.20.193.26:0/579316884 shutdown_connections 2026-02-24T19:18:13.422 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.411+0000 7f9c9042b640 1 -- 10.20.193.26:0/579316884 >> 10.20.193.26:0/579316884 conn(0x7f9c880b65f0 msgr2=0x7f9c880b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:13.422 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.411+0000 7f9c9042b640 1 -- 10.20.193.26:0/579316884 shutdown_connections 2026-02-24T19:18:13.422 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.411+0000 7f9c9042b640 1 -- 10.20.193.26:0/579316884 wait complete. 2026-02-24T19:18:13.422 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.411+0000 7f9c9042b640 10 monclient: build_initial_monmap 2026-02-24T19:18:13.422 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.411+0000 7f9c9042b640 10 monclient: monmap: 2026-02-24T19:18:13.423 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:18:13.423 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:13.423 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:18:13.423 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:18:13.423 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:18:13.423 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:18:13.423 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:13.423 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:13.423 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:13.423 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:13.423 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.411+0000 7f9c9042b640 1 librados: starting msgr at 2026-02-24T19:18:13.423 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.411+0000 7f9c9042b640 1 librados: starting objecter 2026-02-24T19:18:13.423 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.411+0000 7f9c9042b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:13.423 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.412+0000 7f9c9042b640 1 Processor -- start 2026-02-24T19:18:13.423 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.412+0000 7f9c9042b640 1 -- start start 2026-02-24T19:18:13.423 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.412+0000 7f9c9042b640 1 librados: setting wanted keys 2026-02-24T19:18:13.423 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.412+0000 7f9c9042b640 1 librados: calling monclient init 2026-02-24T19:18:13.423 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.412+0000 7f9c9042b640 10 monclient: init 2026-02-24T19:18:13.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.412+0000 7f9c9042b640 10 monclient: _reopen_session rank -1 2026-02-24T19:18:13.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.412+0000 7f9c9042b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:18:13.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.412+0000 7f9c9042b640 10 monclient(hunting): picked mon.noname-c con 0x7f9c88058da0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:13.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.412+0000 7f9c9042b640 10 monclient(hunting): picked mon.noname-b con 0x7f9c880b0410 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:13.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.412+0000 7f9c9042b640 10 monclient(hunting): picked mon.noname-a con 0x7f9c881626a0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:13.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.412+0000 7f9c9042b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c881fbdf0 con 0x7f9c881626a0 2026-02-24T19:18:13.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.412+0000 7f9c9042b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c880ae250 con 0x7f9c880b0410 2026-02-24T19:18:13.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.412+0000 7f9c9042b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c880ae530 con 0x7f9c88058da0 2026-02-24T19:18:13.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.412+0000 7f9c9042b640 10 monclient(hunting): _renew_subs 2026-02-24T19:18:13.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.412+0000 7f9c9042b640 10 monclient(hunting): authenticate will time out at 3676.094483s 2026-02-24T19:18:13.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.412+0000 7f9c8d99f640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f9c880b0410 0x7f9c880af5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:46520/0 (socket says 10.20.193.26:46520) 2026-02-24T19:18:13.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.412+0000 7f9c8d99f640 1 -- 10.20.193.26:0/1070747019 learned_addr learned my addr 10.20.193.26:0/1070747019 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:18:13.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.413+0000 7f9c6effd640 10 client.?.objecter ms_handle_connect 0x7f9c88058da0 2026-02-24T19:18:13.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.413+0000 7f9c6effd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:13.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.413+0000 7f9c6effd640 10 client.?.objecter ms_handle_connect 0x7f9c880b0410 2026-02-24T19:18:13.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.413+0000 7f9c6effd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:13.424 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.413+0000 7f9c6effd640 10 client.?.objecter ms_handle_connect 0x7f9c881626a0 2026-02-24T19:18:13.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.413+0000 7f9c6effd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:13.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.413+0000 7f9c6effd640 1 -- 10.20.193.26:0/1070747019 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1740654931 0 0) 0x7f9c880ae530 con 0x7f9c88058da0 2026-02-24T19:18:13.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.413+0000 7f9c6effd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:13.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.413+0000 7f9c6effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:13.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.413+0000 7f9c6effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:13.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.413+0000 7f9c6effd640 10 monclient(hunting): my global_id is 4676 2026-02-24T19:18:13.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.413+0000 7f9c6effd640 1 -- 10.20.193.26:0/1070747019 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c58003610 con 0x7f9c88058da0 2026-02-24T19:18:13.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.414+0000 7f9c6effd640 1 -- 10.20.193.26:0/1070747019 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3973692576 0 0) 0x7f9c880ae250 con 0x7f9c880b0410 2026-02-24T19:18:13.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.414+0000 7f9c6effd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:13.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.414+0000 7f9c6effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:13.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.414+0000 7f9c6effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:13.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.414+0000 7f9c6effd640 10 monclient(hunting): my global_id is 4618 2026-02-24T19:18:13.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.414+0000 7f9c6effd640 1 -- 10.20.193.26:0/1070747019 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c880ae530 con 0x7f9c880b0410 2026-02-24T19:18:13.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.414+0000 7f9c6effd640 1 -- 10.20.193.26:0/1070747019 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2626317411 0 0) 0x7f9c881fbdf0 con 0x7f9c881626a0 2026-02-24T19:18:13.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.414+0000 7f9c6effd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:13.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.414+0000 7f9c6effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:13.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.414+0000 7f9c6effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:13.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.414+0000 7f9c6effd640 10 monclient(hunting): my global_id is 4659 2026-02-24T19:18:13.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.414+0000 7f9c6effd640 1 -- 10.20.193.26:0/1070747019 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c880ae250 con 0x7f9c881626a0 2026-02-24T19:18:13.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.416+0000 7f9c6effd640 1 -- 10.20.193.26:0/1070747019 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 561748724 0 0) 0x7f9c58003610 con 0x7f9c88058da0 2026-02-24T19:18:13.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.416+0000 7f9c6effd640 1 -- 10.20.193.26:0/1070747019 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9c881fbdf0 con 0x7f9c88058da0 2026-02-24T19:18:13.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.416+0000 7f9c6effd640 1 -- 10.20.193.26:0/1070747019 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9c78003310 con 0x7f9c88058da0 2026-02-24T19:18:13.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.416+0000 7f9c6effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:13.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.416+0000 7f9c6effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:13.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.416+0000 7f9c6effd640 10 monclient(hunting): dump: 2026-02-24T19:18:13.426 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:13.426 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:13.426 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:13.426 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:13.426 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:13.426 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:13.426 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:13.426 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:13.426 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:13.427 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:13.427 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.416+0000 7f9c6effd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:13.427 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.416+0000 7f9c6effd640 1 -- 10.20.193.26:0/1070747019 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2937606992 0 0) 0x7f9c880ae250 con 0x7f9c881626a0 2026-02-24T19:18:13.427 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.416+0000 7f9c6effd640 1 -- 10.20.193.26:0/1070747019 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9c58003610 con 0x7f9c881626a0 2026-02-24T19:18:13.427 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.416+0000 7f9c6effd640 1 -- 10.20.193.26:0/1070747019 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9c84003330 con 0x7f9c881626a0 2026-02-24T19:18:13.427 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.416+0000 7f9c6effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:13.427 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.416+0000 7f9c6effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:13.427 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.416+0000 7f9c6effd640 10 monclient(hunting): dump: 2026-02-24T19:18:13.427 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:13.427 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:13.427 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:13.427 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:13.427 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:13.427 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:13.427 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:13.427 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:13.427 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:13.428 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:13.428 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.416+0000 7f9c6effd640 1 -- 10.20.193.26:0/1070747019 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 814873242 0 0) 0x7f9c880ae530 con 0x7f9c880b0410 2026-02-24T19:18:13.428 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.416+0000 7f9c6effd640 1 -- 10.20.193.26:0/1070747019 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9c880ae250 con 0x7f9c880b0410 2026-02-24T19:18:13.428 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.416+0000 7f9c6effd640 1 -- 10.20.193.26:0/1070747019 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9c7c003170 con 0x7f9c880b0410 2026-02-24T19:18:13.428 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.416+0000 7f9c6effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:13.428 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.416+0000 7f9c6effd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:13.428 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.416+0000 7f9c6effd640 10 monclient(hunting): dump: 2026-02-24T19:18:13.428 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:13.428 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:13.428 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:13.428 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:13.428 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:13.428 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:13.428 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:13.428 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:13.428 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:13.428 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:13.428 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.417+0000 7f9c6effd640 1 -- 10.20.193.26:0/1070747019 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2676801355 0 0) 0x7f9c881fbdf0 con 0x7f9c88058da0 2026-02-24T19:18:13.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.417+0000 7f9c6effd640 1 -- 10.20.193.26:0/1070747019 >> v1:10.20.193.70:6789/0 conn(0x7f9c880b0410 legacy=0x7f9c880af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:13.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.417+0000 7f9c6effd640 1 -- 10.20.193.26:0/1070747019 >> v1:10.20.193.26:6789/0 conn(0x7f9c881626a0 legacy=0x7f9c88163030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:13.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.417+0000 7f9c6effd640 10 monclient: _finish_hunting 0 2026-02-24T19:18:13.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.417+0000 7f9c6effd640 1 monclient: found mon.c 2026-02-24T19:18:13.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.417+0000 7f9c6effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:13.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.417+0000 7f9c6effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:13.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.417+0000 7f9c6effd640 1 -- 10.20.193.26:0/1070747019 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c880ae810 con 0x7f9c88058da0 2026-02-24T19:18:13.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.417+0000 7f9c6effd640 10 monclient: _finish_auth 0 2026-02-24T19:18:13.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.417+0000 7f9c6effd640 10 monclient: _check_auth_tickets 2026-02-24T19:18:13.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.417+0000 7f9c6effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:13.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.417+0000 7f9c9042b640 5 monclient: authenticate success, global_id 4676 2026-02-24T19:18:13.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.417+0000 7f9c9042b640 10 monclient: _renew_subs 2026-02-24T19:18:13.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.417+0000 7f9c9042b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:13.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.417+0000 7f9c9042b640 1 -- 10.20.193.26:0/1070747019 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9c880aeaf0 con 0x7f9c88058da0 2026-02-24T19:18:13.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.417+0000 7f9c9042b640 10 client.4676.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:13.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.417+0000 7f9c9042b640 10 monclient: _renew_subs 2026-02-24T19:18:13.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.417+0000 7f9c9042b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:13.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.417+0000 7f9c9042b640 1 -- 10.20.193.26:0/1070747019 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9c881fe610 con 0x7f9c88058da0 2026-02-24T19:18:13.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.417+0000 7f9c9042b640 1 librados: init done 2026-02-24T19:18:13.430 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.418+0000 7f9c9042b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:13.430 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.418+0000 7f9c9042b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:13.430 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.418+0000 7f9c9042b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:13.430 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.418+0000 7f9c9042b640 1 -- 10.20.193.26:0/1070747019 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c880b6e40 con 0x7f9c88058da0 2026-02-24T19:18:13.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.425+0000 7f9c6effd640 1 -- 10.20.193.26:0/1070747019 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9c78002f80 con 0x7f9c88058da0 2026-02-24T19:18:13.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.425+0000 7f9c6effd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:13.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.425+0000 7f9c6effd640 1 -- 10.20.193.26:0/1070747019 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9c78003b00 con 0x7f9c88058da0 2026-02-24T19:18:13.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.425+0000 7f9c6effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:13.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.425+0000 7f9c6effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:13.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.425+0000 7f9c6effd640 10 monclient: dump: 2026-02-24T19:18:13.431 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:18:13.431 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:13.431 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:13.431 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:13.431 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:18:13.431 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:18:13.432 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:13.432 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:13.432 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:13.432 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:18:13.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.425+0000 7f9c8c99d640 4 set_mon_vals no callback set 2026-02-24T19:18:13.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.425+0000 7f9c6effd640 1 -- 10.20.193.26:0/1070747019 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f9c7801c970 con 0x7f9c88058da0 2026-02-24T19:18:13.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.426+0000 7f9c8d99f640 10 monclient: get_auth_request con 0x7f9c58077ed0 auth_method 0 2026-02-24T19:18:13.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.426+0000 7f9c6effd640 10 client.4676.objecter ms_handle_connect 0x7f9c58077ed0 2026-02-24T19:18:13.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.427+0000 7f9c6effd640 1 -- 10.20.193.26:0/1070747019 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8169+0+0 (unknown 3626019825 0 0) 0x7f9c78002960 con 0x7f9c88058da0 2026-02-24T19:18:13.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.427+0000 7f9c6effd640 10 client.4676.objecter ms_dispatch2 0x7f9c88000b90 osd_map(29..29 src has 1..29) 2026-02-24T19:18:13.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.427+0000 7f9c6effd640 3 client.4676.objecter handle_osd_map got epochs [29,29] > 0 2026-02-24T19:18:13.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.427+0000 7f9c6effd640 3 client.4676.objecter handle_osd_map decoding full epoch 29 2026-02-24T19:18:13.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.427+0000 7f9c6effd640 20 client.4676.objecter dump_active .. 0 homeless 2026-02-24T19:18:13.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.511+0000 7f9c6effd640 1 -- 10.20.193.26:0/1070747019 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f9c7805c900 con 0x7f9c88058da0 2026-02-24T19:18:13.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.511+0000 7f9c6effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:18:13.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.511+0000 7f9c6effd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:18:13.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.648+0000 7f9c9042b640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-24T19:18:13.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.648+0000 7f9c9042b640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-24T19:18:13.650 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.648+0000 7f9c9042b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:18:13.650 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.648+0000 7f9c9042b640 1 -- 10.20.193.26:0/1070747019 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9c880b6b60 con 0x7f9c88058da0 2026-02-24T19:18:13.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.653+0000 7f9c6effd640 1 -- 10.20.193.26:0/1070747019 <== mon.2 v1:10.20.193.103:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (unknown 3730786198 0 4185958460) 0x7f9c7805c200 con 0x7f9c88058da0 2026-02-24T19:18:13.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.653+0000 7f9c6effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-24T19:18:13.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.653+0000 7f9c6effd640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:18:13.654 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:18:13.654 INFO:teuthology.orchestra.run.trial026.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-24T19:18:13.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.654+0000 7f9c9042b640 10 librados: watch_flush enter 2026-02-24T19:18:13.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.654+0000 7f9c9042b640 10 librados: watch_flush exit 2026-02-24T19:18:13.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.654+0000 7f9c9042b640 20 client.4676.objecter shutdown clearing up homeless session... 2026-02-24T19:18:13.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.654+0000 7f9c9042b640 10 client.4676.objecter successfully canceled tick 2026-02-24T19:18:13.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.654+0000 7f9c9042b640 1 -- 10.20.193.26:0/1070747019 >> v1:10.20.193.162:6800/3889602630 conn(0x7f9c58077ed0 legacy=0x7f9c58098380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:13.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.654+0000 7f9c9042b640 10 monclient: shutdown 2026-02-24T19:18:13.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.654+0000 7f9c9042b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:13.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.654+0000 7f9c9042b640 1 -- 10.20.193.26:0/1070747019 >> v1:10.20.193.103:6789/0 conn(0x7f9c88058da0 legacy=0x7f9c88132a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:13.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.654+0000 7f9c9042b640 1 -- 10.20.193.26:0/1070747019 shutdown_connections 2026-02-24T19:18:13.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.654+0000 7f9c9042b640 1 -- 10.20.193.26:0/1070747019 >> 10.20.193.26:0/1070747019 conn(0x7f9c880b65f0 msgr2=0x7f9c880b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:13.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.654+0000 7f9c9042b640 1 -- 10.20.193.26:0/1070747019 shutdown_connections 2026-02-24T19:18:13.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.654+0000 7f9c9042b640 1 -- 10.20.193.26:0/1070747019 wait complete. 2026-02-24T19:18:13.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:18:13.654+0000 7f9c9042b640 1 librados: shutdown 2026-02-24T19:18:13.664 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-24T19:18:13.664 INFO:teuthology.run_tasks:Running task workunit... 2026-02-24T19:18:13.680 INFO:tasks.workunit:Pulling workunits from ref 36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T19:18:13.680 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-24T19:18:13.681 DEBUG:teuthology.orchestra.run.trial162:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-24T19:18:13.699 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T19:18:13.699 INFO:teuthology.orchestra.run.trial162.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-24T19:18:13.700 DEBUG:teuthology.orchestra.run.trial162:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-24T19:18:13.756 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-24T19:18:13.756 DEBUG:teuthology.orchestra.run.trial162:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-24T19:18:13.812 INFO:tasks.workunit:timeout=6h 2026-02-24T19:18:13.812 INFO:tasks.workunit:cleanup=True 2026-02-24T19:18:13.812 DEBUG:teuthology.orchestra.run.trial162:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 36d388f27052dd940bdbaf543bb05bdba0acc155 2026-02-24T19:18:13.875 INFO:tasks.workunit.client.0.trial162.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-24T19:18:15.784 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:01:13.759 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:15.834 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:01:13.809 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:15.852 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:01:13.824 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:15.856 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:01:13.792 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:15.882 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:01:13.819 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:15.882 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:01:13.854 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:15.958 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:01:13.933 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:16.003 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:01:13.940 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:16.006 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:01:13.978 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:35.771 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:01:33.745 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:35.795 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:01:33.770 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:35.814 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:01:33.788 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:35.820 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:01:33.757 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:35.821 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:01:33.792 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:35.821 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:01:33.758 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:35.822 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:01:33.793 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:35.840 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:01:33.777 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:35.841 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:01:33.812 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:41.120 INFO:tasks.workunit.client.0.trial162.stderr:Note: switching to '36d388f27052dd940bdbaf543bb05bdba0acc155'. 2026-02-24T19:18:41.120 INFO:tasks.workunit.client.0.trial162.stderr: 2026-02-24T19:18:41.120 INFO:tasks.workunit.client.0.trial162.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-24T19:18:41.120 INFO:tasks.workunit.client.0.trial162.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-24T19:18:41.121 INFO:tasks.workunit.client.0.trial162.stderr:state without impacting any branches by switching back to a branch. 2026-02-24T19:18:41.121 INFO:tasks.workunit.client.0.trial162.stderr: 2026-02-24T19:18:41.121 INFO:tasks.workunit.client.0.trial162.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-24T19:18:41.121 INFO:tasks.workunit.client.0.trial162.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-24T19:18:41.121 INFO:tasks.workunit.client.0.trial162.stderr: 2026-02-24T19:18:41.121 INFO:tasks.workunit.client.0.trial162.stderr: git switch -c 2026-02-24T19:18:41.121 INFO:tasks.workunit.client.0.trial162.stderr: 2026-02-24T19:18:41.121 INFO:tasks.workunit.client.0.trial162.stderr:Or undo this operation with: 2026-02-24T19:18:41.121 INFO:tasks.workunit.client.0.trial162.stderr: 2026-02-24T19:18:41.121 INFO:tasks.workunit.client.0.trial162.stderr: git switch - 2026-02-24T19:18:41.121 INFO:tasks.workunit.client.0.trial162.stderr: 2026-02-24T19:18:41.121 INFO:tasks.workunit.client.0.trial162.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-24T19:18:41.122 INFO:tasks.workunit.client.0.trial162.stderr: 2026-02-24T19:18:41.122 INFO:tasks.workunit.client.0.trial162.stderr:HEAD is now at 36d388f2705 Merge branch 'aclamk-rocksdb-binned-cache-perf-counters-tentacle' of https://github.com/aclamk/ceph into wip-yuri3-testing-2026-02-19-1610-tentacle 2026-02-24T19:18:41.129 DEBUG:teuthology.orchestra.run.trial162:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-24T19:18:41.186 INFO:tasks.workunit.client.0.trial162.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-24T19:18:41.188 INFO:tasks.workunit.client.0.trial162.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-24T19:18:41.188 INFO:tasks.workunit.client.0.trial162.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-24T19:18:41.277 INFO:tasks.workunit.client.0.trial162.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-24T19:18:41.308 INFO:tasks.workunit.client.0.trial162.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-24T19:18:41.334 INFO:tasks.workunit.client.0.trial162.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-24T19:18:41.336 INFO:tasks.workunit.client.0.trial162.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-24T19:18:41.336 INFO:tasks.workunit.client.0.trial162.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-24T19:18:41.363 INFO:tasks.workunit.client.0.trial162.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-24T19:18:41.367 DEBUG:teuthology.orchestra.run.trial162:> set -ex 2026-02-24T19:18:41.367 DEBUG:teuthology.orchestra.run.trial162:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-24T19:18:41.427 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2026-02-24T19:18:41.430 INFO:tasks.workunit:Running workunit rados/test.sh... 2026-02-24T19:18:41.430 DEBUG:teuthology.orchestra.run.trial162:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=36d388f27052dd940bdbaf543bb05bdba0acc155 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2026-02-24T19:18:41.492 INFO:tasks.workunit.client.0.trial162.stderr:+ parallel=1 2026-02-24T19:18:41.492 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' '' = --serial ']' 2026-02-24T19:18:41.492 INFO:tasks.workunit.client.0.trial162.stderr:+ crimson=0 2026-02-24T19:18:41.492 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' '' = --crimson ']' 2026-02-24T19:18:41.492 INFO:tasks.workunit.client.0.trial162.stderr:+ color= 2026-02-24T19:18:41.492 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -t 1 ']' 2026-02-24T19:18:41.492 INFO:tasks.workunit.client.0.trial162.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2026-02-24T19:18:41.492 INFO:tasks.workunit.client.0.trial162.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2026-02-24T19:18:41.492 INFO:tasks.workunit.client.0.trial162.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2026-02-24T19:18:41.492 INFO:tasks.workunit.client.0.trial162.stderr:+ declare -A pids 2026-02-24T19:18:41.492 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:41.493 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.493 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s api_aio 2026-02-24T19:18:41.493 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' api_aio' 2026-02-24T19:18:41.493 INFO:tasks.workunit.client.0.trial162.stderr:++ echo api_aio 2026-02-24T19:18:41.493 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.495 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=api_aio 2026-02-24T19:18:41.495 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=48778 2026-02-24T19:18:41.495 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test api_aio on pid 48778' 2026-02-24T19:18:41.495 INFO:tasks.workunit.client.0.trial162.stdout:test api_aio on pid 48778 2026-02-24T19:18:41.495 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=48778 2026-02-24T19:18:41.495 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:41.495 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.495 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2026-02-24T19:18:41.495 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s api_aio_pp 2026-02-24T19:18:41.495 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' api_aio_pp' 2026-02-24T19:18:41.496 INFO:tasks.workunit.client.0.trial162.stderr:++ echo api_aio_pp 2026-02-24T19:18:41.496 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.496 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.496 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.496 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.496 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.496 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.496 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.496 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.496 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.496 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.496 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.497 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.497 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.497 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.497 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.497 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.497 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.497 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.497 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.497 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.497 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=api_aio_pp 2026-02-24T19:18:41.497 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=48786 2026-02-24T19:18:41.497 INFO:tasks.workunit.client.0.trial162.stdout:test api_aio_pp on pid 48786 2026-02-24T19:18:41.498 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test api_aio_pp on pid 48786' 2026-02-24T19:18:41.498 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=48786 2026-02-24T19:18:41.498 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:41.498 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.498 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2026-02-24T19:18:41.498 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s api_io 2026-02-24T19:18:41.498 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' api_io' 2026-02-24T19:18:41.498 INFO:tasks.workunit.client.0.trial162.stderr:++ echo api_io 2026-02-24T19:18:41.498 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.498 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.498 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.498 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.498 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.498 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.498 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.499 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.499 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.499 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.499 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.499 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.499 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.499 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.499 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.499 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.499 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.499 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.499 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.499 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.500 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.500 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.500 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.500 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.500 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.500 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.500 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.500 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.500 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.500 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.500 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.500 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.500 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.500 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.500 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.500 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.500 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.500 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.500 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.500 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.500 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=api_io 2026-02-24T19:18:41.500 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=48794 2026-02-24T19:18:41.500 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test api_io on pid 48794' 2026-02-24T19:18:41.500 INFO:tasks.workunit.client.0.trial162.stdout:test api_io on pid 48794 2026-02-24T19:18:41.501 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=48794 2026-02-24T19:18:41.501 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:41.501 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.501 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2026-02-24T19:18:41.501 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s api_io_pp 2026-02-24T19:18:41.501 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' api_io_pp' 2026-02-24T19:18:41.501 INFO:tasks.workunit.client.0.trial162.stderr:++ echo api_io_pp 2026-02-24T19:18:41.501 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.502 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.503 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.503 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.503 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.503 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.503 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.503 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.503 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=api_io_pp 2026-02-24T19:18:41.503 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=48806 2026-02-24T19:18:41.503 INFO:tasks.workunit.client.0.trial162.stdout:test api_io_pp on pid 48806 2026-02-24T19:18:41.504 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test api_io_pp on pid 48806' 2026-02-24T19:18:41.504 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=48806 2026-02-24T19:18:41.504 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:41.504 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.504 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2026-02-24T19:18:41.504 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s api_asio 2026-02-24T19:18:41.504 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' api_asio' 2026-02-24T19:18:41.504 INFO:tasks.workunit.client.0.trial162.stderr:++ echo api_asio 2026-02-24T19:18:41.504 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.504 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.504 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.504 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.504 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.504 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.505 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.506 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.506 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.506 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.506 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.506 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.506 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.506 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.506 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.506 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.506 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.506 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.506 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.506 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.506 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.506 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.506 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.506 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.506 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.506 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=api_asio 2026-02-24T19:18:41.506 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.506 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.506 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.506 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.506 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.506 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=48820 2026-02-24T19:18:41.506 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test api_asio on pid 48820' 2026-02-24T19:18:41.506 INFO:tasks.workunit.client.0.trial162.stdout:test api_asio on pid 48820 2026-02-24T19:18:41.508 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=48820 2026-02-24T19:18:41.508 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:41.508 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.508 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s api_list 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' api_list' 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:++ echo api_list 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.509 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/48778/exe ']' 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.510 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.511 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.511 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.511 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.511 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.511 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.511 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.511 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/48778/exe 2026-02-24T19:18:41.511 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=api_list 2026-02-24T19:18:41.511 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.511 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.511 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.511 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.511 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.511 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=48837 2026-02-24T19:18:41.511 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test api_list on pid 48837' 2026-02-24T19:18:41.511 INFO:tasks.workunit.client.0.trial162.stdout:test api_list on pid 48837 2026-02-24T19:18:41.513 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=48837 2026-02-24T19:18:41.513 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:41.513 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.513 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2026-02-24T19:18:41.513 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.513 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s api_lock 2026-02-24T19:18:41.513 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.513 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' api_lock' 2026-02-24T19:18:41.513 INFO:tasks.workunit.client.0.trial162.stderr:++ echo api_lock 2026-02-24T19:18:41.513 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.513 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.513 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.513 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.513 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.513 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.513 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.513 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.513 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.513 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.513 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.513 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_rados_api_aio.log 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ api_aio: /' 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.514 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/48786/exe ']' 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.515 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.516 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.516 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.516 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.516 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.516 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.516 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/48786/exe 2026-02-24T19:18:41.516 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.516 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.516 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.516 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.516 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.516 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=api_lock 2026-02-24T19:18:41.516 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=48858 2026-02-24T19:18:41.516 INFO:tasks.workunit.client.0.trial162.stdout:test api_lock on pid 48858 2026-02-24T19:18:41.518 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test api_lock on pid 48858' 2026-02-24T19:18:41.518 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=48858 2026-02-24T19:18:41.518 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:41.518 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.518 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.518 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2026-02-24T19:18:41.518 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.518 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s api_lock_pp 2026-02-24T19:18:41.518 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' api_lock_pp' 2026-02-24T19:18:41.518 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.518 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.518 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.518 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.518 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.518 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.518 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.518 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.518 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:++ echo api_lock_pp 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.519 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/48794/exe ']' 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_rados_api_aio_pp.log 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ api_aio_pp: /' 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.520 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.521 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.521 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.521 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.521 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.521 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.521 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.521 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.521 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/48794/exe 2026-02-24T19:18:41.521 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.521 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.521 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.521 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.521 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.521 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.521 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=api_lock_pp 2026-02-24T19:18:41.521 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.521 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=48878 2026-02-24T19:18:41.521 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test api_lock_pp on pid 48878' 2026-02-24T19:18:41.521 INFO:tasks.workunit.client.0.trial162.stdout:test api_lock_pp on pid 48878 2026-02-24T19:18:41.523 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=48878 2026-02-24T19:18:41.523 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:41.523 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.523 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2026-02-24T19:18:41.523 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s api_misc 2026-02-24T19:18:41.523 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' api_misc' 2026-02-24T19:18:41.523 INFO:tasks.workunit.client.0.trial162.stderr:++ echo api_misc 2026-02-24T19:18:41.523 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.523 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.523 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.523 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.523 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.523 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.523 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.523 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.523 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.523 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.523 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.523 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.523 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.523 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.523 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/48806/exe ']' 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_rados_api_io.log 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.524 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ api_io: /' 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/48806/exe 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.525 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.526 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.526 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.526 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=api_misc 2026-02-24T19:18:41.526 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=48896 2026-02-24T19:18:41.526 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test api_misc on pid 48896' 2026-02-24T19:18:41.526 INFO:tasks.workunit.client.0.trial162.stdout:test api_misc on pid 48896 2026-02-24T19:18:41.528 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=48896 2026-02-24T19:18:41.528 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:41.528 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.528 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2026-02-24T19:18:41.528 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.528 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s api_misc_pp 2026-02-24T19:18:41.528 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.528 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.528 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.528 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.528 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.528 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' api_misc_pp' 2026-02-24T19:18:41.528 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.528 INFO:tasks.workunit.client.0.trial162.stderr:++ echo api_misc_pp 2026-02-24T19:18:41.528 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.528 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.528 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.528 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.528 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.528 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_rados_api_io_pp.log 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.529 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ api_io_pp: /' 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/48820/exe ']' 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.530 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.531 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.531 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.531 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.531 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.531 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.531 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.531 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.531 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.531 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.531 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.531 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/48820/exe 2026-02-24T19:18:41.531 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=api_misc_pp 2026-02-24T19:18:41.531 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=48916 2026-02-24T19:18:41.531 INFO:tasks.workunit.client.0.trial162.stdout:test api_misc_pp on pid 48916 2026-02-24T19:18:41.532 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test api_misc_pp on pid 48916' 2026-02-24T19:18:41.532 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=48916 2026-02-24T19:18:41.532 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:41.532 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s api_pool 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' api_pool' 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:++ echo api_pool 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.533 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.534 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ api_asio: /' 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_rados_api_asio.log 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/48837/exe ']' 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=api_pool 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/48837/exe 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=48936 2026-02-24T19:18:41.535 INFO:tasks.workunit.client.0.trial162.stdout:test api_pool on pid 48936 2026-02-24T19:18:41.537 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test api_pool on pid 48936' 2026-02-24T19:18:41.537 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=48936 2026-02-24T19:18:41.537 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:41.537 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.537 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2026-02-24T19:18:41.537 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.537 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.537 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.537 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.537 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.537 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s api_snapshots 2026-02-24T19:18:41.537 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' api_snapshots' 2026-02-24T19:18:41.537 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.537 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.537 INFO:tasks.workunit.client.0.trial162.stderr:++ echo api_snapshots 2026-02-24T19:18:41.537 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.537 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.537 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.537 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.537 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.537 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.537 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.537 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.538 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/48858/exe ']' 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.539 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.540 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.540 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.540 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.540 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/48858/exe 2026-02-24T19:18:41.540 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2026-02-24T19:18:41.540 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_rados_api_list.log 2026-02-24T19:18:41.540 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ api_list: /' 2026-02-24T19:18:41.540 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=api_snapshots 2026-02-24T19:18:41.540 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=48959 2026-02-24T19:18:41.540 INFO:tasks.workunit.client.0.trial162.stdout:test api_snapshots on pid 48959 2026-02-24T19:18:41.542 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.542 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test api_snapshots on pid 48959' 2026-02-24T19:18:41.542 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=48959 2026-02-24T19:18:41.542 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:41.542 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.542 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2026-02-24T19:18:41.542 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s api_snapshots_pp 2026-02-24T19:18:41.542 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.542 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.542 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.542 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' api_snapshots_pp' 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:++ echo api_snapshots_pp 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.543 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_rados_api_lock.log 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ api_lock: /' 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.544 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/48878/exe ']' 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/48878/exe 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=api_snapshots_pp 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.545 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=48980 2026-02-24T19:18:41.546 INFO:tasks.workunit.client.0.trial162.stdout:test api_snapshots_pp on pid 48980 2026-02-24T19:18:41.547 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test api_snapshots_pp on pid 48980' 2026-02-24T19:18:41.547 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=48980 2026-02-24T19:18:41.547 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:41.547 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.547 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s api_stat 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' api_stat' 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/48896/exe ']' 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:++ echo api_stat 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/48896/exe 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.548 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_rados_api_lock_pp.log 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.549 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.550 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.550 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.550 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.550 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ api_lock_pp: /' 2026-02-24T19:18:41.550 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2026-02-24T19:18:41.550 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=api_stat 2026-02-24T19:18:41.550 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49006 2026-02-24T19:18:41.550 INFO:tasks.workunit.client.0.trial162.stdout:test api_stat on pid 49006 2026-02-24T19:18:41.552 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test api_stat on pid 49006' 2026-02-24T19:18:41.552 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=49006 2026-02-24T19:18:41.552 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:41.552 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.552 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2026-02-24T19:18:41.552 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.552 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.552 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.552 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.552 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.552 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.552 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.552 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.552 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.552 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.552 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.552 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.552 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.552 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.552 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.552 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.552 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/48916/exe ']' 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s api_stat_pp 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' api_stat_pp' 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/48916/exe 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:++ echo api_stat_pp 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_rados_api_misc.log 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ api_misc: /' 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.553 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.554 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.555 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.555 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.555 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.555 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.555 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.555 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.555 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.555 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.555 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.555 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.555 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.555 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.555 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.555 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.555 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.555 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.555 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.555 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.555 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=api_stat_pp 2026-02-24T19:18:41.555 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49040 2026-02-24T19:18:41.555 INFO:tasks.workunit.client.0.trial162.stdout:test api_stat_pp on pid 49040 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test api_stat_pp on pid 49040' 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=49040 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_rados_api_misc_pp.log 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s api_watch_notify 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ api_misc_pp: /' 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' api_watch_notify' 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:++ echo api_watch_notify 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.557 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/48936/exe ']' 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/48936/exe 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.558 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.559 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.559 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.559 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.559 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.559 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.559 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.559 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.559 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.559 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.559 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.559 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.559 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.559 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.559 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.559 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=api_watch_notify 2026-02-24T19:18:41.559 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49057 2026-02-24T19:18:41.559 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test api_watch_notify on pid 49057' 2026-02-24T19:18:41.559 INFO:tasks.workunit.client.0.trial162.stdout:test api_watch_notify on pid 49057 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=49057 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s api_watch_notify_pp 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' api_watch_notify_pp' 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:++ echo api_watch_notify_pp 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.561 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_rados_api_pool.log 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ api_pool: /' 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.562 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/48959/exe ']' 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=api_watch_notify_pp 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/48959/exe 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49097 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test api_watch_notify_pp on pid 49097' 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.563 INFO:tasks.workunit.client.0.trial162.stdout:test api_watch_notify_pp on pid 49097 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=49097 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s api_cmd 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.566 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' api_cmd' 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:++ echo api_cmd 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.567 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_rados_api_snapshots.log 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ api_snapshots: /' 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=api_cmd 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.568 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.569 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.569 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.569 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.569 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.569 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.569 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49125 2026-02-24T19:18:41.569 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.569 INFO:tasks.workunit.client.0.trial162.stdout:test api_cmd on pid 49125 2026-02-24T19:18:41.571 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.571 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test api_cmd on pid 49125' 2026-02-24T19:18:41.571 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=49125 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/48980/exe ']' 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s api_cmd_pp 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' api_cmd_pp' 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/48980/exe 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:++ echo api_cmd_pp 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.572 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.573 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/49006/exe ']' 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/49006/exe 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ api_snapshots_pp: /' 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.574 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.575 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.575 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.575 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.575 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.575 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.575 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.575 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.575 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=api_cmd_pp 2026-02-24T19:18:41.575 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.575 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.575 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.575 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49153 2026-02-24T19:18:41.575 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test api_cmd_pp on pid 49153' 2026-02-24T19:18:41.575 INFO:tasks.workunit.client.0.trial162.stdout:test api_cmd_pp on pid 49153 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=49153 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s api_service 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' api_service' 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:++ echo api_service 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.577 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/49040/exe ']' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_rados_api_stat.log 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ api_stat: /' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.578 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.579 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.579 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.579 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.579 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.579 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.579 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.579 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.579 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.579 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.579 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/49040/exe 2026-02-24T19:18:41.579 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.579 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=api_service 2026-02-24T19:18:41.579 INFO:tasks.workunit.client.0.trial162.stdout:test api_service on pid 49190 2026-02-24T19:18:41.581 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.581 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.581 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49190 2026-02-24T19:18:41.581 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test api_service on pid 49190' 2026-02-24T19:18:41.581 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=49190 2026-02-24T19:18:41.581 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:41.581 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.581 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.581 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.581 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.581 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.581 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.581 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.581 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.581 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.581 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.581 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2026-02-24T19:18:41.581 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.581 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s api_service_pp 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/49057/exe ']' 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' api_service_pp' 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/49057/exe 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:++ echo api_service_pp 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.582 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_rados_api_stat_pp.log 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ api_stat_pp: /' 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.583 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_rados_api_watch_notify.log 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=api_service_pp 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ api_watch_notify: /' 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49221 2026-02-24T19:18:41.584 INFO:tasks.workunit.client.0.trial162.stdout:test api_service_pp on pid 49221 2026-02-24T19:18:41.586 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test api_service_pp on pid 49221' 2026-02-24T19:18:41.586 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=49221 2026-02-24T19:18:41.586 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:41.586 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.586 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2026-02-24T19:18:41.586 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s api_c_write_operations 2026-02-24T19:18:41.586 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.586 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.586 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.586 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.586 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.586 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.586 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.586 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.586 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.586 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.586 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.586 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' api_c_write_operations' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/49097/exe ']' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ echo api_c_write_operations 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/49097/exe 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.587 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=api_c_write_operations 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.588 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.589 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.589 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49257 2026-02-24T19:18:41.589 INFO:tasks.workunit.client.0.trial162.stdout:test api_c_write_operations on pid 49257 2026-02-24T19:18:41.590 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test api_c_write_operations on pid 49257' 2026-02-24T19:18:41.590 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=49257 2026-02-24T19:18:41.590 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:41.590 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.590 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.590 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.590 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s api_c_read_operations 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' api_c_read_operations' 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:++ echo api_c_read_operations 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.591 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.592 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.593 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.593 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/49125/exe ']' 2026-02-24T19:18:41.593 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/49125/exe 2026-02-24T19:18:41.593 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.593 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.593 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.593 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.593 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.593 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.593 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=api_c_read_operations 2026-02-24T19:18:41.593 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.593 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.593 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.593 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.593 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.593 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.593 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49294 2026-02-24T19:18:41.593 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.593 INFO:tasks.workunit.client.0.trial162.stdout:test api_c_read_operations on pid 49294 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test api_c_read_operations on pid 49294' 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=49294 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s list_parallel 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' list_parallel' 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:++ echo list_parallel 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.595 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.596 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/49153/exe ']' 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_rados_api_cmd.log 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ api_cmd: /' 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/49153/exe 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=list_parallel 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49319 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test list_parallel on pid 49319' 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2026-02-24T19:18:41.597 INFO:tasks.workunit.client.0.trial162.stdout:test list_parallel on pid 49319 2026-02-24T19:18:41.599 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=49319 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s open_pools_parallel 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' open_pools_parallel' 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:++ echo open_pools_parallel 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.600 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ api_cmd_pp: /' 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/49190/exe ']' 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/49190/exe 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.601 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.602 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.602 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.602 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.602 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.602 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.602 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.602 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.602 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=open_pools_parallel 2026-02-24T19:18:41.602 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.602 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.602 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.602 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.602 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.602 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.602 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.602 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49355 2026-02-24T19:18:41.602 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.602 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.602 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test open_pools_parallel on pid 49355' 2026-02-24T19:18:41.602 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.602 INFO:tasks.workunit.client.0.trial162.stdout:test open_pools_parallel on pid 49355 2026-02-24T19:18:41.604 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.604 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=49355 2026-02-24T19:18:41.604 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.604 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.604 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-24T19:18:41.604 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.604 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.604 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.604 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.604 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.604 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.604 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.604 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.604 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2026-02-24T19:18:41.604 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s delete_pools_parallel 2026-02-24T19:18:41.604 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' delete_pools_parallel' 2026-02-24T19:18:41.604 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.604 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.604 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.604 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:++ echo delete_pools_parallel 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_rados_api_service.log 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ api_service: /' 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.605 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/49221/exe ']' 2026-02-24T19:18:41.606 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/49221/exe 2026-02-24T19:18:41.607 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.607 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.607 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.607 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.607 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.607 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.607 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.607 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.607 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.607 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.607 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.607 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=delete_pools_parallel 2026-02-24T19:18:41.607 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.607 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.607 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.607 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49386 2026-02-24T19:18:41.607 INFO:tasks.workunit.client.0.trial162.stdout:test delete_pools_parallel on pid 49386 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test delete_pools_parallel on pid 49386' 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=49386 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s cls 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' cls' 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:++ echo cls 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.609 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/49257/exe ']' 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_rados_api_service_pp.log 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.610 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/49257/exe 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ api_service_pp: /' 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=cls 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49415 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test cls on pid 49415' 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stdout:test cls on pid 49415 2026-02-24T19:18:41.611 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=49415 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cls 2>&1 | tee ceph_test_neorados_cls.log | sed "s/^/ cls: /"' 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s cmd 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [==========] Running 29 tests from 1 test suite. 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [----------] Global test environment set-up. 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [----------] 29 tests from AsioRados 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.552+0000 7f268c4ec880 10 monclient: get_monmap_and_config 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.552+0000 7f268c4ec880 10 monclient: build_initial_monmap 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.552+0000 7f268c4ec880 10 monclient: monmap: 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: epoch 0 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: last_changed 0.000000 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: created 0.000000 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: min_mon_release 0 (unknown) 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: election_strategy: 1 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.552+0000 7f268c4ec880 1 Processor -- start 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.552+0000 7f268c4ec880 1 -- start start 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.552+0000 7f268c4ec880 10 monclient: init 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.552+0000 7f268c4ec880 10 monclient: _reopen_session rank -1 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.552+0000 7f268c4ec880 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.552+0000 7f268c4ec880 10 monclient(hunting): picked mon.noname-a con 0x558b2539ec10 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.552+0000 7f268c4ec880 10 monclient(hunting): picked mon.noname-b con 0x558b253bfb90 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.552+0000 7f268c4ec880 10 monclient(hunting): picked mon.noname-c con 0x558b253e16c0 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.552+0000 7f268c4ec880 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x558b253a7410 con 0x558b2539ec10 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.552+0000 7f268c4ec880 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x558b2539bff0 con 0x558b253bfb90 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.552+0000 7f268c4ec880 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x558b2539d1d0 con 0x558b253e16c0 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.552+0000 7f268c4ec880 10 monclient(hunting): _renew_subs 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.552+0000 7f268c4ec880 10 monclient(hunting): authenticate will time out at 3697.188391s 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.555+0000 7f268a7a3640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x558b253e16c0 0x558b253998c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.162:54522/0 (socket says 10.20.193.162:54522) 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.555+0000 7f268a7a3640 1 -- 10.20.193.162:0/1862158135 learned_addr learned my addr 10.20.193.162:0/1862158135 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.561+0000 7f267bfff640 1 -- 10.20.193.162:0/1862158135 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1663606853 0 0) 0x558b2539d1d0 con 0x558b253e16c0 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.561+0000 7f267bfff640 10 monclient(hunting): _negotiate 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.561+0000 7f267bfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.561+0000 7f267bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:41.612 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.561+0000 7f267bfff640 10 monclient(hunting): my global_id is 4712 2026-02-24T19:18:41.614 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' cmd' 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:++ echo cmd 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ api_c_write_operations: /' 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.615 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.616 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.617 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.617 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.617 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.617 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.617 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.617 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.617 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.617 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.617 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.617 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=cmd 2026-02-24T19:18:41.617 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.617 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.617 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.617 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.617 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.617 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.617 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.617 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.617 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.617 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.617 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.617 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/49294/exe ']' 2026-02-24T19:18:41.617 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49442 2026-02-24T19:18:41.617 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.561+0000 7f267bfff640 1 -- 10.20.193.162:0/1862158135 --> v1:test cmd on pid 49442 2026-02-24T19:18:41.619 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test cmd on pid 49442' 2026-02-24T19:18:41.619 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=49442 2026-02-24T19:18:41.619 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:18:41.619 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.619 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cmd 2>&1 | tee ceph_test_neorados_cmd.log | sed "s/^/ cmd: /"' 2026-02-24T19:18:41.619 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s handler_error 2026-02-24T19:18:41.619 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/49294/exe 2026-02-24T19:18:41.619 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.619 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' handler_error' 2026-02-24T19:18:41.619 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.619 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.619 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++ echo handler_error 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.620 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/49319/exe ']' 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.621 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.622 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.622 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.622 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.622 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.622 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.622 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.622 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.622 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.622 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.622 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.622 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=handler_error 2026-02-24T19:18:41.622 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2026-02-24T19:18:41.622 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2026-02-24T19:18:41.622 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49471 2026-02-24T19:18:41.622 INFO:tasks.workunit.client.0.trial162.stdout:test handler_error on pid 49471 2026-02-24T19:18:41.624 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test handler_error on pid 49471' 2026-02-24T19:18:41.624 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=49471 2026-02-24T19:18:41.624 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:18:41.624 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.624 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ api_c_read_operations: /' 2026-02-24T19:18:41.624 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_handler_error 2>&1 | tee ceph_test_neorados_handler_error.log | sed "s/^/ handler_error: /"' 2026-02-24T19:18:41.624 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/49319/exe 2026-02-24T19:18:41.624 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.624 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.624 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s io 2026-02-24T19:18:41.624 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.624 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.624 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.624 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' io' 2026-02-24T19:18:41.624 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.624 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.624 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:++ echo io 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.625 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/49355/exe ']' 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.626 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.627 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_rados_list_parallel.log 2026-02-24T19:18:41.627 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.627 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.627 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.627 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.627 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ list_parallel: /' 2026-02-24T19:18:41.627 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.627 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.627 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.627 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.627 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.627 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.627 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.627 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.627 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.627 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.627 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/49355/exe 2026-02-24T19:18:41.627 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.627 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=io 2026-02-24T19:18:41.627 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.627 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49501 2026-02-24T19:18:41.627 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test io on pid 49501' 2026-02-24T19:18:41.627 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_io 2>&1 | tee ceph_test_neorados_io.log | sed "s/^/ io: /"' 2026-02-24T19:18:41.627 INFO:tasks.workunit.client.0.trial162.stdout:test io on pid 49501 2026-02-24T19:18:41.629 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=49501 2026-02-24T19:18:41.629 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:18:41.629 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.629 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s ec_io 2026-02-24T19:18:41.629 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.629 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.629 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.629 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.629 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.629 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' ec_io' 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/49386/exe ']' 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:++ echo ec_io 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/49386/exe 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.630 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ open_pools_parallel: /' 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.631 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.632 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.632 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.632 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.632 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.632 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.632 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.632 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.632 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.632 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=ec_io 2026-02-24T19:18:41.632 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49526 2026-02-24T19:18:41.632 INFO:tasks.workunit.client.0.trial162.stdout:test ec_io on pid 49526 2026-02-24T19:18:41.634 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test ec_io on pid 49526' 2026-02-24T19:18:41.634 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=49526 2026-02-24T19:18:41.634 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:18:41.634 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.634 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.634 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_io 2>&1 | tee ceph_test_neorados_ec_io.log | sed "s/^/ ec_io: /"' 2026-02-24T19:18:41.634 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.634 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.634 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.634 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.634 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.634 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.634 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.634 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.634 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s list 2026-02-24T19:18:41.634 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' list' 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:++ echo list 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ delete_pools_parallel: /' 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.635 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.636 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.637 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.637 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.637 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.637 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.637 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.637 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.637 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/49415/exe ']' 2026-02-24T19:18:41.637 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.637 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=list 2026-02-24T19:18:41.637 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49545 2026-02-24T19:18:41.637 INFO:tasks.workunit.client.0.trial162.stdout:test list on pid 49545 2026-02-24T19:18:41.639 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test list on pid 49545' 2026-02-24T19:18:41.639 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=49545 2026-02-24T19:18:41.639 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:18:41.639 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.639 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.639 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_list 2>&1 | tee ceph_test_neorados_list.log | sed "s/^/ list: /"' 2026-02-24T19:18:41.639 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.639 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.639 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.639 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.639 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/49415/exe 2026-02-24T19:18:41.639 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s ec_list 2026-02-24T19:18:41.639 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.639 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' ec_list' 2026-02-24T19:18:41.639 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.639 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.639 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.639 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.639 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.639 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.639 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.639 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.639 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.639 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.639 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.639 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++ echo ec_list 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.640 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/49442/exe ']' 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/49442/exe 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_neorados_cls 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_neorados_cls.log 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.641 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.642 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.642 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.642 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.642 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.642 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ cls: /' 2026-02-24T19:18:41.642 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.642 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.642 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=ec_list 2026-02-24T19:18:41.642 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49573 2026-02-24T19:18:41.642 INFO:tasks.workunit.client.0.trial162.stdout:test ec_list on pid 49573 2026-02-24T19:18:41.643 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test ec_list on pid 49573' 2026-02-24T19:18:41.643 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=49573 2026-02-24T19:18:41.643 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:18:41.643 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.643 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_list 2>&1 | tee ceph_test_neorados_ec_list.log | sed "s/^/ ec_list: /"' 2026-02-24T19:18:41.643 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.643 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s misc 2026-02-24T19:18:41.643 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' misc' 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:++ echo misc 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_neorados_cmd 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_neorados_cmd.log 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ cmd: /' 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.644 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/49471/exe ']' 2026-02-24T19:18:41.645 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.646 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.646 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/49471/exe 2026-02-24T19:18:41.646 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=misc 2026-02-24T19:18:41.646 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.646 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49594 2026-02-24T19:18:41.646 INFO:tasks.workunit.client.0.trial162.stdout:test misc on pid 49594 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test misc on pid 49594' 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=49594 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_misc 2>&1 | tee ceph_test_neorados_misc.log | sed "s/^/ misc: /"' 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s pool 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' pool' 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:++ echo pool 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.648 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/49501/exe ']' 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.649 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_neorados_handler_error 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_neorados_handler_error.log 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ handler_error: /' 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/49501/exe 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=pool 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49630 2026-02-24T19:18:41.650 INFO:tasks.workunit.client.0.trial162.stdout:test pool on pid 49630 2026-02-24T19:18:41.652 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test pool on pid 49630' 2026-02-24T19:18:41.652 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=49630 2026-02-24T19:18:41.652 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:18:41.652 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.652 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_pool 2>&1 | tee ceph_test_neorados_pool.log | sed "s/^/ pool: /"' 2026-02-24T19:18:41.652 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.652 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.652 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.652 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.652 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s read_operations 2026-02-24T19:18:41.652 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.652 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.652 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.652 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.652 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.652 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.652 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.652 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' read_operations' 2026-02-24T19:18:41.652 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.652 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_neorados_io 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:++ echo read_operations 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_neorados_io.log 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.653 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ io: /' 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.654 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.655 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.655 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.655 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.655 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.655 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.655 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=read_operations 2026-02-24T19:18:41.655 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.655 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.655 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49664 2026-02-24T19:18:41.655 INFO:tasks.workunit.client.0.trial162.stdout:test read_operations on pid 49664 2026-02-24T19:18:41.657 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test read_operations on pid 49664' 2026-02-24T19:18:41.657 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=49664 2026-02-24T19:18:41.657 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:18:41.657 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.657 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_read_operations 2>&1 | tee ceph_test_neorados_read_operations.log | sed "s/^/ read_operations: /"' 2026-02-24T19:18:41.657 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.657 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.657 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s snapshots 2026-02-24T19:18:41.657 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.657 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' snapshots' 2026-02-24T19:18:41.657 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.657 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.657 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.657 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.657 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.657 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.657 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.657 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.657 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.657 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.657 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.657 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ echo snapshots 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/49526/exe ']' 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.658 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/49526/exe 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.659 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.660 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.660 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.660 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.660 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.660 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/49545/exe ']' 2026-02-24T19:18:41.660 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.660 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/49545/exe 2026-02-24T19:18:41.660 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=snapshots 2026-02-24T19:18:41.660 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.660 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.660 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49682 2026-02-24T19:18:41.660 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.660 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.660 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.660 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test snapshots on pid 49682' 2026-02-24T19:18:41.660 INFO:tasks.workunit.client.0.trial162.stdout:test snapshots on pid 49682 2026-02-24T19:18:41.662 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_snapshots 2>&1 | tee ceph_test_neorados_snapshots.log | sed "s/^/ snapshots: /"' 2026-02-24T19:18:41.662 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=49682 2026-02-24T19:18:41.662 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:18:41.662 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.662 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.662 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.662 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s watch_notify 2026-02-24T19:18:41.662 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.662 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.662 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.662 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.662 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.662 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.662 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.662 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.662 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.662 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.662 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' watch_notify' 2026-02-24T19:18:41.662 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.662 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.662 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_neorados_ec_io 2026-02-24T19:18:41.662 INFO:tasks.workunit.client.0.trial162.stderr:++ echo watch_notify 2026-02-24T19:18:41.662 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ ec_io: /' 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_neorados_ec_io.log 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.663 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/49573/exe ']' 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.664 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.665 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.665 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.665 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.665 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.665 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.665 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.665 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.665 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.665 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.665 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.665 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_neorados_list 2026-02-24T19:18:41.665 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/49573/exe 2026-02-24T19:18:41.665 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_neorados_list.log 2026-02-24T19:18:41.665 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ list: /' 2026-02-24T19:18:41.665 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=watch_notify 2026-02-24T19:18:41.665 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49753 2026-02-24T19:18:41.665 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test watch_notify on pid 49753' 2026-02-24T19:18:41.665 INFO:tasks.workunit.client.0.trial162.stdout:test watch_notify on pid 49753 2026-02-24T19:18:41.667 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=49753 2026-02-24T19:18:41.667 INFO:tasks.workunit.client.0.trial162.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-24T19:18:41.667 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.667 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.667 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.667 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.667 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.667 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.667 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.667 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_watch_notify 2>&1 | tee ceph_test_neorados_watch_notify.log | sed "s/^/ watch_notify: /"' 2026-02-24T19:18:41.667 INFO:tasks.workunit.client.0.trial162.stderr:++ printf %25s write_operations 2026-02-24T19:18:41.667 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.667 INFO:tasks.workunit.client.0.trial162.stderr:+ r=' write_operations' 2026-02-24T19:18:41.667 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.667 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.667 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:++ echo write_operations 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:++ awk '{print $1}' 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_neorados_ec_list 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_neorados_ec_list.log 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.668 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ ec_list: /' 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/49594/exe ']' 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/49594/exe 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.669 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.670 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.670 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.670 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.670 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.670 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.670 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.670 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.670 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.670 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.670 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.670 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.670 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.670 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.670 INFO:tasks.workunit.client.0.trial162.stderr:+ ff=write_operations 2026-02-24T19:18:41.670 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49793 2026-02-24T19:18:41.670 INFO:tasks.workunit.client.0.trial162.stderr:+ echo 'test write_operations on pid 49793' 2026-02-24T19:18:41.670 INFO:tasks.workunit.client.0.trial162.stdout:test write_operations on pid 49793 2026-02-24T19:18:41.677 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.677 INFO:tasks.workunit.client.0.trial162.stderr:+ pids[$f]=49793 2026-02-24T19:18:41.677 INFO:tasks.workunit.client.0.trial162.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_write_operations 2>&1 | tee ceph_test_neorados_write_operations.log | sed "s/^/ write_operations: /"' 2026-02-24T19:18:41.677 INFO:tasks.workunit.client.0.trial162.stderr:+ ret=0 2026-02-24T19:18:41.677 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' 1 -eq 1 ']' 2026-02-24T19:18:41.677 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:18:41.677 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=48820 2026-02-24T19:18:41.677 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 48820 2026-02-24T19:18:41.677 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.677 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.677 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -f /etc/bashrc ']' 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:+ . /etc/bashrc 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -z '' ']' 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:++ BASHRCSOURCED=Y 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:++ shopt -q login_shell 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.678 INFO:tasks.workunit.client.0.trial162.stderr:+++ umask 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' 0022 -eq 0 ']' 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:++ SHELL=/bin/bash 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_neorados_misc 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/49630/exe ']' 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_neorados_misc.log 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ misc: /' 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/49630/exe 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.679 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.680 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'grep=grep --color=auto' 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorls.sh 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/49664/exe ']' 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' '!' -t 0 ']' 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:+++ return 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:+++ export S_COLORS=auto 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:+++ S_COLORS=auto 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_neorados_pool 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_neorados_pool.log 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ pool: /' 2026-02-24T19:18:41.681 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/49664/exe 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_neorados_read_operations 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_neorados_read_operations.log 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ read_operations: /' 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.682 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/49682/exe ']' 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:+++ prefix=/usr 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/49682/exe 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset prefix 2026-02-24T19:18:41.683 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/gawk.sh 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/lang.sh 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/locale 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.684 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/49753/exe ']' 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_neorados_snapshots 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_neorados_snapshots.log 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ snapshots: /' 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/49753/exe 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:++++ export LANG=en_US.UTF-8 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:++++ LANG=en_US.UTF-8 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+++ LANG=en_US.UTF-8 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+++ unset LANG_backup config 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n '' ']' 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' dumb = linux ']' 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/less.sh 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:++ for i in /etc/profile.d/*.sh 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:++ '[' '' ']' 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:++ . /etc/profile.d/which2.sh 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+++ '[' -r /proc/49793/exe ']' 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+++++ readlink /proc/49793/exe 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_neorados_watch_notify 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_neorados_watch_notify.log 2026-02-24T19:18:41.685 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ watch_notify: /' 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stderr:++++ basename /usr/bin/bash 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stderr:+++ SHELLNAME=bash 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stderr:+++ case "$SHELLNAME" in 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_declare='declare -f' 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stderr:+++ which_opt=-f 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stderr:+++ export which_declare 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stderr:+++ export -f which 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stderr:++ unset i 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stderr:++ unset -f pathmunge 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stderr:+ export PATH 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stderr:+ unset rc 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stderr:+ ceph_test_neorados_write_operations 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stderr:+ tee ceph_test_neorados_write_operations.log 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stderr:+ sed 's/^/ write_operations: /' 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stdout:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2668001e10 con 0x558b253e16c0 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.579+0000 7f267bfff640 1 -- 10.20.193.162:0/1862158135 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 15579628 0 0) 0x7f2668001e10 con 0x558b253e16c0 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.579+0000 7f267bfff640 1 -- 10.20.193.162:0/1862158135 >> v1:10.20.193.70:6789/0 conn(0x558b253bfb90 legacy=0x558b253e0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.579+0000 7f267bfff640 1 -- 10.20.193.162:0/1862158135 >> v1:10.20.193.26:6789/0 conn(0x558b2539ec10 legacy=0x558b253a6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.579+0000 7f267bfff640 10 monclient: _finish_hunting 0 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.579+0000 7f267bfff640 1 monclient: found mon.noname-c 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.579+0000 7f267bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.579+0000 7f267bfff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.579+0000 7f267bfff640 1 -- 10.20.193.162:0/1862158135 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b2539e3b0 con 0x558b253e16c0 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.579+0000 7f267bfff640 10 monclient: _finish_auth 0 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.579+0000 7f267bfff640 10 monclient: _check_auth_tickets 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.579+0000 7f267bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.579+0000 7f267bfff640 1 -- 10.20.193.162:0/1862158135 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f267c001900 con 0x558b253e16c0 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.579+0000 7f267bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.579+0000 7f267bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.579+0000 7f267bfff640 10 monclient: dump: 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: epoch 1 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: election_strategy: 3 2026-02-24T19:18:41.686 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.579+0000 7f268c4ec880 5 monclient: authenticate success, global_id 4712 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.579+0000 7f268c4ec880 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.611+0000 7f267bfff640 1 -- 10.20.193.162:0/1862158135 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f267c001b80 con 0x558b253e16c0 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.611+0000 7f267bfff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.611+0000 7f267bfff640 1 -- 10.20.193.162:0/1862158135 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f267c001f90 con 0x558b253e16c0 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.611+0000 7f267bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.611+0000 7f267bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.611+0000 7f267bfff640 10 monclient: dump: 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: epoch 1 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: election_strategy: 3 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.611+0000 7f268c4ec880 10 monclient: get_monmap_and_config success 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.611+0000 7f268c4ec880 4 set_mon_vals no callback set 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612+0000 7f268c4ec880 10 monclient: shutdown 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612+0000 7f268c4ec880 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612+0000 7f268c4ec880 1 -- 10.20.193.162:0/1862158135 >> v1:10.20.193.103:6789/0 conn(0x558b253e16c0 legacy=0x558b253998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612+0000 7f268c4ec880 1 -- 10.20.193.162:0/1862158135 shutdown_connections 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612+0000 7f268c4ec880 1 -- 10.20.193.162:0/1862158135 >> 10.20.193.162:0/1862158135 conn(0x558b252eea70 msgr2=0x558b25401b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612+0000 7f268c4ec880 1 -- 10.20.193.162:0/1862158135 shutdown_connections 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612+0000 7f268c4ec880 1 -- 10.20.193.162:0/1862158135 wait complete. 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612+0000 7f268c4ec880 10 monclient: build_initial_monmap 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612+0000 7f268c4ec880 10 monclient: monmap: 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: epoch 0 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: last_changed 0.000000 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: created 0.000000 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: min_mon_release 0 (unknown) 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: election_strategy: 1 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612+0000 7f268c4ec880 1 librados: starting msgr at 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612+0000 7f268c4ec880 1 librados: starting objecter 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612+0000 7f268c4ec880 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:18:41.687 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612+0000 7f268c4ec880 1 Processor -- start 2026-02-24T19:18:41.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612+0000 7f268c4ec880 1 -- start start 2026-02-24T19:18:41.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612+0000 7f268c4ec880 1 librados: setting wanted keys 2026-02-24T19:18:41.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612+0000 7f268c4ec880 1 librados: calling monclient init 2026-02-24T19:18:41.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612+0000 7f268c4ec880 10 monclient: init 2026-02-24T19:18:41.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612+0000 7f268c4ec880 10 monclient: _reopen_session rank -1 2026-02-24T19:18:41.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612+0000 7f268c4ec880 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:18:41.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612+0000 7f268c4ec880 10 monclient(hunting): picked mon.noname-c con 0x558b2539ec10 addr v1:10.20.193.103:6789/0 2026-02-24T19:18:41.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612+0000 7f268c4ec880 10 monclient(hunting): picked mon.noname-b con 0x558b253bfb90 addr v1:10.20.193.70:6789/0 2026-02-24T19:18:41.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612+0000 7f268c4ec880 10 monclient(hunting): picked mon.noname-a con 0x558b253e16c0 addr v1:10.20.193.26:6789/0 2026-02-24T19:18:41.699 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612+0000 7f268c4ec880 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x558b253a9e80 con 0x558b253e16c0 2026-02-24T19:18:41.699 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612+0000 7f268c4ec880 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x558b2539afe0 con 0x558b253bfb90 2026-02-24T19:18:41.699 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612+0000 7f268c4ec880 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x558b2539b1b0 con 0x558b2539ec10 2026-02-24T19:18:41.699 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612+0000 7f268c4ec880 10 monclient(hunting): _renew_subs 2026-02-24T19:18:41.699 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.612+0000 7f268c4ec880 10 monclient(hunting): authenticate will time out at 3697.248884s 2026-02-24T19:18:41.699 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.645+0000 7f268a7a3640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x558b253e16c0 0x558b253988b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.162:55832/0 (socket says 10.20.193.162:55832) 2026-02-24T19:18:41.699 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.645+0000 7f268a7a3640 1 -- 10.20.193.162:0/2235842404 learned_addr learned my addr 10.20.193.162:0/2235842404 (peer_addr_for_me v1:10.20.193.162:0/0) 2026-02-24T19:18:41.699 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.645+0000 7f267affd640 10 client.?.objecter ms_handle_connect 0x558b253e16c0 2026-02-24T19:18:41.699 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.645+0000 7f267affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:41.699 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.657+0000 7f267affd640 10 client.?.objecter ms_handle_connect 0x558b2539ec10 2026-02-24T19:18:41.699 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.657+0000 7f267affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:41.699 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.665+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 331516959 0 0) 0x558b253a9e80 con 0x558b253e16c0 2026-02-24T19:18:41.699 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.665+0000 7f267affd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:41.699 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.665+0000 7f267affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:41.699 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.665+0000 7f267affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:41.699 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.665+0000 7f267affd640 10 monclient(hunting): my global_id is 4803 2026-02-24T19:18:41.699 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.665+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2668001df0 con 0x558b253e16c0 2026-02-24T19:18:41.699 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.670+0000 7f267affd640 10 client.?.objecter ms_handle_connect 0x558b253bfb90 2026-02-24T19:18:41.699 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.670+0000 7f267affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:18:41.699 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.683+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4284681339 0 0) 0x558b2539b1b0 con 0x558b2539ec10 2026-02-24T19:18:41.699 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.683+0000 7f267affd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:41.699 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.683+0000 7f267affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:41.699 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.683+0000 7f267affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:41.699 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.683+0000 7f267affd640 10 monclient(hunting): my global_id is 4817 2026-02-24T19:18:41.699 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.683+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x558b253a9e80 con 0x558b2539ec10 2026-02-24T19:18:41.699 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.697+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 967807034 0 0) 0x558b2539afe0 con 0x558b253bfb90 2026-02-24T19:18:41.699 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.697+0000 7f267affd640 10 monclient(hunting): _negotiate 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.697+0000 7f267affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.697+0000 7f267affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.697+0000 7f267affd640 10 monclient(hunting): my global_id is 4768 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.697+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x558b2539b1b0 con 0x558b253bfb90 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.702+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3957655190 0 0) 0x7f2668001df0 con 0x558b253e16c0 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.702+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x558b2539afe0 con 0x558b253e16c0 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.702+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f267c001c60 con 0x558b253e16c0 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.702+0000 7f267affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.702+0000 7f267affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.702+0000 7f267affd640 10 monclient(hunting): dump: 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: epoch 1 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: election_strategy: 3 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.702+0000 7f267affd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.738+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2194918641 0 0) 0x558b2539b1b0 con 0x558b253bfb90 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.738+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2668001df0 con 0x558b253bfb90 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.738+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2674001840 con 0x558b253bfb90 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.738+0000 7f267affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.738+0000 7f267affd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.738+0000 7f267affd640 10 monclient(hunting): dump: 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: epoch 1 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: election_strategy: 3 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.745 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.743+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4228753170 0 0) 0x558b253a9e80 con 0x558b2539ec10 2026-02-24T19:18:41.756 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.743+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x558b2539b1b0 con 0x558b2539ec10 2026-02-24T19:18:41.756 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.743+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2680001860 con 0x558b2539ec10 2026-02-24T19:18:41.756 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.743+0000 7f267affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:18:41.756 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.743+0000 7f267affd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:18:41.756 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.743+0000 7f267affd640 10 monclient(hunting): dump: 2026-02-24T19:18:41.756 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: epoch 1 2026-02-24T19:18:41.756 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:41.756 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:41.756 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:41.756 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-24T19:18:41.756 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: election_strategy: 3 2026-02-24T19:18:41.756 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:41.756 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:41.756 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:41.756 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.756 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.754+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1786356839 0 0) 0x558b2539afe0 con 0x558b253e16c0 2026-02-24T19:18:41.756 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.754+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 >> v1:10.20.193.103:6789/0 conn(0x558b2539ec10 legacy=0x558b253a9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:41.756 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.754+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 >> v1:10.20.193.70:6789/0 conn(0x558b253bfb90 legacy=0x558b253dff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:41.756 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.754+0000 7f267affd640 10 monclient: _finish_hunting 0 2026-02-24T19:18:41.756 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.754+0000 7f267affd640 1 monclient: found mon.a 2026-02-24T19:18:41.756 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.754+0000 7f267affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:41.756 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.754+0000 7f267affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:41.756 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.754+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b2539b380 con 0x558b253e16c0 2026-02-24T19:18:41.756 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.754+0000 7f267affd640 10 monclient: _finish_auth 0 2026-02-24T19:18:41.756 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.754+0000 7f267affd640 10 monclient: _check_auth_tickets 2026-02-24T19:18:41.757 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.754+0000 7f267affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:41.757 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.754+0000 7f268c4ec880 5 monclient: authenticate success, global_id 4803 2026-02-24T19:18:41.757 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.754+0000 7f268c4ec880 10 monclient: _renew_subs 2026-02-24T19:18:41.757 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.754+0000 7f268c4ec880 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:41.757 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.754+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x558b2539b670 con 0x558b253e16c0 2026-02-24T19:18:41.757 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.754+0000 7f268c4ec880 10 client.4803.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:41.757 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.754+0000 7f268c4ec880 10 monclient: _renew_subs 2026-02-24T19:18:41.757 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.754+0000 7f268c4ec880 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:41.757 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.754+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x558b2539bb40 con 0x558b253e16c0 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.754+0000 7f268c4ec880 1 librados: init done 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.754+0000 7f268c4ec880 10 librados: wait_for_osdmap waiting 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.828+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f267c002010 con 0x558b253e16c0 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.828+0000 7f267affd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.828+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f267c003a00 con 0x558b253e16c0 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.828+0000 7f267affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.828+0000 7f267affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.828+0000 7f267affd640 10 monclient: dump: 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: epoch 1 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: election_strategy: 3 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.828+0000 7f267bfff640 4 set_mon_vals no callback set 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.829+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f267c01c870 con 0x558b253e16c0 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.829+0000 7f2689fa2640 10 monclient: get_auth_request con 0x7f2668076970 auth_method 0 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.830+0000 7f267affd640 10 client.4803.objecter ms_handle_connect 0x7f2668076970 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.830+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(30..30 src has 1..30) ==== 8141+0+0 (unknown 2175082271 0 0) 0x7f267c091e70 con 0x558b253e16c0 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.830+0000 7f267affd640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_map(30..30 src has 1..30) 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.830+0000 7f267affd640 3 client.4803.objecter handle_osd_map got epochs [30,30] > 0 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.830+0000 7f267affd640 3 client.4803.objecter handle_osd_map decoding full epoch 30 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.830+0000 7f267affd640 20 client.4803.objecter dump_active .. 0 homeless 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.830+0000 7f268c4ec880 10 librados: wait_for_osdmap done waiting 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.830+0000 7f268c4ec880 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:41.882 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.830+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x558b2529cda0 con 0x558b253e16c0 2026-02-24T19:18:41.883 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.880+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (unknown 1262516695 0 0) 0x7f267c05bf70 con 0x558b253e16c0 2026-02-24T19:18:41.883 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.880+0000 7f267affd640 10 monclient: handle_get_version_reply finishing 1 version 30 2026-02-24T19:18:41.883 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.880+0000 7f267b7fe640 10 client.4803.objecter _get_latest_version latest 30, have it 2026-02-24T19:18:43.506 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.880+0000 7f268c4ec880 10 client.4803.objecter create_pool name=ceph_test_rados_api_asio 2026-02-24T19:18:43.506 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.880+0000 7f268c4ec880 10 client.4803.objecter pool_op_submit 1 2026-02-24T19:18:43.506 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.880+0000 7f268c4ec880 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:43.506 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:41.880+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6789/0 -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) -- 0x558b25221570 con 0x558b253e16c0 2026-02-24T19:18:43.506 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.427+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 <== mon.0 v1:10.20.193.26:6789/0 10 ==== pool_op_reply(tid 1 (0) Success v32) ==== 43+0+0 (unknown 847317845 0 0) 0x7f267c05c1a0 con 0x558b253e16c0 2026-02-24T19:18:43.506 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.427+0000 7f267affd640 10 client.4803.objecter ms_dispatch2 0x558b25263590 pool_op_reply(tid 1 (0) Success v32) 2026-02-24T19:18:43.506 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.427+0000 7f267affd640 10 client.4803.objecter handle_pool_op_reply pool_op_reply(tid 1 (0) Success v32) 2026-02-24T19:18:43.506 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.427+0000 7f267affd640 10 client.4803.objecter have request 1 at 0x558b253aa5d0 Op: create 2026-02-24T19:18:43.506 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.427+0000 7f267affd640 20 client.4803.objecter waiting for client to reach epoch 32 before calling back 2026-02-24T19:18:43.507 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.427+0000 7f267affd640 10 client.4803.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:18:43.507 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.427+0000 7f267affd640 10 monclient: _renew_subs 2026-02-24T19:18:43.507 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.427+0000 7f267affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:18:43.507 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.427+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=31}) -- 0x558b2539afe0 con 0x558b253e16c0 2026-02-24T19:18:43.507 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.427+0000 7f267affd640 10 client.4803.objecter done 2026-02-24T19:18:43.507 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.503+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 <== mon.0 v1:10.20.193.26:6789/0 11 ==== osd_map(31..32 src has 1..32) ==== 15126+0+0 (unknown 3062241129 0 0) 0x7f267c058130 con 0x558b253e16c0 2026-02-24T19:18:43.507 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.504+0000 7f267affd640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_map(31..32 src has 1..32) 2026-02-24T19:18:43.507 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.504+0000 7f267affd640 3 client.4803.objecter handle_osd_map got epochs [31,32] > 30 2026-02-24T19:18:43.507 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.504+0000 7f267affd640 3 client.4803.objecter handle_osd_map decoding incremental epoch 31 2026-02-24T19:18:43.507 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.504+0000 7f267affd640 3 client.4803.objecter handle_osd_map decoding incremental epoch 32 2026-02-24T19:18:43.507 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.504+0000 7f267affd640 20 client.4803.objecter dump_active .. 0 homeless 2026-02-24T19:18:43.507 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.504+0000 7f268c4ec880 10 librados: set snap read head -> 1 2026-02-24T19:18:43.507 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.504+0000 7f268c4ec880 10 librados: writefull oid=exist nspace= 2026-02-24T19:18:43.508 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.504+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253afc30 2026-02-24T19:18:43.508 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.504+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 32 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:43.508 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.504+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:43.508 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.504+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:43.508 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.504+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:43.508 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.504+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid exist '@9' '@9' [writefull 0~5 in=5b] tid 2 osd.0 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.504+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.504+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 2 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.504+0000 7f268c4ec880 15 client.4803.objecter _send_op 2 to 9.1 on osd.0 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.504+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:2 9.1 9:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558b253b20e0 con 0x558b253b05f0 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.504+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.504+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.777+0000 7f26897a1640 10 monclient: get_auth_request con 0x558b253b05f0 auth_method 0 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:43.797+0000 7f267affd640 10 client.4803.objecter ms_handle_connect 0x558b253b05f0 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:44.612+0000 7f2679ffb640 10 monclient: tick 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:44.612+0000 7f2679ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:44.612+0000 7f2679ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:44.612+0000 7f2679ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:45.613+0000 7f2679ffb640 10 monclient: tick 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:45.613+0000 7f2679ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:45.613+0000 7f2679ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:46.613+0000 7f2679ffb640 10 monclient: tick 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:46.613+0000 7f2679ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:46.613+0000 7f2679ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:46.755+0000 7f268c22d640 10 client.4803.objecter tick 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:46.755+0000 7f268c22d640 20 client.4803.objecter tick: elapsed since last osdmap request 3.32795s, stale_window 10s, epoch 33, monc->get_start(osdmap) 0 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.249+0000 7f267affd640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 1 ==== osd_map(33..34 src has 1..34) ==== 12546+0+0 (unknown 2557429453 0 0) 0x7f2674002ec0 con 0x558b253b05f0 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.249+0000 7f267affd640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_map(33..34 src has 1..34) 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.249+0000 7f267affd640 3 client.4803.objecter handle_osd_map got epochs [33,34] > 32 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.249+0000 7f267affd640 3 client.4803.objecter handle_osd_map decoding incremental epoch 33 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.249+0000 7f267affd640 10 client.4803.objecter checking op 2 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.249+0000 7f267affd640 20 client.4803.objecter _calc_target epoch 33 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.249+0000 7f267affd640 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.249+0000 7f267affd640 3 client.4803.objecter handle_osd_map decoding incremental epoch 34 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.249+0000 7f267affd640 10 client.4803.objecter checking op 2 2026-02-24T19:18:47.251 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.249+0000 7f267affd640 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.249+0000 7f267affd640 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.249+0000 7f267affd640 20 client.4803.objecter dump_active .. 0 homeless 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.249+0000 7f267affd640 20 client.4803.objecter 2 9.d3a59201 osd.0 exist [writefull 0~5 in=5b] 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 2 ==== osd_op_reply(2 exist [writefull 0~5] v34'1 uv1 ondisk = 0) ==== 149+0+0 (unknown 2971109847 0 0) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(2 exist [writefull 0~5] v34'1 uv1 ondisk = 0) 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 2 ondisk uv 1 in 9.1 attempt 0 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 0 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 2 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f26897a1640 15 client.4803.objecter _finish_op 2 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 2 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f26897a1640 5 client.4803.objecter 0 in flight 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f268c4ec880 10 librados: Objecter returned from writefull r=0 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b25399fd0 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f268c4ec880 10 client.4803.objecter chose random osd.11 of [0,11] 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b253afde0 osd=11 3 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid exist '@9' '@9' [read 0~256] tid 3 osd.11 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b253afde0 osd=11 3 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 11 3 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f268c4ec880 15 client.4803.objecter _send_op 3 to 9.1 on osd.11 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.162:6813/1717662802 -- osd_op(unknown.0.0:3 9.1 9:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x558b253b3ba0 con 0x558b2539a990 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b253afde0 osd=11 4 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.469 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b40b0 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f268c4ec880 20 client.4803.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.a7bbaa1 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f268c4ec880 10 client.4803.objecter chose random osd.11 of [0,11] 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b253afde0 osd=11 4 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid noexist '@9' '@9' [read 0~256] tid 4 osd.11 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b253afde0 osd=11 4 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 11 4 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f268c4ec880 15 client.4803.objecter _send_op 4 to 9.1 on osd.11 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.162:6813/1717662802 -- osd_op(unknown.0.0:4 9.1 9:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x558b253b4560 con 0x558b2539a990 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b253afde0 osd=11 5 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.467+0000 7f268c4ec880 5 client.4803.objecter 2 in flight 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.488+0000 7f2689fa2640 10 monclient: get_auth_request con 0x558b2539a990 auth_method 0 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.489+0000 7f267affd640 10 client.4803.objecter ms_handle_connect 0x558b2539a990 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 1 -- 10.20.193.162:0/2235842404 <== osd.11 v1:10.20.193.162:6813/1717662802 1 ==== osd_op_reply(3 exist [read 0~256] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 1856604616 0 0) 0x7f2680006350 con 0x558b2539a990 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(3 exist [read 0~256] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 7 client.4803.objecter handle_osd_op_reply 3 ondisk uv 0 in 9.1 attempt 0 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 7 client.4803.objecter got -EAGAIN, resubmitting 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 20 client.4803.objecter put_session s=0x558b253afde0 osd=11 5 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 15 client.4803.objecter _session_op_remove 11 3 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 10 client.4803.objecter _op_submit op 0x558b25399fd0 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 10 client.4803.objecter _op_submit oid exist '@9' '@9' [read 0~256] tid 5 osd.0 2026-02-24T19:18:47.503 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.518 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 15 client.4803.objecter _session_op_assign 0 5 2026-02-24T19:18:47.518 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 15 client.4803.objecter _send_op 5 to 9.1 on osd.0 2026-02-24T19:18:47.518 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:5 9.1 9:8049a5cb:::exist:head [read 0~256] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34) -- 0x558b253b4560 con 0x558b253b05f0 2026-02-24T19:18:47.518 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.518 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 5 client.4803.objecter 2 in flight 2026-02-24T19:18:47.518 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 1 -- 10.20.193.162:0/2235842404 <== osd.11 v1:10.20.193.162:6813/1717662802 2 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2748284286 0 0) 0x7f2680006350 con 0x558b2539a990 2026-02-24T19:18:47.518 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:47.518 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.518 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 7 client.4803.objecter handle_osd_op_reply 4 ondisk uv 0 in 9.1 attempt 0 2026-02-24T19:18:47.518 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 10 client.4803.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:47.518 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 10 client.4803.objecter op 0 rval 0 len 0 2026-02-24T19:18:47.518 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 15 client.4803.objecter handle_osd_op_reply completed tid 4 2026-02-24T19:18:47.518 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 15 client.4803.objecter _finish_op 4 2026-02-24T19:18:47.518 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 20 client.4803.objecter put_session s=0x558b253afde0 osd=11 4 2026-02-24T19:18:47.518 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 15 client.4803.objecter _session_op_remove 11 4 2026-02-24T19:18:47.518 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.501+0000 7f2689fa2640 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.518 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 3 ==== osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 2160721646 0 3741568377) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.518 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-24T19:18:47.518 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.518 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 5 ondisk uv 1 in 9.1 attempt 1 2026-02-24T19:18:47.518 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 5 2026-02-24T19:18:47.518 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 5 2026-02-24T19:18:47.518 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f26897a1640 15 client.4803.objecter _finish_op 5 2026-02-24T19:18:47.518 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.519 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 5 2026-02-24T19:18:47.519 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f26897a1640 5 client.4803.objecter 0 in flight 2026-02-24T19:18:47.519 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (49 ms) 2026-02-24T19:18:47.519 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncReadDeferred 2026-02-24T19:18:47.521 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b25399fd0 2026-02-24T19:18:47.521 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.521 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.521 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.521 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f268c4ec880 10 client.4803.objecter chose random osd.11 of [0,11] 2026-02-24T19:18:47.521 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b253afde0 osd=11 3 2026-02-24T19:18:47.521 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid exist '@9' '@9' [read 0~256] tid 6 osd.11 2026-02-24T19:18:47.521 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b253afde0 osd=11 3 2026-02-24T19:18:47.521 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 11 6 2026-02-24T19:18:47.521 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f268c4ec880 15 client.4803.objecter _send_op 6 to 9.1 on osd.11 2026-02-24T19:18:47.521 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.162:6813/1717662802 -- osd_op(unknown.0.0:6 9.1 9:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x558b253b40b0 con 0x558b2539a990 2026-02-24T19:18:47.521 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b253afde0 osd=11 4 2026-02-24T19:18:47.521 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.521 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b49e0 2026-02-24T19:18:47.521 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.522 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f268c4ec880 20 client.4803.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2026-02-24T19:18:47.522 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.a7bbaa1 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.522 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f268c4ec880 10 client.4803.objecter chose random osd.0 of [0,11] 2026-02-24T19:18:47.522 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.522 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid noexist '@9' '@9' [read 0~256] tid 7 osd.0 2026-02-24T19:18:47.522 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.522 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 7 2026-02-24T19:18:47.522 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f268c4ec880 15 client.4803.objecter _send_op 7 to 9.1 on osd.0 2026-02-24T19:18:47.522 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:7 9.1 9:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x558b253b4e90 con 0x558b253b05f0 2026-02-24T19:18:47.522 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.522 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.516+0000 7f268c4ec880 5 client.4803.objecter 2 in flight 2026-02-24T19:18:47.522 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.520+0000 7f2689fa2640 1 -- 10.20.193.162:0/2235842404 <== osd.11 v1:10.20.193.162:6813/1717662802 3 ==== osd_op_reply(6 exist [read 0~256] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 1856604616 0 0) 0x7f2680006350 con 0x558b2539a990 2026-02-24T19:18:47.523 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.520+0000 7f2689fa2640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(6 exist [read 0~256] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-24T19:18:47.523 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.520+0000 7f2689fa2640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.523 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.520+0000 7f2689fa2640 7 client.4803.objecter handle_osd_op_reply 6 ondisk uv 0 in 9.1 attempt 0 2026-02-24T19:18:47.523 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.520+0000 7f2689fa2640 7 client.4803.objecter got -EAGAIN, resubmitting 2026-02-24T19:18:47.523 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.520+0000 7f2689fa2640 20 client.4803.objecter put_session s=0x558b253afde0 osd=11 4 2026-02-24T19:18:47.523 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.520+0000 7f2689fa2640 15 client.4803.objecter _session_op_remove 11 6 2026-02-24T19:18:47.523 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.520+0000 7f2689fa2640 10 client.4803.objecter _op_submit op 0x558b25399fd0 2026-02-24T19:18:47.523 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.520+0000 7f2689fa2640 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.523 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.520+0000 7f2689fa2640 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.523 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.520+0000 7f2689fa2640 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.523 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.520+0000 7f2689fa2640 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.523 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.520+0000 7f2689fa2640 10 client.4803.objecter _op_submit oid exist '@9' '@9' [read 0~256] tid 8 osd.0 2026-02-24T19:18:47.523 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.520+0000 7f2689fa2640 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.523 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.520+0000 7f2689fa2640 15 client.4803.objecter _session_op_assign 0 8 2026-02-24T19:18:47.523 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.520+0000 7f2689fa2640 15 client.4803.objecter _send_op 8 to 9.1 on osd.0 2026-02-24T19:18:47.523 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.520+0000 7f2689fa2640 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:8 9.1 9:8049a5cb:::exist:head [read 0~256] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34) -- 0x558b253b40b0 con 0x558b253b05f0 2026-02-24T19:18:47.523 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.520+0000 7f2689fa2640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 5 2026-02-24T19:18:47.523 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.520+0000 7f2689fa2640 5 client.4803.objecter 2 in flight 2026-02-24T19:18:47.523 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.521+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 4 ==== osd_op_reply(7 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2748284286 0 0) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.523 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.521+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(7 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:47.523 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.521+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.523 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.521+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 7 ondisk uv 0 in 9.1 attempt 0 2026-02-24T19:18:47.523 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.521+0000 7f26897a1640 10 client.4803.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:47.523 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.521+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 0 2026-02-24T19:18:47.523 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.521+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 7 2026-02-24T19:18:47.523 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.521+0000 7f26897a1640 15 client.4803.objecter _finish_op 7 2026-02-24T19:18:47.523 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.521+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 5 2026-02-24T19:18:47.531 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.521+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 7 2026-02-24T19:18:47.531 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.521+0000 7f26897a1640 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.531 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.529+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 5 ==== osd_op_reply(8 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 2160721646 0 3741568377) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.531 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.529+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(8 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-24T19:18:47.531 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.529+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.531 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.529+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 8 ondisk uv 1 in 9.1 attempt 1 2026-02-24T19:18:47.531 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.529+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 5 2026-02-24T19:18:47.531 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.529+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 8 2026-02-24T19:18:47.531 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncReadDeferred (13 ms) 2026-02-24T19:18:47.531 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2026-02-24T19:18:47.531 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.529+0000 7f26897a1640 15 client.4803.objecter _finish_op 8 2026-02-24T19:18:47.531 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.529+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.531 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.529+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 8 2026-02-24T19:18:47.531 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.529+0000 7f26897a1640 5 client.4803.objecter 0 in flight 2026-02-24T19:18:47.531 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.530+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b25399fd0 2026-02-24T19:18:47.531 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.530+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.531 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.530+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.532 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.530+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.532 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.530+0000 7f268c4ec880 10 client.4803.objecter chose random osd.0 of [0,11] 2026-02-24T19:18:47.532 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.530+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.532 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.530+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid exist '@9' '@9' [read 0~256] tid 9 osd.0 2026-02-24T19:18:47.532 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.530+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.532 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.530+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 9 2026-02-24T19:18:47.532 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.530+0000 7f268c4ec880 15 client.4803.objecter _send_op 9 to 9.1 on osd.0 2026-02-24T19:18:47.532 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.530+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:9 9.1 9:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x558b253b49e0 con 0x558b253b05f0 2026-02-24T19:18:47.532 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.530+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.532 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.530+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.532 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.530+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b5550 2026-02-24T19:18:47.532 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.530+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.532 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.530+0000 7f268c4ec880 20 client.4803.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2026-02-24T19:18:47.545 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.530+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.a7bbaa1 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.530+0000 7f268c4ec880 10 client.4803.objecter chose random osd.11 of [0,11] 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.530+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b253afde0 osd=11 3 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.530+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid noexist '@9' '@9' [read 0~256] tid 10 osd.11 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.530+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b253afde0 osd=11 3 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.530+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 11 10 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.530+0000 7f268c4ec880 15 client.4803.objecter _send_op 10 to 9.1 on osd.11 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.530+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.162:6813/1717662802 -- osd_op(unknown.0.0:10 9.1 9:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x558b253b5a00 con 0x558b2539a990 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.530+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b253afde0 osd=11 4 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.530+0000 7f268c4ec880 5 client.4803.objecter 2 in flight 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.536+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 6 ==== osd_op_reply(9 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 873761191 0 3741568377) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.536+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(9 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.536+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.536+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 9 ondisk uv 1 in 9.1 attempt 0 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.536+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 5 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.536+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 9 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.536+0000 7f26897a1640 15 client.4803.objecter _finish_op 9 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.536+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.536+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 9 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.536+0000 7f26897a1640 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f2689fa2640 1 -- 10.20.193.162:0/2235842404 <== osd.11 v1:10.20.193.162:6813/1717662802 4 ==== osd_op_reply(10 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2748284286 0 0) 0x7f2680006350 con 0x558b2539a990 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f2689fa2640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(10 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f2689fa2640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f2689fa2640 7 client.4803.objecter handle_osd_op_reply 10 ondisk uv 0 in 9.1 attempt 0 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f2689fa2640 10 client.4803.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f2689fa2640 10 client.4803.objecter op 0 rval 0 len 0 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f2689fa2640 15 client.4803.objecter handle_osd_op_reply completed tid 10 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f2689fa2640 15 client.4803.objecter _finish_op 10 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f2689fa2640 20 client.4803.objecter put_session s=0x558b253afde0 osd=11 4 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f2689fa2640 15 client.4803.objecter _session_op_remove 11 10 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f2689fa2640 5 client.4803.objecter 0 in flight 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (14 ms) 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b5530 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f268c4ec880 10 client.4803.objecter chose random osd.0 of [0,11] 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid exist '@9' '@9' [read 0~256] tid 11 osd.0 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.546 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 11 2026-02-24T19:18:47.547 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f268c4ec880 15 client.4803.objecter _send_op 11 to 9.1 on osd.0 2026-02-24T19:18:47.547 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:11 9.1 9:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x558b2539a0e0 con 0x558b253b05f0 2026-02-24T19:18:47.547 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.547 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.547 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b6080 2026-02-24T19:18:47.547 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.547 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f268c4ec880 20 client.4803.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2026-02-24T19:18:47.547 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.a7bbaa1 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.547 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f268c4ec880 10 client.4803.objecter chose random osd.0 of [0,11] 2026-02-24T19:18:47.547 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.547 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid noexist '@9' '@9' [read 0~256] tid 12 osd.0 2026-02-24T19:18:47.547 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.547 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 12 2026-02-24T19:18:47.547 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f268c4ec880 15 client.4803.objecter _send_op 12 to 9.1 on osd.0 2026-02-24T19:18:47.551 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:12 9.1 9:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x558b253b6530 con 0x558b253b05f0 2026-02-24T19:18:47.551 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 5 2026-02-24T19:18:47.551 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.544+0000 7f268c4ec880 5 client.4803.objecter 2 in flight 2026-02-24T19:18:47.551 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.549+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 7 ==== osd_op_reply(11 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 873761191 0 3741568377) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.551 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.549+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(11 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-24T19:18:47.551 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.549+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.551 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.549+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 11 ondisk uv 1 in 9.1 attempt 0 2026-02-24T19:18:47.551 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.549+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 5 2026-02-24T19:18:47.551 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.549+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 11 2026-02-24T19:18:47.551 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.549+0000 7f26897a1640 15 client.4803.objecter _finish_op 11 2026-02-24T19:18:47.551 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.549+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 5 2026-02-24T19:18:47.551 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.549+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 11 2026-02-24T19:18:47.551 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.549+0000 7f26897a1640 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.551 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 8 ==== osd_op_reply(12 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2748284286 0 0) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.551 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(12 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:47.552 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.552 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 12 ondisk uv 0 in 9.1 attempt 0 2026-02-24T19:18:47.552 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f26897a1640 10 client.4803.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:47.552 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 0 2026-02-24T19:18:47.552 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 12 2026-02-24T19:18:47.552 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f26897a1640 15 client.4803.objecter _finish_op 12 2026-02-24T19:18:47.552 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.552 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (5 ms) 2026-02-24T19:18:47.552 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 12 2026-02-24T19:18:47.552 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncReadAwaitable 2026-02-24T19:18:47.552 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f26897a1640 5 client.4803.objecter 0 in flight 2026-02-24T19:18:47.552 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b5530 2026-02-24T19:18:47.552 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.552 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.554 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.554 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f268c4ec880 10 client.4803.objecter chose random osd.0 of [0,11] 2026-02-24T19:18:47.554 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.554 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid exist '@9' '@9' [read 0~256] tid 13 osd.0 2026-02-24T19:18:47.554 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.554 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 13 2026-02-24T19:18:47.554 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f268c4ec880 15 client.4803.objecter _send_op 13 to 9.1 on osd.0 2026-02-24T19:18:47.554 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:13 9.1 9:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x558b253b68d0 con 0x558b253b05f0 2026-02-24T19:18:47.554 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.554 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.554 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b6dc0 2026-02-24T19:18:47.554 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.554 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f268c4ec880 20 client.4803.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2026-02-24T19:18:47.554 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.a7bbaa1 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.554 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f268c4ec880 10 client.4803.objecter chose random osd.0 of [0,11] 2026-02-24T19:18:47.554 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.554 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid noexist '@9' '@9' [read 0~256] tid 14 osd.0 2026-02-24T19:18:47.554 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.554 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 14 2026-02-24T19:18:47.554 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f268c4ec880 15 client.4803.objecter _send_op 14 to 9.1 on osd.0 2026-02-24T19:18:47.554 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:14 9.1 9:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x558b253b7270 con 0x558b253b05f0 2026-02-24T19:18:47.554 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 5 2026-02-24T19:18:47.554 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.550+0000 7f268c4ec880 5 client.4803.objecter 2 in flight 2026-02-24T19:18:47.554 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.552+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 9 ==== osd_op_reply(13 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 873761191 0 3741568377) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.554 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.552+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(13 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-24T19:18:47.554 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.552+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.554 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.552+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 13 ondisk uv 1 in 9.1 attempt 0 2026-02-24T19:18:47.555 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.552+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 5 2026-02-24T19:18:47.555 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.552+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 13 2026-02-24T19:18:47.555 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.552+0000 7f26897a1640 15 client.4803.objecter _finish_op 13 2026-02-24T19:18:47.555 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.552+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 5 2026-02-24T19:18:47.555 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.552+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 13 2026-02-24T19:18:47.555 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.552+0000 7f26897a1640 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.555 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.553+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 10 ==== osd_op_reply(14 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2748284286 0 0) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.555 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.553+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(14 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:47.555 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.553+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.555 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.553+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 14 ondisk uv 0 in 9.1 attempt 0 2026-02-24T19:18:47.555 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.553+0000 7f26897a1640 10 client.4803.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:47.555 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.553+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 0 2026-02-24T19:18:47.555 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.553+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 14 2026-02-24T19:18:47.555 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.553+0000 7f26897a1640 15 client.4803.objecter _finish_op 14 2026-02-24T19:18:47.555 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.553+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.555 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.553+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 14 2026-02-24T19:18:47.555 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.553+0000 7f26897a1640 5 client.4803.objecter 0 in flight 2026-02-24T19:18:47.555 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncReadAwaitable (3 ms) 2026-02-24T19:18:47.555 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2026-02-24T19:18:47.555 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.553+0000 7f268c4ec880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-24T19:18:47.555 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.553+0000 7f268c4ec880 20 librados: queue_aio_write 0x558b25247390 completion 0x558b253b63d0 write_seq 1 2026-02-24T19:18:47.556 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.553+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b5530 2026-02-24T19:18:47.556 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.553+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:47.556 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.553+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.556 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.553+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.556 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.553+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.556 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.553+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid exist '@9' '@9' [write 0~5 in=5b] tid 15 osd.0 2026-02-24T19:18:47.556 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.553+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.556 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.553+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 15 2026-02-24T19:18:47.556 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.553+0000 7f268c4ec880 15 client.4803.objecter _send_op 15 to 9.1 on osd.0 2026-02-24T19:18:47.596 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.553+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:15 9.1 9:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b253b68d0 con 0x558b253b05f0 2026-02-24T19:18:47.596 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.554+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.596 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.554+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.596 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.554+0000 7f268c4ec880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-24T19:18:47.596 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.595+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 11 ==== osd_op_reply(15 exist [write 0~5] v34'2 uv2 ondisk = 0) ==== 149+0+0 (unknown 2980180799 0 0) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.596 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.595+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(15 exist [write 0~5] v34'2 uv2 ondisk = 0) 2026-02-24T19:18:47.596 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.595+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.596 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.595+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 15 ondisk uv 2 in 9.1 attempt 0 2026-02-24T19:18:47.596 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.595+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 0 2026-02-24T19:18:47.596 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.595+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 15 2026-02-24T19:18:47.596 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.595+0000 7f26897a1640 15 client.4803.objecter _finish_op 15 2026-02-24T19:18:47.596 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.595+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.596 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.595+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 15 2026-02-24T19:18:47.596 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.595+0000 7f26897a1640 5 client.4803.objecter 0 in flight 2026-02-24T19:18:47.596 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.595+0000 7f26897a1640 20 librados: complete_aio_write 0x558b253b63d0 2026-02-24T19:18:47.596 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (41 ms) 2026-02-24T19:18:47.597 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteDeferred 2026-02-24T19:18:47.597 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.595+0000 7f268c4ec880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-24T19:18:47.597 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.595+0000 7f268c4ec880 20 librados: queue_aio_write 0x558b25247390 completion 0x558b253b6dc0 write_seq 2 2026-02-24T19:18:47.597 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.595+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b5530 2026-02-24T19:18:47.597 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.595+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:47.597 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.595+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.597 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.595+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.597 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.595+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.597 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.595+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid exist '@9' '@9' [write 0~5 in=5b] tid 16 osd.0 2026-02-24T19:18:47.597 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.595+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.597 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.595+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 16 2026-02-24T19:18:47.597 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.595+0000 7f268c4ec880 15 client.4803.objecter _send_op 16 to 9.1 on osd.0 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.595+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:16 9.1 9:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b253b6ef0 con 0x558b253b05f0 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.595+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.595+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.595+0000 7f268c4ec880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f2679ffb640 10 monclient: tick 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f2679ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f2679ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 12 ==== osd_op_reply(16 exist [write 0~5] v34'3 uv3 ondisk = 0) ==== 149+0+0 (unknown 3307292907 0 0) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(16 exist [write 0~5] v34'3 uv3 ondisk = 0) 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 16 ondisk uv 3 in 9.1 attempt 0 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 0 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 16 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f26897a1640 15 client.4803.objecter _finish_op 16 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 16 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f26897a1640 5 client.4803.objecter 0 in flight 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f26897a1640 20 librados: complete_aio_write 0x558b253b6dc0 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncWriteDeferred (18 ms) 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f268c4ec880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f268c4ec880 20 librados: queue_aio_write 0x558b25247390 completion 0x558b253b6950 write_seq 3 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b5530 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid exist '@9' '@9' [write 0~5 in=5b] tid 17 osd.0 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 17 2026-02-24T19:18:47.615 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f268c4ec880 15 client.4803.objecter _send_op 17 to 9.1 on osd.0 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:17 9.1 9:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b253b6ef0 con 0x558b253b05f0 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.613+0000 7f268c4ec880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.635+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 13 ==== osd_op_reply(17 exist [write 0~5] v34'4 uv4 ondisk = 0) ==== 149+0+0 (unknown 2404261174 0 0) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.635+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(17 exist [write 0~5] v34'4 uv4 ondisk = 0) 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.635+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.635+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 17 ondisk uv 4 in 9.1 attempt 0 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.635+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 0 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.635+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 17 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.635+0000 7f26897a1640 15 client.4803.objecter _finish_op 17 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.635+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.635+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 17 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.635+0000 7f26897a1640 5 client.4803.objecter 0 in flight 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.635+0000 7f26897a1640 20 librados: complete_aio_write 0x558b253b6950 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (22 ms) 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.635+0000 7f268c4ec880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.635+0000 7f268c4ec880 20 librados: queue_aio_write 0x558b25247390 completion 0x558b253b72b0 write_seq 4 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.635+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b5530 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.635+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.635+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.635+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.635+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.635+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid exist '@9' '@9' [write 0~5 in=5b] tid 18 osd.0 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.635+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.635+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 18 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.635+0000 7f268c4ec880 15 client.4803.objecter _send_op 18 to 9.1 on osd.0 2026-02-24T19:18:47.637 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.635+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:18 9.1 9:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b253bea60 con 0x558b253b05f0 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.635+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.635+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.635+0000 7f268c4ec880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.652+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 14 ==== osd_op_reply(18 exist [write 0~5] v34'5 uv5 ondisk = 0) ==== 149+0+0 (unknown 4224624354 0 0) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.652+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(18 exist [write 0~5] v34'5 uv5 ondisk = 0) 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.652+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.652+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 18 ondisk uv 5 in 9.1 attempt 0 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.652+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 0 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.652+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 18 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.652+0000 7f26897a1640 15 client.4803.objecter _finish_op 18 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.652+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.652+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 18 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (16 ms) 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.652+0000 7f26897a1640 5 client.4803.objecter 0 in flight 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteAwaitable 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.652+0000 7f26897a1640 20 librados: complete_aio_write 0x558b253b72b0 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.652+0000 7f268c4ec880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.652+0000 7f268c4ec880 20 librados: queue_aio_write 0x558b25247390 completion 0x558b253bee20 write_seq 5 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.652+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b5530 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.652+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.652+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.652+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.652+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.652+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid exist '@9' '@9' [write 0~5 in=5b] tid 19 osd.0 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.652+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.652+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 19 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.652+0000 7f268c4ec880 15 client.4803.objecter _send_op 19 to 9.1 on osd.0 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.652+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:19 9.1 9:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b253beff0 con 0x558b253b05f0 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.652+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.654 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.652+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.652+0000 7f268c4ec880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 15 ==== osd_op_reply(19 exist [write 0~5] v34'6 uv6 ondisk = 0) ==== 149+0+0 (unknown 1716480670 0 0) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(19 exist [write 0~5] v34'6 uv6 ondisk = 0) 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 19 ondisk uv 6 in 9.1 attempt 0 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 0 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 19 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f26897a1640 15 client.4803.objecter _finish_op 19 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 19 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f26897a1640 5 client.4803.objecter 0 in flight 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f26897a1640 20 librados: complete_aio_write 0x558b253bee20 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncWriteAwaitable (16 ms) 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b5530 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f268c4ec880 10 client.4803.objecter chose random osd.11 of [0,11] 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b253afde0 osd=11 3 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid exist '@9' '@9' [read 0~0] tid 20 osd.11 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b253afde0 osd=11 3 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 11 20 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f268c4ec880 15 client.4803.objecter _send_op 20 to 9.1 on osd.11 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.162:6813/1717662802 -- osd_op(unknown.0.0:20 9.1 9:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x558b253beff0 con 0x558b2539a990 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b253afde0 osd=11 4 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253bf5b0 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.670 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f268c4ec880 20 client.4803.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2026-02-24T19:18:47.684 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.a7bbaa1 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.684 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f268c4ec880 10 client.4803.objecter chose random osd.11 of [0,11] 2026-02-24T19:18:47.684 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b253afde0 osd=11 4 2026-02-24T19:18:47.684 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid noexist '@9' '@9' [read 0~0] tid 21 osd.11 2026-02-24T19:18:47.684 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b253afde0 osd=11 4 2026-02-24T19:18:47.684 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 11 21 2026-02-24T19:18:47.684 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f268c4ec880 15 client.4803.objecter _send_op 21 to 9.1 on osd.11 2026-02-24T19:18:47.684 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.162:6813/1717662802 -- osd_op(unknown.0.0:21 9.1 9:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x558b253b76b0 con 0x558b2539a990 2026-02-24T19:18:47.684 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b253afde0 osd=11 5 2026-02-24T19:18:47.684 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.668+0000 7f268c4ec880 5 client.4803.objecter 2 in flight 2026-02-24T19:18:47.684 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 1 -- 10.20.193.162:0/2235842404 <== osd.11 v1:10.20.193.162:6813/1717662802 5 ==== osd_op_reply(20 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 52541424 0 0) 0x7f2680006350 con 0x558b2539a990 2026-02-24T19:18:47.684 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(20 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-24T19:18:47.684 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.684 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 7 client.4803.objecter handle_osd_op_reply 20 ondisk uv 0 in 9.1 attempt 0 2026-02-24T19:18:47.684 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 7 client.4803.objecter got -EAGAIN, resubmitting 2026-02-24T19:18:47.684 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 20 client.4803.objecter put_session s=0x558b253afde0 osd=11 5 2026-02-24T19:18:47.684 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 15 client.4803.objecter _session_op_remove 11 20 2026-02-24T19:18:47.684 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 10 client.4803.objecter _op_submit op 0x558b253b5530 2026-02-24T19:18:47.684 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.684 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.684 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.684 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.684 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 10 client.4803.objecter _op_submit oid exist '@9' '@9' [read 0~0] tid 22 osd.0 2026-02-24T19:18:47.684 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.684 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 15 client.4803.objecter _session_op_assign 0 22 2026-02-24T19:18:47.684 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 15 client.4803.objecter _send_op 22 to 9.1 on osd.0 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:22 9.1 9:8049a5cb:::exist:head [read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34) -- 0x558b253b76b0 con 0x558b253b05f0 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 5 client.4803.objecter 2 in flight 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 1 -- 10.20.193.162:0/2235842404 <== osd.11 v1:10.20.193.162:6813/1717662802 6 ==== osd_op_reply(21 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3460776774 0 0) 0x7f2680006350 con 0x558b2539a990 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(21 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 7 client.4803.objecter handle_osd_op_reply 21 ondisk uv 0 in 9.1 attempt 0 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 10 client.4803.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 10 client.4803.objecter op 0 rval 0 len 0 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 15 client.4803.objecter handle_osd_op_reply completed tid 21 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 15 client.4803.objecter _finish_op 21 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 20 client.4803.objecter put_session s=0x558b253afde0 osd=11 4 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 15 client.4803.objecter _session_op_remove 11 21 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.682+0000 7f2689fa2640 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 16 ==== osd_op_reply(22 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 3334087381 0 3741568377) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(22 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 22 ondisk uv 6 in 9.1 attempt 1 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 5 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 22 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f26897a1640 15 client.4803.objecter _finish_op 22 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 22 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f26897a1640 5 client.4803.objecter 0 in flight 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (17 ms) 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationDeferred 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b5530 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.688 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.703 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.703 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f268c4ec880 10 client.4803.objecter chose random osd.11 of [0,11] 2026-02-24T19:18:47.703 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b253afde0 osd=11 3 2026-02-24T19:18:47.703 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid exist '@9' '@9' [read 0~0] tid 23 osd.11 2026-02-24T19:18:47.703 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b253afde0 osd=11 3 2026-02-24T19:18:47.703 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 11 23 2026-02-24T19:18:47.703 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f268c4ec880 15 client.4803.objecter _send_op 23 to 9.1 on osd.11 2026-02-24T19:18:47.703 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.162:6813/1717662802 -- osd_op(unknown.0.0:23 9.1 9:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x558b253bf5b0 con 0x558b2539a990 2026-02-24T19:18:47.703 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b253afde0 osd=11 4 2026-02-24T19:18:47.703 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.703 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b76b0 2026-02-24T19:18:47.703 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.703 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f268c4ec880 20 client.4803.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2026-02-24T19:18:47.703 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.a7bbaa1 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.703 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f268c4ec880 10 client.4803.objecter chose random osd.11 of [0,11] 2026-02-24T19:18:47.703 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b253afde0 osd=11 4 2026-02-24T19:18:47.703 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid noexist '@9' '@9' [read 0~0] tid 24 osd.11 2026-02-24T19:18:47.703 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b253afde0 osd=11 4 2026-02-24T19:18:47.703 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 11 24 2026-02-24T19:18:47.703 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f268c4ec880 15 client.4803.objecter _send_op 24 to 9.1 on osd.11 2026-02-24T19:18:47.703 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.162:6813/1717662802 -- osd_op(unknown.0.0:24 9.1 9:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x558b253b7b60 con 0x558b2539a990 2026-02-24T19:18:47.703 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b253afde0 osd=11 5 2026-02-24T19:18:47.703 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.686+0000 7f268c4ec880 5 client.4803.objecter 2 in flight 2026-02-24T19:18:47.703 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.701+0000 7f2689fa2640 1 -- 10.20.193.162:0/2235842404 <== osd.11 v1:10.20.193.162:6813/1717662802 7 ==== osd_op_reply(23 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 52541424 0 0) 0x7f2680006350 con 0x558b2539a990 2026-02-24T19:18:47.703 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.701+0000 7f2689fa2640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(23 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-24T19:18:47.703 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.701+0000 7f2689fa2640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.701+0000 7f2689fa2640 7 client.4803.objecter handle_osd_op_reply 23 ondisk uv 0 in 9.1 attempt 0 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.701+0000 7f2689fa2640 7 client.4803.objecter got -EAGAIN, resubmitting 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.701+0000 7f2689fa2640 20 client.4803.objecter put_session s=0x558b253afde0 osd=11 5 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.701+0000 7f2689fa2640 15 client.4803.objecter _session_op_remove 11 23 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.701+0000 7f2689fa2640 10 client.4803.objecter _op_submit op 0x558b253b5530 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.701+0000 7f2689fa2640 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.701+0000 7f2689fa2640 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.701+0000 7f2689fa2640 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.701+0000 7f2689fa2640 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.701+0000 7f2689fa2640 10 client.4803.objecter _op_submit oid exist '@9' '@9' [read 0~0] tid 25 osd.0 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.701+0000 7f2689fa2640 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.701+0000 7f2689fa2640 15 client.4803.objecter _session_op_assign 0 25 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.701+0000 7f2689fa2640 15 client.4803.objecter _send_op 25 to 9.1 on osd.0 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.701+0000 7f2689fa2640 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:25 9.1 9:8049a5cb:::exist:head [read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34) -- 0x558b253b7b60 con 0x558b253b05f0 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.701+0000 7f2689fa2640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.701+0000 7f2689fa2640 5 client.4803.objecter 2 in flight 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.703+0000 7f2689fa2640 1 -- 10.20.193.162:0/2235842404 <== osd.11 v1:10.20.193.162:6813/1717662802 8 ==== osd_op_reply(24 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3460776774 0 0) 0x7f2680006350 con 0x558b2539a990 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.703+0000 7f2689fa2640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(24 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.703+0000 7f2689fa2640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.703+0000 7f2689fa2640 7 client.4803.objecter handle_osd_op_reply 24 ondisk uv 0 in 9.1 attempt 0 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.703+0000 7f2689fa2640 10 client.4803.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.703+0000 7f2689fa2640 10 client.4803.objecter op 0 rval 0 len 0 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.703+0000 7f2689fa2640 15 client.4803.objecter handle_osd_op_reply completed tid 24 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.703+0000 7f2689fa2640 15 client.4803.objecter _finish_op 24 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.703+0000 7f2689fa2640 20 client.4803.objecter put_session s=0x558b253afde0 osd=11 4 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.703+0000 7f2689fa2640 15 client.4803.objecter _session_op_remove 11 24 2026-02-24T19:18:47.706 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.703+0000 7f2689fa2640 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 17 ==== osd_op_reply(25 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 3334087381 0 3741568377) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(25 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 25 ondisk uv 6 in 9.1 attempt 1 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 5 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 25 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f26897a1640 15 client.4803.objecter _finish_op 25 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 25 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f26897a1640 5 client.4803.objecter 0 in flight 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationDeferred (18 ms) 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b5530 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f268c4ec880 10 client.4803.objecter chose random osd.11 of [0,11] 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b253afde0 osd=11 3 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid exist '@9' '@9' [read 0~0] tid 26 osd.11 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b253afde0 osd=11 3 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 11 26 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f268c4ec880 15 client.4803.objecter _send_op 26 to 9.1 on osd.11 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.162:6813/1717662802 -- osd_op(unknown.0.0:26 9.1 9:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x558b253b76b0 con 0x558b2539a990 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b253afde0 osd=11 4 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b7c40 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f268c4ec880 20 client.4803.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.a7bbaa1 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.707 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f268c4ec880 10 client.4803.objecter chose random osd.11 of [0,11] 2026-02-24T19:18:47.719 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b253afde0 osd=11 4 2026-02-24T19:18:47.719 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid noexist '@9' '@9' [read 0~0] tid 27 osd.11 2026-02-24T19:18:47.719 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b253afde0 osd=11 4 2026-02-24T19:18:47.719 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 11 27 2026-02-24T19:18:47.719 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f268c4ec880 15 client.4803.objecter _send_op 27 to 9.1 on osd.11 2026-02-24T19:18:47.719 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.162:6813/1717662802 -- osd_op(unknown.0.0:27 9.1 9:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x558b253b80f0 con 0x558b2539a990 2026-02-24T19:18:47.719 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b253afde0 osd=11 5 2026-02-24T19:18:47.719 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.704+0000 7f268c4ec880 5 client.4803.objecter 2 in flight 2026-02-24T19:18:47.719 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 1 -- 10.20.193.162:0/2235842404 <== osd.11 v1:10.20.193.162:6813/1717662802 9 ==== osd_op_reply(26 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 52541424 0 0) 0x7f2680006350 con 0x558b2539a990 2026-02-24T19:18:47.719 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(26 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-24T19:18:47.719 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.719 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 7 client.4803.objecter handle_osd_op_reply 26 ondisk uv 0 in 9.1 attempt 0 2026-02-24T19:18:47.719 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 7 client.4803.objecter got -EAGAIN, resubmitting 2026-02-24T19:18:47.719 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 20 client.4803.objecter put_session s=0x558b253afde0 osd=11 5 2026-02-24T19:18:47.719 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 15 client.4803.objecter _session_op_remove 11 26 2026-02-24T19:18:47.719 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 10 client.4803.objecter _op_submit op 0x558b253b5530 2026-02-24T19:18:47.719 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.719 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.719 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.719 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.719 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 10 client.4803.objecter _op_submit oid exist '@9' '@9' [read 0~0] tid 28 osd.0 2026-02-24T19:18:47.719 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.719 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 15 client.4803.objecter _session_op_assign 0 28 2026-02-24T19:18:47.719 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 15 client.4803.objecter _send_op 28 to 9.1 on osd.0 2026-02-24T19:18:47.719 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:28 9.1 9:8049a5cb:::exist:head [read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34) -- 0x558b253b80f0 con 0x558b253b05f0 2026-02-24T19:18:47.719 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.719 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 5 client.4803.objecter 2 in flight 2026-02-24T19:18:47.722 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 1 -- 10.20.193.162:0/2235842404 <== osd.11 v1:10.20.193.162:6813/1717662802 10 ==== osd_op_reply(27 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3460776774 0 0) 0x7f2680006350 con 0x558b2539a990 2026-02-24T19:18:47.722 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(27 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:47.722 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.722 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 7 client.4803.objecter handle_osd_op_reply 27 ondisk uv 0 in 9.1 attempt 0 2026-02-24T19:18:47.722 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 10 client.4803.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:47.722 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 10 client.4803.objecter op 0 rval 0 len 0 2026-02-24T19:18:47.722 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 15 client.4803.objecter handle_osd_op_reply completed tid 27 2026-02-24T19:18:47.722 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 15 client.4803.objecter _finish_op 27 2026-02-24T19:18:47.722 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 20 client.4803.objecter put_session s=0x558b253afde0 osd=11 4 2026-02-24T19:18:47.722 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 15 client.4803.objecter _session_op_remove 11 27 2026-02-24T19:18:47.722 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.717+0000 7f2689fa2640 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.722 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 18 ==== osd_op_reply(28 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 3334087381 0 3741568377) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.722 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(28 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-24T19:18:47.723 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.723 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 28 ondisk uv 6 in 9.1 attempt 1 2026-02-24T19:18:47.723 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 5 2026-02-24T19:18:47.723 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 28 2026-02-24T19:18:47.723 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f26897a1640 15 client.4803.objecter _finish_op 28 2026-02-24T19:18:47.723 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.723 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 28 2026-02-24T19:18:47.723 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f26897a1640 5 client.4803.objecter 0 in flight 2026-02-24T19:18:47.723 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (16 ms) 2026-02-24T19:18:47.723 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2026-02-24T19:18:47.723 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b5530 2026-02-24T19:18:47.723 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.723 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.723 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.723 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f268c4ec880 10 client.4803.objecter chose random osd.0 of [0,11] 2026-02-24T19:18:47.723 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.726 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid exist '@9' '@9' [read 0~0] tid 29 osd.0 2026-02-24T19:18:47.726 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.726 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 29 2026-02-24T19:18:47.726 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f268c4ec880 15 client.4803.objecter _send_op 29 to 9.1 on osd.0 2026-02-24T19:18:47.726 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:29 9.1 9:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x558b253b7b30 con 0x558b253b05f0 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b2552d2e0 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f268c4ec880 20 client.4803.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.a7bbaa1 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f268c4ec880 10 client.4803.objecter chose random osd.0 of [0,11] 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid noexist '@9' '@9' [read 0~0] tid 30 osd.0 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 30 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f268c4ec880 15 client.4803.objecter _send_op 30 to 9.1 on osd.0 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:30 9.1 9:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x558b253b80e0 con 0x558b253b05f0 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 5 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.721+0000 7f268c4ec880 5 client.4803.objecter 2 in flight 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 19 ==== osd_op_reply(29 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 1919374748 0 3741568377) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(29 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 29 ondisk uv 6 in 9.1 attempt 0 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 5 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 29 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f26897a1640 15 client.4803.objecter _finish_op 29 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 5 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 29 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f26897a1640 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 20 ==== osd_op_reply(30 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3460776774 0 0) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(30 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 30 ondisk uv 0 in 9.1 attempt 0 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f26897a1640 10 client.4803.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 0 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 30 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f26897a1640 15 client.4803.objecter _finish_op 30 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 30 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f26897a1640 5 client.4803.objecter 0 in flight 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (4 ms) 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationAwaitable 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b5530 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.727 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.728 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.728 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f268c4ec880 10 client.4803.objecter chose random osd.11 of [0,11] 2026-02-24T19:18:47.728 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b253afde0 osd=11 3 2026-02-24T19:18:47.728 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid exist '@9' '@9' [read 0~0] tid 31 osd.11 2026-02-24T19:18:47.728 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b253afde0 osd=11 3 2026-02-24T19:18:47.728 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 11 31 2026-02-24T19:18:47.728 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f268c4ec880 15 client.4803.objecter _send_op 31 to 9.1 on osd.11 2026-02-24T19:18:47.728 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.162:6813/1717662802 -- osd_op(unknown.0.0:31 9.1 9:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x558b253b7aa0 con 0x558b2539a990 2026-02-24T19:18:47.728 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b253afde0 osd=11 4 2026-02-24T19:18:47.728 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.729 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b254ed2c0 2026-02-24T19:18:47.729 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.729 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f268c4ec880 20 client.4803.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2026-02-24T19:18:47.729 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.a7bbaa1 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.729 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f268c4ec880 10 client.4803.objecter chose random osd.0 of [0,11] 2026-02-24T19:18:47.729 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.729 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid noexist '@9' '@9' [read 0~0] tid 32 osd.0 2026-02-24T19:18:47.729 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.729 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 32 2026-02-24T19:18:47.729 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f268c4ec880 15 client.4803.objecter _send_op 32 to 9.1 on osd.0 2026-02-24T19:18:47.729 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:32 9.1 9:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x558b254ed770 con 0x558b253b05f0 2026-02-24T19:18:47.729 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.729 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.725+0000 7f268c4ec880 5 client.4803.objecter 2 in flight 2026-02-24T19:18:47.729 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 21 ==== osd_op_reply(32 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3460776774 0 0) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.729 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(32 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:47.729 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.729 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 32 ondisk uv 0 in 9.1 attempt 0 2026-02-24T19:18:47.729 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f26897a1640 10 client.4803.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:47.729 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 0 2026-02-24T19:18:47.729 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 32 2026-02-24T19:18:47.729 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f26897a1640 15 client.4803.objecter _finish_op 32 2026-02-24T19:18:47.729 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.729 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 32 2026-02-24T19:18:47.729 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f26897a1640 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.729 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f2689fa2640 1 -- 10.20.193.162:0/2235842404 <== osd.11 v1:10.20.193.162:6813/1717662802 11 ==== osd_op_reply(31 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 52541424 0 0) 0x7f2680006350 con 0x558b2539a990 2026-02-24T19:18:47.729 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f2689fa2640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(31 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f2689fa2640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f2689fa2640 7 client.4803.objecter handle_osd_op_reply 31 ondisk uv 0 in 9.1 attempt 0 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f2689fa2640 7 client.4803.objecter got -EAGAIN, resubmitting 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f2689fa2640 20 client.4803.objecter put_session s=0x558b253afde0 osd=11 4 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f2689fa2640 15 client.4803.objecter _session_op_remove 11 31 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f2689fa2640 10 client.4803.objecter _op_submit op 0x558b253b5530 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f2689fa2640 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f2689fa2640 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f2689fa2640 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f2689fa2640 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f2689fa2640 10 client.4803.objecter _op_submit oid exist '@9' '@9' [read 0~0] tid 33 osd.0 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f2689fa2640 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f2689fa2640 15 client.4803.objecter _session_op_assign 0 33 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f2689fa2640 15 client.4803.objecter _send_op 33 to 9.1 on osd.0 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f2689fa2640 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:33 9.1 9:8049a5cb:::exist:head [read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e34) -- 0x558b253b7aa0 con 0x558b253b05f0 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f2689fa2640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.727+0000 7f2689fa2640 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.730+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 22 ==== osd_op_reply(33 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 3334087381 0 3741568377) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.730+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(33 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.730+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.730+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 33 ondisk uv 6 in 9.1 attempt 1 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.730+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 5 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.730+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 33 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.730+0000 7f26897a1640 15 client.4803.objecter _finish_op 33 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.730+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.730+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 33 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.730+0000 7f26897a1640 5 client.4803.objecter 0 in flight 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationAwaitable (5 ms) 2026-02-24T19:18:47.732 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2026-02-24T19:18:47.752 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.730+0000 7f268c4ec880 20 librados: queue_aio_write 0x558b25247390 completion 0x558b253b7fd0 write_seq 6 2026-02-24T19:18:47.752 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.730+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b5530 2026-02-24T19:18:47.752 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.730+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:47.752 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.730+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.752 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.730+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.752 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.730+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.752 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.730+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid exist '@9' '@9' [writefull 0~5 in=5b] tid 34 osd.0 2026-02-24T19:18:47.752 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.730+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.752 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.730+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 34 2026-02-24T19:18:47.752 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.730+0000 7f268c4ec880 15 client.4803.objecter _send_op 34 to 9.1 on osd.0 2026-02-24T19:18:47.752 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.730+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:34 9.1 9:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b253b7aa0 con 0x558b253b05f0 2026-02-24T19:18:47.752 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.730+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.752 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.730+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.752 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.750+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 23 ==== osd_op_reply(34 exist [writefull 0~5] v34'7 uv7 ondisk = 0) ==== 149+0+0 (unknown 2415421406 0 0) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.752 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.750+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(34 exist [writefull 0~5] v34'7 uv7 ondisk = 0) 2026-02-24T19:18:47.752 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.750+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.752 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.750+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 34 ondisk uv 7 in 9.1 attempt 0 2026-02-24T19:18:47.752 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.750+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 0 2026-02-24T19:18:47.752 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.750+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 34 2026-02-24T19:18:47.752 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.750+0000 7f26897a1640 15 client.4803.objecter _finish_op 34 2026-02-24T19:18:47.752 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.750+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.752 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (20 ms) 2026-02-24T19:18:47.753 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.750+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 34 2026-02-24T19:18:47.753 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationDeferred 2026-02-24T19:18:47.753 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.750+0000 7f26897a1640 5 client.4803.objecter 0 in flight 2026-02-24T19:18:47.753 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.750+0000 7f26897a1640 20 librados: complete_aio_write 0x558b253b7fd0 2026-02-24T19:18:47.753 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.750+0000 7f268c4ec880 20 librados: queue_aio_write 0x558b25247390 completion 0x558b253bf430 write_seq 7 2026-02-24T19:18:47.753 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.750+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b5530 2026-02-24T19:18:47.753 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.750+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.750+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.750+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.750+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.750+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid exist '@9' '@9' [writefull 0~5 in=5b] tid 35 osd.0 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.750+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.750+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 35 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.750+0000 7f268c4ec880 15 client.4803.objecter _send_op 35 to 9.1 on osd.0 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.750+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:35 9.1 9:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b253b7aa0 con 0x558b253b05f0 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.750+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.750+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.773+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 24 ==== osd_op_reply(35 exist [writefull 0~5] v34'8 uv8 ondisk = 0) ==== 149+0+0 (unknown 1873180592 0 0) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.773+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(35 exist [writefull 0~5] v34'8 uv8 ondisk = 0) 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.773+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.773+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 35 ondisk uv 8 in 9.1 attempt 0 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.773+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 0 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.773+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 35 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.773+0000 7f26897a1640 15 client.4803.objecter _finish_op 35 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.773+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.773+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 35 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationDeferred (22 ms) 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.773+0000 7f26897a1640 5 client.4803.objecter 0 in flight 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.773+0000 7f26897a1640 20 librados: complete_aio_write 0x558b253bf430 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.773+0000 7f268c4ec880 20 librados: queue_aio_write 0x558b25247390 completion 0x558b253b7fd0 write_seq 8 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.773+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b5530 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.773+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.773+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.773+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.775 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.773+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.773+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid exist '@9' '@9' [writefull 0~5 in=5b] tid 36 osd.0 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.773+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.773+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 36 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.773+0000 7f268c4ec880 15 client.4803.objecter _send_op 36 to 9.1 on osd.0 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.773+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:36 9.1 9:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b253b7aa0 con 0x558b253b05f0 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.773+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.773+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.792+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 25 ==== osd_op_reply(36 exist [writefull 0~5] v34'9 uv9 ondisk = 0) ==== 149+0+0 (unknown 455527524 0 0) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.792+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(36 exist [writefull 0~5] v34'9 uv9 ondisk = 0) 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.792+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.792+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 36 ondisk uv 9 in 9.1 attempt 0 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.792+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 0 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.792+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 36 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.792+0000 7f26897a1640 15 client.4803.objecter _finish_op 36 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.792+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.792+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 36 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.792+0000 7f26897a1640 5 client.4803.objecter 0 in flight 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.792+0000 7f26897a1640 20 librados: complete_aio_write 0x558b253b7fd0 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (19 ms) 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.792+0000 7f268c4ec880 20 librados: queue_aio_write 0x558b25247390 completion 0x558b253bf430 write_seq 9 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.792+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b5530 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.792+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.792+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.792+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.792+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.792+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid exist '@9' '@9' [writefull 0~5 in=5b] tid 37 osd.0 2026-02-24T19:18:47.794 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.792+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.795 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.792+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 37 2026-02-24T19:18:47.795 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.792+0000 7f268c4ec880 15 client.4803.objecter _send_op 37 to 9.1 on osd.0 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.792+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:37 9.1 9:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b253b7aa0 con 0x558b253b05f0 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.792+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.792+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.834+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 26 ==== osd_op_reply(37 exist [writefull 0~5] v34'10 uv10 ondisk = 0) ==== 149+0+0 (unknown 2259091480 0 0) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.834+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(37 exist [writefull 0~5] v34'10 uv10 ondisk = 0) 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.834+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.834+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 37 ondisk uv 10 in 9.1 attempt 0 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.834+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 0 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.834+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 37 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.834+0000 7f26897a1640 15 client.4803.objecter _finish_op 37 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.834+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.834+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 37 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.834+0000 7f26897a1640 5 client.4803.objecter 0 in flight 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.834+0000 7f26897a1640 20 librados: complete_aio_write 0x558b253bf430 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (41 ms) 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationAwaitable 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.834+0000 7f268c4ec880 20 librados: queue_aio_write 0x558b25247390 completion 0x558b253b7fd0 write_seq 10 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.834+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b5530 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.834+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.834+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.834+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.834+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.834+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid exist '@9' '@9' [writefull 0~5 in=5b] tid 38 osd.0 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.834+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.834+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 38 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.834+0000 7f268c4ec880 15 client.4803.objecter _send_op 38 to 9.1 on osd.0 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.834+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:38 9.1 9:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b253b7aa0 con 0x558b253b05f0 2026-02-24T19:18:47.836 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.834+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.859 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.834+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.859 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 27 ==== osd_op_reply(38 exist [writefull 0~5] v34'11 uv11 ondisk = 0) ==== 149+0+0 (unknown 4062690252 0 0) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.859 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(38 exist [writefull 0~5] v34'11 uv11 ondisk = 0) 2026-02-24T19:18:47.859 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.860 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 38 ondisk uv 11 in 9.1 attempt 0 2026-02-24T19:18:47.860 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 0 2026-02-24T19:18:47.860 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 38 2026-02-24T19:18:47.860 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f26897a1640 15 client.4803.objecter _finish_op 38 2026-02-24T19:18:47.860 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.860 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 38 2026-02-24T19:18:47.860 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f26897a1640 5 client.4803.objecter 0 in flight 2026-02-24T19:18:47.860 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationAwaitable (23 ms) 2026-02-24T19:18:47.860 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyCallback 2026-02-24T19:18:47.860 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f26897a1640 20 librados: complete_aio_write 0x558b253b7fd0 2026-02-24T19:18:47.860 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 10 client.4803.objecter linger_register info 0x558b253b5530 linger_id 1 cookie 94056113460528 2026-02-24T19:18:47.860 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.860 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.860 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.860 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.860 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.860 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 15 client.4803.objecter _session_linger_op_assign 0 1 2026-02-24T19:18:47.860 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.860 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 15 client.4803.objecter send_linger 1 register 2026-02-24T19:18:47.860 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b254ef2e0 2026-02-24T19:18:47.860 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.860 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.860 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.860 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid exist '@9' '@9' [notify cookie 94056113460528 in=17b] tid 39 osd.0 2026-02-24T19:18:47.860 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.860 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 39 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 15 client.4803.objecter _send_op 39 to 9.1 on osd.0 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:39 9.1 9:8049a5cb:::exist:head [notify cookie 94056113460528 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b253b7aa0 con 0x558b253b05f0 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 5 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 10 client.4803.objecter linger_register info 0x558b254ef790 linger_id 2 cookie 94056114747280 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 20 client.4803.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.a7bbaa1 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 5 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 5 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 15 client.4803.objecter _session_linger_op_assign 0 2 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 6 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 15 client.4803.objecter send_linger 2 register 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b254f0bd0 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 20 client.4803.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 6 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid noexist '@9' '@9' [notify cookie 94056114747280 in=17b] tid 40 osd.0 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 6 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 40 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 15 client.4803.objecter _send_op 40 to 9.1 on osd.0 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:40 9.1 9:855dde50:::noexist:head [notify cookie 94056114747280 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b254f1080 con 0x558b253b05f0 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 7 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.858+0000 7f268c4ec880 5 client.4803.objecter 2 in flight 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 28 ==== watch-notify(notify_complete (2) cookie 94056113460528 notify 146028888065 ret 0) ==== 42+0+8 (unknown 3148748821 0 0) 0x7f2668001df0 con 0x558b253b05f0 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 watch-notify(notify_complete (2) cookie 94056113460528 notify 146028888065 ret 0) 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 29 ==== osd_op_reply(39 exist [notify cookie 94056113460528 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 3452579471 0 561924653) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(39 exist [notify cookie 94056113460528 out=8b] v0'0 uv11 ondisk = 0) 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 39 ondisk uv 11 in 9.1 attempt 0 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 8 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 39 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f26897a1640 15 client.4803.objecter _finish_op 39 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 7 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 39 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f26897a1640 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.873 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f267b7fe640 10 librados: operator() completed notify (linger op 0x558b253b5530), ec = system:0 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f267b7fe640 10 client.4803.objecter _linger_commit 1 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f267b7fe640 10 client.4803.objecter _linger_commit notify_id=146028888065 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 30 ==== osd_op_reply(40 noexist [notify cookie 94056114747280] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 4047390868 0 0) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f267b7fe640 10 librados: finish linger op 0x558b253b5530 acked (0) 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(40 noexist [notify cookie 94056114747280] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 40 ondisk uv 0 in 9.1 attempt 0 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f26897a1640 10 client.4803.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 0 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f267b7fe640 20 client.4803.objecter _linger_cancel linger_id=1 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 40 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f26897a1640 15 client.4803.objecter _finish_op 40 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 6 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 40 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f26897a1640 5 client.4803.objecter 0 in flight 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f267b7fe640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f267b7fe640 15 client.4803.objecter _session_linger_op_remove 0 1 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f267bfff640 10 client.4803.objecter _linger_commit 2 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f267b7fe640 10 librados: operator() completed notify (linger op 0x558b254ef790), ec = osd:2 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f267bfff640 10 librados: finish linger op 0x558b254ef790 acked (-2) 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f267bfff640 20 client.4803.objecter _linger_cancel linger_id=2 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f267bfff640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f267bfff640 15 client.4803.objecter _session_linger_op_remove 0 2 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyCallback (13 ms) 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyDeferred 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 10 client.4803.objecter linger_register info 0x558b253b5530 linger_id 3 cookie 94056113460528 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 15 client.4803.objecter _session_linger_op_assign 0 3 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 15 client.4803.objecter send_linger 3 register 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b252f25f0 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid exist '@9' '@9' [notify cookie 94056113460528 in=17b] tid 41 osd.0 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 41 2026-02-24T19:18:47.874 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 15 client.4803.objecter _send_op 41 to 9.1 on osd.0 2026-02-24T19:18:47.875 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:41 9.1 9:8049a5cb:::exist:head [notify cookie 94056113460528 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b253b7aa0 con 0x558b253b05f0 2026-02-24T19:18:47.875 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 5 2026-02-24T19:18:47.875 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.875 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 10 client.4803.objecter linger_register info 0x558b252f3ab0 linger_id 4 cookie 94056112667312 2026-02-24T19:18:47.883 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.883 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 20 client.4803.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2026-02-24T19:18:47.883 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.a7bbaa1 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.883 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 5 2026-02-24T19:18:47.883 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 5 2026-02-24T19:18:47.883 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 15 client.4803.objecter _session_linger_op_assign 0 4 2026-02-24T19:18:47.883 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 6 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 15 client.4803.objecter send_linger 4 register 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b252f3ee0 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 20 client.4803.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 6 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid noexist '@9' '@9' [notify cookie 94056112667312 in=17b] tid 42 osd.0 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 6 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 42 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 15 client.4803.objecter _send_op 42 to 9.1 on osd.0 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:42 9.1 9:855dde50:::noexist:head [notify cookie 94056112667312 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b252f43f0 con 0x558b253b05f0 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 7 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.871+0000 7f268c4ec880 5 client.4803.objecter 2 in flight 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 31 ==== watch-notify(notify_complete (2) cookie 94056113460528 notify 146028888066 ret 0) ==== 42+0+8 (unknown 1888627062 0 0) 0x7f2668001df0 con 0x558b253b05f0 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 watch-notify(notify_complete (2) cookie 94056113460528 notify 146028888066 ret 0) 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 32 ==== osd_op_reply(41 exist [notify cookie 94056113460528 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 3452579471 0 4198157636) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(41 exist [notify cookie 94056113460528 out=8b] v0'0 uv11 ondisk = 0) 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f267b7fe640 10 librados: operator() completed notify (linger op 0x558b253b5530), ec = system:0 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 41 ondisk uv 11 in 9.1 attempt 0 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 8 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 41 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f26897a1640 15 client.4803.objecter _finish_op 41 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 7 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 41 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f26897a1640 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f267bfff640 10 client.4803.objecter _linger_commit 3 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f267bfff640 10 client.4803.objecter _linger_commit notify_id=146028888066 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f267bfff640 10 librados: finish linger op 0x558b253b5530 acked (0) 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 33 ==== osd_op_reply(42 noexist [notify cookie 94056112667312] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3031619505 0 0) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f267bfff640 20 client.4803.objecter _linger_cancel linger_id=3 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f267bfff640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 5 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(42 noexist [notify cookie 94056112667312] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f267bfff640 15 client.4803.objecter _session_linger_op_remove 0 3 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 42 ondisk uv 0 in 9.1 attempt 0 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f26897a1640 10 client.4803.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 0 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 42 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f26897a1640 15 client.4803.objecter _finish_op 42 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 5 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 42 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f26897a1640 5 client.4803.objecter 0 in flight 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f267b7fe640 10 client.4803.objecter _linger_commit 4 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f267b7fe640 10 librados: finish linger op 0x558b252f3ab0 acked (-2) 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f267bfff640 10 librados: operator() completed notify (linger op 0x558b252f3ab0), ec = osd:2 2026-02-24T19:18:47.884 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f267bfff640 20 client.4803.objecter _linger_cancel linger_id=4 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f267bfff640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f267bfff640 15 client.4803.objecter _session_linger_op_remove 0 4 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyDeferred (10 ms) 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyFuture 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 10 client.4803.objecter linger_register info 0x558b253b5530 linger_id 5 cookie 94056113460528 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 15 client.4803.objecter _session_linger_op_assign 0 5 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 15 client.4803.objecter send_linger 5 register 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b252f25f0 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid exist '@9' '@9' [notify cookie 94056113460528 in=17b] tid 43 osd.0 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 43 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 15 client.4803.objecter _send_op 43 to 9.1 on osd.0 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:43 9.1 9:8049a5cb:::exist:head [notify cookie 94056113460528 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b253b7aa0 con 0x558b253b05f0 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 5 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 10 client.4803.objecter linger_register info 0x558b252f2aa0 linger_id 6 cookie 94056112663200 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 20 client.4803.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.a7bbaa1 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 5 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 5 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 15 client.4803.objecter _session_linger_op_assign 0 6 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 6 2026-02-24T19:18:47.885 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 15 client.4803.objecter send_linger 6 register 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b252f3ee0 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 20 client.4803.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 6 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid noexist '@9' '@9' [notify cookie 94056112663200 in=17b] tid 44 osd.0 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 6 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 44 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 15 client.4803.objecter _send_op 44 to 9.1 on osd.0 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:44 9.1 9:855dde50:::noexist:head [notify cookie 94056112663200 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b252f43f0 con 0x558b253b05f0 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 7 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.882+0000 7f268c4ec880 5 client.4803.objecter 2 in flight 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 34 ==== watch-notify(notify_complete (2) cookie 94056113460528 notify 146028888067 ret 0) ==== 42+0+8 (unknown 3403541496 0 0) 0x7f2668001df0 con 0x558b253b05f0 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 watch-notify(notify_complete (2) cookie 94056113460528 notify 146028888067 ret 0) 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 35 ==== osd_op_reply(43 exist [notify cookie 94056113460528 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 3452579471 0 3003560035) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f267b7fe640 10 librados: operator() completed notify (linger op 0x558b253b5530), ec = system:0 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(43 exist [notify cookie 94056113460528 out=8b] v0'0 uv11 ondisk = 0) 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 43 ondisk uv 11 in 9.1 attempt 0 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 8 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 43 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f26897a1640 15 client.4803.objecter _finish_op 43 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 7 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 43 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f26897a1640 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f267bfff640 10 client.4803.objecter _linger_commit 5 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f267bfff640 10 client.4803.objecter _linger_commit notify_id=146028888067 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 36 ==== osd_op_reply(44 noexist [notify cookie 94056112663200] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1146380645 0 0) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f267bfff640 10 librados: finish linger op 0x558b253b5530 acked (0) 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(44 noexist [notify cookie 94056112663200] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f267bfff640 20 client.4803.objecter _linger_cancel linger_id=5 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f267bfff640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 5 2026-02-24T19:18:47.890 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f267bfff640 15 client.4803.objecter _session_linger_op_remove 0 5 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 44 ondisk uv 0 in 9.1 attempt 0 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f26897a1640 10 client.4803.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 0 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 44 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f26897a1640 15 client.4803.objecter _finish_op 44 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 5 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 44 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f26897a1640 5 client.4803.objecter 0 in flight 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f267b7fe640 10 client.4803.objecter _linger_commit 6 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f267b7fe640 10 librados: finish linger op 0x558b252f2aa0 acked (-2) 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyFuture (6 ms) 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyYield 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f267b7fe640 10 librados: operator() completed notify (linger op 0x558b252f2aa0), ec = osd:2 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f267b7fe640 20 client.4803.objecter _linger_cancel linger_id=6 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f267b7fe640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f267b7fe640 15 client.4803.objecter _session_linger_op_remove 0 6 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 10 client.4803.objecter linger_register info 0x558b253b5530 linger_id 7 cookie 94056113460528 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 15 client.4803.objecter _session_linger_op_assign 0 7 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 15 client.4803.objecter send_linger 7 register 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b252f25f0 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid exist '@9' '@9' [notify cookie 94056113460528 in=17b] tid 45 osd.0 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 45 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 15 client.4803.objecter _send_op 45 to 9.1 on osd.0 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:45 9.1 9:8049a5cb:::exist:head [notify cookie 94056113460528 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b253b7aa0 con 0x558b253b05f0 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 5 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 10 client.4803.objecter linger_register info 0x558b252f2aa0 linger_id 8 cookie 94056112663200 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 20 client.4803.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.a7bbaa1 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 5 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 5 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 15 client.4803.objecter _session_linger_op_assign 0 8 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 6 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 15 client.4803.objecter send_linger 8 register 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b252f3ee0 2026-02-24T19:18:47.891 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.892 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 20 client.4803.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2026-02-24T19:18:47.892 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 6 2026-02-24T19:18:47.892 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid noexist '@9' '@9' [notify cookie 94056112663200 in=17b] tid 46 osd.0 2026-02-24T19:18:47.892 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 6 2026-02-24T19:18:47.894 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 46 2026-02-24T19:18:47.894 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 15 client.4803.objecter _send_op 46 to 9.1 on osd.0 2026-02-24T19:18:47.894 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:46 9.1 9:855dde50:::noexist:head [notify cookie 94056112663200 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b252f43f0 con 0x558b253b05f0 2026-02-24T19:18:47.894 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 7 2026-02-24T19:18:47.894 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.888+0000 7f268c4ec880 5 client.4803.objecter 2 in flight 2026-02-24T19:18:47.894 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 37 ==== watch-notify(notify_complete (2) cookie 94056113460528 notify 146028888068 ret 0) ==== 42+0+8 (unknown 3808836929 0 0) 0x7f2668001df0 con 0x558b253b05f0 2026-02-24T19:18:47.894 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 watch-notify(notify_complete (2) cookie 94056113460528 notify 146028888068 ret 0) 2026-02-24T19:18:47.894 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 38 ==== osd_op_reply(45 exist [notify cookie 94056113460528 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 3452579471 0 1231009127) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.894 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(45 exist [notify cookie 94056113460528 out=8b] v0'0 uv11 ondisk = 0) 2026-02-24T19:18:47.894 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.894 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 45 ondisk uv 11 in 9.1 attempt 0 2026-02-24T19:18:47.894 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 8 2026-02-24T19:18:47.894 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 45 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f26897a1640 15 client.4803.objecter _finish_op 45 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f267bfff640 10 librados: operator() completed notify (linger op 0x558b253b5530), ec = system:0 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 7 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 45 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f26897a1640 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 39 ==== osd_op_reply(46 noexist [notify cookie 94056112663200] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1146380645 0 0) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(46 noexist [notify cookie 94056112663200] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f267b7fe640 10 client.4803.objecter _linger_commit 7 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 46 ondisk uv 0 in 9.1 attempt 0 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f26897a1640 10 client.4803.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f267b7fe640 10 client.4803.objecter _linger_commit notify_id=146028888068 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 0 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 46 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f26897a1640 15 client.4803.objecter _finish_op 46 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyYield (4 ms) 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 6 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 46 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyAwaitable 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f26897a1640 5 client.4803.objecter 0 in flight 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f267b7fe640 10 librados: finish linger op 0x558b253b5530 acked (0) 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f267b7fe640 10 client.4803.objecter _linger_commit 8 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f267bfff640 20 client.4803.objecter _linger_cancel linger_id=7 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f267bfff640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f267bfff640 15 client.4803.objecter _session_linger_op_remove 0 7 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f267b7fe640 10 librados: finish linger op 0x558b252f2aa0 acked (-2) 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f267bfff640 10 librados: operator() completed notify (linger op 0x558b252f2aa0), ec = osd:2 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f267b7fe640 20 client.4803.objecter _linger_cancel linger_id=8 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f267b7fe640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f267b7fe640 15 client.4803.objecter _session_linger_op_remove 0 8 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 10 client.4803.objecter linger_register info 0x558b253b5530 linger_id 9 cookie 94056113460528 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.d3a59201 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 15 client.4803.objecter _session_linger_op_assign 0 9 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 15 client.4803.objecter send_linger 9 register 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b252f25f0 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base exist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 20 client.4803.objecter _calc_target target exist @9 -> pgid 9.d3a59201 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.895 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid exist '@9' '@9' [notify cookie 94056113460528 in=17b] tid 47 osd.0 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 47 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 15 client.4803.objecter _send_op 47 to 9.1 on osd.0 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:47 9.1 9:8049a5cb:::exist:head [notify cookie 94056113460528 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b253b7aa0 con 0x558b253b05f0 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 5 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 10 client.4803.objecter linger_register info 0x558b252f2aa0 linger_id 10 cookie 94056112663200 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 20 client.4803.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.a7bbaa1 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 5 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 5 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 15 client.4803.objecter _session_linger_op_assign 0 10 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 6 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 15 client.4803.objecter send_linger 10 register 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b254ed2c0 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 20 client.4803.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 6 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid noexist '@9' '@9' [notify cookie 94056112663200 in=17b] tid 48 osd.0 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 6 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 48 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 15 client.4803.objecter _send_op 48 to 9.1 on osd.0 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:48 9.1 9:855dde50:::noexist:head [notify cookie 94056112663200 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b252f43f0 con 0x558b253b05f0 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 7 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.893+0000 7f268c4ec880 5 client.4803.objecter 2 in flight 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 40 ==== watch-notify(notify_complete (2) cookie 94056113460528 notify 146028888069 ret 0) ==== 42+0+8 (unknown 1498021839 0 0) 0x7f2668001df0 con 0x558b253b05f0 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 watch-notify(notify_complete (2) cookie 94056113460528 notify 146028888069 ret 0) 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 41 ==== osd_op_reply(47 exist [notify cookie 94056113460528 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 3452579471 0 6539328) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(47 exist [notify cookie 94056113460528 out=8b] v0'0 uv11 ondisk = 0) 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 47 ondisk uv 11 in 9.1 attempt 0 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 8 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f267bfff640 10 librados: operator() completed notify (linger op 0x558b253b5530), ec = system:0 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 47 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f26897a1640 15 client.4803.objecter _finish_op 47 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 7 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 47 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f26897a1640 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f267b7fe640 10 client.4803.objecter _linger_commit 9 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 42 ==== osd_op_reply(48 noexist [notify cookie 94056112663200] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1146380645 0 0) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f267b7fe640 10 client.4803.objecter _linger_commit notify_id=146028888069 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(48 noexist [notify cookie 94056112663200] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:47.900 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 48 ondisk uv 0 in 9.1 attempt 0 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f267b7fe640 10 librados: finish linger op 0x558b253b5530 acked (0) 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f26897a1640 10 client.4803.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 0 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 48 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f26897a1640 15 client.4803.objecter _finish_op 48 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f267b7fe640 20 client.4803.objecter _linger_cancel linger_id=9 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 6 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 48 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f26897a1640 5 client.4803.objecter 0 in flight 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f267b7fe640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f267b7fe640 15 client.4803.objecter _session_linger_op_remove 0 9 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f267bfff640 10 client.4803.objecter _linger_commit 10 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f267bfff640 10 librados: finish linger op 0x558b252f2aa0 acked (-2) 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f267bfff640 10 librados: operator() completed notify (linger op 0x558b252f2aa0), ec = osd:2 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f267bfff640 20 client.4803.objecter _linger_cancel linger_id=10 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f267bfff640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f267bfff640 15 client.4803.objecter _session_linger_op_remove 0 10 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyAwaitable (5 ms) 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCancelTerminal 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b5530 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 20 client.4803.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.a7bbaa1 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 10 client.4803.objecter chose random osd.0 of [0,11] 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid noexist '@9' '@9' [stat] tid 49 osd.0 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 49 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 15 client.4803.objecter _send_op 49 to 9.1 on osd.0 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:49 9.1 9:855dde50:::noexist:head [stat] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x558b253b7aa0 con 0x558b253b05f0 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 5 client.4803.objecter _op_cancel: cancelling tid 49 r=-125 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 10 client.4803.objecter op_cancel tid 49 in session 0 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 15 client.4803.objecter _finish_op 49 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 15 client.4803.objecter _session_op_remove 0 49 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCancelTerminal (0 ms) 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCancelTotal 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b5530 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base noexist @9 precalc_pgid 0 pgid 0.0 is_read 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 20 client.4803.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.a7bbaa1 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 10 client.4803.objecter chose random osd.0 of [0,11] 2026-02-24T19:18:47.901 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.902 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid noexist '@9' '@9' [stat] tid 50 osd.0 2026-02-24T19:18:47.902 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.902 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 50 2026-02-24T19:18:47.902 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 15 client.4803.objecter _send_op 50 to 9.1 on osd.0 2026-02-24T19:18:47.902 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:50 9.1 9:855dde50:::noexist:head [stat] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e34) -- 0x558b253b7aa0 con 0x558b253b05f0 2026-02-24T19:18:47.902 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.902 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCancelTotal (0 ms) 2026-02-24T19:18:47.902 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.902 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCancelTerminal 2026-02-24T19:18:47.902 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 5 client.4803.objecter _op_cancel: cancelling tid 50 r=-125 2026-02-24T19:18:47.902 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 10 client.4803.objecter op_cancel tid 50 in session 0 2026-02-24T19:18:47.902 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 15 client.4803.objecter _finish_op 50 2026-02-24T19:18:47.902 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.902 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 15 client.4803.objecter _session_op_remove 0 50 2026-02-24T19:18:47.902 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 20 librados: queue_aio_write 0x558b25247390 completion 0x558b253bebd0 write_seq 11 2026-02-24T19:18:47.902 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b5530 2026-02-24T19:18:47.902 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base noexist @9 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:47.902 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 20 client.4803.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2026-02-24T19:18:47.902 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.a7bbaa1 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.902 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.902 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid noexist '@9' '@9' [stat] tid 51 osd.0 2026-02-24T19:18:47.902 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.902 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 51 2026-02-24T19:18:47.902 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 15 client.4803.objecter _send_op 51 to 9.1 on osd.0 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:51 9.1 9:855dde50:::noexist:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b253b7aa0 con 0x558b253b05f0 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 5 client.4803.objecter _op_cancel: cancelling tid 51 r=-125 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCancelTerminal (0 ms) 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 10 client.4803.objecter op_cancel tid 51 in session 0 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCancelTotal 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 20 librados: complete_aio_write 0x558b253bebd0 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 15 client.4803.objecter _finish_op 51 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 15 client.4803.objecter _session_op_remove 0 51 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 20 librados: queue_aio_write 0x558b25247390 completion 0x558b253bebd0 write_seq 12 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 10 client.4803.objecter _op_submit op 0x558b253b5530 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 20 client.4803.objecter _calc_target epoch 34 base noexist @9 precalc_pgid 0 pgid 0.0 is_write 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 20 client.4803.objecter _calc_target target noexist @9 -> pgid 9.a7bbaa1 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 10 client.4803.objecter _calc_target raw pgid 9.a7bbaa1 -> actual 9.1 acting [0,11] primary 0 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 20 client.4803.objecter _get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 10 client.4803.objecter _op_submit oid noexist '@9' '@9' [stat] tid 52 osd.0 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 20 client.4803.objecter get_session s=0x558b2539be30 osd=0 3 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 15 client.4803.objecter _session_op_assign 0 52 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 15 client.4803.objecter _send_op 52 to 9.1 on osd.0 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 --> v1:10.20.193.26:6808/4098203721 -- osd_op(unknown.0.0:52 9.1 9:855dde50:::noexist:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b253b7aa0 con 0x558b253b05f0 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.898+0000 7f268c4ec880 5 client.4803.objecter 1 in flight 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.901+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 43 ==== osd_op_reply(49 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1399911890 0 0) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.901+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(49 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.901+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.901+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 49 ondisk ... stray 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 44 ==== osd_op_reply(50 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1399911890 0 0) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(50 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.907 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 50 ondisk ... stray 2026-02-24T19:18:47.908 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 45 ==== osd_op_reply(51 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3654515095 0 0) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.908 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(51 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:47.908 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.908 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 51 ondisk ... stray 2026-02-24T19:18:47.908 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f26897a1640 1 -- 10.20.193.162:0/2235842404 <== osd.0 v1:10.20.193.26:6808/4098203721 46 ==== osd_op_reply(52 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3654515095 0 0) 0x7f26740031c0 con 0x558b253b05f0 2026-02-24T19:18:47.908 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f26897a1640 10 client.4803.objecter ms_dispatch2 0x558b25263590 osd_op_reply(52 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-24T19:18:47.908 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f26897a1640 10 client.4803.objecter in handle_osd_op_reply 2026-02-24T19:18:47.908 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f26897a1640 7 client.4803.objecter handle_osd_op_reply 52 ondisk uv 0 in 9.1 attempt 0 2026-02-24T19:18:47.908 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f26897a1640 10 client.4803.objecter op 0 rval 0 len 0 2026-02-24T19:18:47.908 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f26897a1640 15 client.4803.objecter handle_osd_op_reply completed tid 52 2026-02-24T19:18:47.908 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f26897a1640 15 client.4803.objecter _finish_op 52 2026-02-24T19:18:47.908 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f26897a1640 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 4 2026-02-24T19:18:47.908 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f26897a1640 15 client.4803.objecter _session_op_remove 0 52 2026-02-24T19:18:47.908 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f26897a1640 5 client.4803.objecter 0 in flight 2026-02-24T19:18:47.908 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f26897a1640 20 librados: complete_aio_write 0x558b253bebd0 2026-02-24T19:18:47.908 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCancelTotal (7 ms) 2026-02-24T19:18:47.908 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f268c4ec880 10 librados: watch_flush enter 2026-02-24T19:18:47.908 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f268c4ec880 10 librados: watch_flush exit 2026-02-24T19:18:47.908 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f268c4ec880 10 client.4803.objecter close_session for osd.0 2026-02-24T19:18:47.908 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 >> v1:10.20.193.26:6808/4098203721 conn(0x558b253b05f0 legacy=0x558b253b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:47.908 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b2539be30 osd=0 1 2026-02-24T19:18:47.908 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f268c4ec880 10 client.4803.objecter close_session for osd.11 2026-02-24T19:18:47.908 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 >> v1:10.20.193.162:6813/1717662802 conn(0x558b2539a990 legacy=0x558b253b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:47.910 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f268c4ec880 20 client.4803.objecter put_session s=0x558b253afde0 osd=11 1 2026-02-24T19:18:47.910 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f268c4ec880 20 client.4803.objecter shutdown clearing up homeless session... 2026-02-24T19:18:47.910 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f268c4ec880 10 client.4803.objecter successfully canceled tick 2026-02-24T19:18:47.910 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 >> v1:10.20.193.162:6800/3889602630 conn(0x7f2668076970 legacy=0x7f2668096e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:47.910 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f268c4ec880 10 monclient: shutdown 2026-02-24T19:18:47.910 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f268c4ec880 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:18:47.910 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 >> v1:10.20.193.26:6789/0 conn(0x558b253e16c0 legacy=0x558b253988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:18:47.910 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f268a7a3640 1 -- 10.20.193.162:0/2235842404 reap_dead start 2026-02-24T19:18:47.910 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f268a7a3640 1 -- 10.20.193.162:0/2235842404 reap_dead start 2026-02-24T19:18:47.910 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 shutdown_connections 2026-02-24T19:18:47.910 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 >> 10.20.193.162:0/2235842404 conn(0x558b252eea70 msgr2=0x558b25401b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:18:47.910 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 shutdown_connections 2026-02-24T19:18:47.910 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f268c4ec880 1 -- 10.20.193.162:0/2235842404 wait complete. 2026-02-24T19:18:47.910 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.905+0000 7f268c4ec880 1 librados: shutdown 2026-02-24T19:18:47.910 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [----------] 29 tests from AsioRados (438 ms total) 2026-02-24T19:18:47.910 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: 2026-02-24T19:18:47.910 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [----------] Global test environment tear-down 2026-02-24T19:18:47.910 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [==========] 29 tests from 1 test suite ran. (6354 ms total) 2026-02-24T19:18:47.910 INFO:tasks.workunit.client.0.trial162.stdout: api_asio: [ PASSED ] 29 tests. 2026-02-24T19:18:47.911 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:18:47.911 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=48959 2026-02-24T19:18:47.911 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 48959 2026-02-24T19:18:49.309 INFO:tasks.workunit.client.0.trial162.stdout: handler_error: Running main() from gmock_main.cc 2026-02-24T19:18:49.310 INFO:tasks.workunit.client.0.trial162.stdout: handler_error: [==========] Running 1 test from 1 test suite. 2026-02-24T19:18:49.310 INFO:tasks.workunit.client.0.trial162.stdout: handler_error: [----------] Global test environment set-up. 2026-02-24T19:18:49.310 INFO:tasks.workunit.client.0.trial162.stdout: handler_error: [----------] 1 test from neocls_handler_error 2026-02-24T19:18:49.310 INFO:tasks.workunit.client.0.trial162.stdout: handler_error: [ RUN ] neocls_handler_error.test_handler_error 2026-02-24T19:18:49.310 INFO:tasks.workunit.client.0.trial162.stdout: handler_error: [ OK ] neocls_handler_error.test_handler_error (7714 ms) 2026-02-24T19:18:49.310 INFO:tasks.workunit.client.0.trial162.stdout: handler_error: [----------] 1 test from neocls_handler_error (7714 ms total) 2026-02-24T19:18:49.310 INFO:tasks.workunit.client.0.trial162.stdout: handler_error: 2026-02-24T19:18:49.310 INFO:tasks.workunit.client.0.trial162.stdout: handler_error: [----------] Global test environment tear-down 2026-02-24T19:18:49.310 INFO:tasks.workunit.client.0.trial162.stdout: handler_error: [==========] 1 test from 1 test suite ran. (7714 ms total) 2026-02-24T19:18:49.310 INFO:tasks.workunit.client.0.trial162.stdout: handler_error: [ PASSED ] 1 test. 2026-02-24T19:18:49.314 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd_pp: Running main() from gmock_main.cc 2026-02-24T19:18:49.314 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2026-02-24T19:18:49.314 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd_pp: [----------] Global test environment set-up. 2026-02-24T19:18:49.314 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2026-02-24T19:18:49.314 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2026-02-24T19:18:49.314 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (539 ms) 2026-02-24T19:18:49.314 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2026-02-24T19:18:49.314 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (294 ms) 2026-02-24T19:18:49.314 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2026-02-24T19:18:49.314 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (6914 ms) 2026-02-24T19:18:49.314 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (7748 ms total) 2026-02-24T19:18:49.314 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd_pp: 2026-02-24T19:18:49.314 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd_pp: [----------] Global test environment tear-down 2026-02-24T19:18:49.314 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (7748 ms total) 2026-02-24T19:18:49.314 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2026-02-24T19:18:49.461 INFO:tasks.workunit.client.0.trial162.stdout: cls: Running main() from gmock_main.cc 2026-02-24T19:18:49.461 INFO:tasks.workunit.client.0.trial162.stdout: cls: [==========] Running 1 test from 1 test suite. 2026-02-24T19:18:49.461 INFO:tasks.workunit.client.0.trial162.stdout: cls: [----------] Global test environment set-up. 2026-02-24T19:18:49.461 INFO:tasks.workunit.client.0.trial162.stdout: cls: [----------] 1 test from NeoRadosCls 2026-02-24T19:18:49.461 INFO:tasks.workunit.client.0.trial162.stdout: cls: [ RUN ] NeoRadosCls.DNE 2026-02-24T19:18:49.461 INFO:tasks.workunit.client.0.trial162.stdout: cls: [ OK ] NeoRadosCls.DNE (7871 ms) 2026-02-24T19:18:49.461 INFO:tasks.workunit.client.0.trial162.stdout: cls: [----------] 1 test from NeoRadosCls (7871 ms total) 2026-02-24T19:18:49.461 INFO:tasks.workunit.client.0.trial162.stdout: cls: 2026-02-24T19:18:49.461 INFO:tasks.workunit.client.0.trial162.stdout: cls: [----------] Global test environment tear-down 2026-02-24T19:18:49.461 INFO:tasks.workunit.client.0.trial162.stdout: cls: [==========] 1 test from 1 test suite ran. (7871 ms total) 2026-02-24T19:18:49.461 INFO:tasks.workunit.client.0.trial162.stdout: cls: [ PASSED ] 1 test. 2026-02-24T19:18:50.461 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: Running main() from gmock_main.cc 2026-02-24T19:18:50.461 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2026-02-24T19:18:50.461 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: [----------] Global test environment set-up. 2026-02-24T19:18:50.461 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2026-02-24T19:18:50.461 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2026-02-24T19:18:50.461 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (645 ms) 2026-02-24T19:18:50.461 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2026-02-24T19:18:50.461 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (191 ms) 2026-02-24T19:18:50.461 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2026-02-24T19:18:50.461 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (7949 ms) 2026-02-24T19:18:50.461 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2026-02-24T19:18:50.461 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:47.811784+0000 mon.a [INF] from='client.? v1:10.20.193.162:0/3990418030' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_trial162-48845-2","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T19:18:50.461 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:47.813007+0000 mon.a [INF] from='client.4970 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial162-48868-2","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T19:18:50.461 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:48.112749+0000 mon.b [INF] from='client.? v1:10.20.193.162:0/460592071' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial162-49072-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:50.461 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:48.383121+0000 mon.a [INF] from='client.? v1:10.20.193.162:0/2732869921' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritetrial162-49694-1"} : dispatch 2026-02-24T19:18:50.461 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:48.496036+0000 mon.a [INF] from='client.4900 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial162-49072-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:50.461 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:49.139254+0000 mon.a [INF] from='client.? v1:10.20.193.162:0/2732869921' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritetrial162-49694-1"}]': finished 2026-02-24T19:18:50.461 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:49.140925+0000 mon.a [INF] from='client.4900 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial162-49072-2","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T19:18:50.461 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:49.283070+0000 mon.a [INF] from='client.? v1:10.20.193.162:0/2732869921' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritetrial162-49694-1"} : dispatch 2026-02-24T19:18:50.461 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:49.430452+0000 mon.c [INF] from='client.? v1:10.20.193.162:0/2536924085' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_trial162-49166-7"} : dispatch 2026-02-24T19:18:50.461 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:49.467855+0000 mon.a [INF] from='client.5144 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_trial162-49166-7"} : dispatch 2026-02-24T19:18:50.462 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:49.492465+0000 mon.c [INF] from='client.? v1:10.20.193.162:0/2536924085' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_trial162-49166-7"} : dispatch 2026-02-24T19:18:50.462 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:49.500709+0000 mon.b [INF] from='client.? v1:10.20.193.162:0/395634665' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_trial162-49201-7"} : dispatch 2026-02-24T19:18:50.462 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:49.516058+0000 mon.a [INF] from='client.5144 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_trial162-49166-7"} : dispatch 2026-02-24T19:18:51.485 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:49.522708+0000 mon.a [INF] from='client.5065 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_trial162-49201-7"} : dispatch 2026-02-24T19:18:51.485 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:49.531019+0000 mon.b [INF] from='client.? v1:10.20.193.162:0/395634665' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_trial162-49201-7"} : dispatch 2026-02-24T19:18:51.485 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:49.534418+0000 mon.c [INF] from='client.? v1:10.20.193.162:0/2536924085' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_trial162-49166-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T19:18:51.486 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:49.536803+0000 mon.a [INF] from='client.5065 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_trial162-49201-7"} : dispatch 2026-02-24T19:18:51.486 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:49.544767+0000 mon.b [INF] from='client.? v1:10.20.193.162:0/395634665' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_trial162-49201-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T19:18:51.486 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:49.547069+0000 mon.a [INF] from='client.5144 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_trial162-49166-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T19:18:51.486 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:49.562417+0000 mon.a [INF] from='client.5065 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_trial162-49201-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T19:18:51.486 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:50.220893+0000 mon.a [INF] from='client.? v1:10.20.193.162:0/2732869921' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritetrial162-49694-1"}]': finished 2026-02-24T19:18:51.486 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:50.222594+0000 mon.a [INF] from='client.5144 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_trial162-49166-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-24T19:18:51.486 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:50.223673+0000 mon.a [INF] from='client.5065 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_trial162-49201-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-24T19:18:51.486 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:50.321442+0000 mon.c [INF] from='client.? v1:10.20.193.162:0/2536924085' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatEC_trial162-49166-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_trial162-49166-7"} : dispatch 2026-02-24T19:18:51.486 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:50.331990+0000 mon.b [INF] from='client.? v1:10.20.193.162:0/395634665' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatECPP_trial162-49201-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_trial162-49201-7"} : dispatch 2026-02-24T19:18:51.486 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:50.338221+0000 mon.a [INF] from='client.5144 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatEC_trial162-49166-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_trial162-49166-7"} : dispatch 2026-02-24T19:18:51.486 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:50.354990+0000 mon.a [INF] from='client.5065 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosStatECPP_trial162-49201-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_trial162-49201-7"} : dispatch 2026-02-24T19:18:51.557 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:50.356382+0000 mon.c [INF] from='client.? v1:10.20.193.162:0/1993065181' entity='client.admin' api_service: [==========] Running 4 tests from 1 test suite. 2026-02-24T19:18:51.557 INFO:tasks.workunit.client.0.trial162.stdout: api_service: [----------] Global test environment set-up. 2026-02-24T19:18:51.557 INFO:tasks.workunit.client.0.trial162.stdout: api_service: [----------] 4 tests from LibRadosService 2026-02-24T19:18:51.557 INFO:tasks.workunit.client.0.trial162.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2026-02-24T19:18:51.558 INFO:tasks.workunit.client.0.trial162.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5344 ms) 2026-02-24T19:18:51.558 INFO:tasks.workunit.client.0.trial162.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2026-02-24T19:18:51.558 INFO:tasks.workunit.client.0.trial162.stdout: api_service: [ OK ] LibRadosService.RegisterLate (19 ms) 2026-02-24T19:18:51.558 INFO:tasks.workunit.client.0.trial162.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2026-02-24T19:18:51.558 INFO:tasks.workunit.client.0.trial162.stdout: api_service: cluster: 2026-02-24T19:18:51.558 INFO:tasks.workunit.client.0.trial162.stdout: api_service: id: 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:51.558 INFO:tasks.workunit.client.0.trial162.stdout: api_service: health: HEALTH_OK 2026-02-24T19:18:51.558 INFO:tasks.workunit.client.0.trial162.stdout: api_service: 2026-02-24T19:18:51.558 INFO:tasks.workunit.client.0.trial162.stdout: api_service: services: 2026-02-24T19:18:51.558 INFO:tasks.workunit.client.0.trial162.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 85s) [leader: a] 2026-02-24T19:18:51.558 INFO:tasks.workunit.client.0.trial162.stdout: api_service: mgr: x(active, since 82s), standbys: y 2026-02-24T19:18:51.558 INFO:tasks.workunit.client.0.trial162.stdout: api_service: osd: 16 osds: 16 up (since 52s), 16 in (since 78s) 2026-02-24T19:18:51.558 INFO:tasks.workunit.client.0.trial162.stdout: api_service: laundry: 2 daemons active (1 hosts) 2026-02-24T19:18:51.558 INFO:tasks.workunit.client.0.trial162.stdout: api_service: 2026-02-24T19:18:51.559 INFO:tasks.workunit.client.0.trial162.stdout: api_service: data: 2026-02-24T19:18:51.559 INFO:tasks.workunit.client.0.trial162.stdout: api_service: pools: 30 pools, 905 pgs 2026-02-24T19:18:51.559 INFO:tasks.workunit.client.0.trial162.stdout: api_service: objects: 4 objects, 449 KiB 2026-02-24T19:18:51.559 INFO:tasks.workunit.client.0.trial162.stdout: api_service: usage: 427 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T19:18:51.559 INFO:tasks.workunit.client.0.trial162.stdout: api_service: pgs: 99.006% pgs unknown 2026-02-24T19:18:51.559 INFO:tasks.workunit.client.0.trial162.stdout: api_service: 896 unknown 2026-02-24T19:18:51.559 INFO:tasks.workunit.client.0.trial162.stdout: api_service: 9 active+clean 2026-02-24T19:18:51.559 INFO:tasks.workunit.client.0.trial162.stdout: api_service: 2026-02-24T19:18:51.559 INFO:tasks.workunit.client.0.trial162.stdout: api_service: 2026-02-24T19:18:51.559 INFO:tasks.workunit.client.0.trial162.stdout: api_service: cluster: 2026-02-24T19:18:51.559 INFO:tasks.workunit.client.0.trial162.stdout: api_service: id: 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:51.559 INFO:tasks.workunit.client.0.trial162.stdout: api_service: health: HEALTH_OK 2026-02-24T19:18:51.559 INFO:tasks.workunit.client.0.trial162.stdout: api_service: 2026-02-24T19:18:51.559 INFO:tasks.workunit.client.0.trial162.stdout: api_service: services: 2026-02-24T19:18:51.560 INFO:tasks.workunit.client.0.trial162.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 87s) [leader: a] 2026-02-24T19:18:51.560 INFO:tasks.workunit.client.0.trial162.stdout: api_service: mgr: x(active, since 84s), standbys: y 2026-02-24T19:18:51.560 INFO:tasks.workunit.client.0.trial162.stdout: api_service: osd: 16 osds: 16 up (since 54s), 16 in (since 80s) 2026-02-24T19:18:51.560 INFO:tasks.workunit.client.0.trial162.stdout: api_service: laundry: 2 daemons active (1 hosts) 2026-02-24T19:18:51.560 INFO:tasks.workunit.client.0.trial162.stdout: api_service: 2026-02-24T19:18:51.560 INFO:tasks.workunit.client.0.trial162.stdout: api_service: data: 2026-02-24T19:18:51.560 INFO:tasks.workunit.client.0.trial162.stdout: api_service: pools: 37 pools, 1057 pgs 2026-02-24T19:18:51.560 INFO:tasks.workunit.client.0.trial162.stdout: api_service: objects: 18 objects, 449 KiB 2026-02-24T19:18:51.560 INFO:tasks.workunit.client.0.trial162.stdout: api_service: usage: 428 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T19:18:51.560 INFO:tasks.workunit.client.0.trial162.stdout: api_service: pgs: 21.949% pgs unknown 2026-02-24T19:18:51.560 INFO:tasks.workunit.client.0.trial162.stdout: api_service: 24.314% pgs not active 2026-02-24T19:18:51.560 INFO:tasks.workunit.client.0.trial162.stdout: api_service: 566 active+clean 2026-02-24T19:18:51.560 INFO:tasks.workunit.client.0.trial162.stdout: api_service: 244 creating+activating 2026-02-24T19:18:51.560 INFO:tasks.workunit.client.0.trial162.stdout: api_service: 232 unknown 2026-02-24T19:18:51.560 INFO:tasks.workunit.client.0.trial162.stdout: api_service: 13 creating+peering 2026-02-24T19:18:51.561 INFO:tasks.workunit.client.0.trial162.stdout: api_service: 2 active 2026-02-24T19:18:51.561 INFO:tasks.workunit.client.0.trial162.stdout: api_service: 2026-02-24T19:18:51.561 INFO:tasks.workunit.client.0.trial162.stdout: api_service: io: 2026-02-24T19:18:51.561 INFO:tasks.workunit.client.0.trial162.stdout: api_service: client: 0 B/s rd, 1.6 KiB/s wr, 0 op/s rd, 2 op/s wr 2026-02-24T19:18:51.561 INFO:tasks.workunit.client.0.trial162.stdout: api_service: 2026-02-24T19:18:51.561 INFO:tasks.workunit.client.0.trial162.stdout: api_service: 2026-02-24T19:18:51.561 INFO:tasks.workunit.client.0.trial162.stdout: api_service: cluster: 2026-02-24T19:18:51.561 INFO:tasks.workunit.client.0.trial162.stdout: api_service: id: 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:18:51.561 INFO:tasks.workunit.client.0.trial162.stdout: api_service: health: HEALTH_OK 2026-02-24T19:18:51.561 INFO:tasks.workunit.client.0.trial162.stdout: api_service: 2026-02-24T19:18:51.561 INFO:tasks.workunit.client.0.trial162.stdout: api_service: services: 2026-02-24T19:18:51.561 INFO:tasks.workunit.client.0.trial162.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 89s) [leader: a] 2026-02-24T19:18:51.561 INFO:tasks.workunit.client.0.trial162.stdout: api_service: mgr: x(active, since 87s), standbys: y 2026-02-24T19:18:51.561 INFO:tasks.workunit.client.0.trial162.stdout: api_service: osd: 16 osds: 16 up (since 56s), 16 in (since 82s) 2026-02-24T19:18:51.561 INFO:tasks.workunit.client.0.trial162.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2026-02-24T19:18:51.562 INFO:tasks.workunit.client.0.trial162.stdout: api_service: laundry: 1 daemon active (1 hosts) 2026-02-24T19:18:51.562 INFO:tasks.workunit.client.0.trial162.stdout: api_service: 2026-02-24T19:18:51.562 INFO:tasks.workunit.client.0.trial162.stdout: api_service: data: 2026-02-24T19:18:51.562 INFO:tasks.workunit.client.0.trial162.stdout: api_service: pools: 30 pools, 857 pgs 2026-02-24T19:18:51.562 INFO:tasks.workunit.client.0.trial162.stdout: api_service: objects: 14 objects, 449 KiB 2026-02-24T19:18:51.562 INFO:tasks.workunit.client.0.trial162.stdout: api_service: usage: 428 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-24T19:18:51.562 INFO:tasks.workunit.client.0.trial162.stdout: api_service: pgs: 53.909% pgs unknown 2026-02-24T19:18:51.562 INFO:tasks.workunit.client.0.trial162.stdout: api_service: 14.236% pgs not active 2026-02-24T19:18:51.562 INFO:tasks.workunit.client.0.trial162.stdout: api_service: 462 unknown 2026-02-24T19:18:54.608 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: Running main() from gmock_main.cc 2026-02-24T19:18:54.608 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2026-02-24T19:18:54.608 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [----------] Global test environment set-up. 2026-02-24T19:18:54.608 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2026-02-24T19:18:54.609 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2026-02-24T19:18:54.609 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2026-02-24T19:18:54.609 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2026-02-24T19:18:54.609 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (1681 ms) 2026-02-24T19:18:54.609 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2026-02-24T19:18:54.609 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (781 ms) 2026-02-24T19:18:54.609 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2026-02-24T19:18:54.609 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (499 ms) 2026-02-24T19:18:54.609 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2026-02-24T19:18:54.609 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (340 ms) 2026-02-24T19:18:54.609 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2026-02-24T19:18:54.609 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (96 ms) 2026-02-24T19:18:54.610 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2026-02-24T19:18:54.610 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (534 ms) 2026-02-24T19:18:54.610 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2026-02-24T19:18:54.610 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (500 ms) 2026-02-24T19:18:54.610 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2026-02-24T19:18:54.610 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (64 ms) 2026-02-24T19:18:54.610 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2026-02-24T19:18:54.610 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (31 ms) 2026-02-24T19:18:54.610 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2026-02-24T19:18:54.610 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (45 ms) 2026-02-24T19:18:54.610 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2026-02-24T19:18:54.610 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (375 ms) 2026-02-24T19:18:54.610 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2026-02-24T19:18:54.611 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (938 ms) 2026-02-24T19:18:54.611 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2026-02-24T19:18:54.611 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (2017 ms) 2026-02-24T19:18:54.611 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2026-02-24T19:18:54.611 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (877 ms) 2026-02-24T19:18:54.611 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2026-02-24T19:18:54.611 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (112 ms) 2026-02-24T19:18:54.611 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2026-02-24T19:18:54.611 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (538 ms) 2026-02-24T19:18:54.611 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (9435 ms total) 2026-02-24T19:18:54.611 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: 2026-02-24T19:18:54.611 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [----------] Global test environment tear-down 2026-02-24T19:18:54.611 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (13029 ms total) 2026-02-24T19:18:54.612 INFO:tasks.workunit.client.0.trial162.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2026-02-24T19:18:54.660 INFO:tasks.workunit.client.0.trial162.stdout: cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial162-48868-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:54.660 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:50.365086+0000 mon.c [INF] from='client.? v1:10.20.193.162:0/520997070' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial162-49424-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:54.660 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:50.368351+0000 mon.a [INF] from='client.4970 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial162-48868-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:54.660 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:50.375607+0000 mon.a [INF] from='client.5105 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial162-49424-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:54.661 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:50.431961+0000 client.admin [INF] onexx 2026-02-24T19:18:54.661 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:50.439521+0000 mon.b [INF] from='client.? v1:10.20.193.162:0/1257985167' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOptrial162-49694-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T19:18:54.661 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:50.439957+0000 mon.a [INF] from='client.? v1:10.20.193.162:0/2766880781' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2026-02-24T19:18:54.661 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:50.468041+0000 mon.c [INF] from='client.? v1:10.20.193.162:0/3925441266' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_trial162-48885-16"} : dispatch 2026-02-24T19:18:54.661 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:50.480352+0000 mon.a [INF] from='client.5077 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOptrial162-49694-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T19:18:54.661 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:50.506303+0000 mon.a [INF] from='client.5213 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_trial162-48885-16"} : dispatch 2026-02-24T19:18:54.661 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:50.522115+0000 mon.c [INF] from='client.? v1:10.20.193.162:0/3925441266' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_trial162-48885-16"} : dispatch 2026-02-24T19:18:54.661 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:50.529352+0000 mon.a [INF] from='client.5213 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_trial162-48885-16"} : dispatch 2026-02-24T19:18:54.661 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:50.536944+0000 mon.c [INF] from='client.? v1:10.20.193.162:0/3925441266' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_trial162-48885-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T19:18:54.661 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:50.541375+0000 mon.a [INF] from='client.5213 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_trial162-48885-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T19:18:54.661 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:52.533624+0000 mon.a [INF] from='client.? v1:10.20.193.162:0/2766880781' entity='client.admin' cmd={"prefix":"log", "logtext":["twoxx"]} : dispatch 2026-02-24T19:18:54.662 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:52.547247+0000 mon.b [INF] from='client.? v1:10.20.193.162:0/3060222017' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_trial162-48845-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:54.662 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:52.551279+0000 mon.c [INF] from='client.? v1:10.20.193.162:0/3801646063' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_trial162-49260-1"} : dispatch 2026-02-24T19:18:54.662 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:52.578223+0000 mon.b [INF] from='client.? v1:10.20.193.162:0/698060629' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_trial162-49001-10"} : dispatch 2026-02-24T19:18:54.662 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:52.595960+0000 mon.b [INF] from='client.? v1:10.20.193.162:0/965228786' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_trial162-48967-10"} : dispatch 2026-02-24T19:18:54.662 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:52.598116+0000 mon.a [INF] from='client.5149 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_trial162-48845-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:54.662 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:52.623829+0000 mon.a [INF] from='client.5158 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_trial162-49001-10"} : dispatch 2026-02-24T19:18:54.662 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:52.629314+0000 mon.a [INF] from='client.5161 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_trial162-48967-10"} : dispatch 2026-02-24T19:18:54.662 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:52.631474+0000 mon.a [INF] from='client.? v1:10.20.193.162:0/772953415' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectstrial162-49772-1"} : dispatch 2026-02-24T19:18:54.662 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:52.645289+0000 mon.b [INF] from='client.? v1:10.20.193.162:0/698060629' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_trial162-49001-10"} : dispatch 2026-02-24T19:18:54.662 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:52.646758+0000 mon.b [INF] from='client.? v1:10.20.193.162:0/965228786' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_trial162-48967-10"} : dispatch 2026-02-24T19:18:54.662 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:52.647746+0000 mon.a [INF] from='client.? v1:10.20.193.162:0/2766880781' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2026-02-24T19:18:54.662 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:52.712652+0000 mon.a [INF] from='client.4856 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_trial162-49260-1"} : dispatch 2026-02-24T19:18:54.662 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:52.773502+0000 mon.a [INF] from='client.5158 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_trial162-49001-10"} : dispatch 2026-02-24T19:18:54.663 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:52.780513+0000 mon.a [INF] from='client.5161 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_trial162-48967-10"} : dispatch 2026-02-24T19:18:54.663 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:52.830148+0000 mon.b [INF] from='client.? v1:10.20.193.162:0/698060629' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_trial162-49001-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T19:18:54.663 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:52.836595+0000 mon.b [INF] from='client.? v1:10.20.193.162:0/965228786' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_trial162-48967-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T19:18:54.663 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:52.845545+0000 mon.a [INF] from='client.5158 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_trial162-49001-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T19:18:54.663 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:52.849800+0000 mon.a [INF] from='client.5161 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_trial162-48967-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T19:18:54.663 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:53.439988+0000 mon.a [INF] from='client.5077 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOptrial162-49694-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOptrial162-49694-2"}]': finished 2026-02-24T19:18:54.663 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:53.441507+0000 mon.a [INF] from='client.5213 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_trial162-48885-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_trial162-48885-16"}]': finished 2026-02-24T19:18:54.663 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:53.442475+0000 mon.a [INF] from='client.5149 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_trial162-48845-3","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-24T19:18:54.663 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:53.443343+0000 mon.a [INF] from='client.? v1:10.20.193.162:0/772953415' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectstrial162-49772-1"}]': finished 2026-02-24T19:18:54.663 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:53.444742+0000 mon.a [INF] from='client.4856 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_trial162-49260-1"}]': finished 2026-02-24T19:18:54.663 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:53.445550+0000 mon.a [INF] from='client.5158 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_trial162-49001-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-24T19:18:54.663 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:53.446517+0000 mon.a [INF] from='client.5161 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_trial162-48967-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-24T19:18:54.664 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:53.512437+0000 mon.c [INF] from='client.? v1:10.20.193.162:0/3801646063' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_trial162-49260-1"} : dispatch 2026-02-24T19:18:54.664 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:53.513628+0000 mon.b [INF] from='client.? v1:10.20.193.162:0/698060629' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockECPP_trial162-49001-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_trial162-49001-10"} : dispatch 2026-02-24T19:18:54.664 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:53.521868+0000 mon.a [INF] from='client.4856 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_trial162-49260-1"} : dispatch 2026-02-24T19:18:54.664 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:53.524005+0000 mon.b [INF] from='client.? v1:10.20.193.162:0/965228786' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockEC_trial162-48967-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_trial162-48967-10"} : dispatch 2026-02-24T19:18:54.664 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:53.528516+0000 mon.a [INF] from='client.5158 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockECPP_trial162-49001-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_trial162-49001-10"} : dispatch 2026-02-24T19:18:54.664 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:53.545531+0000 mon.a [INF] from='client.5161 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockEC_trial162-48967-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_trial162-48967-10"} : dispatch 2026-02-24T19:18:54.664 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:53.587547+0000 mon.b [INF] from='client.? v1:10.20.193.162:0/3742408386' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNStrial162-49772-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T19:18:55.657 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:53.603754+0000 mon.a [INF] from='client.5170 ' entity='client.admin' cmd={"pre cmd: Running main() from gmock_main.cc 2026-02-24T19:18:55.657 INFO:tasks.workunit.client.0.trial162.stdout: cmd: [==========] Running 3 tests from 1 test suite. 2026-02-24T19:18:55.657 INFO:tasks.workunit.client.0.trial162.stdout: cmd: [----------] Global test environment set-up. 2026-02-24T19:18:55.657 INFO:tasks.workunit.client.0.trial162.stdout: cmd: [----------] 3 tests from NeoRadosCmd 2026-02-24T19:18:55.657 INFO:tasks.workunit.client.0.trial162.stdout: cmd: [ RUN ] NeoRadosCmd.MonDescribe 2026-02-24T19:18:55.657 INFO:tasks.workunit.client.0.trial162.stdout: cmd: [ OK ] NeoRadosCmd.MonDescribe (2968 ms) 2026-02-24T19:18:55.657 INFO:tasks.workunit.client.0.trial162.stdout: cmd: [ RUN ] NeoRadosCmd.OSDCmd 2026-02-24T19:18:55.657 INFO:tasks.workunit.client.0.trial162.stdout: cmd: [ OK ] NeoRadosCmd.OSDCmd (4750 ms) 2026-02-24T19:18:55.658 INFO:tasks.workunit.client.0.trial162.stdout: cmd: [ RUN ] NeoRadosCmd.PGCmd 2026-02-24T19:18:55.658 INFO:tasks.workunit.client.0.trial162.stdout: cmd: [ OK ] NeoRadosCmd.PGCmd (6347 ms) 2026-02-24T19:18:55.658 INFO:tasks.workunit.client.0.trial162.stdout: cmd: [----------] 3 tests from NeoRadosCmd (14066 ms total) 2026-02-24T19:18:55.658 INFO:tasks.workunit.client.0.trial162.stdout: cmd: 2026-02-24T19:18:55.658 INFO:tasks.workunit.client.0.trial162.stdout: cmd: [----------] Global test environment tear-down 2026-02-24T19:18:55.658 INFO:tasks.workunit.client.0.trial162.stdout: cmd: [==========] 3 tests from 1 test suite ran. (14066 ms total) 2026-02-24T19:18:55.658 INFO:tasks.workunit.client.0.trial162.stdout: cmd: [ PASSED ] 3 tests. 2026-02-24T19:18:55.944 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:01:53.919 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:55.963 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:01:53.938 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:55.967 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:01:53.939 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:55.969 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:01:53.905 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:55.971 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:01:53.942 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:56.026 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:01:53.962 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:56.103 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:01:54.039 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:56.119 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:01:54.090 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:56.147 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:01:54.122 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:18:57.126 INFO:tasks.workunit.client.0.trial162.stdout: pool: Running main() from gmock_main.cc 2026-02-24T19:18:57.126 INFO:tasks.workunit.client.0.trial162.stdout: pool: [==========] Running 6 tests from 1 test suite. 2026-02-24T19:18:57.126 INFO:tasks.workunit.client.0.trial162.stdout: pool: [----------] Global test environment set-up. 2026-02-24T19:18:57.126 INFO:tasks.workunit.client.0.trial162.stdout: pool: [----------] 6 tests from NeoRadosPools 2026-02-24T19:18:57.127 INFO:tasks.workunit.client.0.trial162.stdout: pool: [ RUN ] NeoRadosPools.PoolList 2026-02-24T19:18:57.127 INFO:tasks.workunit.client.0.trial162.stdout: pool: [ OK ] NeoRadosPools.PoolList (2933 ms) 2026-02-24T19:18:57.127 INFO:tasks.workunit.client.0.trial162.stdout: pool: [ RUN ] NeoRadosPools.PoolLookup 2026-02-24T19:18:57.127 INFO:tasks.workunit.client.0.trial162.stdout: pool: [ OK ] NeoRadosPools.PoolLookup (4019 ms) 2026-02-24T19:18:57.127 INFO:tasks.workunit.client.0.trial162.stdout: pool: [ RUN ] NeoRadosPools.PoolLookupOtherInstance 2026-02-24T19:18:57.127 INFO:tasks.workunit.client.0.trial162.stdout: pool: [ OK ] NeoRadosPools.PoolLookupOtherInstance (2860 ms) 2026-02-24T19:18:57.127 INFO:tasks.workunit.client.0.trial162.stdout: pool: [ RUN ] NeoRadosPools.PoolDelete 2026-02-24T19:18:57.127 INFO:tasks.workunit.client.0.trial162.stdout: pool: [ OK ] NeoRadosPools.PoolDelete (2123 ms) 2026-02-24T19:18:57.127 INFO:tasks.workunit.client.0.trial162.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateDelete 2026-02-24T19:18:57.127 INFO:tasks.workunit.client.0.trial162.stdout: pool: [ OK ] NeoRadosPools.PoolCreateDelete (2110 ms) 2026-02-24T19:18:57.127 INFO:tasks.workunit.client.0.trial162.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2026-02-24T19:18:57.127 INFO:tasks.workunit.client.0.trial162.stdout: pool: [ OK ] NeoRadosPools.PoolCreateWithCrushRule (1467 ms) 2026-02-24T19:18:57.127 INFO:tasks.workunit.client.0.trial162.stdout: pool: [----------] 6 tests from NeoRadosPools (15514 ms total) 2026-02-24T19:18:57.128 INFO:tasks.workunit.client.0.trial162.stdout: pool: 2026-02-24T19:18:57.128 INFO:tasks.workunit.client.0.trial162.stdout: pool: [----------] Global test environment tear-down 2026-02-24T19:18:57.128 INFO:tasks.workunit.client.0.trial162.stdout: pool: [==========] 6 tests from 1 test suite ran. (15514 ms total) 2026-02-24T19:18:57.128 INFO:tasks.workunit.client.0.trial162.stdout: pool: [ PASSED ] 6 tests. 2026-02-24T19:18:57.132 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: Running main() from gmock_main.cc 2026-02-24T19:18:57.132 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2026-02-24T19:18:57.132 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: [----------] Global test environment set-up. 2026-02-24T19:18:57.132 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2026-02-24T19:18:57.132 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: seed 49201 2026-02-24T19:18:57.132 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2026-02-24T19:18:57.132 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (1900 ms) 2026-02-24T19:18:57.133 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2026-02-24T19:18:57.133 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (448 ms) 2026-02-24T19:18:57.133 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2026-02-24T19:18:57.133 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (25 ms) 2026-02-24T19:18:57.133 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2026-02-24T19:18:57.133 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (43 ms) 2026-02-24T19:18:57.133 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2026-02-24T19:18:57.133 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (205 ms) 2026-02-24T19:18:57.133 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (2624 ms total) 2026-02-24T19:18:57.133 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: 2026-02-24T19:18:57.133 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2026-02-24T19:18:57.133 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2026-02-24T19:18:57.133 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (1777 ms) 2026-02-24T19:18:57.134 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2026-02-24T19:18:57.134 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (1 ms) 2026-02-24T19:18:57.134 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2026-02-24T19:18:57.134 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (140 ms) 2026-02-24T19:18:57.134 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2026-02-24T19:18:57.134 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (774 ms) 2026-02-24T19:18:57.134 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (2694 ms total) 2026-02-24T19:18:57.134 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: 2026-02-24T19:18:57.134 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: [----------] Global test environment tear-down 2026-02-24T19:18:57.134 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (15578 ms total) 2026-02-24T19:18:57.134 INFO:tasks.workunit.client.0.trial162.stdout: api_stat_pp: [ PASSED ] 9 tests. 2026-02-24T19:18:57.165 INFO:tasks.workunit.client.0.trial162.stdout: open_pools_parallel: process_1_[49592]: starting. 2026-02-24T19:18:57.165 INFO:tasks.workunit.client.0.trial162.stdout: open_pools_parallel: process_1_[49592]: creating pool ceph_test_rados_open_pools_parallel.trial162-49518 2026-02-24T19:18:57.165 INFO:tasks.workunit.client.0.trial162.stdout: open_pools_parallel: process_1_[49592]: created object 0... 2026-02-24T19:18:57.165 INFO:tasks.workunit.client.0.trial162.stdout: open_pools_parallel: process_1_[49592]: created object 25... 2026-02-24T19:18:57.165 INFO:tasks.workunit.client.0.trial162.stdout: open_pools_parallel: process_1_[49592]: created object 49... 2026-02-24T19:18:57.165 INFO:tasks.workunit.client.0.trial162.stdout: open_pools_parallel: process_1_[49592]: finishing. 2026-02-24T19:18:57.165 INFO:tasks.workunit.client.0.trial162.stdout: open_pools_parallel: process_1_[49592]: shutting down. 2026-02-24T19:18:57.165 INFO:tasks.workunit.client.0.trial162.stdout: open_pools_parallel: process_2_[49595]: starting. 2026-02-24T19:18:57.165 INFO:tasks.workunit.client.0.trial162.stdout: open_pools_parallel: process_2_[49595]: rados_pool_create. 2026-02-24T19:18:57.165 INFO:tasks.workunit.client.0.trial162.stdout: open_pools_parallel: process_2_[49595]: rados_ioctx_create. 2026-02-24T19:18:57.166 INFO:tasks.workunit.client.0.trial162.stdout: open_pools_parallel: process_2_[49595]: shutting down. 2026-02-24T19:18:57.166 INFO:tasks.workunit.client.0.trial162.stdout: open_pools_parallel: ******************************* 2026-02-24T19:18:57.166 INFO:tasks.workunit.client.0.trial162.stdout: open_pools_parallel: process_3_[50974]: starting. 2026-02-24T19:18:57.166 INFO:tasks.workunit.client.0.trial162.stdout: open_pools_parallel: process_3_[50974]: creating pool ceph_test_rados_open_pools_parallel.trial162-49518 2026-02-24T19:18:57.166 INFO:tasks.workunit.client.0.trial162.stdout: open_pools_parallel: process_3_[50974]: created object 0... 2026-02-24T19:18:57.166 INFO:tasks.workunit.client.0.trial162.stdout: open_pools_parallel: process_3_[50974]: created object 25... 2026-02-24T19:18:57.166 INFO:tasks.workunit.client.0.trial162.stdout: open_pools_parallel: process_3_[50974]: created object 49... 2026-02-24T19:18:57.166 INFO:tasks.workunit.client.0.trial162.stdout: open_pools_parallel: process_3_[50974]: finishing. 2026-02-24T19:18:57.166 INFO:tasks.workunit.client.0.trial162.stdout: open_pools_parallel: process_3_[50974]: shutting down. 2026-02-24T19:18:57.166 INFO:tasks.workunit.client.0.trial162.stdout: open_pools_parallel: ******************************* 2026-02-24T19:18:57.166 INFO:tasks.workunit.client.0.trial162.stdout: open_pools_parallel: process_4_[50975]: starting. 2026-02-24T19:18:57.166 INFO:tasks.workunit.client.0.trial162.stdout: open_pools_parallel: process_4_[50975]: rados_pool_create. 2026-02-24T19:18:57.166 INFO:tasks.workunit.client.0.trial162.stdout: open_pools_parallel: process_4_[50975]: rados_ioctx_create. 2026-02-24T19:18:57.167 INFO:tasks.workunit.client.0.trial162.stdout: open_pools_parallel: process_4_[50975]: shutting down. 2026-02-24T19:18:57.167 INFO:tasks.workunit.client.0.trial162.stdout: open_pools_parallel: ******************************* 2026-02-24T19:18:57.167 INFO:tasks.workunit.client.0.trial162.stdout: open_pools_parallel: ******************************* 2026-02-24T19:18:57.167 INFO:tasks.workunit.client.0.trial162.stdout: open_pools_parallel: ******* SUCCESS ********** 2026-02-24T19:18:58.176 INFO:tasks.workunit.client.0.trial162.stdout: ec_io: Running main() from gmock_main.cc 2026-02-24T19:18:58.176 INFO:tasks.workunit.client.0.trial162.stdout: ec_io: [==========] Running 2 tests from 1 test suite. 2026-02-24T19:18:58.176 INFO:tasks.workunit.client.0.trial162.stdout: ec_io: [----------] Global test environment set-up. 2026-02-24T19:18:58.176 INFO:tasks.workunit.client.0.trial162.stdout: ec_io: [----------] 2 tests from NeoRadosECIo 2026-02-24T19:18:58.176 INFO:tasks.workunit.client.0.trial162.stdout: ec_io: [ RUN ] NeoRadosECIo.SimpleWrite 2026-02-24T19:18:58.176 INFO:tasks.workunit.client.0.trial162.stdout: ec_io: [ OK ] NeoRadosECIo.SimpleWrite (8636 ms) 2026-02-24T19:18:58.177 INFO:tasks.workunit.client.0.trial162.stdout: ec_io: [ RUN ] NeoRadosECIo.ReadOp 2026-02-24T19:18:58.177 INFO:tasks.workunit.client.0.trial162.stdout: ec_io: [ OK ] NeoRadosECIo.ReadOp (7936 ms) 2026-02-24T19:18:58.177 INFO:tasks.workunit.client.0.trial162.stdout: ec_io: [----------] 2 tests from NeoRadosECIo (16573 ms total) 2026-02-24T19:18:58.177 INFO:tasks.workunit.client.0.trial162.stdout: ec_io: 2026-02-24T19:18:58.177 INFO:tasks.workunit.client.0.trial162.stdout: ec_io: [----------] Global test environment tear-down 2026-02-24T19:18:58.177 INFO:tasks.workunit.client.0.trial162.stdout: ec_io: [==========] 2 tests from 1 test suite ran. (16573 ms total) 2026-02-24T19:18:58.177 INFO:tasks.workunit.client.0.trial162.stdout: ec_io: [ PASSED ] 2 tests. 2026-02-24T19:18:58.267 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: process_1_[49611]: starting. 2026-02-24T19:18:58.267 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: process_1_[49611]: creating pool ceph_test_rados_delete_pools_parallel.trial162-49530 2026-02-24T19:18:58.267 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: process_1_[49611]: created object 0... 2026-02-24T19:18:58.267 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: process_1_[49611]: created object 25... 2026-02-24T19:18:58.267 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: process_1_[49611]: created object 49... 2026-02-24T19:18:58.267 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: process_1_[49611]: finishing. 2026-02-24T19:18:58.268 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: process_1_[49611]: shutting down. 2026-02-24T19:18:58.268 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: process_2_[49620]: starting. 2026-02-24T19:18:58.268 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: process_2_[49620]: deleting pool ceph_test_rados_delete_pools_parallel.trial162-49530 2026-02-24T19:18:58.268 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: process_2_[49620]: shutting down. 2026-02-24T19:18:58.268 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: ******************************* 2026-02-24T19:18:58.268 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: process_3_[50990]: starting. 2026-02-24T19:18:58.268 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: process_3_[50990]: creating pool ceph_test_rados_delete_pools_parallel.trial162-49530 2026-02-24T19:18:58.268 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: process_3_[50990]: created object 0... 2026-02-24T19:18:58.268 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: process_3_[50990]: created object 25... 2026-02-24T19:18:58.268 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: process_3_[50990]: created object 49... 2026-02-24T19:18:58.268 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: process_3_[50990]: finishing. 2026-02-24T19:18:58.268 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: process_3_[50990]: shutting down. 2026-02-24T19:18:58.269 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: ******************************* 2026-02-24T19:18:58.269 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: process_5_[50992]: starting. 2026-02-24T19:18:58.269 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: process_5_[50992]: listing objects. 2026-02-24T19:18:58.269 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: process_5_[50992]: listed object 0... 2026-02-24T19:18:58.269 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: process_5_[50992]: listed object 25... 2026-02-24T19:18:58.269 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: process_5_[50992]: saw 50 objects 2026-02-24T19:18:58.269 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: process_5_[50992]: shutting down. 2026-02-24T19:18:58.269 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: ******************************* 2026-02-24T19:18:58.269 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: process_4_[50991]: starting. 2026-02-24T19:18:58.269 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: process_4_[50991]: deleting pool ceph_test_rados_delete_pools_parallel.trial162-49530 2026-02-24T19:18:58.269 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: process_4_[50991]: shutting down. 2026-02-24T19:18:58.269 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: ******************************* 2026-02-24T19:18:58.269 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: ******************************* 2026-02-24T19:18:58.270 INFO:tasks.workunit.client.0.trial162.stdout: delete_pools_parallel: ******* SUCCESS ********** 2026-02-24T19:18:58.272 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: Running main() from gmock_main.cc 2026-02-24T19:18:58.273 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2026-02-24T19:18:58.273 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: [----------] Global test environment set-up. 2026-02-24T19:18:58.273 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: [----------] 5 tests from LibRadosStat 2026-02-24T19:18:58.273 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2026-02-24T19:18:58.273 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: [ OK ] LibRadosStat.Stat (2415 ms) 2026-02-24T19:18:58.273 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2026-02-24T19:18:58.273 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (278 ms) 2026-02-24T19:18:58.273 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2026-02-24T19:18:58.273 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: [ OK ] LibRadosStat.StatNS (219 ms) 2026-02-24T19:18:58.273 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2026-02-24T19:18:58.273 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (15 ms) 2026-02-24T19:18:58.274 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2026-02-24T19:18:58.274 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (174 ms) 2026-02-24T19:18:58.274 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: [----------] 5 tests from LibRadosStat (3104 ms total) 2026-02-24T19:18:58.274 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: 2026-02-24T19:18:58.274 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2026-02-24T19:18:58.274 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2026-02-24T19:18:58.274 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (1763 ms) 2026-02-24T19:18:58.274 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2026-02-24T19:18:58.274 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (501 ms) 2026-02-24T19:18:58.274 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2026-02-24T19:18:58.274 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (0 ms) 2026-02-24T19:18:58.274 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2026-02-24T19:18:58.274 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (188 ms) 2026-02-24T19:18:58.275 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (2454 ms total) 2026-02-24T19:18:58.275 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: 2026-02-24T19:18:58.275 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: [----------] Global test environment tear-down 2026-02-24T19:18:58.275 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (16718 ms total) 2026-02-24T19:18:58.275 INFO:tasks.workunit.client.0.trial162.stdout: api_stat: [ PASSED ] 9 tests. 2026-02-24T19:18:58.888 INFO:tasks.workunit.client.0.trial162.stdout:fix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNStrial162-49772-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-24T19:18:58.888 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:54.505764+0000 mon.a [INF] from='client.4856 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_trial162-49260-1"}]': finished 2026-02-24T19:18:58.889 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:54.507225+0000 mon.a [INF] from='client.5170 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNStrial162-49772-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-24T19:18:58.889 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:54.589711+0000 mon.b [INF] from='client.? v1:10.20.193.162:0/3742408386' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsNStrial162-49772-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNStrial162-49772-2"} : dispatch 2026-02-24T19:18:58.889 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:54.612180+0000 mon.b [INF] from='client.? v1:10.20.193.162:0/984717050' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial162-49072-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:58.889 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:54.612437+0000 mon.a [INF] from='client.5170 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsNStrial162-49772-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNStrial162-49772-2"} : dispatch 2026-02-24T19:18:58.889 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:54.618424+0000 mon.c [INF] from='client.? v1:10.20.193.162:0/122501736' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial162-49424-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:58.889 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:54.639723+0000 mon.a [INF] from='client.5209 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial162-49072-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:58.889 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:54.648280+0000 mon.a [INF] from='client.5291 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial162-49424-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-24T19:18:58.889 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:54.657182+0000 client.admin [INF] threexx 2026-02-24T19:18:58.889 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: got: 2026-02-24T19:18:54.658679+0000 mon.a [INF] from='client.? v1:10.20.193.162:0/2766880781' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2026-02-24T19:18:58.889 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (8539 ms) 2026-02-24T19:18:58.889 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (17325 ms total) 2026-02-24T19:18:58.890 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: 2026-02-24T19:18:58.890 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: [----------] Global test environment tear-down 2026-02-24T19:18:58.890 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (17325 ms total) 2026-02-24T19:18:58.890 INFO:tasks.workunit.client.0.trial162.stdout: api_cmd: [ PASSED ] 4 tests. 2026-02-24T19:19:01.738 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2026-02-24T19:19:01.738 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [----------] Global test environment set-up. 2026-02-24T19:19:01.738 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [----------] 7 tests from LibRadosList 2026-02-24T19:19:01.738 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2026-02-24T19:19:01.739 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [ OK ] LibRadosList.ListObjects (3147 ms) 2026-02-24T19:19:01.739 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2026-02-24T19:19:01.739 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (1175 ms) 2026-02-24T19:19:01.739 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2026-02-24T19:19:01.739 INFO:tasks.workunit.client.0.trial162.stdout: api_list: myset foo1,foo2,foo3 2026-02-24T19:19:01.739 INFO:tasks.workunit.client.0.trial162.stdout: api_list: foo1 2026-02-24T19:19:01.739 INFO:tasks.workunit.client.0.trial162.stdout: api_list: foo2 2026-02-24T19:19:01.739 INFO:tasks.workunit.client.0.trial162.stdout: api_list: foo3 2026-02-24T19:19:01.739 INFO:tasks.workunit.client.0.trial162.stdout: api_list: myset foo1,foo4,foo5 2026-02-24T19:19:01.739 INFO:tasks.workunit.client.0.trial162.stdout: api_list: foo4 2026-02-24T19:19:01.739 INFO:tasks.workunit.client.0.trial162.stdout: api_list: foo5 2026-02-24T19:19:01.739 INFO:tasks.workunit.client.0.trial162.stdout: api_list: foo1 2026-02-24T19:19:01.740 INFO:tasks.workunit.client.0.trial162.stdout: api_list: myset foo6,foo7 2026-02-24T19:19:01.740 INFO:tasks.workunit.client.0.trial162.stdout: api_list: foo7 2026-02-24T19:19:01.740 INFO:tasks.workunit.client.0.trial162.stdout: api_list: foo6 2026-02-24T19:19:01.740 INFO:tasks.workunit.client.0.trial162.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2026-02-24T19:19:01.740 INFO:tasks.workunit.client.0.trial162.stdout: api_list: ns1:foo4 2026-02-24T19:19:01.740 INFO:tasks.workunit.client.0.trial162.stdout: api_list: ns1:foo5 2026-02-24T19:19:01.740 INFO:tasks.workunit.client.0.trial162.stdout: api_list: ns2:foo7 2026-02-24T19:19:01.740 INFO:tasks.workunit.client.0.trial162.stdout: api_list: ns2:foo6 2026-02-24T19:19:01.740 INFO:tasks.workunit.client.0.trial162.stdout: api_list: ns1:foo1 2026-02-24T19:19:01.740 INFO:tasks.workunit.client.0.trial162.stdout: api_list: :foo1 2026-02-24T19:19:01.740 INFO:tasks.workunit.client.0.trial162.stdout: api_list: :foo2 2026-02-24T19:19:01.740 INFO:tasks.workunit.client.0.trial162.stdout: api_list: :foo3 2026-02-24T19:19:01.740 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (4641 ms) 2026-02-24T19:19:01.741 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2026-02-24T19:19:01.741 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 1 0 2026-02-24T19:19:01.741 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 10 0 2026-02-24T19:19:01.741 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 13 0 2026-02-24T19:19:01.741 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 7 0 2026-02-24T19:19:01.741 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 14 0 2026-02-24T19:19:01.741 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 0 0 2026-02-24T19:19:01.741 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 15 0 2026-02-24T19:19:01.741 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 11 0 2026-02-24T19:19:01.741 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 5 0 2026-02-24T19:19:01.741 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 8 0 2026-02-24T19:19:01.741 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 6 0 2026-02-24T19:19:01.741 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 3 0 2026-02-24T19:19:01.742 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 4 0 2026-02-24T19:19:01.742 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 12 0 2026-02-24T19:19:01.742 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 9 0 2026-02-24T19:19:01.742 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 2 0 2026-02-24T19:19:01.742 INFO:tasks.workunit.client.0.trial162.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2026-02-24T19:19:01.742 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (3654 ms) 2026-02-24T19:19:01.742 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2026-02-24T19:19:01.742 INFO:tasks.workunit.client.0.trial162.stdout: api_list: x cursor=MIN 2026-02-24T19:19:01.742 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > oid=1 cursor=8:02547ec2:::1:head 2026-02-24T19:19:01.742 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > oid=10 cursor=8:52ea6a34:::10:head 2026-02-24T19:19:01.742 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > oid=13 cursor=8:566253c9:::13:head 2026-02-24T19:19:01.742 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > oid=7 cursor=8:5c6b0b28:::7:head 2026-02-24T19:19:01.742 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > oid=14 cursor=8:62a1935d:::14:head 2026-02-24T19:19:01.743 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > oid=0 cursor=8:6cac518f:::0:head 2026-02-24T19:19:01.743 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > oid=15 cursor=8:863748b0:::15:head 2026-02-24T19:19:01.743 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > oid=11 cursor=8:89d3ae78:::11:head 2026-02-24T19:19:01.743 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > oid=5 cursor=8:b29083e3:::5:head 2026-02-24T19:19:01.743 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > oid=8 cursor=8:bd63b0f1:::8:head 2026-02-24T19:19:01.743 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > oid=6 cursor=8:c4fdafeb:::6:head 2026-02-24T19:19:01.743 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > oid=3 cursor=8:cfc208b3:::3:head 2026-02-24T19:19:01.743 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > oid=4 cursor=8:d83876eb:::4:head 2026-02-24T19:19:01.743 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > oid=12 cursor=8:de5d7c5f:::12:head 2026-02-24T19:19:01.743 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > oid=9 cursor=8:e960b815:::9:head 2026-02-24T19:19:01.743 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > oid=2 cursor=8:f905c69b:::2:head 2026-02-24T19:19:01.743 INFO:tasks.workunit.client.0.trial162.stdout: api_list: FIRST> seek to MIN oid=1 2026-02-24T19:19:01.743 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : oid=1 cursor=8:02547ec2:::1:head 2026-02-24T19:19:01.744 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:02547ec2:::1:head 2026-02-24T19:19:01.744 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:02547ec2:::1:head -> 1 2026-02-24T19:19:01.744 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : oid=10 cursor=8:52ea6a34:::10:head 2026-02-24T19:19:01.744 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:52ea6a34:::10:head 2026-02-24T19:19:01.744 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:52ea6a34:::10:head -> 10 2026-02-24T19:19:01.744 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : oid=13 cursor=8:566253c9:::13:head 2026-02-24T19:19:01.744 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:566253c9:::13:head 2026-02-24T19:19:01.744 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:566253c9:::13:head -> 13 2026-02-24T19:19:01.744 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : oid=7 cursor=8:5c6b0b28:::7:head 2026-02-24T19:19:01.744 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:5c6b0b28:::7:head 2026-02-24T19:19:01.744 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:5c6b0b28:::7:head -> 7 2026-02-24T19:19:02.062 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : oid=14 cursor=8:62a1935d:::14:h api_io: Running main() from gmock_main.cc 2026-02-24T19:19:02.062 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2026-02-24T19:19:02.062 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [----------] Global test environment set-up. 2026-02-24T19:19:02.062 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [----------] 14 tests from LibRadosIo 2026-02-24T19:19:02.062 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2026-02-24T19:19:02.062 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (2819 ms) 2026-02-24T19:19:02.063 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2026-02-24T19:19:02.063 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2026-02-24T19:19:02.063 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2026-02-24T19:19:02.063 INFO:tasks.workunit.client.0.trial162.stdout: api_io: no timeout :/ 2026-02-24T19:19:02.063 INFO:tasks.workunit.client.0.trial162.stdout: api_io: no timeout :/ 2026-02-24T19:19:02.063 INFO:tasks.workunit.client.0.trial162.stdout: api_io: no timeout :/ 2026-02-24T19:19:02.063 INFO:tasks.workunit.client.0.trial162.stdout: api_io: no timeout :/ 2026-02-24T19:19:02.063 INFO:tasks.workunit.client.0.trial162.stdout: api_io: no timeout :/ 2026-02-24T19:19:02.063 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (1149 ms) 2026-02-24T19:19:02.063 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2026-02-24T19:19:02.063 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (96 ms) 2026-02-24T19:19:02.063 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2026-02-24T19:19:02.064 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ OK ] LibRadosIo.Checksum (44 ms) 2026-02-24T19:19:02.064 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2026-02-24T19:19:02.064 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (87 ms) 2026-02-24T19:19:02.064 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2026-02-24T19:19:02.064 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (64 ms) 2026-02-24T19:19:02.064 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2026-02-24T19:19:02.064 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (95 ms) 2026-02-24T19:19:02.064 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2026-02-24T19:19:02.064 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (48 ms) 2026-02-24T19:19:02.064 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2026-02-24T19:19:02.064 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ OK ] LibRadosIo.TruncTest (68 ms) 2026-02-24T19:19:02.064 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2026-02-24T19:19:02.064 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (349 ms) 2026-02-24T19:19:02.065 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2026-02-24T19:19:02.065 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (397 ms) 2026-02-24T19:19:02.065 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2026-02-24T19:19:02.065 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ OK ] LibRadosIo.RmXattr (308 ms) 2026-02-24T19:19:02.065 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2026-02-24T19:19:02.065 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ OK ] LibRadosIo.XattrIter (73 ms) 2026-02-24T19:19:02.065 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [----------] 14 tests from LibRadosIo (5604 ms total) 2026-02-24T19:19:02.065 INFO:tasks.workunit.client.0.trial162.stdout: api_io: 2026-02-24T19:19:02.065 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2026-02-24T19:19:02.065 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2026-02-24T19:19:02.065 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (1663 ms) 2026-02-24T19:19:02.065 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2026-02-24T19:19:02.065 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (282 ms) 2026-02-24T19:19:02.065 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2026-02-24T19:19:02.066 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (195 ms) 2026-02-24T19:19:02.066 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2026-02-24T19:19:02.066 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (1148 ms) 2026-02-24T19:19:02.066 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2026-02-24T19:19:02.066 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (225 ms) 2026-02-24T19:19:02.066 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2026-02-24T19:19:02.066 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (77 ms) 2026-02-24T19:19:02.066 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2026-02-24T19:19:02.066 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (985 ms) 2026-02-24T19:19:02.066 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2026-02-24T19:19:02.066 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (616 ms) 2026-02-24T19:19:02.066 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2026-02-24T19:19:02.067 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (312 ms) 2026-02-24T19:19:02.067 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2026-02-24T19:19:02.067 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (71 ms) 2026-02-24T19:19:02.067 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [----------] 10 tests from LibRadosIoEC (5578 ms total) 2026-02-24T19:19:02.067 INFO:tasks.workunit.client.0.trial162.stdout: api_io: 2026-02-24T19:19:02.067 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [----------] Global test environment tear-down 2026-02-24T19:19:02.067 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [==========] 24 tests from 2 test suites ran. (20541 ms total) 2026-02-24T19:19:02.067 INFO:tasks.workunit.client.0.trial162.stdout: api_io: [ PASSED ] 24 tests. 2026-02-24T19:19:03.936 INFO:tasks.workunit.client.0.trial162.stdout:ead 2026-02-24T19:19:03.936 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:62a1935d:::14:head 2026-02-24T19:19:03.936 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:62a1935d:::14:head -> 14 2026-02-24T19:19:03.936 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : oid=0 cursor=8:6cac518f:::0:head 2026-02-24T19:19:03.936 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:6cac518f:::0:head 2026-02-24T19:19:03.936 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:6cac518f:::0:head -> 0 2026-02-24T19:19:03.937 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : oid=15 cursor=8:863748b0:::15:head 2026-02-24T19:19:03.937 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:863748b0:::15:head 2026-02-24T19:19:03.937 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:863748b0:::15:head -> 15 2026-02-24T19:19:03.937 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : oid=11 cursor=8:89d3ae78:::11:head 2026-02-24T19:19:03.937 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:89d3ae78:::11:head 2026-02-24T19:19:03.937 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:89d3ae78:::11:head -> 11 2026-02-24T19:19:03.937 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : oid=5 cursor=8:b29083e3:::5:head 2026-02-24T19:19:03.937 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:b29083e3:::5:head 2026-02-24T19:19:03.937 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:b29083e3:::5:head -> 5 2026-02-24T19:19:03.937 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : oid=8 cursor=8:bd63b0f1:::8:head 2026-02-24T19:19:03.937 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:bd63b0f1:::8:head 2026-02-24T19:19:03.937 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:bd63b0f1:::8:head -> 8 2026-02-24T19:19:03.937 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : oid=6 cursor=8:c4fdafeb:::6:head 2026-02-24T19:19:03.938 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:c4fdafeb:::6:head 2026-02-24T19:19:03.938 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:c4fdafeb:::6:head -> 6 2026-02-24T19:19:03.938 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : oid=3 cursor=8:cfc208b3:::3:head 2026-02-24T19:19:03.938 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:cfc208b3:::3:head 2026-02-24T19:19:03.938 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:cfc208b3:::3:head -> 3 2026-02-24T19:19:03.938 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : oid=4 cursor=8:d83876eb:::4:head 2026-02-24T19:19:03.938 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:d83876eb:::4:head 2026-02-24T19:19:03.938 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:d83876eb:::4:head -> 4 2026-02-24T19:19:03.938 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : oid=12 cursor=8:de5d7c5f:::12:head 2026-02-24T19:19:03.938 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:de5d7c5f:::12:head 2026-02-24T19:19:03.938 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:de5d7c5f:::12:head -> 12 2026-02-24T19:19:03.938 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : oid=9 cursor=8:e960b815:::9:head 2026-02-24T19:19:03.938 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:e960b815:::9:head 2026-02-24T19:19:03.939 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:e960b815:::9:head -> 9 2026-02-24T19:19:03.939 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : oid=2 cursor=8:f905c69b:::2:head 2026-02-24T19:19:03.939 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:f905c69b:::2:head 2026-02-24T19:19:03.939 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:f905c69b:::2:head -> 2 2026-02-24T19:19:03.939 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:f905c69b:::2:head 2026-02-24T19:19:03.939 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : cursor()=8:f905c69b:::2:head expected=8:f905c69b:::2:head 2026-02-24T19:19:03.939 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:f905c69b:::2:head -> 2 2026-02-24T19:19:03.939 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : entry=2 expected=2 2026-02-24T19:19:03.939 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:e960b815:::9:head 2026-02-24T19:19:03.939 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : cursor()=8:e960b815:::9:head expected=8:e960b815:::9:head 2026-02-24T19:19:03.939 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:e960b815:::9:head -> 9 2026-02-24T19:19:03.939 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : entry=9 expected=9 2026-02-24T19:19:03.939 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:d83876eb:::4:head 2026-02-24T19:19:03.939 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : cursor()=8:d83876eb:::4:head expected=8:d83876eb:::4:head 2026-02-24T19:19:03.940 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:d83876eb:::4:head -> 4 2026-02-24T19:19:03.940 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : entry=4 expected=4 2026-02-24T19:19:03.940 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:cfc208b3:::3:head 2026-02-24T19:19:03.940 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : cursor()=8:cfc208b3:::3:head expected=8:cfc208b3:::3:head 2026-02-24T19:19:03.940 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:cfc208b3:::3:head -> 3 2026-02-24T19:19:03.940 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : entry=3 expected=3 2026-02-24T19:19:03.940 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:c4fdafeb:::6:head 2026-02-24T19:19:03.940 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : cursor()=8:c4fdafeb:::6:head expected=8:c4fdafeb:::6:head 2026-02-24T19:19:03.940 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:c4fdafeb:::6:head -> 6 2026-02-24T19:19:03.940 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : entry=6 expected=6 2026-02-24T19:19:03.940 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:bd63b0f1:::8:head 2026-02-24T19:19:03.940 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : cursor()=8:bd63b0f1:::8:head expected=8:bd63b0f1:::8:head 2026-02-24T19:19:03.941 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:bd63b0f1:::8:head -> 8 2026-02-24T19:19:03.941 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : entry=8 expected=8 2026-02-24T19:19:03.941 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:b29083e3:::5:head 2026-02-24T19:19:03.941 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : cursor()=8:b29083e3:::5:head expected=8:b29083e3:::5:head 2026-02-24T19:19:03.941 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:b29083e3:::5:head -> 5 2026-02-24T19:19:03.941 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : entry=5 expected=5 2026-02-24T19:19:03.941 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:89d3ae78:::11:head 2026-02-24T19:19:03.941 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : cursor()=8:89d3ae78:::11:head expected=8:89d3ae78:::11:head 2026-02-24T19:19:03.941 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:89d3ae78:::11:head -> 11 2026-02-24T19:19:03.941 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : entry=11 expected=11 2026-02-24T19:19:03.941 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:52ea6a34:::10:head 2026-02-24T19:19:05.685 INFO:tasks.workunit.client.0.trial162.stdout: api_list: api_lock: Running main() from gmock_main.cc 2026-02-24T19:19:05.685 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2026-02-24T19:19:05.685 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [----------] Global test environment set-up. 2026-02-24T19:19:05.686 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [----------] 8 tests from LibRadosLock 2026-02-24T19:19:05.686 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2026-02-24T19:19:05.686 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (2276 ms) 2026-02-24T19:19:05.686 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2026-02-24T19:19:05.686 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ OK ] LibRadosLock.LockShared (201 ms) 2026-02-24T19:19:05.686 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2026-02-24T19:19:05.686 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1294 ms) 2026-02-24T19:19:05.686 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2026-02-24T19:19:05.686 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1597 ms) 2026-02-24T19:19:05.686 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2026-02-24T19:19:05.686 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (230 ms) 2026-02-24T19:19:05.686 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2026-02-24T19:19:05.687 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ OK ] LibRadosLock.Unlock (549 ms) 2026-02-24T19:19:05.687 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2026-02-24T19:19:05.687 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (468 ms) 2026-02-24T19:19:05.687 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2026-02-24T19:19:05.687 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (70 ms) 2026-02-24T19:19:05.687 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [----------] 8 tests from LibRadosLock (6688 ms total) 2026-02-24T19:19:05.687 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: 2026-02-24T19:19:05.687 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2026-02-24T19:19:05.687 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2026-02-24T19:19:05.687 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (2416 ms) 2026-02-24T19:19:05.687 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2026-02-24T19:19:05.687 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (729 ms) 2026-02-24T19:19:05.688 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2026-02-24T19:19:05.688 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1163 ms) 2026-02-24T19:19:05.688 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2026-02-24T19:19:05.688 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1274 ms) 2026-02-24T19:19:05.688 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2026-02-24T19:19:05.688 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (128 ms) 2026-02-24T19:19:05.688 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2026-02-24T19:19:05.688 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (84 ms) 2026-02-24T19:19:05.688 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2026-02-24T19:19:05.688 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (107 ms) 2026-02-24T19:19:05.688 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2026-02-24T19:19:05.688 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (61 ms) 2026-02-24T19:19:05.688 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (5966 ms total) 2026-02-24T19:19:05.689 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: 2026-02-24T19:19:05.689 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [----------] Global test environment tear-down 2026-02-24T19:19:05.689 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (24152 ms total) 2026-02-24T19:19:05.689 INFO:tasks.workunit.client.0.trial162.stdout: api_lock: [ PASSED ] 16 tests. 2026-02-24T19:19:05.689 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: Running main() from gmock_main.cc 2026-02-24T19:19:05.689 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2026-02-24T19:19:05.689 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [----------] Global test environment set-up. 2026-02-24T19:19:05.689 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2026-02-24T19:19:05.689 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: seed 49001 2026-02-24T19:19:05.689 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2026-02-24T19:19:05.689 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (2316 ms) 2026-02-24T19:19:05.689 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2026-02-24T19:19:05.690 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (211 ms) 2026-02-24T19:19:05.690 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2026-02-24T19:19:05.690 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (1280 ms) 2026-02-24T19:19:05.690 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2026-02-24T19:19:05.690 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1547 ms) 2026-02-24T19:19:05.690 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2026-02-24T19:19:05.690 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (201 ms) 2026-02-24T19:19:05.690 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2026-02-24T19:19:05.690 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (765 ms) 2026-02-24T19:19:05.690 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2026-02-24T19:19:05.690 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (105 ms) 2026-02-24T19:19:05.690 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2026-02-24T19:19:05.690 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (221 ms) 2026-02-24T19:19:05.690 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (6651 ms total) 2026-02-24T19:19:05.691 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: 2026-02-24T19:19:05.691 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2026-02-24T19:19:05.691 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2026-02-24T19:19:05.691 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (2261 ms) 2026-02-24T19:19:05.691 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2026-02-24T19:19:05.691 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (627 ms) 2026-02-24T19:19:05.691 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2026-02-24T19:19:05.691 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1277 ms) 2026-02-24T19:19:05.691 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2026-02-24T19:19:05.691 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1478 ms) 2026-02-24T19:19:05.691 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2026-02-24T19:19:05.691 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (72 ms) 2026-02-24T19:19:05.691 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2026-02-24T19:19:05.692 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (92 ms) 2026-02-24T19:19:05.692 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2026-02-24T19:19:05.692 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (108 ms) 2026-02-24T19:19:05.692 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2026-02-24T19:19:05.692 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (70 ms) 2026-02-24T19:19:05.692 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (5989 ms total) 2026-02-24T19:19:05.692 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: 2026-02-24T19:19:05.692 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [----------] Global test environment tear-down 2026-02-24T19:19:05.692 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (24148 ms total) 2026-02-24T19:19:05.692 INFO:tasks.workunit.client.0.trial162.stdout: api_lock_pp: [ PASSED ] 16 tests. 2026-02-24T19:19:07.591 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2026-02-24T19:19:07.592 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2026-02-24T19:19:07.592 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2026-02-24T19:19:07.592 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2026-02-24T19:19:07.592 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2026-02-24T19:19:07.592 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: notify 2026-02-24T19:19:07.592 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (5281 ms) 2026-02-24T19:19:07.592 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2026-02-24T19:19:07.592 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (1201 ms) 2026-02-24T19:19:07.592 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (6482 ms total) 2026-02-24T19:19:07.592 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: 2026-02-24T19:19:07.592 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2026-02-24T19:19:07.593 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2026-02-24T19:19:07.593 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: notify 2026-02-24T19:19:07.593 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (1797 ms) 2026-02-24T19:19:07.593 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2026-02-24T19:19:07.593 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: notify 2026-02-24T19:19:07.593 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (3916 ms) 2026-02-24T19:19:07.593 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2026-02-24T19:19:07.593 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (819 ms) 2026-02-24T19:19:07.593 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2026-02-24T19:19:07.593 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (171 ms) 2026-02-24T19:19:07.593 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2026-02-24T19:19:07.593 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: handle_notify cookie 94198830638848 notify_id 214748364801 notifier_gid 5221 2026-02-24T19:19:07.594 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (110 ms) 2026-02-24T19:19:07.594 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2026-02-24T19:19:07.594 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: handle_notify cookie 94198830638848 notify_id 214748364802 notifier_gid 5221 2026-02-24T19:19:07.594 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (80 ms) 2026-02-24T19:19:07.594 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2026-02-24T19:19:07.594 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: handle_notify cookie 94198830638848 notify_id 214748364800 notifier_gid 5221 2026-02-24T19:19:07.594 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (140 ms) 2026-02-24T19:19:07.594 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2026-02-24T19:19:07.594 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: handle_notify cookie 94198830638848 notify_id 214748364801 notifier_gid 5221 2026-02-24T19:19:07.594 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (112 ms) 2026-02-24T19:19:07.594 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2026-02-24T19:19:07.594 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: handle_notify cookie 94198830638848 notify_id 214748364802 notifier_gid 5221 2026-02-24T19:19:07.594 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (113 ms) 2026-02-24T19:19:07.595 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2026-02-24T19:19:07.595 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: handle_notify cookie 94198830638848 notify_id 214748364803 notifier_gid 5221 2026-02-24T19:19:07.595 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (98 ms) 2026-02-24T19:19:07.595 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2026-02-24T19:19:07.595 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: trying... 2026-02-24T19:19:07.595 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: handle_notify cookie 94198830638848 notify_id 214748364803 notifier_gid 5221 2026-02-24T19:19:07.595 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: timed out 2026-02-24T19:19:07.595 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: flushing 2026-02-24T19:19:07.622 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_1_[49579]: starting. 2026-02-24T19:19:07.622 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_1_[49579]: creating pool ceph_test_rados_list_parallel.trial162-49491 2026-02-24T19:19:07.622 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_1_[49579]: created object 0... 2026-02-24T19:19:07.622 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_1_[49579]: created object 25... 2026-02-24T19:19:07.622 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_1_[49579]: created object 49... 2026-02-24T19:19:07.622 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_1_[49579]: finishing. 2026-02-24T19:19:07.622 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_1_[49579]: shutting down. 2026-02-24T19:19:07.623 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_2_[49582]: starting. 2026-02-24T19:19:07.623 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_2_[49582]: listing objects. 2026-02-24T19:19:07.623 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_2_[49582]: listed object 0... 2026-02-24T19:19:07.623 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_2_[49582]: listed object 25... 2026-02-24T19:19:07.623 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_2_[49582]: saw 50 objects 2026-02-24T19:19:07.623 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_2_[49582]: shutting down. 2026-02-24T19:19:07.623 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:07.623 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_3_[51114]: starting. 2026-02-24T19:19:07.623 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_3_[51114]: creating pool ceph_test_rados_list_parallel.trial162-49491 2026-02-24T19:19:07.623 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_3_[51114]: created object 0... 2026-02-24T19:19:07.623 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_3_[51114]: created object 25... 2026-02-24T19:19:07.623 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_3_[51114]: created object 49... 2026-02-24T19:19:07.623 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_3_[51114]: finishing. 2026-02-24T19:19:07.624 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_3_[51114]: shutting down. 2026-02-24T19:19:07.624 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:07.624 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_4_[51115]: starting. 2026-02-24T19:19:07.624 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_4_[51115]: listing objects. 2026-02-24T19:19:07.624 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_4_[51115]: listed object 0... 2026-02-24T19:19:07.624 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_4_[51115]: listed object 25... 2026-02-24T19:19:07.624 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_4_[51115]: saw 46 objects 2026-02-24T19:19:07.624 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_4_[51115]: shutting down. 2026-02-24T19:19:07.624 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:07.624 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_5_[51116]: starting. 2026-02-24T19:19:07.624 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_5_[51116]: removed 25 objects... 2026-02-24T19:19:07.624 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_5_[51116]: removed half of the objects 2026-02-24T19:19:07.624 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_5_[51116]: removed 50 objects... 2026-02-24T19:19:07.625 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_5_[51116]: removed 50 objects 2026-02-24T19:19:07.625 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_5_[51116]: shutting down. 2026-02-24T19:19:07.625 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:07.625 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:07.625 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_6_[51624]: starting. 2026-02-24T19:19:07.625 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_6_[51624]: creating pool ceph_test_rados_list_parallel.trial162-49491 2026-02-24T19:19:07.625 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_6_[51624]: created object 0... 2026-02-24T19:19:07.625 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_6_[51624]: created object 25... 2026-02-24T19:19:07.625 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_6_[51624]: created object 49... 2026-02-24T19:19:07.625 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_6_[51624]: finishing. 2026-02-24T19:19:07.625 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_6_[51624]: shutting down. 2026-02-24T19:19:07.625 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:07.625 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:07.626 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_7_[51625]: starting. 2026-02-24T19:19:07.626 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_7_[51625]: listing objects. 2026-02-24T19:19:07.626 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_7_[51625]: listed object 0... 2026-02-24T19:19:07.626 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_7_[51625]: listed object 25... 2026-02-24T19:19:07.626 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_7_[51625]: listed object 50... 2026-02-24T19:19:07.626 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_7_[51625]: saw 56 objects 2026-02-24T19:19:07.626 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_7_[51625]: shutting down. 2026-02-24T19:19:07.626 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:07.626 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:07.626 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_8_[51626]: starting. 2026-02-24T19:19:07.626 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_8_[51626]: added 25 objects... 2026-02-24T19:19:07.626 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_8_[51626]: added half of the objects 2026-02-24T19:19:07.626 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_8_[51626]: added 50 objects... 2026-02-24T19:19:07.626 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_8_[51626]: added 50 objects 2026-02-24T19:19:07.627 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_8_[51626]: shutting down. 2026-02-24T19:19:07.627 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:07.627 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:11.075 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ************************* api_io_pp: Running main() from gmock_main.cc 2026-02-24T19:19:11.075 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [==========] Running 40 tests from 2 test suites. 2026-02-24T19:19:11.076 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [----------] Global test environment set-up. 2026-02-24T19:19:11.076 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [----------] 22 tests from LibRadosIoPP 2026-02-24T19:19:11.076 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: seed 48906 2026-02-24T19:19:11.076 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2026-02-24T19:19:11.076 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2026-02-24T19:19:11.076 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2026-02-24T19:19:11.076 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (3198 ms) 2026-02-24T19:19:11.076 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2026-02-24T19:19:11.076 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (405 ms) 2026-02-24T19:19:11.076 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2026-02-24T19:19:11.076 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (62 ms) 2026-02-24T19:19:11.076 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadExtentArrayOpPP 2026-02-24T19:19:11.077 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadExtentArrayOpPP (12025 ms) 2026-02-24T19:19:11.077 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2026-02-24T19:19:11.077 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (19 ms) 2026-02-24T19:19:11.077 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2026-02-24T19:19:11.077 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (23 ms) 2026-02-24T19:19:11.077 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2026-02-24T19:19:11.077 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (549 ms) 2026-02-24T19:19:11.077 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2026-02-24T19:19:11.077 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (86 ms) 2026-02-24T19:19:11.077 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2026-02-24T19:19:11.077 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (180 ms) 2026-02-24T19:19:11.077 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2026-02-24T19:19:11.077 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (94 ms) 2026-02-24T19:19:11.078 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2026-02-24T19:19:11.078 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (33 ms) 2026-02-24T19:19:11.078 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2026-02-24T19:19:11.078 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (55 ms) 2026-02-24T19:19:11.078 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2026-02-24T19:19:11.078 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (716 ms) 2026-02-24T19:19:11.078 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2026-02-24T19:19:11.078 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (42 ms) 2026-02-24T19:19:11.078 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2026-02-24T19:19:11.078 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (41 ms) 2026-02-24T19:19:11.078 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2026-02-24T19:19:11.078 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (522 ms) 2026-02-24T19:19:11.078 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2026-02-24T19:19:11.079 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (71 ms) 2026-02-24T19:19:11.079 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CrcZeroWrite 2026-02-24T19:19:11.079 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoPP.CrcZeroWrite (88 ms) 2026-02-24T19:19:11.079 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2026-02-24T19:19:11.079 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (60 ms) 2026-02-24T19:19:11.079 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2026-02-24T19:19:11.079 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (31 ms) 2026-02-24T19:19:11.079 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2026-02-24T19:19:11.079 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (40 ms) 2026-02-24T19:19:11.079 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [----------] 22 tests from LibRadosIoPP (18348 ms total) 2026-02-24T19:19:11.079 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: 2026-02-24T19:19:11.079 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [----------] 18 tests from LibRadosIoECPP 2026-02-24T19:19:11.079 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2026-02-24T19:19:11.080 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (4034 ms) 2026-02-24T19:19:11.080 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2026-02-24T19:19:11.080 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (281 ms) 2026-02-24T19:19:11.080 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2026-02-24T19:19:11.604 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadO api_service: 273 active+clean 2026-02-24T19:19:11.605 INFO:tasks.workunit.client.0.trial162.stdout: api_service: 117 creating+activating 2026-02-24T19:19:11.605 INFO:tasks.workunit.client.0.trial162.stdout: api_service: 5 creating+peering 2026-02-24T19:19:11.605 INFO:tasks.workunit.client.0.trial162.stdout: api_service: 2026-02-24T19:19:11.605 INFO:tasks.workunit.client.0.trial162.stdout: api_service: io: 2026-02-24T19:19:11.605 INFO:tasks.workunit.client.0.trial162.stdout: api_service: client: 0 B/s rd, 1.4 KiB/s wr, 0 op/s rd, 1 op/s wr 2026-02-24T19:19:11.605 INFO:tasks.workunit.client.0.trial162.stdout: api_service: 2026-02-24T19:19:11.605 INFO:tasks.workunit.client.0.trial162.stdout: api_service: 2026-02-24T19:19:11.605 INFO:tasks.workunit.client.0.trial162.stdout: api_service: [ OK ] LibRadosService.StatusFormat (4633 ms) 2026-02-24T19:19:11.605 INFO:tasks.workunit.client.0.trial162.stdout: api_service: [ RUN ] LibRadosService.Status 2026-02-24T19:19:11.605 INFO:tasks.workunit.client.0.trial162.stdout: api_service: [ OK ] LibRadosService.Status (20025 ms) 2026-02-24T19:19:11.605 INFO:tasks.workunit.client.0.trial162.stdout: api_service: [----------] 4 tests from LibRadosService (30024 ms total) 2026-02-24T19:19:11.605 INFO:tasks.workunit.client.0.trial162.stdout: api_service: 2026-02-24T19:19:11.606 INFO:tasks.workunit.client.0.trial162.stdout: api_service: [----------] Global test environment tear-down 2026-02-24T19:19:11.606 INFO:tasks.workunit.client.0.trial162.stdout: api_service: [==========] 4 tests from 1 test suite ran. (30024 ms total) 2026-02-24T19:19:11.606 INFO:tasks.workunit.client.0.trial162.stdout: api_service: [ PASSED ] 4 tests. 2026-02-24T19:19:12.641 INFO:tasks.workunit.client.0.trial162.stdout:****** 2026-02-24T19:19:12.641 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_9_[54028]: starting. 2026-02-24T19:19:12.641 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_9_[54028]: creating pool ceph_test_rados_list_parallel.trial162-49491 2026-02-24T19:19:12.641 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_9_[54028]: created object 0... 2026-02-24T19:19:12.641 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_9_[54028]: created object 25... 2026-02-24T19:19:12.642 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_9_[54028]: created object 49... 2026-02-24T19:19:12.642 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_9_[54028]: finishing. 2026-02-24T19:19:12.642 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_9_[54028]: shutting down. 2026-02-24T19:19:12.642 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:12.642 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:12.642 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:12.642 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_10_[54029]: starting. 2026-02-24T19:19:12.642 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_10_[54029]: listing objects. 2026-02-24T19:19:12.642 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_10_[54029]: listed object 0... 2026-02-24T19:19:12.642 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_10_[54029]: listed object 25... 2026-02-24T19:19:12.642 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_10_[54029]: listed object 50... 2026-02-24T19:19:12.642 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_10_[54029]: listed object 75... 2026-02-24T19:19:12.642 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_10_[54029]: listed object 100... 2026-02-24T19:19:12.643 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_10_[54029]: saw 101 objects 2026-02-24T19:19:12.643 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_10_[54029]: shutting down. 2026-02-24T19:19:12.643 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:12.643 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:12.643 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:12.643 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_13_[54032]: starting. 2026-02-24T19:19:12.643 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_13_[54032]: removed 25 objects... 2026-02-24T19:19:12.643 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_13_[54032]: removed half of the objects 2026-02-24T19:19:12.643 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_13_[54032]: removed 50 objects... 2026-02-24T19:19:12.643 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_13_[54032]: removed 50 objects 2026-02-24T19:19:12.643 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_13_[54032]: shutting down. 2026-02-24T19:19:12.643 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:12.643 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:12.644 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:12.644 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_11_[54030]: starting. 2026-02-24T19:19:12.644 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_11_[54030]: added 25 objects... 2026-02-24T19:19:12.644 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_11_[54030]: added half of the objects 2026-02-24T19:19:12.644 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_11_[54030]: added 50 objects... 2026-02-24T19:19:12.644 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_11_[54030]: added 50 objects 2026-02-24T19:19:12.644 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_11_[54030]: shutting down. 2026-02-24T19:19:12.644 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:12.644 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:12.644 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:12.644 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_12_[54031]: starting. 2026-02-24T19:19:12.644 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_12_[54031]: added 25 objects... 2026-02-24T19:19:12.644 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_12_[54031]: added half of the objects 2026-02-24T19:19:12.645 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_12_[54031]: added 50 objects... 2026-02-24T19:19:12.645 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_12_[54031]: added 50 objects 2026-02-24T19:19:12.645 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_12_[54031]: shutting down. 2026-02-24T19:19:12.645 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:12.645 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:12.645 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:12.645 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:12.645 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_14_[57690]: starting. 2026-02-24T19:19:12.645 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_14_[57690]: creating pool ceph_test_rados_list_parallel.trial162-49491 2026-02-24T19:19:12.645 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_14_[57690]: created object 0... 2026-02-24T19:19:12.645 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_14_[57690]: created object 25... 2026-02-24T19:19:12.645 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_14_[57690]: created object 49... 2026-02-24T19:19:12.645 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_14_[57690]: finishing. 2026-02-24T19:19:12.646 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_14_[57690]: shutting down. 2026-02-24T19:19:12.646 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:12.646 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:12.646 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:12.646 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:12.646 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_15_[57694]: starting. 2026-02-24T19:19:12.646 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_15_[57694]: listing objects. 2026-02-24T19:19:16.256 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_15_[57694]: listed object 0.. list: Running main() from gmock_main.cc 2026-02-24T19:19:16.256 INFO:tasks.workunit.client.0.trial162.stdout: list: [==========] Running 3 tests from 1 test suite. 2026-02-24T19:19:16.256 INFO:tasks.workunit.client.0.trial162.stdout: list: [----------] Global test environment set-up. 2026-02-24T19:19:16.256 INFO:tasks.workunit.client.0.trial162.stdout: list: [----------] 3 tests from NeoradosList 2026-02-24T19:19:16.256 INFO:tasks.workunit.client.0.trial162.stdout: list: [ RUN ] NeoradosList.ListObjects 2026-02-24T19:19:16.256 INFO:tasks.workunit.client.0.trial162.stdout: list: [ OK ] NeoradosList.ListObjects (7747 ms) 2026-02-24T19:19:16.256 INFO:tasks.workunit.client.0.trial162.stdout: list: [ RUN ] NeoradosList.ListObjectsNS 2026-02-24T19:19:16.256 INFO:tasks.workunit.client.0.trial162.stdout: list: [ OK ] NeoradosList.ListObjectsNS (6311 ms) 2026-02-24T19:19:16.256 INFO:tasks.workunit.client.0.trial162.stdout: list: [ RUN ] NeoradosList.ListObjectsMany 2026-02-24T19:19:16.257 INFO:tasks.workunit.client.0.trial162.stdout: list: [ OK ] NeoradosList.ListObjectsMany (20592 ms) 2026-02-24T19:19:16.257 INFO:tasks.workunit.client.0.trial162.stdout: list: [----------] 3 tests from NeoradosList (34651 ms total) 2026-02-24T19:19:16.257 INFO:tasks.workunit.client.0.trial162.stdout: list: 2026-02-24T19:19:16.257 INFO:tasks.workunit.client.0.trial162.stdout: list: [----------] Global test environment tear-down 2026-02-24T19:19:16.257 INFO:tasks.workunit.client.0.trial162.stdout: list: [==========] 3 tests from 1 test suite ran. (34651 ms total) 2026-02-24T19:19:16.257 INFO:tasks.workunit.client.0.trial162.stdout: list: [ PASSED ] 3 tests. 2026-02-24T19:19:17.383 INFO:tasks.workunit.client.0.trial162.stdout:. 2026-02-24T19:19:17.383 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_15_[57694]: listed object 25... 2026-02-24T19:19:17.383 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_15_[57694]: listed object 50... 2026-02-24T19:19:17.383 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_15_[57694]: listed object 75... 2026-02-24T19:19:17.383 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_15_[57694]: listed object 100... 2026-02-24T19:19:17.383 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_15_[57694]: listed object 125... 2026-02-24T19:19:17.383 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_15_[57694]: saw 150 objects 2026-02-24T19:19:17.383 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_15_[57694]: shutting down. 2026-02-24T19:19:17.383 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:17.384 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:17.384 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:17.384 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:17.384 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_16_[57695]: starting. 2026-02-24T19:19:17.384 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_16_[57695]: added 25 objects... 2026-02-24T19:19:17.384 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_16_[57695]: added half of the objects 2026-02-24T19:19:17.384 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_16_[57695]: added 50 objects... 2026-02-24T19:19:17.384 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_16_[57695]: added 50 objects 2026-02-24T19:19:17.384 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: process_16_[57695]: shutting down. 2026-02-24T19:19:17.384 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:17.384 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:17.384 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:17.384 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:17.385 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******************************* 2026-02-24T19:19:17.385 INFO:tasks.workunit.client.0.trial162.stdout: list_parallel: ******* SUCCESS ********** 2026-02-24T19:19:17.681 INFO:tasks.workunit.client.0.trial162.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2026-02-24T19:19:17.682 INFO:tasks.workunit.client.0.trial162.stdout: api_service_pp: [----------] Global test environment set-up. 2026-02-24T19:19:17.682 INFO:tasks.workunit.client.0.trial162.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2026-02-24T19:19:17.682 INFO:tasks.workunit.client.0.trial162.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2026-02-24T19:19:17.682 INFO:tasks.workunit.client.0.trial162.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5258 ms) 2026-02-24T19:19:17.682 INFO:tasks.workunit.client.0.trial162.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2026-02-24T19:19:17.682 INFO:tasks.workunit.client.0.trial162.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (31 ms) 2026-02-24T19:19:17.682 INFO:tasks.workunit.client.0.trial162.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2026-02-24T19:19:17.682 INFO:tasks.workunit.client.0.trial162.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20025 ms) 2026-02-24T19:19:17.682 INFO:tasks.workunit.client.0.trial162.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2026-02-24T19:19:17.682 INFO:tasks.workunit.client.0.trial162.stdout: api_service_pp: attempt 0 of 20 2026-02-24T19:19:17.683 INFO:tasks.workunit.client.0.trial162.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (10786 ms) 2026-02-24T19:19:17.683 INFO:tasks.workunit.client.0.trial162.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (36101 ms total) 2026-02-24T19:19:17.683 INFO:tasks.workunit.client.0.trial162.stdout: api_service_pp: 2026-02-24T19:19:17.683 INFO:tasks.workunit.client.0.trial162.stdout: api_service_pp: [----------] Global test environment tear-down 2026-02-24T19:19:17.683 INFO:tasks.workunit.client.0.trial162.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (36101 ms total) 2026-02-24T19:19:17.683 INFO:tasks.workunit.client.0.trial162.stdout: api_service_pp: [ PASSED ] 4 tests. 2026-02-24T19:19:22.209 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:02:20.184 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:22.243 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:02:20.218 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:22.326 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:02:20.301 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:22.448 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:02:20.384 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:22.529 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:02:20.500 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:22.532 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:02:20.469 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:22.572 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:02:20.543 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:22.582 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:02:20.518 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:22.619 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:02:20.590 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:24.182 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: flushed 2026-02-24T19:19:24.182 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3066 ms) 2026-02-24T19:19:24.182 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2026-02-24T19:19:24.182 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: trying... 2026-02-24T19:19:24.182 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: handle_notify cookie 94198830638848 notify_id 223338299397 notifier_gid 5221 2026-02-24T19:19:24.182 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: timed out 2026-02-24T19:19:24.182 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: flushing 2026-02-24T19:19:24.182 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: flushed 2026-02-24T19:19:24.182 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3086 ms) 2026-02-24T19:19:24.183 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2026-02-24T19:19:24.183 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: List watches 2026-02-24T19:19:24.183 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: notify2 2026-02-24T19:19:24.183 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: handle_notify cookie 94198830638848 notify_id 231928233989 notifier_gid 5221 2026-02-24T19:19:24.183 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: notify2 done 2026-02-24T19:19:24.183 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: watch_check 2026-02-24T19:19:24.183 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: unwatch2 2026-02-24T19:19:24.183 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: flushing 2026-02-24T19:19:24.183 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: done 2026-02-24T19:19:24.183 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3241 ms) 2026-02-24T19:19:24.183 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2026-02-24T19:19:24.183 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: List watches 2026-02-24T19:19:24.184 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: notify2 2026-02-24T19:19:24.184 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: handle_notify cookie 94198830638848 notify_id 236223201286 notifier_gid 5221 2026-02-24T19:19:24.184 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: notify2 done 2026-02-24T19:19:24.184 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: watch_check 2026-02-24T19:19:24.184 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: unwatch2 2026-02-24T19:19:24.184 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: flushing 2026-02-24T19:19:24.184 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: done 2026-02-24T19:19:24.184 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3152 ms) 2026-02-24T19:19:24.184 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (19907 ms total) 2026-02-24T19:19:24.184 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: 2026-02-24T19:19:24.184 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2026-02-24T19:19:24.184 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (42622 ms total) 2026-02-24T19:19:24.184 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2026-02-24T19:19:27.712 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: Running main() from gmock_main.cc 2026-02-24T19:19:27.712 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2026-02-24T19:19:27.712 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [----------] Global test environment set-up. 2026-02-24T19:19:27.712 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2026-02-24T19:19:27.712 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2026-02-24T19:19:27.713 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: watch_notify_test_cb 2026-02-24T19:19:27.713 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (2529 ms) 2026-02-24T19:19:27.713 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2026-02-24T19:19:27.713 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2026-02-24T19:19:27.713 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93970058789808 err -107 2026-02-24T19:19:27.713 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (1391 ms) 2026-02-24T19:19:27.713 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2026-02-24T19:19:27.713 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2026-02-24T19:19:27.713 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93970058797744 err -107 2026-02-24T19:19:27.713 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (1726 ms) 2026-02-24T19:19:27.713 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2026-02-24T19:19:27.713 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: watch_notify2_test_cb from 4850 notify_id 158913789952 cookie 93970058802672 2026-02-24T19:19:27.713 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (950 ms) 2026-02-24T19:19:27.714 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2026-02-24T19:19:27.714 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: watch_notify2_test_cb from 4850 notify_id 158913789952 cookie 93970058819408 2026-02-24T19:19:27.714 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (103 ms) 2026-02-24T19:19:27.714 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2026-02-24T19:19:27.714 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: watch_notify2_test_cb from 4850 notify_id 158913789952 cookie 93970058830528 2026-02-24T19:19:27.714 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (1064 ms) 2026-02-24T19:19:27.714 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2026-02-24T19:19:27.714 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: watch_notify2_test_cb from 4850 notify_id 163208757248 cookie 93970058830528 2026-02-24T19:19:27.714 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: watch_notify2_test_cb from 4850 notify_id 163208757248 cookie 93970060210400 2026-02-24T19:19:27.714 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (127 ms) 2026-02-24T19:19:27.714 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2026-02-24T19:19:27.714 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: watch_notify2_test_cb from 4850 notify_id 163208757249 cookie 93970058844304 2026-02-24T19:19:27.715 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: watch_notify2_test_cb from 4850 notify_id 171798691842 cookie 93970058844304 2026-02-24T19:19:27.715 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3088 ms) 2026-02-24T19:19:27.715 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2026-02-24T19:19:27.715 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2026-02-24T19:19:27.715 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93970058844304 err -107 2026-02-24T19:19:27.715 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: watch_notify2_test_cb from 4850 notify_id 201863462915 cookie 93970058844304 2026-02-24T19:19:27.715 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (5509 ms) 2026-02-24T19:19:27.715 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2026-02-24T19:19:27.715 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2026-02-24T19:19:27.715 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93970057646800 err -107 2026-02-24T19:19:27.715 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (1619 ms) 2026-02-24T19:19:27.715 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (18110 ms total) 2026-02-24T19:19:27.715 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: 2026-02-24T19:19:27.715 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2026-02-24T19:19:27.716 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2026-02-24T19:19:27.716 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: watch_notify_test_cb 2026-02-24T19:19:27.716 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (4165 ms) 2026-02-24T19:19:27.716 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (4165 ms total) 2026-02-24T19:19:27.716 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: 2026-02-24T19:19:27.716 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [----------] Global test environment tear-down 2026-02-24T19:19:27.716 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (46158 ms total) 2026-02-24T19:19:27.717 INFO:tasks.workunit.client.0.trial162.stdout: api_watch_notify: [ PASSED ] 11 tests. 2026-02-24T19:19:29.238 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: Running main() from gmock_main.cc 2026-02-24T19:19:29.238 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: [==========] Running 6 tests from 2 test suites. 2026-02-24T19:19:29.238 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: [----------] Global test environment set-up. 2026-02-24T19:19:29.238 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify 2026-02-24T19:19:29.238 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotify 2026-02-24T19:19:29.238 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: handle_notify cookie 94678802772864 notify_id 146028888064 notifier_gid 4905 2026-02-24T19:19:29.238 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotify (7731 ms) 2026-02-24T19:19:29.238 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2026-02-24T19:19:29.238 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: Trying... 2026-02-24T19:19:29.239 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: handle_notify cookie 94678815583552 notify_id 163208757248 notifier_gid 4995 2026-02-24T19:19:29.239 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: Waiting for 3.000000000s 2026-02-24T19:19:29.239 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: Timed out. 2026-02-24T19:19:29.239 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: Flushing... 2026-02-24T19:19:29.239 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: Flushed... 2026-02-24T19:19:29.239 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (8837 ms) 2026-02-24T19:19:29.239 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify (16568 ms total) 2026-02-24T19:19:29.239 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: 2026-02-24T19:19:29.239 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: [----------] 4 tests from NeoRadosWatchNotifyPoll 2026-02-24T19:19:29.239 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WatchNotify 2026-02-24T19:19:29.239 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WatchNotify (3873 ms) 2026-02-24T19:19:29.239 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WatchNotifyTimeout 2026-02-24T19:19:29.240 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WatchNotifyTimeout (6743 ms) 2026-02-24T19:19:29.240 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WrongWatchType 2026-02-24T19:19:29.240 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WrongWatchType (10580 ms) 2026-02-24T19:19:29.240 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WatchNotifyCancel 2026-02-24T19:19:29.240 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WatchNotifyCancel (9852 ms) 2026-02-24T19:19:29.240 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: [----------] 4 tests from NeoRadosWatchNotifyPoll (31049 ms total) 2026-02-24T19:19:29.240 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: 2026-02-24T19:19:29.240 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: [----------] Global test environment tear-down 2026-02-24T19:19:29.240 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: [==========] 6 tests from 2 test suites ran. (47618 ms total) 2026-02-24T19:19:29.240 INFO:tasks.workunit.client.0.trial162.stdout: watch_notify: [ PASSED ] 6 tests. 2026-02-24T19:19:33.301 INFO:tasks.workunit.client.0.trial162.stdout: ec_list: Running main() from gmock_main.cc 2026-02-24T19:19:33.301 INFO:tasks.workunit.client.0.trial162.stdout: ec_list: [==========] Running 3 tests from 1 test suite. 2026-02-24T19:19:33.301 INFO:tasks.workunit.client.0.trial162.stdout: ec_list: [----------] Global test environment set-up. 2026-02-24T19:19:33.302 INFO:tasks.workunit.client.0.trial162.stdout: ec_list: [----------] 3 tests from NeoradosECList 2026-02-24T19:19:33.302 INFO:tasks.workunit.client.0.trial162.stdout: ec_list: [ RUN ] NeoradosECList.ListObjects 2026-02-24T19:19:33.302 INFO:tasks.workunit.client.0.trial162.stdout: ec_list: [ OK ] NeoradosECList.ListObjects (11887 ms) 2026-02-24T19:19:33.302 INFO:tasks.workunit.client.0.trial162.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsNS 2026-02-24T19:19:33.302 INFO:tasks.workunit.client.0.trial162.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsNS (8544 ms) 2026-02-24T19:19:33.302 INFO:tasks.workunit.client.0.trial162.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsMany 2026-02-24T19:19:33.302 INFO:tasks.workunit.client.0.trial162.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsMany (31264 ms) 2026-02-24T19:19:33.302 INFO:tasks.workunit.client.0.trial162.stdout: ec_list: [----------] 3 tests from NeoradosECList (51695 ms total) 2026-02-24T19:19:33.302 INFO:tasks.workunit.client.0.trial162.stdout: ec_list: 2026-02-24T19:19:33.302 INFO:tasks.workunit.client.0.trial162.stdout: ec_list: [----------] Global test environment tear-down 2026-02-24T19:19:33.302 INFO:tasks.workunit.client.0.trial162.stdout: ec_list: [==========] 3 tests from 1 test suite ran. (51695 ms total) 2026-02-24T19:19:33.302 INFO:tasks.workunit.client.0.trial162.stdout: ec_list: [ PASSED ] 3 tests. 2026-02-24T19:19:45.123 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: Running main() from gmock_main.cc 2026-02-24T19:19:45.124 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2026-02-24T19:19:45.124 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: [----------] Global test environment set-up. 2026-02-24T19:19:45.124 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2026-02-24T19:19:45.124 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2026-02-24T19:19:45.124 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2026-02-24T19:19:45.124 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2026-02-24T19:19:45.124 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: 2026-02-24T19:19:45.124 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2026-02-24T19:19:45.124 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2026-02-24T19:19:45.124 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (6981 ms) 2026-02-24T19:19:45.124 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2026-02-24T19:19:45.125 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (4978 ms) 2026-02-24T19:19:45.125 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2026-02-24T19:19:45.125 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (3680 ms) 2026-02-24T19:19:45.125 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2026-02-24T19:19:45.125 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (3055 ms) 2026-02-24T19:19:45.125 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2026-02-24T19:19:45.125 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (2754 ms) 2026-02-24T19:19:45.125 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2026-02-24T19:19:45.125 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (9072 ms) 2026-02-24T19:19:45.125 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2026-02-24T19:19:45.125 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (33025 ms) 2026-02-24T19:19:45.125 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (63548 ms total) 2026-02-24T19:19:45.125 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: 2026-02-24T19:19:45.126 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: [----------] Global test environment tear-down 2026-02-24T19:19:45.126 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (63548 ms total) 2026-02-24T19:19:45.126 INFO:tasks.workunit.client.0.trial162.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2026-02-24T19:19:47.210 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:02:45.184 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:47.236 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:02:45.211 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:47.309 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:02:45.284 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:47.324 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:02:45.260 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:47.346 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:02:45.317 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:47.348 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:02:45.319 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:47.355 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:02:45.291 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:47.459 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:02:45.395 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:47.484 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:02:45.455 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:19:50.045 INFO:tasks.workunit.client.0.trial162.stdout: write_operations: Running main() from gmock_main.cc 2026-02-24T19:19:50.045 INFO:tasks.workunit.client.0.trial162.stdout: write_operations: [==========] Running 8 tests from 1 test suite. 2026-02-24T19:19:50.045 INFO:tasks.workunit.client.0.trial162.stdout: write_operations: [----------] Global test environment set-up. 2026-02-24T19:19:50.045 INFO:tasks.workunit.client.0.trial162.stdout: write_operations: [----------] 8 tests from NeoRadosWriteOps 2026-02-24T19:19:50.045 INFO:tasks.workunit.client.0.trial162.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertExists 2026-02-24T19:19:50.045 INFO:tasks.workunit.client.0.trial162.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertExists (7730 ms) 2026-02-24T19:19:50.045 INFO:tasks.workunit.client.0.trial162.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertVersion 2026-02-24T19:19:50.045 INFO:tasks.workunit.client.0.trial162.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertVersion (4184 ms) 2026-02-24T19:19:50.046 INFO:tasks.workunit.client.0.trial162.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Xattrs 2026-02-24T19:19:50.046 INFO:tasks.workunit.client.0.trial162.stdout: write_operations: [ OK ] NeoRadosWriteOps.Xattrs (3676 ms) 2026-02-24T19:19:50.046 INFO:tasks.workunit.client.0.trial162.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Write 2026-02-24T19:19:50.046 INFO:tasks.workunit.client.0.trial162.stdout: write_operations: [ OK ] NeoRadosWriteOps.Write (3043 ms) 2026-02-24T19:19:50.046 INFO:tasks.workunit.client.0.trial162.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Exec 2026-02-24T19:19:50.046 INFO:tasks.workunit.client.0.trial162.stdout: write_operations: [ OK ] NeoRadosWriteOps.Exec (2809 ms) 2026-02-24T19:19:50.046 INFO:tasks.workunit.client.0.trial162.stdout: write_operations: [ RUN ] NeoRadosWriteOps.WriteSame 2026-02-24T19:19:50.046 INFO:tasks.workunit.client.0.trial162.stdout: write_operations: [ OK ] NeoRadosWriteOps.WriteSame (9094 ms) 2026-02-24T19:19:50.046 INFO:tasks.workunit.client.0.trial162.stdout: write_operations: [ RUN ] NeoRadosWriteOps.CmpExt 2026-02-24T19:19:50.046 INFO:tasks.workunit.client.0.trial162.stdout: write_operations: [ OK ] NeoRadosWriteOps.CmpExt (31603 ms) 2026-02-24T19:19:50.046 INFO:tasks.workunit.client.0.trial162.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Cancel 2026-02-24T19:19:50.046 INFO:tasks.workunit.client.0.trial162.stdout: write_operations: [ OK ] NeoRadosWriteOps.Cancel (6282 ms) 2026-02-24T19:19:50.046 INFO:tasks.workunit.client.0.trial162.stdout: write_operations: [----------] 8 tests from NeoRadosWriteOps (68424 ms total) 2026-02-24T19:19:50.047 INFO:tasks.workunit.client.0.trial162.stdout: write_operations: 2026-02-24T19:19:50.047 INFO:tasks.workunit.client.0.trial162.stdout: write_operations: [----------] Global test environment tear-down 2026-02-24T19:19:50.047 INFO:tasks.workunit.client.0.trial162.stdout: write_operations: [==========] 8 tests from 1 test suite ran. (68424 ms total) 2026-02-24T19:19:50.047 INFO:tasks.workunit.client.0.trial162.stdout: write_operations: [ PASSED ] 8 tests. 2026-02-24T19:19:51.717 INFO:tasks.workunit.client.0.trial162.stdout:pPP (47 ms) 2026-02-24T19:19:51.717 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2026-02-24T19:19:51.717 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (33 ms) 2026-02-24T19:19:51.718 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2026-02-24T19:19:51.718 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (124 ms) 2026-02-24T19:19:51.718 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2026-02-24T19:19:51.718 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (174 ms) 2026-02-24T19:19:51.718 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2026-02-24T19:19:51.718 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (170 ms) 2026-02-24T19:19:51.718 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2026-02-24T19:19:51.718 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (38 ms) 2026-02-24T19:19:51.718 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2026-02-24T19:19:51.718 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (194 ms) 2026-02-24T19:19:51.718 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2026-02-24T19:19:51.718 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (64 ms) 2026-02-24T19:19:51.719 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2026-02-24T19:19:51.719 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (92 ms) 2026-02-24T19:19:51.719 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2026-02-24T19:19:51.719 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (489 ms) 2026-02-24T19:19:51.719 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2026-02-24T19:19:51.719 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (197 ms) 2026-02-24T19:19:51.719 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CrcZeroWrite 2026-02-24T19:19:51.719 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CrcZeroWrite (24325 ms) 2026-02-24T19:19:51.719 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2026-02-24T19:19:51.719 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (4051 ms) 2026-02-24T19:19:51.719 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2026-02-24T19:19:51.719 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (85 ms) 2026-02-24T19:19:51.719 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2026-02-24T19:19:51.720 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (45 ms) 2026-02-24T19:19:51.720 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2026-02-24T19:19:51.720 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (68 ms) 2026-02-24T19:19:51.720 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [----------] 18 tests from LibRadosIoECPP (34519 ms total) 2026-02-24T19:19:51.720 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: 2026-02-24T19:19:51.720 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [----------] Global test environment tear-down 2026-02-24T19:19:51.720 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [==========] 40 tests from 2 test suites ran. (70191 ms total) 2026-02-24T19:19:51.720 INFO:tasks.workunit.client.0.trial162.stdout: api_io_pp: [ PASSED ] 40 tests. 2026-02-24T19:19:57.021 INFO:tasks.workunit.client.0.trial162.stdout: misc: Running main() from gmock_main.cc 2026-02-24T19:19:57.021 INFO:tasks.workunit.client.0.trial162.stdout: misc: [==========] Running 12 tests from 1 test suite. 2026-02-24T19:19:57.022 INFO:tasks.workunit.client.0.trial162.stdout: misc: [----------] Global test environment set-up. 2026-02-24T19:19:57.022 INFO:tasks.workunit.client.0.trial162.stdout: misc: [----------] 12 tests from NeoRadosMisc 2026-02-24T19:19:57.022 INFO:tasks.workunit.client.0.trial162.stdout: misc: [ RUN ] NeoRadosMisc.Version 2026-02-24T19:19:57.022 INFO:tasks.workunit.client.0.trial162.stdout: misc: [ OK ] NeoRadosMisc.Version (2934 ms) 2026-02-24T19:19:57.022 INFO:tasks.workunit.client.0.trial162.stdout: misc: [ RUN ] NeoRadosMisc.WaitOSDMap 2026-02-24T19:19:57.022 INFO:tasks.workunit.client.0.trial162.stdout: misc: [ OK ] NeoRadosMisc.WaitOSDMap (4252 ms) 2026-02-24T19:19:57.022 INFO:tasks.workunit.client.0.trial162.stdout: misc: [ RUN ] NeoRadosMisc.LongName 2026-02-24T19:19:57.022 INFO:tasks.workunit.client.0.trial162.stdout: misc: [ OK ] NeoRadosMisc.LongName (4739 ms) 2026-02-24T19:19:57.022 INFO:tasks.workunit.client.0.trial162.stdout: misc: [ RUN ] NeoRadosMisc.LongLocator 2026-02-24T19:19:57.022 INFO:tasks.workunit.client.0.trial162.stdout: misc: [ OK ] NeoRadosMisc.LongLocator (3602 ms) 2026-02-24T19:19:57.022 INFO:tasks.workunit.client.0.trial162.stdout: misc: [ RUN ] NeoRadosMisc.LongNamespace 2026-02-24T19:19:57.022 INFO:tasks.workunit.client.0.trial162.stdout: misc: [ OK ] NeoRadosMisc.LongNamespace (3117 ms) 2026-02-24T19:19:57.022 INFO:tasks.workunit.client.0.trial162.stdout: misc: [ RUN ] NeoRadosMisc.LongAttrName 2026-02-24T19:19:57.023 INFO:tasks.workunit.client.0.trial162.stdout: misc: [ OK ] NeoRadosMisc.LongAttrName (2770 ms) 2026-02-24T19:19:57.023 INFO:tasks.workunit.client.0.trial162.stdout: misc: [ RUN ] NeoRadosMisc.Exec 2026-02-24T19:19:57.023 INFO:tasks.workunit.client.0.trial162.stdout: misc: [ OK ] NeoRadosMisc.Exec (9068 ms) 2026-02-24T19:19:57.023 INFO:tasks.workunit.client.0.trial162.stdout: misc: [ RUN ] NeoRadosMisc.Operate1 2026-02-24T19:19:57.023 INFO:tasks.workunit.client.0.trial162.stdout: misc: [ OK ] NeoRadosMisc.Operate1 (9989 ms) 2026-02-24T19:19:57.023 INFO:tasks.workunit.client.0.trial162.stdout: misc: [ RUN ] NeoRadosMisc.Operate2 2026-02-24T19:19:57.023 INFO:tasks.workunit.client.0.trial162.stdout: misc: [ OK ] NeoRadosMisc.Operate2 (11647 ms) 2026-02-24T19:19:57.023 INFO:tasks.workunit.client.0.trial162.stdout: misc: [ RUN ] NeoRadosMisc.BigObject 2026-02-24T19:19:57.023 INFO:tasks.workunit.client.0.trial162.stdout: misc: [ OK ] NeoRadosMisc.BigObject (10047 ms) 2026-02-24T19:19:57.023 INFO:tasks.workunit.client.0.trial162.stdout: misc: [ RUN ] NeoRadosMisc.BigAttr 2026-02-24T19:19:57.023 INFO:tasks.workunit.client.0.trial162.stdout: misc: [ OK ] NeoRadosMisc.BigAttr (6268 ms) 2026-02-24T19:19:57.023 INFO:tasks.workunit.client.0.trial162.stdout: misc: [ RUN ] NeoRadosMisc.WriteSame 2026-02-24T19:19:57.023 INFO:tasks.workunit.client.0.trial162.stdout: misc: [ OK ] NeoRadosMisc.WriteSame (6973 ms) 2026-02-24T19:19:57.024 INFO:tasks.workunit.client.0.trial162.stdout: misc: [----------] 12 tests from NeoRadosMisc (75411 ms total) 2026-02-24T19:19:57.024 INFO:tasks.workunit.client.0.trial162.stdout: misc: 2026-02-24T19:19:57.024 INFO:tasks.workunit.client.0.trial162.stdout: misc: [----------] Global test environment tear-down 2026-02-24T19:19:57.024 INFO:tasks.workunit.client.0.trial162.stdout: misc: [==========] 12 tests from 1 test suite ran. (75411 ms total) 2026-02-24T19:19:57.024 INFO:tasks.workunit.client.0.trial162.stdout: misc: [ PASSED ] 12 tests. 2026-02-24T19:20:00.035 INFO:tasks.workunit.client.0.trial162.stdout: api_pool: Running main() from gmock_main.cc 2026-02-24T19:20:00.035 INFO:tasks.workunit.client.0.trial162.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2026-02-24T19:20:00.035 INFO:tasks.workunit.client.0.trial162.stdout: api_pool: [----------] Global test environment set-up. 2026-02-24T19:20:00.035 INFO:tasks.workunit.client.0.trial162.stdout: api_pool: [----------] 9 tests from LibRadosPools 2026-02-24T19:20:00.035 INFO:tasks.workunit.client.0.trial162.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2026-02-24T19:20:00.035 INFO:tasks.workunit.client.0.trial162.stdout: api_pool: [ OK ] LibRadosPools.PoolList (4092 ms) 2026-02-24T19:20:00.035 INFO:tasks.workunit.client.0.trial162.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2026-02-24T19:20:00.035 INFO:tasks.workunit.client.0.trial162.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (4716 ms) 2026-02-24T19:20:00.035 INFO:tasks.workunit.client.0.trial162.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2026-02-24T19:20:00.036 INFO:tasks.workunit.client.0.trial162.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (3185 ms) 2026-02-24T19:20:00.036 INFO:tasks.workunit.client.0.trial162.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2026-02-24T19:20:00.036 INFO:tasks.workunit.client.0.trial162.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (3626 ms) 2026-02-24T19:20:00.036 INFO:tasks.workunit.client.0.trial162.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2026-02-24T19:20:00.036 INFO:tasks.workunit.client.0.trial162.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3091 ms) 2026-02-24T19:20:00.036 INFO:tasks.workunit.client.0.trial162.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2026-02-24T19:20:00.036 INFO:tasks.workunit.client.0.trial162.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (8633 ms) 2026-02-24T19:20:00.036 INFO:tasks.workunit.client.0.trial162.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2026-02-24T19:20:00.036 INFO:tasks.workunit.client.0.trial162.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (13238 ms) 2026-02-24T19:20:00.036 INFO:tasks.workunit.client.0.trial162.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2026-02-24T19:20:00.036 INFO:tasks.workunit.client.0.trial162.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (16180 ms) 2026-02-24T19:20:00.036 INFO:tasks.workunit.client.0.trial162.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2026-02-24T19:20:00.037 INFO:tasks.workunit.client.0.trial162.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (21726 ms) 2026-02-24T19:20:00.037 INFO:tasks.workunit.client.0.trial162.stdout: api_pool: [----------] 9 tests from LibRadosPools (78491 ms total) 2026-02-24T19:20:00.037 INFO:tasks.workunit.client.0.trial162.stdout: api_pool: 2026-02-24T19:20:00.037 INFO:tasks.workunit.client.0.trial162.stdout: api_pool: [----------] Global test environment tear-down 2026-02-24T19:20:00.037 INFO:tasks.workunit.client.0.trial162.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (78491 ms total) 2026-02-24T19:20:00.037 INFO:tasks.workunit.client.0.trial162.stdout: api_pool: [ PASSED ] 9 tests. 2026-02-24T19:20:02.817 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2026-02-24T19:20:02.818 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [----------] Global test environment set-up. 2026-02-24T19:20:02.818 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2026-02-24T19:20:02.818 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2026-02-24T19:20:02.818 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2026-02-24T19:20:02.818 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2026-02-24T19:20:02.818 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: 2026-02-24T19:20:02.818 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2026-02-24T19:20:02.818 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2026-02-24T19:20:02.819 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2026-02-24T19:20:02.819 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: 2026-02-24T19:18:41.753+0000 7fdbe0aed880 -1 failed for service _ceph-mon._tcp 2026-02-24T19:20:02.819 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: 2026-02-24T19:18:41.753+0000 7fdbe0aed880 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2026-02-24T19:20:02.819 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (213 ms) 2026-02-24T19:20:02.819 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2026-02-24T19:20:02.819 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (5003 ms) 2026-02-24T19:20:02.819 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (5217 ms total) 2026-02-24T19:20:02.819 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: 2026-02-24T19:20:02.819 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2026-02-24T19:20:02.819 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2026-02-24T19:20:02.819 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: started 0x5646fc9e5fb0 2026-02-24T19:20:02.819 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: started 0x5646fcbc7ee0 2026-02-24T19:20:02.820 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: started 2 aios 2026-02-24T19:20:02.820 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: waiting 0x5646fc9e5fb0 2026-02-24T19:20:02.820 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: waiting 0x5646fcbc7ee0 2026-02-24T19:20:02.820 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: done. 2026-02-24T19:20:02.820 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (7857 ms) 2026-02-24T19:20:02.820 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (7857 ms total) 2026-02-24T19:20:02.820 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: 2026-02-24T19:20:02.820 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2026-02-24T19:20:02.820 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2026-02-24T19:20:02.820 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2026-02-24T19:20:02.820 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2026-02-24T19:20:02.820 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [ OK ] LibRadosMisc.Exec (859 ms) 2026-02-24T19:20:02.820 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2026-02-24T19:20:02.821 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (59 ms) 2026-02-24T19:20:02.821 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2026-02-24T19:20:02.821 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (32 ms) 2026-02-24T19:20:02.821 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2026-02-24T19:20:02.821 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [ OK ] LibRadosMisc.Applications (4958 ms) 2026-02-24T19:20:02.821 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2026-02-24T19:20:02.821 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2026-02-24T19:20:02.821 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2026-02-24T19:20:02.821 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2026-02-24T19:20:02.821 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2026-02-24T19:20:02.821 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (58625 ms) 2026-02-24T19:20:02.821 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [----------] 8 tests from LibRadosMisc (64536 ms total) 2026-02-24T19:20:02.821 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: 2026-02-24T19:20:02.822 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [----------] Global test environment tear-down 2026-02-24T19:20:02.822 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (81261 ms total) 2026-02-24T19:20:02.822 INFO:tasks.workunit.client.0.trial162.stdout: api_misc: [ PASSED ] 12 tests. 2026-02-24T19:20:06.361 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:03:04.331 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:06.361 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:03:04.335 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:06.363 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:03:04.334 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:06.365 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:03:04.339 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:06.397 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:03:04.333 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:06.398 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:03:04.368 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:06.401 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:03:04.376 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:06.404 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:03:04.340 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:06.438 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:03:04.375 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: Running main() from gmock_main.cc 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [==========] Running 14 tests from 1 test suite. 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [----------] Global test environment set-up. 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [----------] 14 tests from NeoRadosIo 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ RUN ] NeoRadosIo.Limits 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ OK ] NeoRadosIo.Limits (7719 ms) 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ RUN ] NeoRadosIo.SimpleWrite 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ OK ] NeoRadosIo.SimpleWrite (4199 ms) 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ RUN ] NeoRadosIo.ReadOp 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ OK ] NeoRadosIo.ReadOp (3687 ms) 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ RUN ] NeoRadosIo.SparseRead 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ OK ] NeoRadosIo.SparseRead (3056 ms) 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ RUN ] NeoRadosIo.RoundTrip 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ OK ] NeoRadosIo.RoundTrip (2810 ms) 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ RUN ] NeoRadosIo.ReadIntoBuufferlist 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ OK ] NeoRadosIo.ReadIntoBuufferlist (7487 ms) 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ OK ] NeoRadosIo.OverlappingWriteRoundTrip (11550 ms) 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ RUN ] NeoRadosIo.WriteFullRoundTrip 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ OK ] NeoRadosIo.WriteFullRoundTrip (9943 ms) 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ RUN ] NeoRadosIo.AppendRoundTrip 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ OK ] NeoRadosIo.AppendRoundTrip (11690 ms) 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ RUN ] NeoRadosIo.Trunc 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ OK ] NeoRadosIo.Trunc (10384 ms) 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ RUN ] NeoRadosIo.Remove 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ OK ] NeoRadosIo.Remove (7657 ms) 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ RUN ] NeoRadosIo.XattrsRoundTrip 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ OK ] NeoRadosIo.XattrsRoundTrip (3178 ms) 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ RUN ] NeoRadosIo.RmXattr 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ OK ] NeoRadosIo.RmXattr (2350 ms) 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ RUN ] NeoRadosIo.GetXattrs 2026-02-24T19:20:10.507 INFO:tasks.workunit.client.0.trial162.stdout: io: [ OK ] NeoRadosIo.GetXattrs (3188 ms) 2026-02-24T19:20:10.508 INFO:tasks.workunit.client.0.trial162.stdout: io: [----------] 14 tests from NeoRadosIo (88906 ms total) 2026-02-24T19:20:10.508 INFO:tasks.workunit.client.0.trial162.stdout: io: 2026-02-24T19:20:10.508 INFO:tasks.workunit.client.0.trial162.stdout: io: [----------] Global test environment tear-down 2026-02-24T19:20:10.508 INFO:tasks.workunit.client.0.trial162.stdout: io: [==========] 14 tests from 1 test suite ran. (88906 ms total) 2026-02-24T19:20:10.508 INFO:tasks.workunit.client.0.trial162.stdout: io: [ PASSED ] 14 tests. 2026-02-24T19:20:14.384 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: Running main() from gmock_main.cc 2026-02-24T19:20:14.384 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [==========] Running 15 tests from 1 test suite. 2026-02-24T19:20:14.384 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [----------] Global test environment set-up. 2026-02-24T19:20:14.384 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [----------] 15 tests from NeoRadosReadOps 2026-02-24T19:20:14.384 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ RUN ] NeoRadosReadOps.SetOpFlags 2026-02-24T19:20:14.384 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ OK ] NeoRadosReadOps.SetOpFlags (7739 ms) 2026-02-24T19:20:14.385 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertExists 2026-02-24T19:20:14.385 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertExists (4185 ms) 2026-02-24T19:20:14.385 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertVersion 2026-02-24T19:20:14.385 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertVersion (3620 ms) 2026-02-24T19:20:14.385 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpXattr 2026-02-24T19:20:14.385 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpXattr (3885 ms) 2026-02-24T19:20:14.385 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ RUN ] NeoRadosReadOps.Read 2026-02-24T19:20:14.385 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ OK ] NeoRadosReadOps.Read (5804 ms) 2026-02-24T19:20:14.385 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ RUN ] NeoRadosReadOps.Checksum 2026-02-24T19:20:14.385 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ OK ] NeoRadosReadOps.Checksum (10626 ms) 2026-02-24T19:20:14.385 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ RUN ] NeoRadosReadOps.RWOrderedRead 2026-02-24T19:20:14.385 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ OK ] NeoRadosReadOps.RWOrderedRead (10116 ms) 2026-02-24T19:20:14.385 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ RUN ] NeoRadosReadOps.ShortRead 2026-02-24T19:20:14.386 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ OK ] NeoRadosReadOps.ShortRead (9124 ms) 2026-02-24T19:20:14.386 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ RUN ] NeoRadosReadOps.Exec 2026-02-24T19:20:14.386 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ OK ] NeoRadosReadOps.Exec (7051 ms) 2026-02-24T19:20:14.386 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ RUN ] NeoRadosReadOps.Stat 2026-02-24T19:20:14.386 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ OK ] NeoRadosReadOps.Stat (11796 ms) 2026-02-24T19:20:14.386 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ RUN ] NeoRadosReadOps.Omap 2026-02-24T19:20:14.386 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ OK ] NeoRadosReadOps.Omap (7239 ms) 2026-02-24T19:20:14.386 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ RUN ] NeoRadosReadOps.OmapNuls 2026-02-24T19:20:14.386 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ OK ] NeoRadosReadOps.OmapNuls (3183 ms) 2026-02-24T19:20:14.386 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ RUN ] NeoRadosReadOps.GetXattrs 2026-02-24T19:20:14.386 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ OK ] NeoRadosReadOps.GetXattrs (2381 ms) 2026-02-24T19:20:14.386 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpExt 2026-02-24T19:20:14.386 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpExt (2955 ms) 2026-02-24T19:20:14.387 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ RUN ] NeoRadosReadOps.Cancel 2026-02-24T19:20:14.387 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ OK ] NeoRadosReadOps.Cancel (3058 ms) 2026-02-24T19:20:14.387 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [----------] 15 tests from NeoRadosReadOps (92769 ms total) 2026-02-24T19:20:14.387 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: 2026-02-24T19:20:14.387 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [----------] Global test environment tear-down 2026-02-24T19:20:14.387 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [==========] 15 tests from 1 test suite ran. (92769 ms total) 2026-02-24T19:20:14.387 INFO:tasks.workunit.client.0.trial162.stdout: read_operations: [ PASSED ] 15 tests. 2026-02-24T19:20:20.577 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: Running main() from gmock_main.cc 2026-02-24T19:20:20.577 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [==========] Running 21 tests from 5 test suites. 2026-02-24T19:20:20.577 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2026-02-24T19:20:20.578 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2026-02-24T19:20:20.578 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: seed 49149 2026-02-24T19:20:20.578 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2026-02-24T19:20:20.578 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (5795 ms) 2026-02-24T19:20:20.578 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2026-02-24T19:20:20.578 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (2182 ms) 2026-02-24T19:20:20.578 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2026-02-24T19:20:20.578 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (2081 ms) 2026-02-24T19:20:20.578 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2026-02-24T19:20:20.578 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (2606 ms) 2026-02-24T19:20:20.578 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2026-02-24T19:20:20.578 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (3782 ms) 2026-02-24T19:20:20.578 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (16448 ms total) 2026-02-24T19:20:20.579 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: 2026-02-24T19:20:20.579 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2026-02-24T19:20:20.579 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2026-02-24T19:20:20.579 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (7203 ms) 2026-02-24T19:20:20.579 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2026-02-24T19:20:20.579 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (7949 ms) 2026-02-24T19:20:20.579 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2026-02-24T19:20:20.579 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (13295 ms) 2026-02-24T19:20:20.579 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2026-02-24T19:20:20.579 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (7065 ms) 2026-02-24T19:20:20.579 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2026-02-24T19:20:20.579 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (3433 ms) 2026-02-24T19:20:20.580 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2026-02-24T19:20:20.580 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: /ceph/rpmbuild/BUILD/ceph-20.2.0-681-g36d388f2/src/test/librados/snapshots_cxx.cc:460: Skipped 2026-02-24T19:20:20.580 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: 2026-02-24T19:20:20.580 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: 2026-02-24T19:20:20.580 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2026-02-24T19:20:20.580 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2026-02-24T19:20:20.580 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_trial162-49149-7 2026-02-24T19:20:20.580 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: waiting for snaps to purge 2026-02-24T19:20:20.580 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (21083 ms) 2026-02-24T19:20:20.580 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (60031 ms total) 2026-02-24T19:20:20.580 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: 2026-02-24T19:20:20.580 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2026-02-24T19:20:20.580 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2026-02-24T19:20:20.581 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (3 ms) 2026-02-24T19:20:20.581 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2026-02-24T19:20:20.581 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (4578 ms) 2026-02-24T19:20:20.581 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (4581 ms total) 2026-02-24T19:20:20.581 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: 2026-02-24T19:20:20.581 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2026-02-24T19:20:20.581 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2026-02-24T19:20:20.581 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (3032 ms) 2026-02-24T19:20:20.581 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2026-02-24T19:20:20.581 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapRemovePP (2121 ms) 2026-02-24T19:20:20.581 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2026-02-24T19:20:23.382 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ api_snapshots: Running main() from gmock_main.cc 2026-02-24T19:20:23.383 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2026-02-24T19:20:23.383 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [----------] Global test environment set-up. 2026-02-24T19:20:23.383 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2026-02-24T19:20:23.383 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2026-02-24T19:20:23.383 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (4809 ms) 2026-02-24T19:20:23.383 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2026-02-24T19:20:23.383 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (1958 ms) 2026-02-24T19:20:23.383 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2026-02-24T19:20:23.383 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (3210 ms) 2026-02-24T19:20:23.384 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2026-02-24T19:20:23.384 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (2542 ms) 2026-02-24T19:20:23.384 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (12520 ms total) 2026-02-24T19:20:23.384 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: 2026-02-24T19:20:23.384 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2026-02-24T19:20:23.384 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2026-02-24T19:20:23.384 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (4919 ms) 2026-02-24T19:20:23.384 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2026-02-24T19:20:23.384 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (14181 ms) 2026-02-24T19:20:23.384 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2026-02-24T19:20:23.384 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (15975 ms) 2026-02-24T19:20:23.384 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (35076 ms total) 2026-02-24T19:20:23.384 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: 2026-02-24T19:20:23.385 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2026-02-24T19:20:23.385 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2026-02-24T19:20:23.385 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (8852 ms) 2026-02-24T19:20:23.385 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2026-02-24T19:20:23.385 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (4482 ms) 2026-02-24T19:20:23.385 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2026-02-24T19:20:23.385 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (2165 ms) 2026-02-24T19:20:23.385 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2026-02-24T19:20:23.385 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (1357 ms) 2026-02-24T19:20:23.385 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (16857 ms total) 2026-02-24T19:20:23.385 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: 2026-02-24T19:20:23.385 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2026-02-24T19:20:23.386 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2026-02-24T19:20:23.386 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (4240 ms) 2026-02-24T19:20:23.386 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2026-02-24T19:20:23.386 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (4125 ms) 2026-02-24T19:20:23.386 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (8366 ms total) 2026-02-24T19:20:23.386 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: 2026-02-24T19:20:23.386 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [----------] Global test environment tear-down 2026-02-24T19:20:23.386 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (101837 ms total) 2026-02-24T19:20:23.386 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots: [ PASSED ] 13 tests. 2026-02-24T19:20:23.388 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:20:23.388 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49386 2026-02-24T19:20:23.388 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 49386 2026-02-24T19:20:23.388 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:20:23.388 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49153 2026-02-24T19:20:23.388 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 49153 2026-02-24T19:20:23.388 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:20:23.388 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49040 2026-02-24T19:20:23.388 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 49040 2026-02-24T19:20:23.388 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:20:23.388 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=48896 2026-02-24T19:20:23.389 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 48896 2026-02-24T19:20:23.389 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:20:23.389 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49097 2026-02-24T19:20:23.389 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 49097 2026-02-24T19:20:23.389 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:20:23.389 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49501 2026-02-24T19:20:23.389 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 49501 2026-02-24T19:20:23.389 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:20:23.389 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49526 2026-02-24T19:20:23.389 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 49526 2026-02-24T19:20:23.389 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:20:23.389 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=48916 2026-02-24T19:20:23.390 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 48916 2026-02-24T19:20:26.326 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:03:24.301 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:26.327 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:03:24.298 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:26.330 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:03:24.304 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:26.330 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:03:24.301 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:26.356 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:03:24.292 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:26.358 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:03:24.294 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:26.359 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:03:24.334 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:26.359 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:03:24.330 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:26.387 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:03:24.324 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:39.832 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: Running main() from gmock_main.cc 2026-02-24T19:20:39.832 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [==========] Running 11 tests from 2 test suites. 2026-02-24T19:20:39.832 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [----------] Global test environment set-up. 2026-02-24T19:20:39.832 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots 2026-02-24T19:20:39.832 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapList 2026-02-24T19:20:39.832 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapList (9780 ms) 2026-02-24T19:20:39.832 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapRemove 2026-02-24T19:20:39.832 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapRemove (5821 ms) 2026-02-24T19:20:39.832 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [ RUN ] NeoRadosSnapshots.Rollback 2026-02-24T19:20:39.832 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [ OK ] NeoRadosSnapshots.Rollback (4844 ms) 2026-02-24T19:20:39.832 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapGetName 2026-02-24T19:20:39.832 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapGetName (10031 ms) 2026-02-24T19:20:39.832 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapCreateRemove 2026-02-24T19:20:39.832 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapCreateRemove (17052 ms) 2026-02-24T19:20:39.832 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots (47531 ms total) 2026-02-24T19:20:39.832 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: 2026-02-24T19:20:39.832 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps 2026-02-24T19:20:39.832 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Snap 2026-02-24T19:20:39.832 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Snap (11717 ms) 2026-02-24T19:20:39.832 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Rollback 2026-02-24T19:20:39.832 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Rollback (17437 ms) 2026-02-24T19:20:39.832 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2026-02-24T19:20:39.832 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (12200 ms) 2026-02-24T19:20:39.832 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2026-02-24T19:20:39.832 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Bug11677 (5888 ms) 2026-02-24T19:20:39.832 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2026-02-24T19:20:39.832 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4194 ms) 2026-02-24T19:20:39.833 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2026-02-24T19:20:39.833 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: Deleting snap 3 in pool ReusePurgedSnaptrial162-49871-11. 2026-02-24T19:20:39.833 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: Waiting for snaps to purge. 2026-02-24T19:20:39.833 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (19245 ms) 2026-02-24T19:20:39.833 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps (70683 ms total) 2026-02-24T19:20:39.833 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: 2026-02-24T19:20:39.833 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [----------] Global test environment tear-down 2026-02-24T19:20:39.833 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [==========] 11 tests from 2 test suites ran. (118215 ms total) 2026-02-24T19:20:39.833 INFO:tasks.workunit.client.0.trial162.stdout: snapshots: [ PASSED ] 11 tests. 2026-02-24T19:20:42.611 INFO:tasks.workunit.client.0.trial162.stdout:: cursor()=8:52ea6a34:::10:head expected=8:52ea6a34:::10:head 2026-02-24T19:20:42.611 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:52ea6a34:::10:head -> 10 2026-02-24T19:20:42.611 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : entry=10 expected=10 2026-02-24T19:20:42.611 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:5c6b0b28:::7:head 2026-02-24T19:20:42.611 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : cursor()=8:5c6b0b28:::7:head expected=8:5c6b0b28:::7:head 2026-02-24T19:20:42.611 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:5c6b0b28:::7:head -> 7 2026-02-24T19:20:42.611 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : entry=7 expected=7 2026-02-24T19:20:42.611 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:de5d7c5f:::12:head 2026-02-24T19:20:42.611 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : cursor()=8:de5d7c5f:::12:head expected=8:de5d7c5f:::12:head 2026-02-24T19:20:42.611 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:de5d7c5f:::12:head -> 12 2026-02-24T19:20:42.611 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : entry=12 expected=12 2026-02-24T19:20:42.612 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:566253c9:::13:head 2026-02-24T19:20:42.612 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : cursor()=8:566253c9:::13:head expected=8:566253c9:::13:head 2026-02-24T19:20:42.612 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:566253c9:::13:head -> 13 2026-02-24T19:20:42.612 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : entry=13 expected=13 2026-02-24T19:20:42.612 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:863748b0:::15:head 2026-02-24T19:20:42.612 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : cursor()=8:863748b0:::15:head expected=8:863748b0:::15:head 2026-02-24T19:20:42.612 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:863748b0:::15:head -> 15 2026-02-24T19:20:42.612 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : entry=15 expected=15 2026-02-24T19:20:42.612 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:62a1935d:::14:head 2026-02-24T19:20:42.612 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : cursor()=8:62a1935d:::14:head expected=8:62a1935d:::14:head 2026-02-24T19:20:42.612 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:62a1935d:::14:head -> 14 2026-02-24T19:20:42.612 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : entry=14 expected=14 2026-02-24T19:20:42.612 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:02547ec2:::1:head 2026-02-24T19:20:42.612 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : cursor()=8:02547ec2:::1:head expected=8:02547ec2:::1:head 2026-02-24T19:20:42.612 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:02547ec2:::1:head -> 1 2026-02-24T19:20:42.612 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : entry=1 expected=1 2026-02-24T19:20:42.612 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : seek to 8:6cac518f:::0:head 2026-02-24T19:20:42.612 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : cursor()=8:6cac518f:::0:head expected=8:6cac518f:::0:head 2026-02-24T19:20:42.612 INFO:tasks.workunit.client.0.trial162.stdout: api_list: > 8:6cac518f:::0:head -> 0 2026-02-24T19:20:42.612 INFO:tasks.workunit.client.0.trial162.stdout: api_list: : entry=0 expected=0 2026-02-24T19:20:42.612 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (8311 ms) 2026-02-24T19:20:42.612 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2026-02-24T19:20:42.612 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (73786 ms) 2026-02-24T19:20:42.612 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2026-02-24T19:20:42.613 INFO:tasks.workunit.client.0.trial162.stdout: api_list: split 0/5 -> MIN 8:33333333::::head 2026-02-24T19:20:42.613 INFO:tasks.workunit.client.0.trial162.stdout: api_list: split 1/5 -> 8:33333333::::head 8:66666666::::head 2026-02-24T19:20:42.613 INFO:tasks.workunit.client.0.trial162.stdout: api_list: split 2/5 -> 8:66666666::::head 8:99999999::::head 2026-02-24T19:20:42.613 INFO:tasks.workunit.client.0.trial162.stdout: api_list: split 3/5 -> 8:99999999::::head 8:cccccccc::::head 2026-02-24T19:20:42.613 INFO:tasks.workunit.client.0.trial162.stdout: api_list: split 4/5 -> 8:cccccccc::::head MAX 2026-02-24T19:20:42.613 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (17946 ms) 2026-02-24T19:20:42.613 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [----------] 7 tests from LibRadosList (112661 ms total) 2026-02-24T19:20:42.613 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 2026-02-24T19:20:42.613 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [----------] 3 tests from LibRadosListEC 2026-02-24T19:20:42.613 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2026-02-24T19:20:42.613 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (835 ms) 2026-02-24T19:20:42.613 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2026-02-24T19:20:42.613 INFO:tasks.workunit.client.0.trial162.stdout: api_list: myset foo1,foo2,foo3 2026-02-24T19:20:42.613 INFO:tasks.workunit.client.0.trial162.stdout: api_list: foo1 2026-02-24T19:20:42.613 INFO:tasks.workunit.client.0.trial162.stdout: api_list: foo2 2026-02-24T19:20:42.613 INFO:tasks.workunit.client.0.trial162.stdout: api_list: foo3 2026-02-24T19:20:42.613 INFO:tasks.workunit.client.0.trial162.stdout: api_list: myset foo1,foo4,foo5 2026-02-24T19:20:42.613 INFO:tasks.workunit.client.0.trial162.stdout: api_list: foo4 2026-02-24T19:20:42.613 INFO:tasks.workunit.client.0.trial162.stdout: api_list: foo5 2026-02-24T19:20:42.613 INFO:tasks.workunit.client.0.trial162.stdout: api_list: foo1 2026-02-24T19:20:42.613 INFO:tasks.workunit.client.0.trial162.stdout: api_list: myset foo6,foo7 2026-02-24T19:20:42.613 INFO:tasks.workunit.client.0.trial162.stdout: api_list: foo7 2026-02-24T19:20:42.613 INFO:tasks.workunit.client.0.trial162.stdout: api_list: foo6 2026-02-24T19:20:42.613 INFO:tasks.workunit.client.0.trial162.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2026-02-24T19:20:42.614 INFO:tasks.workunit.client.0.trial162.stdout: api_list: ns1:foo4 2026-02-24T19:20:42.614 INFO:tasks.workunit.client.0.trial162.stdout: api_list: ns1:foo5 2026-02-24T19:20:42.614 INFO:tasks.workunit.client.0.trial162.stdout: api_list: ns2:foo7 2026-02-24T19:20:42.614 INFO:tasks.workunit.client.0.trial162.stdout: api_list: ns2:foo6 2026-02-24T19:20:42.614 INFO:tasks.workunit.client.0.trial162.stdout: api_list: ns1:foo1 2026-02-24T19:20:42.614 INFO:tasks.workunit.client.0.trial162.stdout: api_list: :foo1 2026-02-24T19:20:42.614 INFO:tasks.workunit.client.0.trial162.stdout: api_list: :foo2 2026-02-24T19:20:42.614 INFO:tasks.workunit.client.0.trial162.stdout: api_list: :foo3 2026-02-24T19:20:42.614 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (434 ms) 2026-02-24T19:20:42.614 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2026-02-24T19:20:42.614 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 1 0 2026-02-24T19:20:42.614 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 10 0 2026-02-24T19:20:42.614 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 13 0 2026-02-24T19:20:43.483 INFO:tasks.workunit.client.0.trial162.stdout: a OK ] LibRadosSnapshotsECPP.RollbackPP (2066 ms) 2026-02-24T19:20:43.483 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2026-02-24T19:20:43.483 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (1779 ms) 2026-02-24T19:20:43.483 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (8999 ms total) 2026-02-24T19:20:43.483 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: 2026-02-24T19:20:43.483 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2026-02-24T19:20:43.483 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2026-02-24T19:20:43.483 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (3890 ms) 2026-02-24T19:20:43.483 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2026-02-24T19:20:43.483 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (4104 ms) 2026-02-24T19:20:43.484 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2026-02-24T19:20:43.484 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (4198 ms) 2026-02-24T19:20:43.484 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (12193 ms total) 2026-02-24T19:20:43.484 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: 2026-02-24T19:20:43.484 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2026-02-24T19:20:43.484 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [==========] 21 tests from 5 test suites ran. (121932 ms total) 2026-02-24T19:20:43.484 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ PASSED ] 20 tests. 2026-02-24T19:20:43.484 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ SKIPPED ] 1 test, listed below: 2026-02-24T19:20:43.484 INFO:tasks.workunit.client.0.trial162.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2026-02-24T19:20:46.372 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:03:44.347 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:46.374 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:03:44.349 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:46.400 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:03:44.371 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:46.401 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:03:44.372 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:46.401 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:03:44.337 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:46.403 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:03:44.377 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:46.403 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:03:44.339 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:46.429 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:03:44.400 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:46.430 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:03:44.366 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:20:48.741 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2026-02-24T19:20:48.742 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [----------] Global test environment set-up. 2026-02-24T19:20:48.742 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2026-02-24T19:20:48.742 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2026-02-24T19:20:48.742 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2026-02-24T19:20:48.742 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2026-02-24T19:20:48.742 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: 2026-02-24T19:20:48.742 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2026-02-24T19:20:48.742 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: seed 49039 2026-02-24T19:20:48.742 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2026-02-24T19:20:48.742 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (3 ms) 2026-02-24T19:20:48.743 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2026-02-24T19:20:48.743 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (3017 ms) 2026-02-24T19:20:48.743 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2026-02-24T19:20:48.743 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (129 ms) 2026-02-24T19:20:48.743 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2026-02-24T19:20:48.743 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (139 ms) 2026-02-24T19:20:48.743 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2026-02-24T19:20:48.743 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (293 ms) 2026-02-24T19:20:48.743 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2026-02-24T19:20:48.743 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (19 ms) 2026-02-24T19:20:48.743 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2026-02-24T19:20:48.743 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (91 ms) 2026-02-24T19:20:48.743 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2026-02-24T19:20:48.743 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (411 ms) 2026-02-24T19:20:48.744 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2026-02-24T19:20:48.744 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (29 ms) 2026-02-24T19:20:48.744 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2026-02-24T19:20:48.744 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (318 ms) 2026-02-24T19:20:48.744 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2026-02-24T19:20:48.744 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (37 ms) 2026-02-24T19:20:48.744 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2026-02-24T19:20:48.744 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (94 ms) 2026-02-24T19:20:48.744 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2026-02-24T19:20:48.744 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (107 ms) 2026-02-24T19:20:48.744 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2026-02-24T19:20:48.744 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: osd_max_attr_size = 0 2026-02-24T19:20:48.745 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2026-02-24T19:20:48.745 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (39174 ms) 2026-02-24T19:20:48.745 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2026-02-24T19:20:48.745 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (3380 ms) 2026-02-24T19:20:48.745 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2026-02-24T19:20:48.745 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: waiting for initial deep scrubs... 2026-02-24T19:20:48.745 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: done waiting, doing copies 2026-02-24T19:20:48.745 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: waiting for final deep scrubs... 2026-02-24T19:20:48.745 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: done waiting 2026-02-24T19:20:48.745 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (71409 ms) 2026-02-24T19:20:48.745 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2026-02-24T19:20:48.745 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (52 ms) 2026-02-24T19:20:48.746 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2026-02-24T19:20:48.746 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (21 ms) 2026-02-24T19:20:48.746 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2026-02-24T19:20:48.746 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4461 ms) 2026-02-24T19:20:48.746 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2026-02-24T19:20:48.746 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2026-02-24T19:20:48.746 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2026-02-24T19:20:48.746 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2026-02-24T19:20:48.746 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2026-02-24T19:20:48.746 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2026-02-24T19:20:48.750 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [----------] 22 tests fpi_list: 7 0 2026-02-24T19:20:48.750 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 14 0 2026-02-24T19:20:48.750 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 0 0 2026-02-24T19:20:48.750 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 15 0 2026-02-24T19:20:48.750 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 11 0 2026-02-24T19:20:48.750 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 5 0 2026-02-24T19:20:48.750 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 8 0 2026-02-24T19:20:48.750 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 6 0 2026-02-24T19:20:48.750 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 3 0 2026-02-24T19:20:48.750 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 4 0 2026-02-24T19:20:48.751 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 12 0 2026-02-24T19:20:48.751 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 9 0 2026-02-24T19:20:48.751 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 2 0 2026-02-24T19:20:48.751 INFO:tasks.workunit.client.0.trial162.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2026-02-24T19:20:48.751 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (879 ms) 2026-02-24T19:20:48.751 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [----------] 3 tests from LibRadosListEC (2148 ms total) 2026-02-24T19:20:48.751 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 2026-02-24T19:20:48.751 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [----------] 1 test from LibRadosListNP 2026-02-24T19:20:48.751 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2026-02-24T19:20:48.751 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (3099 ms) 2026-02-24T19:20:48.751 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [----------] 1 test from LibRadosListNP (3099 ms total) 2026-02-24T19:20:48.751 INFO:tasks.workunit.client.0.trial162.stdout: api_list: 2026-02-24T19:20:48.751 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [----------] Global test environment tear-down 2026-02-24T19:20:48.752 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [==========] 11 tests from 3 test suites ran. (127210 ms total) 2026-02-24T19:20:48.752 INFO:tasks.workunit.client.0.trial162.stdout: api_list: [ PASSED ] 11 tests. 2026-02-24T19:20:49.795 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: Running main() from gmock_main.cc 2026-02-24T19:20:49.795 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [==========] Running 45 tests from 2 test suites. 2026-02-24T19:20:49.795 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [----------] Global test environment set-up. 2026-02-24T19:20:49.795 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [----------] 29 tests from LibRadosAio 2026-02-24T19:20:49.796 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2026-02-24T19:20:49.796 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.TooBig (3023 ms) 2026-02-24T19:20:49.796 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2026-02-24T19:20:49.796 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (6855 ms) 2026-02-24T19:20:49.796 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2026-02-24T19:20:49.796 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (3221 ms) 2026-02-24T19:20:49.796 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2026-02-24T19:20:49.796 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (3593 ms) 2026-02-24T19:20:49.796 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2026-02-24T19:20:49.796 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (2772 ms) 2026-02-24T19:20:49.796 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2026-02-24T19:20:49.796 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (3727 ms) 2026-02-24T19:20:49.797 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2026-02-24T19:20:49.797 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (9563 ms) 2026-02-24T19:20:49.797 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2026-02-24T19:20:49.797 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (9854 ms) 2026-02-24T19:20:49.797 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2026-02-24T19:20:49.797 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (9530 ms) 2026-02-24T19:20:49.797 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2026-02-24T19:20:49.797 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (10101 ms) 2026-02-24T19:20:49.797 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2026-02-24T19:20:49.797 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (10364 ms) 2026-02-24T19:20:49.797 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2026-02-24T19:20:49.797 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (7662 ms) 2026-02-24T19:20:49.798 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2026-02-24T19:20:49.798 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (3177 ms) 2026-02-24T19:20:49.798 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2026-02-24T19:20:49.798 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (2357 ms) 2026-02-24T19:20:49.798 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2026-02-24T19:20:49.798 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.Flush (3199 ms) 2026-02-24T19:20:49.798 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2026-02-24T19:20:49.798 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (2836 ms) 2026-02-24T19:20:49.798 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2026-02-24T19:20:49.798 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (3027 ms) 2026-02-24T19:20:49.798 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2026-02-24T19:20:49.798 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (3165 ms) 2026-02-24T19:20:49.798 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2026-02-24T19:20:49.799 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (2801 ms) 2026-02-24T19:20:49.799 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2026-02-24T19:20:49.799 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (3106 ms) 2026-02-24T19:20:49.799 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2026-02-24T19:20:49.799 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (3147 ms) 2026-02-24T19:20:49.799 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2026-02-24T19:20:49.799 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (2747 ms) 2026-02-24T19:20:49.799 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2026-02-24T19:20:49.799 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (3149 ms) 2026-02-24T19:20:49.799 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2026-02-24T19:20:49.799 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (3195 ms) 2026-02-24T19:20:49.799 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2026-02-24T19:20:49.799 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (3110 ms) 2026-02-24T19:20:49.800 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2026-02-24T19:20:49.800 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (2664 ms) 2026-02-24T19:20:49.800 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.CancelBeforeSubmit 2026-02-24T19:20:49.800 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.CancelBeforeSubmit (3227 ms) 2026-02-24T19:20:49.800 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.CancelBeforeComplete 2026-02-24T19:21:06.422 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:04:04.396 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:06.423 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:04:04.398 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:06.425 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:04:04.396 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:06.427 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:04:04.398 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:06.450 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:04:04.386 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:06.451 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:04:04.387 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:06.451 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:04:04.425 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:06.453 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:04:04.424 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:06.477 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:04:04.413 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:07.761 INFO:tasks.workunit.client.0.trial162.stdout: a api_aio_pp: Running main() from gmock_main.cc 2026-02-24T19:21:07.761 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [==========] Running 63 tests from 5 test suites. 2026-02-24T19:21:07.761 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [----------] Global test environment set-up. 2026-02-24T19:21:07.761 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2026-02-24T19:21:07.762 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2026-02-24T19:21:07.762 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (3039 ms) 2026-02-24T19:21:07.762 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2026-02-24T19:21:07.762 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (29820 ms) 2026-02-24T19:21:07.762 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2026-02-24T19:21:07.762 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (23613 ms) 2026-02-24T19:21:07.762 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2026-02-24T19:21:07.762 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (9043 ms) 2026-02-24T19:21:07.762 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2026-02-24T19:21:07.762 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (9974 ms) 2026-02-24T19:21:07.763 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2026-02-24T19:21:07.763 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (6804 ms) 2026-02-24T19:21:07.763 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2026-02-24T19:21:07.763 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (3507 ms) 2026-02-24T19:21:07.763 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2026-02-24T19:21:07.763 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (3201 ms) 2026-02-24T19:21:07.763 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2026-02-24T19:21:07.763 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (2830 ms) 2026-02-24T19:21:07.763 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2026-02-24T19:21:07.763 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (3036 ms) 2026-02-24T19:21:07.763 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2026-02-24T19:21:07.763 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (3161 ms) 2026-02-24T19:21:07.764 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2026-02-24T19:21:07.764 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (2805 ms) 2026-02-24T19:21:07.764 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2026-02-24T19:21:07.764 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (3108 ms) 2026-02-24T19:21:07.764 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2026-02-24T19:21:07.764 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (3143 ms) 2026-02-24T19:21:07.764 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2026-02-24T19:21:07.764 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (2744 ms) 2026-02-24T19:21:07.764 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2026-02-24T19:21:07.764 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (3149 ms) 2026-02-24T19:21:07.764 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2026-02-24T19:21:07.764 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (3194 ms) 2026-02-24T19:21:07.764 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2026-02-24T19:21:07.765 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (3109 ms) 2026-02-24T19:21:07.765 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2026-02-24T19:21:07.765 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (2671 ms) 2026-02-24T19:21:07.765 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2026-02-24T19:21:07.765 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (3229 ms) 2026-02-24T19:21:07.765 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2026-02-24T19:21:07.765 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (3088 ms) 2026-02-24T19:21:07.765 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2026-02-24T19:21:07.765 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (2622 ms) 2026-02-24T19:21:07.765 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2026-02-24T19:21:07.765 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (3042 ms) 2026-02-24T19:21:07.765 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2026-02-24T19:21:07.765 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (3050 ms) 2026-02-24T19:21:07.765 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2026-02-24T19:21:07.766 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (2911 ms) 2026-02-24T19:21:07.766 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2026-02-24T19:21:07.766 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (3146 ms) 2026-02-24T19:21:07.766 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2026-02-24T19:21:14.601 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAirom LibRadosMiscPP (123194 ms total) 2026-02-24T19:21:14.601 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: 2026-02-24T19:21:14.601 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2026-02-24T19:21:14.601 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2026-02-24T19:21:14.601 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (904 ms) 2026-02-24T19:21:14.601 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (904 ms total) 2026-02-24T19:21:14.601 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: 2026-02-24T19:21:14.601 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0,Checksummer::xxhash32,ceph_le > 2026-02-24T19:21:14.602 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2026-02-24T19:21:14.602 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (156 ms) 2026-02-24T19:21:14.602 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2026-02-24T19:21:14.602 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (20 ms) 2026-02-24T19:21:14.602 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (177 ms total) 2026-02-24T19:21:14.602 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: 2026-02-24T19:21:14.602 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1,Checksummer::xxhash64,ceph_le > 2026-02-24T19:21:14.602 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2026-02-24T19:21:14.602 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (179 ms) 2026-02-24T19:21:14.602 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2026-02-24T19:21:14.602 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (31 ms) 2026-02-24T19:21:14.602 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (211 ms total) 2026-02-24T19:21:14.603 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: 2026-02-24T19:21:14.603 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2,Checksummer::crc32c,ceph_le > 2026-02-24T19:21:14.603 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2026-02-24T19:21:14.603 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (159 ms) 2026-02-24T19:21:14.603 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2026-02-24T19:21:14.603 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (23 ms) 2026-02-24T19:21:14.603 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (183 ms total) 2026-02-24T19:21:14.603 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: 2026-02-24T19:21:14.603 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2026-02-24T19:21:14.603 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2026-02-24T19:21:14.603 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (772 ms) 2026-02-24T19:21:14.603 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (772 ms total) 2026-02-24T19:21:14.603 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: 2026-02-24T19:21:14.604 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [----------] Global test environment tear-down 2026-02-24T19:21:14.604 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (153048 ms total) 2026-02-24T19:21:14.604 INFO:tasks.workunit.client.0.trial162.stdout: api_misc_pp: [ PASSED ] 31 tests. 2026-02-24T19:21:14.605 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:21:14.605 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49415 2026-02-24T19:21:14.605 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 49415 2026-02-24T19:21:14.605 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:21:14.605 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=48794 2026-02-24T19:21:14.606 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 48794 2026-02-24T19:21:14.606 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:21:14.606 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=48858 2026-02-24T19:21:14.606 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 48858 2026-02-24T19:21:14.606 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:21:14.606 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49319 2026-02-24T19:21:14.606 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 49319 2026-02-24T19:21:14.606 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:21:14.606 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=48786 2026-02-24T19:21:14.606 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 48786 2026-02-24T19:21:46.521 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:04:44.495 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:46.522 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:04:44.497 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:46.549 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:04:44.520 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:46.550 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:04:44.486 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:46.550 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:04:44.521 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:46.551 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:04:44.487 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:46.560 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:04:44.535 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:46.586 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:04:44.522 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:21:46.588 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:04:44.559 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:06.553 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:05:04.527 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:06.554 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:05:04.529 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:06.575 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:05:04.550 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:06.581 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:05:04.517 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:06.582 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:05:04.518 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:06.585 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:05:04.556 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:06.586 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:05:04.557 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:06.602 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:05:04.539 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:06.607 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:05:04.578 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:26.594 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:05:24.568 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:26.596 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:05:24.570 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:26.621 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:05:24.557 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:26.622 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:05:24.596 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:26.622 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:05:24.558 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:26.624 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:05:24.594 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:26.624 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:05:24.595 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:26.644 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:05:24.581 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:26.648 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:05:24.619 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:44.808 INFO:tasks.workunit.client.0.trial162.stdout:pi_aio: [ OK ] LibRadosAio.CancelBeforeComplete (3091 ms) 2026-02-24T19:22:44.808 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAio.CancelAfterComplete 2026-02-24T19:22:44.808 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAio.CancelAfterComplete (2631 ms) 2026-02-24T19:22:44.808 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [----------] 29 tests from LibRadosAio (130909 ms total) 2026-02-24T19:22:44.808 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: 2026-02-24T19:22:44.808 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2026-02-24T19:22:44.808 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWrite 2026-02-24T19:22:44.808 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (7118 ms) 2026-02-24T19:22:44.808 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2026-02-24T19:22:44.808 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (7200 ms) 2026-02-24T19:22:44.808 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2026-02-24T19:22:44.808 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (6794 ms) 2026-02-24T19:22:44.808 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2026-02-24T19:22:44.808 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (7210 ms) 2026-02-24T19:22:44.808 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2026-02-24T19:22:44.808 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (7049 ms) 2026-02-24T19:22:44.809 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2026-02-24T19:22:44.809 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (6798 ms) 2026-02-24T19:22:44.809 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2026-02-24T19:22:44.809 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (6926 ms) 2026-02-24T19:22:44.809 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2026-02-24T19:22:44.809 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (7277 ms) 2026-02-24T19:22:44.809 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2026-02-24T19:22:44.809 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (6938 ms) 2026-02-24T19:22:44.809 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2026-02-24T19:22:44.809 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (6831 ms) 2026-02-24T19:22:44.809 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2026-02-24T19:22:44.809 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (7481 ms) 2026-02-24T19:22:44.809 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2026-02-24T19:22:44.809 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (6764 ms) 2026-02-24T19:22:44.809 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2026-02-24T19:22:44.809 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (6863 ms) 2026-02-24T19:22:44.809 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2026-02-24T19:22:44.809 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (7167 ms) 2026-02-24T19:22:44.809 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2026-02-24T19:22:44.809 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (7070 ms) 2026-02-24T19:22:44.809 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2026-02-24T19:22:44.809 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (6885 ms) 2026-02-24T19:22:44.809 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (112379 ms total) 2026-02-24T19:22:44.809 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: 2026-02-24T19:22:44.809 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [----------] Global test environment tear-down 2026-02-24T19:22:44.809 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [==========] 45 tests from 2 test suites ran. (243289 ms total) 2026-02-24T19:22:44.809 INFO:tasks.workunit.client.0.trial162.stdout: api_aio: [ PASSED ] 45 tests. 2026-02-24T19:22:46.643 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:05:44.618 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:46.644 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:05:44.619 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:46.646 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:05:44.616 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:46.647 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:05:44.618 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:46.669 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:05:44.640 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:46.670 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:05:44.644 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:46.671 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:05:44.607 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:46.672 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:05:44.608 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:22:46.692 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:05:44.629 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:06.675 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:06:04.649 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:06.680 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:06:04.654 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:06.692 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:06:04.663 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:06.698 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:06:04.672 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:06.708 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:06:04.644 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:06.709 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:06:04.645 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:06.709 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:06:04.680 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:06.727 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:06:04.663 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:06.728 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:06:04.699 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:26.712 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:06:24.686 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:26.714 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:06:24.689 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:26.733 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:06:24.708 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:26.740 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:06:24.676 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:26.740 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:06:24.711 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:26.741 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:06:24.677 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:26.742 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:06:24.713 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:26.760 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:06:24.697 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:26.763 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:06:24.733 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:29.028 INFO:tasks.workunit.client.0.trial162.stdout:o.RoundTripAppendPP (3188 ms) 2026-02-24T19:23:29.028 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2026-02-24T19:23:29.028 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (3142 ms) 2026-02-24T19:23:29.028 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2026-02-24T19:23:29.028 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (2630 ms) 2026-02-24T19:23:29.029 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2026-02-24T19:23:29.029 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (3076 ms) 2026-02-24T19:23:29.029 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2026-02-24T19:23:29.029 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: sending pool EIO time: 2026-02-24T19:21:23.668230+0000 2026-02-24T19:23:29.029 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: /ceph/rpmbuild/BUILD/ceph-20.2.0-681-g36d388f2/src/test/librados/aio_cxx.cc:2430: Skipped 2026-02-24T19:23:29.029 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: eio flag missed all ios that already completed 2026-02-24T19:23:29.029 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: 2026-02-24T19:23:29.029 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ SKIPPED ] LibRadosAio.PoolEIOFlag (9044 ms) 2026-02-24T19:23:29.029 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2026-02-24T19:23:29.029 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (3210 ms) 2026-02-24T19:23:29.029 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (167346 ms total) 2026-02-24T19:23:29.030 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: 2026-02-24T19:23:29.030 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2026-02-24T19:23:29.030 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2026-02-24T19:23:29.030 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (2627 ms) 2026-02-24T19:23:29.030 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2026-02-24T19:23:29.030 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (9198 ms) 2026-02-24T19:23:29.030 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2026-02-24T19:23:29.030 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (15049 ms) 2026-02-24T19:23:29.030 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2026-02-24T19:23:29.030 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (3033 ms) 2026-02-24T19:23:29.030 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (29908 ms total) 2026-02-24T19:23:29.030 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: 2026-02-24T19:23:29.030 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2026-02-24T19:23:29.031 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2026-02-24T19:23:29.031 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (2789 ms) 2026-02-24T19:23:29.031 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (2789 ms total) 2026-02-24T19:23:29.031 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: 2026-02-24T19:23:29.031 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2026-02-24T19:23:29.031 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2026-02-24T19:23:29.031 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (14223 ms) 2026-02-24T19:23:29.031 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2026-02-24T19:23:29.031 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (6823 ms) 2026-02-24T19:23:29.031 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2026-02-24T19:23:29.031 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (7220 ms) 2026-02-24T19:23:29.031 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2026-02-24T19:23:29.032 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (7007 ms) 2026-02-24T19:23:29.032 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2026-02-24T19:23:29.032 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (3142 ms) 2026-02-24T19:23:29.032 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2026-02-24T19:23:29.032 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (6966 ms) 2026-02-24T19:23:29.032 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2026-02-24T19:23:29.032 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (6800 ms) 2026-02-24T19:23:29.032 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2026-02-24T19:23:29.032 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (7258 ms) 2026-02-24T19:23:29.032 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2026-02-24T19:23:29.032 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (6826 ms) 2026-02-24T19:23:29.032 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2026-02-24T19:23:29.032 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (6902 ms) 2026-02-24T19:23:29.033 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2026-02-24T19:23:29.033 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (6981 ms) 2026-02-24T19:23:29.033 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2026-02-24T19:23:29.033 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (7311 ms) 2026-02-24T19:23:46.751 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:06:44.726 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:46.754 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:06:44.728 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:46.773 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:06:44.747 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:46.780 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:06:44.716 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:46.781 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:06:44.751 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:46.781 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:06:44.717 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:46.782 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:06:44.752 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:46.801 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:06:44.772 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:46.803 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:06:44.739 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:58.976 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:06:56.950 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:59.001 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:06:56.975 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:59.017 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:06:56.991 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:59.025 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:06:56.996 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:59.026 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:06:56.997 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:59.026 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:06:56.963 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:59.027 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:06:56.963 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:59.042 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:06:57.013 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:23:59.043 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:06:56.979 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:06.793 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:07:04.767 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:06.794 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:07:04.769 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:06.805 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:07:04.779 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:06.820 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:07:04.756 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:06.821 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:07:04.757 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:06.824 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:07:04.795 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:06.825 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:07:04.796 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:06.831 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:07:04.767 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:06.834 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:07:04.804 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:23.892 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2026-02-24T19:24:23.893 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (6783 ms) 2026-02-24T19:24:23.893 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2026-02-24T19:24:23.893 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3142 ms) 2026-02-24T19:24:23.893 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2026-02-24T19:24:23.893 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (6885 ms) 2026-02-24T19:24:23.893 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2026-02-24T19:24:23.893 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (6950 ms) 2026-02-24T19:24:23.893 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2026-02-24T19:24:23.893 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (7219 ms) 2026-02-24T19:24:23.893 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2026-02-24T19:24:23.893 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (7059 ms) 2026-02-24T19:24:23.893 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2026-02-24T19:24:23.894 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (6806 ms) 2026-02-24T19:24:23.894 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2026-02-24T19:24:23.894 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (7365 ms) 2026-02-24T19:24:23.894 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (139676 ms total) 2026-02-24T19:24:23.894 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: 2026-02-24T19:24:23.894 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [----------] 6 tests from LibRadosAio/Cancel 2026-02-24T19:24:23.894 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeSubmit/aio_cancel 2026-02-24T19:24:23.894 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeSubmit/aio_cancel (0 ms) 2026-02-24T19:24:23.894 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeSubmit/cancel 2026-02-24T19:24:23.894 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeSubmit/cancel (0 ms) 2026-02-24T19:24:23.894 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeComplete/aio_cancel 2026-02-24T19:24:23.894 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeComplete/aio_cancel (0 ms) 2026-02-24T19:24:23.895 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeComplete/cancel 2026-02-24T19:24:23.895 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeComplete/cancel (0 ms) 2026-02-24T19:24:23.895 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.AfterComplete/aio_cancel 2026-02-24T19:24:23.895 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.AfterComplete/aio_cancel (65 ms) 2026-02-24T19:24:23.895 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.AfterComplete/cancel 2026-02-24T19:24:23.895 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.AfterComplete/cancel (26 ms) 2026-02-24T19:24:23.895 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [----------] 6 tests from LibRadosAio/Cancel (92 ms total) 2026-02-24T19:24:23.895 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: 2026-02-24T19:24:23.895 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [----------] Global test environment tear-down 2026-02-24T19:24:23.895 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [==========] 63 tests from 5 test suites ran. (342370 ms total) 2026-02-24T19:24:23.895 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ PASSED ] 62 tests. 2026-02-24T19:24:23.895 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ SKIPPED ] 1 test, listed below: 2026-02-24T19:24:23.895 INFO:tasks.workunit.client.0.trial162.stdout: api_aio_pp: [ SKIPPED ] LibRadosAio.PoolEIOFlag 2026-02-24T19:24:23.900 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:23.900 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=48806 2026-02-24T19:24:23.900 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 48806 2026-02-24T19:24:23.900 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:23.901 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49594 2026-02-24T19:24:23.901 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 49594 2026-02-24T19:24:23.901 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:23.901 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=48980 2026-02-24T19:24:23.901 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 48980 2026-02-24T19:24:23.901 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:23.901 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49664 2026-02-24T19:24:23.901 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 49664 2026-02-24T19:24:23.901 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:23.901 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49057 2026-02-24T19:24:23.901 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 49057 2026-02-24T19:24:23.902 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:23.902 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49471 2026-02-24T19:24:23.902 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 49471 2026-02-24T19:24:23.902 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:23.902 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49753 2026-02-24T19:24:23.902 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 49753 2026-02-24T19:24:23.902 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:23.902 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49006 2026-02-24T19:24:23.902 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 49006 2026-02-24T19:24:23.902 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:23.902 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49355 2026-02-24T19:24:23.902 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 49355 2026-02-24T19:24:23.903 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:23.903 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49573 2026-02-24T19:24:23.903 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 49573 2026-02-24T19:24:23.903 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:23.903 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49442 2026-02-24T19:24:23.903 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 49442 2026-02-24T19:24:23.903 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:23.903 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49630 2026-02-24T19:24:23.903 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 49630 2026-02-24T19:24:23.903 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:23.903 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49294 2026-02-24T19:24:23.903 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 49294 2026-02-24T19:24:23.904 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:23.904 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=48936 2026-02-24T19:24:23.904 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 48936 2026-02-24T19:24:23.904 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:23.904 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49682 2026-02-24T19:24:23.904 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 49682 2026-02-24T19:24:23.904 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:23.904 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49190 2026-02-24T19:24:23.904 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 49190 2026-02-24T19:24:23.904 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:23.904 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=48778 2026-02-24T19:24:23.904 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 48778 2026-02-24T19:24:23.904 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:23.905 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=48837 2026-02-24T19:24:23.905 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 48837 2026-02-24T19:24:23.905 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:23.905 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49125 2026-02-24T19:24:23.905 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 49125 2026-02-24T19:24:23.905 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:23.905 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=48878 2026-02-24T19:24:23.905 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 48878 2026-02-24T19:24:23.905 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:23.905 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49221 2026-02-24T19:24:23.905 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 49221 2026-02-24T19:24:23.905 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:23.905 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49257 2026-02-24T19:24:23.906 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 49257 2026-02-24T19:24:23.906 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:23.906 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49545 2026-02-24T19:24:23.906 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 49545 2026-02-24T19:24:23.906 INFO:tasks.workunit.client.0.trial162.stderr:+ for t in "${!pids[@]}" 2026-02-24T19:24:23.906 INFO:tasks.workunit.client.0.trial162.stderr:+ pid=49793 2026-02-24T19:24:23.906 INFO:tasks.workunit.client.0.trial162.stderr:+ wait 49793 2026-02-24T19:24:23.906 INFO:tasks.workunit.client.0.trial162.stderr:+ exit 0 2026-02-24T19:24:23.906 INFO:tasks.workunit.client.0.trial162.stderr:+ cleanup 2026-02-24T19:24:23.906 INFO:tasks.workunit.client.0.trial162.stderr:+ pkill -P 48772 2026-02-24T19:24:23.907 INFO:tasks.workunit.client.0.trial162.stderr:+ true 2026-02-24T19:24:23.908 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-24T19:24:23.908 DEBUG:teuthology.orchestra.run.trial162:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-24T19:24:23.937 INFO:tasks.workunit:Stopping ['rados/test.sh'] on client.0... 2026-02-24T19:24:23.937 DEBUG:teuthology.orchestra.run.trial162:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-24T19:24:24.290 DEBUG:teuthology.parallel:result is None 2026-02-24T19:24:24.290 DEBUG:teuthology.orchestra.run.trial162:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-24T19:24:24.315 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-24T19:24:24.315 DEBUG:teuthology.orchestra.run.trial162:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-24T19:24:24.371 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-24T19:24:24.372 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-24T19:24:24.385 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-24T19:24:24.386 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T19:24:24.456 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.455+0000 7fc204afe640 10 monclient: get_monmap_and_config 2026-02-24T19:24:24.457 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.455+0000 7fc204afe640 10 monclient: build_initial_monmap 2026-02-24T19:24:24.457 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.455+0000 7fc204afe640 10 monclient: monmap: 2026-02-24T19:24:24.457 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:24.457 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:24.457 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:24.456047+0000 2026-02-24T19:24:24.457 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:24.456047+0000 2026-02-24T19:24:24.457 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:24.457 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:24.457 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:24.457 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:24.457 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:24.458 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:24.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.455+0000 7fc204afe640 1 Processor -- start 2026-02-24T19:24:24.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.455+0000 7fc204afe640 1 -- start start 2026-02-24T19:24:24.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.455+0000 7fc204afe640 10 monclient: init 2026-02-24T19:24:24.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.456+0000 7fc204afe640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:24.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.456+0000 7fc204afe640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:24:24.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.456+0000 7fc204afe640 10 monclient(hunting): picked mon.noname-b con 0x7fc200058da0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:24.460 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.456+0000 7fc204afe640 10 monclient(hunting): picked mon.noname-c con 0x7fc2000b0410 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:24.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.456+0000 7fc204afe640 10 monclient(hunting): picked mon.noname-a con 0x7fc2001626a0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:24.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.456+0000 7fc204afe640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2001655c0 con 0x7fc2001626a0 2026-02-24T19:24:24.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.456+0000 7fc204afe640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2000b12b0 con 0x7fc200058da0 2026-02-24T19:24:24.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.456+0000 7fc204afe640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2000b1590 con 0x7fc2000b0410 2026-02-24T19:24:24.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.456+0000 7fc204afe640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:24.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.456+0000 7fc204afe640 10 monclient(hunting): authenticate will time out at 4047.138345s 2026-02-24T19:24:24.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.456+0000 7fc1fdd74640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fc2000b0410 0x7fc200164eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58146/0 (socket says 10.20.193.26:58146) 2026-02-24T19:24:24.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.456+0000 7fc1fdd74640 1 -- 10.20.193.26:0/2455005959 learned_addr learned my addr 10.20.193.26:0/2455005959 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:24.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.458+0000 7fc1fd573640 1 -- 10.20.193.26:0/2455005959 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1974710049 0 0) 0x7fc2000b12b0 con 0x7fc200058da0 2026-02-24T19:24:24.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.458+0000 7fc1fd573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:24.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.458+0000 7fc1fd573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:24.461 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.458+0000 7fc1fd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:24.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.458+0000 7fc1fd573640 10 monclient(hunting): my global_id is 28015 2026-02-24T19:24:24.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.458+0000 7fc1fd573640 1 -- 10.20.193.26:0/2455005959 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1ec003610 con 0x7fc200058da0 2026-02-24T19:24:24.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.458+0000 7fc1fd573640 1 -- 10.20.193.26:0/2455005959 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2066627174 0 0) 0x7fc2000b1590 con 0x7fc2000b0410 2026-02-24T19:24:24.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.458+0000 7fc1fd573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:24.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.458+0000 7fc1fd573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:24.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.458+0000 7fc1fd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:24.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.458+0000 7fc1fd573640 10 monclient(hunting): my global_id is 29939 2026-02-24T19:24:24.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.458+0000 7fc1fd573640 1 -- 10.20.193.26:0/2455005959 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2000b12b0 con 0x7fc2000b0410 2026-02-24T19:24:24.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.458+0000 7fc1fd573640 1 -- 10.20.193.26:0/2455005959 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 709664207 0 0) 0x7fc2001655c0 con 0x7fc2001626a0 2026-02-24T19:24:24.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.458+0000 7fc1fd573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:24.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.458+0000 7fc1fd573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:24.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.458+0000 7fc1fd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:24.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.458+0000 7fc1fd573640 10 monclient(hunting): my global_id is 30603 2026-02-24T19:24:24.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.458+0000 7fc1fd573640 1 -- 10.20.193.26:0/2455005959 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2000b1590 con 0x7fc2001626a0 2026-02-24T19:24:24.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.460+0000 7fc1fd573640 1 -- 10.20.193.26:0/2455005959 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1026882704 0 0) 0x7fc2000b12b0 con 0x7fc2000b0410 2026-02-24T19:24:24.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.460+0000 7fc1fd573640 1 -- 10.20.193.26:0/2455005959 >> v1:10.20.193.70:6789/0 conn(0x7fc200058da0 legacy=0x7fc2001647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:24.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.460+0000 7fc1fd573640 1 -- 10.20.193.26:0/2455005959 >> v1:10.20.193.26:6789/0 conn(0x7fc2001626a0 legacy=0x7fc2001c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:24.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.460+0000 7fc1fd573640 10 monclient: _finish_hunting 0 2026-02-24T19:24:24.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.460+0000 7fc1fd573640 1 monclient: found mon.noname-c 2026-02-24T19:24:24.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.460+0000 7fc1fd573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:24.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.460+0000 7fc1fd573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:24:24.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.460+0000 7fc1fd573640 1 -- 10.20.193.26:0/2455005959 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2000b1870 con 0x7fc2000b0410 2026-02-24T19:24:24.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.460+0000 7fc1fd573640 10 monclient: _finish_auth 0 2026-02-24T19:24:24.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.460+0000 7fc1fd573640 10 monclient: _check_auth_tickets 2026-02-24T19:24:24.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.460+0000 7fc1fd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:24.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.460+0000 7fc1fd573640 1 -- 10.20.193.26:0/2455005959 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc1e8002df0 con 0x7fc2000b0410 2026-02-24T19:24:24.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.460+0000 7fc204afe640 5 monclient: authenticate success, global_id 29939 2026-02-24T19:24:24.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.460+0000 7fc204afe640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:24.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.460+0000 7fc1fd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:24.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.460+0000 7fc1fd573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:24.468 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.460+0000 7fc1fd573640 10 monclient: dump: 2026-02-24T19:24:24.468 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:24.468 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:24.469 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:24.469 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:24.469 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:24.469 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:24.469 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:24.469 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:24.469 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:24.469 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:24.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.460+0000 7fc204afe640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:24.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.460+0000 7fc1fd573640 1 -- 10.20.193.26:0/2455005959 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc1e8002f90 con 0x7fc2000b0410 2026-02-24T19:24:24.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.460+0000 7fc1fd573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:24.469 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.460+0000 7fc1fd573640 1 -- 10.20.193.26:0/2455005959 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc1e80033d0 con 0x7fc2000b0410 2026-02-24T19:24:24.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.460+0000 7fc1fd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:24.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.460+0000 7fc1fd573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:24.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.460+0000 7fc1fd573640 10 monclient: dump: 2026-02-24T19:24:24.470 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:24.470 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:24.470 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:24.470 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:24.470 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:24.470 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:24.470 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:24.470 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:24.470 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:24.470 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:24.470 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.460+0000 7fc204afe640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:24.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.460+0000 7fc204afe640 4 set_mon_vals no callback set 2026-02-24T19:24:24.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.461+0000 7fc204afe640 10 monclient: shutdown 2026-02-24T19:24:24.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.461+0000 7fc204afe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:24.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.461+0000 7fc204afe640 1 -- 10.20.193.26:0/2455005959 >> v1:10.20.193.103:6789/0 conn(0x7fc2000b0410 legacy=0x7fc200164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:24.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.461+0000 7fc204afe640 1 -- 10.20.193.26:0/2455005959 shutdown_connections 2026-02-24T19:24:24.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.461+0000 7fc204afe640 1 -- 10.20.193.26:0/2455005959 >> 10.20.193.26:0/2455005959 conn(0x7fc2000b65f0 msgr2=0x7fc2000b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:24.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.461+0000 7fc204afe640 1 -- 10.20.193.26:0/2455005959 shutdown_connections 2026-02-24T19:24:24.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.461+0000 7fc204afe640 1 -- 10.20.193.26:0/2455005959 wait complete. 2026-02-24T19:24:24.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.461+0000 7fc204afe640 10 monclient: build_initial_monmap 2026-02-24T19:24:24.471 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.461+0000 7fc204afe640 10 monclient: monmap: 2026-02-24T19:24:24.471 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:24.471 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:24.472 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:24.472 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:24.472 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:24.472 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:24.472 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:24.472 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:24.472 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:24.472 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:24.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.462+0000 7fc204afe640 1 librados: starting msgr at 2026-02-24T19:24:24.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.462+0000 7fc204afe640 1 librados: starting objecter 2026-02-24T19:24:24.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.462+0000 7fc204afe640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:24.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.462+0000 7fc204afe640 1 Processor -- start 2026-02-24T19:24:24.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.462+0000 7fc204afe640 1 -- start start 2026-02-24T19:24:24.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.462+0000 7fc204afe640 1 librados: setting wanted keys 2026-02-24T19:24:24.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.462+0000 7fc204afe640 1 librados: calling monclient init 2026-02-24T19:24:24.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.462+0000 7fc204afe640 10 monclient: init 2026-02-24T19:24:24.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.462+0000 7fc204afe640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:24.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.462+0000 7fc204afe640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:24.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.462+0000 7fc204afe640 10 monclient(hunting): picked mon.noname-a con 0x7fc200058da0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:24.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.462+0000 7fc204afe640 10 monclient(hunting): picked mon.noname-c con 0x7fc2000b0410 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:24.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.462+0000 7fc204afe640 10 monclient(hunting): picked mon.noname-b con 0x7fc2001626a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:24.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.462+0000 7fc204afe640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc20013ba80 con 0x7fc200058da0 2026-02-24T19:24:24.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.462+0000 7fc204afe640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2001fc030 con 0x7fc2001626a0 2026-02-24T19:24:24.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.462+0000 7fc204afe640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2001fb580 con 0x7fc2000b0410 2026-02-24T19:24:24.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.462+0000 7fc204afe640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:24.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.462+0000 7fc204afe640 10 monclient(hunting): authenticate will time out at 4047.144651s 2026-02-24T19:24:24.473 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.462+0000 7fc1fdd74640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fc2000b0410 0x7fc2001fd800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58154/0 (socket says 10.20.193.26:58154) 2026-02-24T19:24:24.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.462+0000 7fc1fdd74640 1 -- 10.20.193.26:0/2329736960 learned_addr learned my addr 10.20.193.26:0/2329736960 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:24.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.463+0000 7fc1e6ffd640 10 client.?.objecter ms_handle_connect 0x7fc2000b0410 2026-02-24T19:24:24.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.463+0000 7fc1e6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:24.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.463+0000 7fc1e6ffd640 10 client.?.objecter ms_handle_connect 0x7fc200058da0 2026-02-24T19:24:24.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.463+0000 7fc1e6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:24.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.463+0000 7fc1e6ffd640 10 client.?.objecter ms_handle_connect 0x7fc2001626a0 2026-02-24T19:24:24.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.463+0000 7fc1e6ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:24.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.464+0000 7fc1e6ffd640 1 -- 10.20.193.26:0/2329736960 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2872300737 0 0) 0x7fc2001fb580 con 0x7fc2000b0410 2026-02-24T19:24:24.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.464+0000 7fc1e6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:24.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.464+0000 7fc1e6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:24.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.464+0000 7fc1e6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:24.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.464+0000 7fc1e6ffd640 10 monclient(hunting): my global_id is 29942 2026-02-24T19:24:24.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.464+0000 7fc1e6ffd640 1 -- 10.20.193.26:0/2329736960 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1cc003610 con 0x7fc2000b0410 2026-02-24T19:24:24.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.464+0000 7fc1e6ffd640 1 -- 10.20.193.26:0/2329736960 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1058906632 0 0) 0x7fc20013ba80 con 0x7fc200058da0 2026-02-24T19:24:24.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.464+0000 7fc1e6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:24.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.464+0000 7fc1e6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:24.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.464+0000 7fc1e6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:24.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.464+0000 7fc1e6ffd640 10 monclient(hunting): my global_id is 30606 2026-02-24T19:24:24.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.464+0000 7fc1e6ffd640 1 -- 10.20.193.26:0/2329736960 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2001fb580 con 0x7fc200058da0 2026-02-24T19:24:24.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.464+0000 7fc1e6ffd640 1 -- 10.20.193.26:0/2329736960 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2205218049 0 0) 0x7fc2001fc030 con 0x7fc2001626a0 2026-02-24T19:24:24.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.464+0000 7fc1e6ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:24.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.464+0000 7fc1e6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:24.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.464+0000 7fc1e6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:24.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.464+0000 7fc1e6ffd640 10 monclient(hunting): my global_id is 28018 2026-02-24T19:24:24.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.464+0000 7fc1e6ffd640 1 -- 10.20.193.26:0/2329736960 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc20013ba80 con 0x7fc2001626a0 2026-02-24T19:24:24.479 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.466+0000 7fc1e6ffd640 1 -- 10.20.193.26:0/2329736960 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3379238893 0 0) 0x7fc1cc003610 con 0x7fc2000b0410 2026-02-24T19:24:24.479 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.466+0000 7fc1e6ffd640 1 -- 10.20.193.26:0/2329736960 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc2001fc030 con 0x7fc2000b0410 2026-02-24T19:24:24.479 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.466+0000 7fc1e6ffd640 1 -- 10.20.193.26:0/2329736960 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc1e80033a0 con 0x7fc2000b0410 2026-02-24T19:24:24.479 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.466+0000 7fc1e6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:24.479 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.466+0000 7fc1e6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:24.480 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.466+0000 7fc1e6ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:24.480 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:24.480 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:24.480 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:24.480 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:24.480 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:24.480 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:24.480 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:24.480 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:24.480 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:24.480 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:24.480 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.466+0000 7fc1e6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:24.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.466+0000 7fc1e6ffd640 1 -- 10.20.193.26:0/2329736960 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1444661143 0 0) 0x7fc2001fb580 con 0x7fc200058da0 2026-02-24T19:24:24.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.466+0000 7fc1e6ffd640 1 -- 10.20.193.26:0/2329736960 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc1cc003610 con 0x7fc200058da0 2026-02-24T19:24:24.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.466+0000 7fc1e6ffd640 1 -- 10.20.193.26:0/2329736960 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc1f4002fd0 con 0x7fc200058da0 2026-02-24T19:24:24.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.466+0000 7fc1e6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:24.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.466+0000 7fc1e6ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:24.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.466+0000 7fc1e6ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:24.481 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:24.481 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:24.481 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:24.481 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:24.481 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:24.481 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:24.482 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:24.482 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:24.482 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:24.482 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:24.482 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.466+0000 7fc1e6ffd640 1 -- 10.20.193.26:0/2329736960 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 435750905 0 0) 0x7fc20013ba80 con 0x7fc2001626a0 2026-02-24T19:24:24.482 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.466+0000 7fc1e6ffd640 1 -- 10.20.193.26:0/2329736960 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc2001fb580 con 0x7fc2001626a0 2026-02-24T19:24:24.482 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.466+0000 7fc1e6ffd640 1 -- 10.20.193.26:0/2329736960 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc1f00032b0 con 0x7fc2001626a0 2026-02-24T19:24:24.482 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.466+0000 7fc1e6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:24.482 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.466+0000 7fc1e6ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:24.482 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.466+0000 7fc1e6ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:24.482 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:24.482 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:24.482 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:24.482 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:24.483 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:24.483 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:24.483 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:24.483 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:24.483 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:24.483 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:24.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.468+0000 7fc1e6ffd640 1 -- 10.20.193.26:0/2329736960 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4059990175 0 0) 0x7fc2001fc030 con 0x7fc2000b0410 2026-02-24T19:24:24.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.468+0000 7fc1e6ffd640 1 -- 10.20.193.26:0/2329736960 >> v1:10.20.193.70:6789/0 conn(0x7fc2001626a0 legacy=0x7fc20013b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:24.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.468+0000 7fc1e6ffd640 1 -- 10.20.193.26:0/2329736960 >> v1:10.20.193.26:6789/0 conn(0x7fc200058da0 legacy=0x7fc200138b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:24.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.468+0000 7fc1e6ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:24.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.468+0000 7fc1e6ffd640 1 monclient: found mon.c 2026-02-24T19:24:24.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.468+0000 7fc1e6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:24.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.468+0000 7fc1e6ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:24.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.468+0000 7fc1e6ffd640 1 -- 10.20.193.26:0/2329736960 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2001fb860 con 0x7fc2000b0410 2026-02-24T19:24:24.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.468+0000 7fc1e6ffd640 10 monclient: _finish_auth 0 2026-02-24T19:24:24.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.468+0000 7fc1e6ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:24.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.468+0000 7fc1e6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:24.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.468+0000 7fc204afe640 5 monclient: authenticate success, global_id 29942 2026-02-24T19:24:24.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.468+0000 7fc204afe640 10 monclient: _renew_subs 2026-02-24T19:24:24.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.468+0000 7fc204afe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:24.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.468+0000 7fc204afe640 1 -- 10.20.193.26:0/2329736960 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc20013a890 con 0x7fc2000b0410 2026-02-24T19:24:24.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.468+0000 7fc204afe640 10 client.29942.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:24.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.468+0000 7fc204afe640 10 monclient: _renew_subs 2026-02-24T19:24:24.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.468+0000 7fc204afe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:24.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.468+0000 7fc204afe640 1 -- 10.20.193.26:0/2329736960 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc20013ae50 con 0x7fc2000b0410 2026-02-24T19:24:24.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.468+0000 7fc204afe640 1 librados: init done 2026-02-24T19:24:24.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.468+0000 7fc204afe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:24.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.468+0000 7fc204afe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:24.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.468+0000 7fc204afe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:24.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.468+0000 7fc204afe640 1 -- 10.20.193.26:0/2329736960 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc200164200 con 0x7fc2000b0410 2026-02-24T19:24:24.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.475+0000 7fc1e6ffd640 1 -- 10.20.193.26:0/2329736960 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc1e80029a0 con 0x7fc2000b0410 2026-02-24T19:24:24.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.475+0000 7fc1e6ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:24.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.475+0000 7fc1e6ffd640 1 -- 10.20.193.26:0/2329736960 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc1e8004b80 con 0x7fc2000b0410 2026-02-24T19:24:24.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.475+0000 7fc1e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:24.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.475+0000 7fc1e6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:24.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.475+0000 7fc1fcd72640 4 set_mon_vals no callback set 2026-02-24T19:24:24.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.475+0000 7fc1e6ffd640 10 monclient: dump: 2026-02-24T19:24:24.485 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:24.485 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:24.486 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:24.486 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:24.486 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:24.486 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:24.486 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:24.486 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:24.486 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:24.486 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:24.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.476+0000 7fc1e6ffd640 1 -- 10.20.193.26:0/2329736960 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fc1e8004d60 con 0x7fc2000b0410 2026-02-24T19:24:24.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.477+0000 7fc1fe575640 10 monclient: get_auth_request con 0x7fc1cc077e70 auth_method 0 2026-02-24T19:24:24.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.477+0000 7fc1e6ffd640 10 client.29942.objecter ms_handle_connect 0x7fc1cc077e70 2026-02-24T19:24:24.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.478+0000 7fc1e6ffd640 1 -- 10.20.193.26:0/2329736960 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7fc1e80931e0 con 0x7fc2000b0410 2026-02-24T19:24:24.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.478+0000 7fc1e6ffd640 10 client.29942.objecter ms_dispatch2 0x7fc200000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:24.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.478+0000 7fc1e6ffd640 3 client.29942.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:24.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.478+0000 7fc1e6ffd640 3 client.29942.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:24.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.478+0000 7fc1e6ffd640 20 client.29942.objecter dump_active .. 0 homeless 2026-02-24T19:24:24.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.564+0000 7fc1e6ffd640 1 -- 10.20.193.26:0/2329736960 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fc200164200 con 0x7fc2000b0410 2026-02-24T19:24:24.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.564+0000 7fc1e6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:24.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.564+0000 7fc1e6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:24.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.666+0000 7fc204afe640 1 -- 10.20.193.26:0/2329736960 --> v1:10.20.193.162:6800/3889602630 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc2001fdf10 con 0x7fc1cc077e70 2026-02-24T19:24:24.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.668+0000 7fc1e6ffd640 1 -- 10.20.193.26:0/2329736960 <== mgr.4107 v1:10.20.193.162:6800/3889602630 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125115 (unknown 2965378022 0 1335917128) 0x7fc2001fdf10 con 0x7fc1cc077e70 2026-02-24T19:24:24.671 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:24:24.672 INFO:teuthology.orchestra.run.trial026.stderr:dumped all 2026-02-24T19:24:24.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.669+0000 7fc204afe640 10 librados: watch_flush enter 2026-02-24T19:24:24.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.669+0000 7fc204afe640 10 librados: watch_flush exit 2026-02-24T19:24:24.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.669+0000 7fc204afe640 20 client.29942.objecter shutdown clearing up homeless session... 2026-02-24T19:24:24.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.669+0000 7fc204afe640 10 client.29942.objecter successfully canceled tick 2026-02-24T19:24:24.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.669+0000 7fc204afe640 1 -- 10.20.193.26:0/2329736960 >> v1:10.20.193.162:6800/3889602630 conn(0x7fc1cc077e70 legacy=0x7fc1cc098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:24.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.669+0000 7fc204afe640 10 monclient: shutdown 2026-02-24T19:24:24.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.669+0000 7fc204afe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:24.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.669+0000 7fc204afe640 1 -- 10.20.193.26:0/2329736960 >> v1:10.20.193.103:6789/0 conn(0x7fc2000b0410 legacy=0x7fc2001fd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:24.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.669+0000 7fc204afe640 1 -- 10.20.193.26:0/2329736960 shutdown_connections 2026-02-24T19:24:24.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.669+0000 7fc204afe640 1 -- 10.20.193.26:0/2329736960 >> 10.20.193.26:0/2329736960 conn(0x7fc2000b65f0 msgr2=0x7fc2000b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:24.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.669+0000 7fc204afe640 1 -- 10.20.193.26:0/2329736960 shutdown_connections 2026-02-24T19:24:24.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.669+0000 7fc204afe640 1 -- 10.20.193.26:0/2329736960 wait complete. 2026-02-24T19:24:24.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.670+0000 7fc204afe640 1 librados: shutdown 2026-02-24T19:24:24.679 INFO:teuthology.orchestra.run.trial026.stdout:{"pg_ready":true,"pg_map":{"version":543,"stamp":"2026-02-24T19:24:23.880107+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":559680,"kb_used_data":110272,"kb_used_omap":25576,"kb_used_meta":423575,"kb_avail":1509389760,"statfs":{"total":1546188226560,"available":1545615114240,"internally_reserved":0,"allocated":112918528,"data_stored":69901870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26190805,"internal_metadata":433740843},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.766697"},"pg_stats":[{"pgid":"9.15","version":"0'0","reported_seq":628,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:20.723651+0000","last_change":"2026-02-24T19:18:45.993805+0000","last_active":"2026-02-24T19:24:20.723651+0000","last_peered":"2026-02-24T19:24:20.723651+0000","last_clean":"2026-02-24T19:24:20.723651+0000","last_became_active":"2026-02-24T19:18:45.991617+0000","last_became_peered":"2026-02-24T19:18:45.991617+0000","last_unstale":"2026-02-24T19:24:20.723651+0000","last_undegraded":"2026-02-24T19:24:20.723651+0000","last_fullsized":"2026-02-24T19:24:20.723651+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:00:31.861264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":627,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.176272+0000","last_change":"2026-02-24T19:18:45.686747+0000","last_active":"2026-02-24T19:24:19.176272+0000","last_peered":"2026-02-24T19:24:19.176272+0000","last_clean":"2026-02-24T19:24:19.176272+0000","last_became_active":"2026-02-24T19:18:45.681436+0000","last_became_peered":"2026-02-24T19:18:45.681436+0000","last_unstale":"2026-02-24T19:24:19.176272+0000","last_undegraded":"2026-02-24T19:24:19.176272+0000","last_fullsized":"2026-02-24T19:24:19.176272+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:49:11.919250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":632,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.227313+0000","last_change":"2026-02-24T19:18:46.870170+0000","last_active":"2026-02-24T19:24:21.227313+0000","last_peered":"2026-02-24T19:24:21.227313+0000","last_clean":"2026-02-24T19:24:21.227313+0000","last_became_active":"2026-02-24T19:18:46.867835+0000","last_became_peered":"2026-02-24T19:18:46.867835+0000","last_unstale":"2026-02-24T19:24:21.227313+0000","last_undegraded":"2026-02-24T19:24:21.227313+0000","last_fullsized":"2026-02-24T19:24:21.227313+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:26:18.415712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":626,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.557518+0000","last_change":"2026-02-24T19:18:46.457667+0000","last_active":"2026-02-24T19:24:21.557518+0000","last_peered":"2026-02-24T19:24:21.557518+0000","last_clean":"2026-02-24T19:24:21.557518+0000","last_became_active":"2026-02-24T19:18:46.452160+0000","last_became_peered":"2026-02-24T19:18:46.452160+0000","last_unstale":"2026-02-24T19:24:21.557518+0000","last_undegraded":"2026-02-24T19:24:21.557518+0000","last_fullsized":"2026-02-24T19:24:21.557518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:59:23.251747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":627,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.181177+0000","last_change":"2026-02-24T19:18:46.510024+0000","last_active":"2026-02-24T19:24:19.181177+0000","last_peered":"2026-02-24T19:24:19.181177+0000","last_clean":"2026-02-24T19:24:19.181177+0000","last_became_active":"2026-02-24T19:18:46.482414+0000","last_became_peered":"2026-02-24T19:18:46.482414+0000","last_unstale":"2026-02-24T19:24:19.181177+0000","last_undegraded":"2026-02-24T19:24:19.181177+0000","last_fullsized":"2026-02-24T19:24:19.181177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:12:29.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,13],"acting":[14,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":627,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.553723+0000","last_change":"2026-02-24T19:18:45.879863+0000","last_active":"2026-02-24T19:24:21.553723+0000","last_peered":"2026-02-24T19:24:21.553723+0000","last_clean":"2026-02-24T19:24:21.553723+0000","last_became_active":"2026-02-24T19:18:45.877648+0000","last_became_peered":"2026-02-24T19:18:45.877648+0000","last_unstale":"2026-02-24T19:24:21.553723+0000","last_undegraded":"2026-02-24T19:24:21.553723+0000","last_fullsized":"2026-02-24T19:24:21.553723+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:15:47.469119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":632,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.224638+0000","last_change":"2026-02-24T19:18:45.539139+0000","last_active":"2026-02-24T19:24:21.224638+0000","last_peered":"2026-02-24T19:24:21.224638+0000","last_clean":"2026-02-24T19:24:21.224638+0000","last_became_active":"2026-02-24T19:18:45.537014+0000","last_became_peered":"2026-02-24T19:18:45.537014+0000","last_unstale":"2026-02-24T19:24:21.224638+0000","last_undegraded":"2026-02-24T19:24:21.224638+0000","last_fullsized":"2026-02-24T19:24:21.224638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:53:12.241320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":631,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.458262+0000","last_change":"2026-02-24T19:18:46.437120+0000","last_active":"2026-02-24T19:24:21.458262+0000","last_peered":"2026-02-24T19:24:21.458262+0000","last_clean":"2026-02-24T19:24:21.458262+0000","last_became_active":"2026-02-24T19:18:46.435006+0000","last_became_peered":"2026-02-24T19:18:46.435006+0000","last_unstale":"2026-02-24T19:24:21.458262+0000","last_undegraded":"2026-02-24T19:24:21.458262+0000","last_fullsized":"2026-02-24T19:24:21.458262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:07:13.215303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,0],"acting":[12,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":624,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.128989+0000","last_change":"2026-02-24T19:18:47.214595+0000","last_active":"2026-02-24T19:24:19.128989+0000","last_peered":"2026-02-24T19:24:19.128989+0000","last_clean":"2026-02-24T19:24:19.128989+0000","last_became_active":"2026-02-24T19:18:47.212334+0000","last_became_peered":"2026-02-24T19:18:47.212334+0000","last_unstale":"2026-02-24T19:24:19.128989+0000","last_undegraded":"2026-02-24T19:24:19.128989+0000","last_fullsized":"2026-02-24T19:24:19.128989+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:28:19.454092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":630,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.480787+0000","last_change":"2026-02-24T19:18:45.704988+0000","last_active":"2026-02-24T19:24:21.480787+0000","last_peered":"2026-02-24T19:24:21.480787+0000","last_clean":"2026-02-24T19:24:21.480787+0000","last_became_active":"2026-02-24T19:18:45.702531+0000","last_became_peered":"2026-02-24T19:18:45.702531+0000","last_unstale":"2026-02-24T19:24:21.480787+0000","last_undegraded":"2026-02-24T19:24:21.480787+0000","last_fullsized":"2026-02-24T19:24:21.480787+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:40:40.455743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0],"acting":[10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":624,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.246402+0000","last_change":"2026-02-24T19:18:45.247267+0000","last_active":"2026-02-24T19:24:19.246402+0000","last_peered":"2026-02-24T19:24:19.246402+0000","last_clean":"2026-02-24T19:24:19.246402+0000","last_became_active":"2026-02-24T19:18:45.245053+0000","last_became_peered":"2026-02-24T19:18:45.245053+0000","last_unstale":"2026-02-24T19:24:19.246402+0000","last_undegraded":"2026-02-24T19:24:19.246402+0000","last_fullsized":"2026-02-24T19:24:19.246402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:11:55.548126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":632,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.225496+0000","last_change":"2026-02-24T19:18:45.470833+0000","last_active":"2026-02-24T19:24:21.225496+0000","last_peered":"2026-02-24T19:24:21.225496+0000","last_clean":"2026-02-24T19:24:21.225496+0000","last_became_active":"2026-02-24T19:18:45.468683+0000","last_became_peered":"2026-02-24T19:18:45.468683+0000","last_unstale":"2026-02-24T19:24:21.225496+0000","last_undegraded":"2026-02-24T19:24:21.225496+0000","last_fullsized":"2026-02-24T19:24:21.225496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:29:30.418354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":630,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:20.103133+0000","last_change":"2026-02-24T19:18:45.264091+0000","last_active":"2026-02-24T19:24:20.103133+0000","last_peered":"2026-02-24T19:24:20.103133+0000","last_clean":"2026-02-24T19:24:20.103133+0000","last_became_active":"2026-02-24T19:18:45.260524+0000","last_became_peered":"2026-02-24T19:18:45.260524+0000","last_unstale":"2026-02-24T19:24:20.103133+0000","last_undegraded":"2026-02-24T19:24:20.103133+0000","last_fullsized":"2026-02-24T19:24:20.103133+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:28:01.882056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":643,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.559025+0000","last_change":"2026-02-24T19:18:07.814826+0000","last_active":"2026-02-24T19:24:21.559025+0000","last_peered":"2026-02-24T19:24:21.559025+0000","last_clean":"2026-02-24T19:24:21.559025+0000","last_became_active":"2026-02-24T19:18:06.131387+0000","last_became_peered":"2026-02-24T19:18:06.131387+0000","last_unstale":"2026-02-24T19:24:21.559025+0000","last_undegraded":"2026-02-24T19:24:21.559025+0000","last_fullsized":"2026-02-24T19:24:21.559025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:38:29.559020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060150395000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":627,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:20.704257+0000","last_change":"2026-02-24T19:18:46.022578+0000","last_active":"2026-02-24T19:24:20.704257+0000","last_peered":"2026-02-24T19:24:20.704257+0000","last_clean":"2026-02-24T19:24:20.704257+0000","last_became_active":"2026-02-24T19:18:46.019677+0000","last_became_peered":"2026-02-24T19:18:46.019677+0000","last_unstale":"2026-02-24T19:24:20.704257+0000","last_undegraded":"2026-02-24T19:24:20.704257+0000","last_fullsized":"2026-02-24T19:24:20.704257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:32:42.029209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,13],"acting":[6,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":648,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.217952+0000","last_change":"2026-02-24T19:18:08.286588+0000","last_active":"2026-02-24T19:24:21.217952+0000","last_peered":"2026-02-24T19:24:21.217952+0000","last_clean":"2026-02-24T19:24:21.217952+0000","last_became_active":"2026-02-24T19:18:05.714006+0000","last_became_peered":"2026-02-24T19:18:05.714006+0000","last_unstale":"2026-02-24T19:24:21.217952+0000","last_undegraded":"2026-02-24T19:24:21.217952+0000","last_fullsized":"2026-02-24T19:24:21.217952+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:57:02.402866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030292255000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,10],"acting":[15,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":630,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.477610+0000","last_change":"2026-02-24T19:18:46.052119+0000","last_active":"2026-02-24T19:24:21.477610+0000","last_peered":"2026-02-24T19:24:21.477610+0000","last_clean":"2026-02-24T19:24:21.477610+0000","last_became_active":"2026-02-24T19:18:46.049357+0000","last_became_peered":"2026-02-24T19:18:46.049357+0000","last_unstale":"2026-02-24T19:24:21.477610+0000","last_undegraded":"2026-02-24T19:24:21.477610+0000","last_fullsized":"2026-02-24T19:24:21.477610+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:14:48.414481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,7],"acting":[10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":645,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.180858+0000","last_change":"2026-02-24T19:18:07.750038+0000","last_active":"2026-02-24T19:24:19.180858+0000","last_peered":"2026-02-24T19:24:19.180858+0000","last_clean":"2026-02-24T19:24:19.180858+0000","last_became_active":"2026-02-24T19:18:06.025485+0000","last_became_peered":"2026-02-24T19:18:06.025485+0000","last_unstale":"2026-02-24T19:24:19.180858+0000","last_undegraded":"2026-02-24T19:24:19.180858+0000","last_fullsized":"2026-02-24T19:24:19.180858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:00:12.835602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.040704530000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":627,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:20.708188+0000","last_change":"2026-02-24T19:18:45.751018+0000","last_active":"2026-02-24T19:24:20.708188+0000","last_peered":"2026-02-24T19:24:20.708188+0000","last_clean":"2026-02-24T19:24:20.708188+0000","last_became_active":"2026-02-24T19:18:45.739451+0000","last_became_peered":"2026-02-24T19:18:45.739451+0000","last_unstale":"2026-02-24T19:24:20.708188+0000","last_undegraded":"2026-02-24T19:24:20.708188+0000","last_fullsized":"2026-02-24T19:24:20.708188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:58:38.717085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":645,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.175707+0000","last_change":"2026-02-24T19:18:07.747179+0000","last_active":"2026-02-24T19:24:19.175707+0000","last_peered":"2026-02-24T19:24:19.175707+0000","last_clean":"2026-02-24T19:24:19.175707+0000","last_became_active":"2026-02-24T19:18:05.911513+0000","last_became_peered":"2026-02-24T19:18:05.911513+0000","last_unstale":"2026-02-24T19:24:19.175707+0000","last_undegraded":"2026-02-24T19:24:19.175707+0000","last_fullsized":"2026-02-24T19:24:19.175707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:16:20.335977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027602962000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":629,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.545191+0000","last_change":"2026-02-24T19:18:45.328853+0000","last_active":"2026-02-24T19:24:21.545191+0000","last_peered":"2026-02-24T19:24:21.545191+0000","last_clean":"2026-02-24T19:24:21.545191+0000","last_became_active":"2026-02-24T19:18:45.316395+0000","last_became_peered":"2026-02-24T19:18:45.316395+0000","last_unstale":"2026-02-24T19:24:21.545191+0000","last_undegraded":"2026-02-24T19:24:21.545191+0000","last_fullsized":"2026-02-24T19:24:21.545191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:15:16.945455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.2","version":"29'2","reported_seq":646,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.553089+0000","last_change":"2026-02-24T19:18:07.812765+0000","last_active":"2026-02-24T19:24:21.553089+0000","last_peered":"2026-02-24T19:24:21.553089+0000","last_clean":"2026-02-24T19:24:21.553089+0000","last_became_active":"2026-02-24T19:18:06.102285+0000","last_became_peered":"2026-02-24T19:18:06.102285+0000","last_unstale":"2026-02-24T19:24:21.553089+0000","last_undegraded":"2026-02-24T19:24:21.553089+0000","last_fullsized":"2026-02-24T19:24:21.553089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T07:17:19.620766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071463911000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":626,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.553628+0000","last_change":"2026-02-24T19:18:46.227053+0000","last_active":"2026-02-24T19:24:21.553628+0000","last_peered":"2026-02-24T19:24:21.553628+0000","last_clean":"2026-02-24T19:24:21.553628+0000","last_became_active":"2026-02-24T19:18:46.224954+0000","last_became_peered":"2026-02-24T19:18:46.224954+0000","last_unstale":"2026-02-24T19:24:21.553628+0000","last_undegraded":"2026-02-24T19:24:21.553628+0000","last_fullsized":"2026-02-24T19:24:21.553628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:09:45.760181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":647,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.544073+0000","last_change":"2026-02-24T19:18:08.293695+0000","last_active":"2026-02-24T19:24:21.544073+0000","last_peered":"2026-02-24T19:24:21.544073+0000","last_clean":"2026-02-24T19:24:21.544073+0000","last_became_active":"2026-02-24T19:18:06.040390+0000","last_became_peered":"2026-02-24T19:18:06.040390+0000","last_unstale":"2026-02-24T19:24:21.544073+0000","last_undegraded":"2026-02-24T19:24:21.544073+0000","last_fullsized":"2026-02-24T19:24:21.544073+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:59:15.837152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.035880255999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":624,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.124087+0000","last_change":"2026-02-24T19:18:45.635906+0000","last_active":"2026-02-24T19:24:19.124087+0000","last_peered":"2026-02-24T19:24:19.124087+0000","last_clean":"2026-02-24T19:24:19.124087+0000","last_became_active":"2026-02-24T19:18:45.633612+0000","last_became_peered":"2026-02-24T19:18:45.633612+0000","last_unstale":"2026-02-24T19:24:19.124087+0000","last_undegraded":"2026-02-24T19:24:19.124087+0000","last_fullsized":"2026-02-24T19:24:19.124087+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:04:11.968601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":645,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:20.706417+0000","last_change":"2026-02-24T19:18:08.371822+0000","last_active":"2026-02-24T19:24:20.706417+0000","last_peered":"2026-02-24T19:24:20.706417+0000","last_clean":"2026-02-24T19:24:20.706417+0000","last_became_active":"2026-02-24T19:18:05.913043+0000","last_became_peered":"2026-02-24T19:18:05.913043+0000","last_unstale":"2026-02-24T19:24:20.706417+0000","last_undegraded":"2026-02-24T19:24:20.706417+0000","last_fullsized":"2026-02-24T19:24:20.706417+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:07:35.933859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030508101999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":628,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.219143+0000","last_change":"2026-02-24T19:18:46.152118+0000","last_active":"2026-02-24T19:24:21.219143+0000","last_peered":"2026-02-24T19:24:21.219143+0000","last_clean":"2026-02-24T19:24:21.219143+0000","last_became_active":"2026-02-24T19:18:46.150051+0000","last_became_peered":"2026-02-24T19:18:46.150051+0000","last_unstale":"2026-02-24T19:24:21.219143+0000","last_undegraded":"2026-02-24T19:24:21.219143+0000","last_fullsized":"2026-02-24T19:24:21.219143+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:17:04.915264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":645,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.556517+0000","last_change":"2026-02-24T19:18:07.773906+0000","last_active":"2026-02-24T19:24:21.556517+0000","last_peered":"2026-02-24T19:24:21.556517+0000","last_clean":"2026-02-24T19:24:21.556517+0000","last_became_active":"2026-02-24T19:18:05.910166+0000","last_became_peered":"2026-02-24T19:18:05.910166+0000","last_unstale":"2026-02-24T19:24:21.556517+0000","last_undegraded":"2026-02-24T19:24:21.556517+0000","last_fullsized":"2026-02-24T19:24:21.556517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:39:15.323606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036726662,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'32","reported_seq":694,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.457317+0000","last_change":"2026-02-24T19:17:58.600915+0000","last_active":"2026-02-24T19:24:21.457317+0000","last_peered":"2026-02-24T19:24:21.457317+0000","last_clean":"2026-02-24T19:24:21.457317+0000","last_became_active":"2026-02-24T19:17:58.584752+0000","last_became_peered":"2026-02-24T19:17:58.584752+0000","last_unstale":"2026-02-24T19:24:21.457317+0000","last_undegraded":"2026-02-24T19:24:21.457317+0000","last_fullsized":"2026-02-24T19:24:21.457317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:57.017986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:57.017986+0000","last_clean_scrub_stamp":"2026-02-24T19:17:57.017986+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:48:59.744548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,10],"acting":[12,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":630,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:20.101420+0000","last_change":"2026-02-24T19:18:45.767728+0000","last_active":"2026-02-24T19:24:20.101420+0000","last_peered":"2026-02-24T19:24:20.101420+0000","last_clean":"2026-02-24T19:24:20.101420+0000","last_became_active":"2026-02-24T19:18:45.762826+0000","last_became_peered":"2026-02-24T19:18:45.762826+0000","last_unstale":"2026-02-24T19:24:20.101420+0000","last_undegraded":"2026-02-24T19:24:20.101420+0000","last_fullsized":"2026-02-24T19:24:20.101420+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:51:03.107522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,13],"acting":[5,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":627,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:20.120006+0000","last_change":"2026-02-24T19:18:45.851171+0000","last_active":"2026-02-24T19:24:20.120006+0000","last_peered":"2026-02-24T19:24:20.120006+0000","last_clean":"2026-02-24T19:24:20.120006+0000","last_became_active":"2026-02-24T19:18:45.848885+0000","last_became_peered":"2026-02-24T19:18:45.848885+0000","last_unstale":"2026-02-24T19:24:20.120006+0000","last_undegraded":"2026-02-24T19:24:20.120006+0000","last_fullsized":"2026-02-24T19:24:20.120006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:33:05.467412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,12],"acting":[7,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":632,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.219572+0000","last_change":"2026-02-24T19:18:45.779094+0000","last_active":"2026-02-24T19:24:21.219572+0000","last_peered":"2026-02-24T19:24:21.219572+0000","last_clean":"2026-02-24T19:24:21.219572+0000","last_became_active":"2026-02-24T19:18:45.776560+0000","last_became_peered":"2026-02-24T19:18:45.776560+0000","last_unstale":"2026-02-24T19:24:21.219572+0000","last_undegraded":"2026-02-24T19:24:21.219572+0000","last_fullsized":"2026-02-24T19:24:21.219572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:41:36.699391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"9.1","version":"34'11","reported_seq":650,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.114808+0000","last_change":"2026-02-24T19:18:47.225931+0000","last_active":"2026-02-24T19:24:19.114808+0000","last_peered":"2026-02-24T19:24:19.114808+0000","last_clean":"2026-02-24T19:24:19.114808+0000","last_became_active":"2026-02-24T19:18:47.223324+0000","last_became_peered":"2026-02-24T19:18:47.223324+0000","last_unstale":"2026-02-24T19:24:19.114808+0000","last_undegraded":"2026-02-24T19:24:19.114808+0000","last_fullsized":"2026-02-24T19:24:19.114808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:12:24.845087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":627,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.184070+0000","last_change":"2026-02-24T19:18:46.077881+0000","last_active":"2026-02-24T19:24:19.184070+0000","last_peered":"2026-02-24T19:24:19.184070+0000","last_clean":"2026-02-24T19:24:19.184070+0000","last_became_active":"2026-02-24T19:18:46.075425+0000","last_became_peered":"2026-02-24T19:18:46.075425+0000","last_unstale":"2026-02-24T19:24:19.184070+0000","last_undegraded":"2026-02-24T19:24:19.184070+0000","last_fullsized":"2026-02-24T19:24:19.184070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:23:06.041454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,8],"acting":[14,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":627,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.188045+0000","last_change":"2026-02-24T19:18:45.984836+0000","last_active":"2026-02-24T19:24:19.188045+0000","last_peered":"2026-02-24T19:24:19.188045+0000","last_clean":"2026-02-24T19:24:19.188045+0000","last_became_active":"2026-02-24T19:18:45.978376+0000","last_became_peered":"2026-02-24T19:18:45.978376+0000","last_unstale":"2026-02-24T19:24:19.188045+0000","last_undegraded":"2026-02-24T19:24:19.188045+0000","last_fullsized":"2026-02-24T19:24:19.188045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:43:57.738043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,9],"acting":[14,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":627,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.182763+0000","last_change":"2026-02-24T19:18:46.028144+0000","last_active":"2026-02-24T19:24:19.182763+0000","last_peered":"2026-02-24T19:24:19.182763+0000","last_clean":"2026-02-24T19:24:19.182763+0000","last_became_active":"2026-02-24T19:18:46.025768+0000","last_became_peered":"2026-02-24T19:18:46.025768+0000","last_unstale":"2026-02-24T19:24:19.182763+0000","last_undegraded":"2026-02-24T19:24:19.182763+0000","last_fullsized":"2026-02-24T19:24:19.182763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:49:38.486896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,8],"acting":[14,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":627,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:20.122830+0000","last_change":"2026-02-24T19:18:45.820589+0000","last_active":"2026-02-24T19:24:20.122830+0000","last_peered":"2026-02-24T19:24:20.122830+0000","last_clean":"2026-02-24T19:24:20.122830+0000","last_became_active":"2026-02-24T19:18:45.818087+0000","last_became_peered":"2026-02-24T19:18:45.818087+0000","last_unstale":"2026-02-24T19:24:20.122830+0000","last_undegraded":"2026-02-24T19:24:20.122830+0000","last_fullsized":"2026-02-24T19:24:20.122830+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:57:48.688473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,12],"acting":[7,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":627,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.168828+0000","last_change":"2026-02-24T19:18:45.323793+0000","last_active":"2026-02-24T19:24:19.168828+0000","last_peered":"2026-02-24T19:24:19.168828+0000","last_clean":"2026-02-24T19:24:19.168828+0000","last_became_active":"2026-02-24T19:18:45.320912+0000","last_became_peered":"2026-02-24T19:18:45.320912+0000","last_unstale":"2026-02-24T19:24:19.168828+0000","last_undegraded":"2026-02-24T19:24:19.168828+0000","last_fullsized":"2026-02-24T19:24:19.168828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:36:16.467243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":628,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.221559+0000","last_change":"2026-02-24T19:18:45.406813+0000","last_active":"2026-02-24T19:24:21.221559+0000","last_peered":"2026-02-24T19:24:21.221559+0000","last_clean":"2026-02-24T19:24:21.221559+0000","last_became_active":"2026-02-24T19:18:45.399050+0000","last_became_peered":"2026-02-24T19:18:45.399050+0000","last_unstale":"2026-02-24T19:24:21.221559+0000","last_undegraded":"2026-02-24T19:24:21.221559+0000","last_fullsized":"2026-02-24T19:24:21.221559+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:31:08.031303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":628,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:20.719206+0000","last_change":"2026-02-24T19:18:45.727292+0000","last_active":"2026-02-24T19:24:20.719206+0000","last_peered":"2026-02-24T19:24:20.719206+0000","last_clean":"2026-02-24T19:24:20.719206+0000","last_became_active":"2026-02-24T19:18:45.721374+0000","last_became_peered":"2026-02-24T19:18:45.721374+0000","last_unstale":"2026-02-24T19:24:20.719206+0000","last_undegraded":"2026-02-24T19:24:20.719206+0000","last_fullsized":"2026-02-24T19:24:20.719206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:41:57.598852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,6],"acting":[13,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":627,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.169913+0000","last_change":"2026-02-24T19:18:45.558833+0000","last_active":"2026-02-24T19:24:19.169913+0000","last_peered":"2026-02-24T19:24:19.169913+0000","last_clean":"2026-02-24T19:24:19.169913+0000","last_became_active":"2026-02-24T19:18:45.553944+0000","last_became_peered":"2026-02-24T19:18:45.553944+0000","last_unstale":"2026-02-24T19:24:19.169913+0000","last_undegraded":"2026-02-24T19:24:19.169913+0000","last_fullsized":"2026-02-24T19:24:19.169913+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:02:54.257449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,13],"acting":[9,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":15},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":21,"seq":90194313296,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33828,"kb_used_data":6868,"kb_used_omap":212,"kb_used_meta":26731,"kb_avail":94338012,"statfs":{"total":96636764160,"available":96602124288,"internally_reserved":0,"allocated":7032832,"data_stored":4337010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":217625,"internal_metadata":27373031},"hb_peers":[0,2,3,4,6,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313295,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33796,"kb_used_data":6836,"kb_used_omap":3017,"kb_used_meta":23926,"kb_avail":94338044,"statfs":{"total":96636764160,"available":96602157056,"internally_reserved":0,"allocated":7000064,"data_stored":4315440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3089424,"internal_metadata":24501232},"hb_peers":[0,1,2,5,6,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313295,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":211,"kb_used_meta":26732,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4324823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":216553,"internal_metadata":27374103},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313295,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33800,"kb_used_data":6840,"kb_used_omap":206,"kb_used_meta":26737,"kb_avail":94338040,"statfs":{"total":96636764160,"available":96602152960,"internally_reserved":0,"allocated":7004160,"data_stored":4315445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":211771,"internal_metadata":27378885},"hb_peers":[1,3,4,5,6,7,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313296,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33796,"kb_used_data":6836,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94338044,"statfs":{"total":96636764160,"available":96602157056,"internally_reserved":0,"allocated":7000064,"data_stored":4315440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":214072,"internal_metadata":27376584},"hb_peers":[0,2,4,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313295,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51844,"kb_used_data":6836,"kb_used_omap":107,"kb_used_meta":44884,"kb_avail":94319996,"statfs":{"total":96636764160,"available":96583675904,"internally_reserved":0,"allocated":7000064,"data_stored":4315440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":110577,"internal_metadata":45961231},"hb_peers":[0,1,3,5,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313295,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":5821,"kb_used_meta":21122,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4324842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5960958,"internal_metadata":21629698},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313295,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33796,"kb_used_data":6836,"kb_used_omap":98,"kb_used_meta":26845,"kb_avail":94338044,"statfs":{"total":96636764160,"available":96602157056,"internally_reserved":0,"allocated":7000064,"data_stored":4315440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":100579,"internal_metadata":27490077},"hb_peers":[0,1,3,5,6,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313296,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":210,"kb_used_meta":26733,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4324823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":215533,"internal_metadata":27375123},"hb_peers":[0,1,4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313295,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33796,"kb_used_data":6836,"kb_used_omap":8631,"kb_used_meta":18312,"kb_avail":94338044,"statfs":{"total":96636764160,"available":96602157056,"internally_reserved":0,"allocated":7000064,"data_stored":4315440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8839068,"internal_metadata":18751588},"hb_peers":[1,2,4,5,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313295,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":208,"kb_used_meta":26735,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4324823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":213278,"internal_metadata":27377378},"hb_peers":[0,2,3,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313295,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33796,"kb_used_data":6836,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94338044,"statfs":{"total":96636764160,"available":96602157056,"internally_reserved":0,"allocated":7000064,"data_stored":4315440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":214294,"internal_metadata":27376362},"hb_peers":[0,1,2,3,4,5,6,7,9,10,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313295,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33796,"kb_used_data":6836,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94338044,"statfs":{"total":96636764160,"available":96602157056,"internally_reserved":0,"allocated":7000064,"data_stored":4315440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":214309,"internal_metadata":27376347},"hb_peers":[0,1,2,3,4,5,7,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313296,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34188,"kb_used_data":7228,"kb_used_omap":5827,"kb_used_meta":21116,"kb_avail":94337652,"statfs":{"total":96636764160,"available":96601755648,"internally_reserved":0,"allocated":7401472,"data_stored":4713280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5967048,"internal_metadata":21623608},"hb_peers":[0,1,3,4,5,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313296,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33804,"kb_used_data":6844,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94338036,"statfs":{"total":96636764160,"available":96602148864,"internally_reserved":0,"allocated":7008256,"data_stored":4315464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":215036,"internal_metadata":27375620},"hb_peers":[0,1,3,4,5,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313295,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34188,"kb_used_data":7228,"kb_used_omap":186,"kb_used_meta":26757,"kb_avail":94337652,"statfs":{"total":96636764160,"available":96601755648,"internally_reserved":0,"allocated":7401472,"data_stored":4713280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":190680,"internal_metadata":27399976},"hb_peers":[0,1,2,3,4,5,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T19:24:24.683 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T19:24:24.755 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.753+0000 7fb9a4416640 10 monclient: get_monmap_and_config 2026-02-24T19:24:24.755 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.753+0000 7fb9a4416640 10 monclient: build_initial_monmap 2026-02-24T19:24:24.755 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.753+0000 7fb9a4416640 10 monclient: monmap: 2026-02-24T19:24:24.755 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:24.755 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:24.755 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:24.754356+0000 2026-02-24T19:24:24.755 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:24.754356+0000 2026-02-24T19:24:24.756 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:24.756 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:24.756 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:24.756 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:24.756 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:24.756 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:24.758 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.754+0000 7fb9a4416640 1 Processor -- start 2026-02-24T19:24:24.759 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.754+0000 7fb9a4416640 1 -- start start 2026-02-24T19:24:24.759 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.754+0000 7fb9a4416640 10 monclient: init 2026-02-24T19:24:24.759 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.754+0000 7fb9a4416640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:24.759 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.754+0000 7fb9a4416640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:24.759 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.754+0000 7fb9a4416640 10 monclient(hunting): picked mon.noname-a con 0x7fb99c058da0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:24.759 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.754+0000 7fb9a4416640 10 monclient(hunting): picked mon.noname-c con 0x7fb99c0b0410 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:24.759 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.754+0000 7fb9a4416640 10 monclient(hunting): picked mon.noname-b con 0x7fb99c1626a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:24.759 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.754+0000 7fb9a4416640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb99c1655c0 con 0x7fb99c058da0 2026-02-24T19:24:24.759 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.754+0000 7fb9a4416640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb99c0b12b0 con 0x7fb99c1626a0 2026-02-24T19:24:24.759 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.754+0000 7fb9a4416640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb99c0b1590 con 0x7fb99c0b0410 2026-02-24T19:24:24.759 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.754+0000 7fb9a4416640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:24.760 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.754+0000 7fb9a4416640 10 monclient(hunting): authenticate will time out at 4047.436736s 2026-02-24T19:24:24.760 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.755+0000 7fb9a198a640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fb99c0b0410 0x7fb99c164eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58156/0 (socket says 10.20.193.26:58156) 2026-02-24T19:24:24.760 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.755+0000 7fb9a198a640 1 -- 10.20.193.26:0/467346680 learned_addr learned my addr 10.20.193.26:0/467346680 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:24.760 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.756+0000 7fb9a1189640 1 -- 10.20.193.26:0/467346680 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3382848695 0 0) 0x7fb99c0b1590 con 0x7fb99c0b0410 2026-02-24T19:24:24.760 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.756+0000 7fb9a1189640 10 monclient(hunting): _negotiate 2026-02-24T19:24:24.760 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.756+0000 7fb9a1189640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:24.760 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.756+0000 7fb9a1189640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:24.760 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.756+0000 7fb9a1189640 10 monclient(hunting): my global_id is 29945 2026-02-24T19:24:24.760 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.756+0000 7fb9a1189640 1 -- 10.20.193.26:0/467346680 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb984003610 con 0x7fb99c0b0410 2026-02-24T19:24:24.760 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.756+0000 7fb9a1189640 1 -- 10.20.193.26:0/467346680 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2363680719 0 0) 0x7fb99c1655c0 con 0x7fb99c058da0 2026-02-24T19:24:24.760 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.756+0000 7fb9a1189640 10 monclient(hunting): _negotiate 2026-02-24T19:24:24.760 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.756+0000 7fb9a1189640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:24.760 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.756+0000 7fb9a1189640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:24.761 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.756+0000 7fb9a1189640 10 monclient(hunting): my global_id is 30609 2026-02-24T19:24:24.761 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.756+0000 7fb9a1189640 1 -- 10.20.193.26:0/467346680 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb99c0b1590 con 0x7fb99c058da0 2026-02-24T19:24:24.761 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.756+0000 7fb9a1189640 1 -- 10.20.193.26:0/467346680 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1063951012 0 0) 0x7fb99c0b12b0 con 0x7fb99c1626a0 2026-02-24T19:24:24.761 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.756+0000 7fb9a1189640 10 monclient(hunting): _negotiate 2026-02-24T19:24:24.761 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.756+0000 7fb9a1189640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:24.761 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.756+0000 7fb9a1189640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:24.761 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.756+0000 7fb9a1189640 10 monclient(hunting): my global_id is 28021 2026-02-24T19:24:24.761 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.756+0000 7fb9a1189640 1 -- 10.20.193.26:0/467346680 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb99c1655c0 con 0x7fb99c1626a0 2026-02-24T19:24:24.766 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.758+0000 7fb9a1189640 1 -- 10.20.193.26:0/467346680 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3391293570 0 0) 0x7fb984003610 con 0x7fb99c0b0410 2026-02-24T19:24:24.767 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.758+0000 7fb9a1189640 1 -- 10.20.193.26:0/467346680 >> v1:10.20.193.70:6789/0 conn(0x7fb99c1626a0 legacy=0x7fb99c1c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:24.767 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.758+0000 7fb9a1189640 1 -- 10.20.193.26:0/467346680 >> v1:10.20.193.26:6789/0 conn(0x7fb99c058da0 legacy=0x7fb99c1647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:24.767 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.758+0000 7fb9a1189640 10 monclient: _finish_hunting 0 2026-02-24T19:24:24.767 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.758+0000 7fb9a1189640 1 monclient: found mon.noname-c 2026-02-24T19:24:24.767 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.758+0000 7fb9a1189640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:24.767 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.758+0000 7fb9a1189640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:24:24.767 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.758+0000 7fb9a1189640 1 -- 10.20.193.26:0/467346680 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99c0b1870 con 0x7fb99c0b0410 2026-02-24T19:24:24.767 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.758+0000 7fb9a1189640 10 monclient: _finish_auth 0 2026-02-24T19:24:24.767 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.758+0000 7fb9a1189640 10 monclient: _check_auth_tickets 2026-02-24T19:24:24.767 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.758+0000 7fb9a1189640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:24.767 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.758+0000 7fb9a1189640 1 -- 10.20.193.26:0/467346680 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fb990002df0 con 0x7fb99c0b0410 2026-02-24T19:24:24.768 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.758+0000 7fb9a1189640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:24.768 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.758+0000 7fb9a1189640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:24.768 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.758+0000 7fb9a1189640 10 monclient: dump: 2026-02-24T19:24:24.768 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:24.768 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:24.768 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:24.768 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:24.768 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:24.768 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:24.768 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:24.768 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:24.768 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:24.769 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:24.769 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.758+0000 7fb9a4416640 5 monclient: authenticate success, global_id 29945 2026-02-24T19:24:24.769 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.758+0000 7fb9a4416640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:24.769 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.759+0000 7fb9a1189640 1 -- 10.20.193.26:0/467346680 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb990002fc0 con 0x7fb99c0b0410 2026-02-24T19:24:24.769 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.759+0000 7fb9a1189640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:24.769 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.759+0000 7fb9a1189640 1 -- 10.20.193.26:0/467346680 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fb990003400 con 0x7fb99c0b0410 2026-02-24T19:24:24.769 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.759+0000 7fb9a1189640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:24.769 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.759+0000 7fb9a1189640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:24.769 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.759+0000 7fb9a1189640 10 monclient: dump: 2026-02-24T19:24:24.769 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:24.769 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:24.769 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:24.769 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:24.770 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:24.770 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:24.770 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:24.770 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:24.770 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:24.770 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:24.770 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.759+0000 7fb9a4416640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:24.770 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.759+0000 7fb9a4416640 4 set_mon_vals no callback set 2026-02-24T19:24:24.770 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.759+0000 7fb9a4416640 10 monclient: shutdown 2026-02-24T19:24:24.770 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.759+0000 7fb9a4416640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:24.770 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.759+0000 7fb9a4416640 1 -- 10.20.193.26:0/467346680 >> v1:10.20.193.103:6789/0 conn(0x7fb99c0b0410 legacy=0x7fb99c164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:24.770 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.759+0000 7fb9a4416640 1 -- 10.20.193.26:0/467346680 shutdown_connections 2026-02-24T19:24:24.771 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.759+0000 7fb9a4416640 1 -- 10.20.193.26:0/467346680 >> 10.20.193.26:0/467346680 conn(0x7fb99c0b65f0 msgr2=0x7fb99c0b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:24.771 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.759+0000 7fb9a4416640 1 -- 10.20.193.26:0/467346680 shutdown_connections 2026-02-24T19:24:24.771 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.759+0000 7fb9a4416640 1 -- 10.20.193.26:0/467346680 wait complete. 2026-02-24T19:24:24.771 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.759+0000 7fb9a4416640 10 monclient: build_initial_monmap 2026-02-24T19:24:24.771 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.759+0000 7fb9a4416640 10 monclient: monmap: 2026-02-24T19:24:24.771 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:24.771 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:24.771 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:24.771 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:24.771 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:24.771 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:24.771 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:24.771 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:24.772 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:24.772 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:24.772 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.760+0000 7fb9a4416640 1 librados: starting msgr at 2026-02-24T19:24:24.772 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.760+0000 7fb9a4416640 1 librados: starting objecter 2026-02-24T19:24:24.772 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.760+0000 7fb9a4416640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:24.772 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.760+0000 7fb9a4416640 1 Processor -- start 2026-02-24T19:24:24.772 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.760+0000 7fb9a4416640 1 -- start start 2026-02-24T19:24:24.772 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.760+0000 7fb9a4416640 1 librados: setting wanted keys 2026-02-24T19:24:24.772 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.760+0000 7fb9a4416640 1 librados: calling monclient init 2026-02-24T19:24:24.772 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.760+0000 7fb9a4416640 10 monclient: init 2026-02-24T19:24:24.772 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.760+0000 7fb9a4416640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:24.772 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.760+0000 7fb9a4416640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:24:24.772 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.760+0000 7fb9a4416640 10 monclient(hunting): picked mon.noname-a con 0x7fb99c058da0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:24.773 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.760+0000 7fb9a4416640 10 monclient(hunting): picked mon.noname-b con 0x7fb99c0b0410 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:24.773 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.760+0000 7fb9a4416640 10 monclient(hunting): picked mon.noname-c con 0x7fb99c1626a0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:24.773 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.760+0000 7fb9a4416640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb99c1fd850 con 0x7fb99c058da0 2026-02-24T19:24:24.773 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.760+0000 7fb9a4416640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb99c137c10 con 0x7fb99c0b0410 2026-02-24T19:24:24.773 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.760+0000 7fb9a4416640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb99c137eb0 con 0x7fb99c1626a0 2026-02-24T19:24:24.773 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.760+0000 7fb9a4416640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:24.773 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.760+0000 7fb9a4416640 10 monclient(hunting): authenticate will time out at 4047.442708s 2026-02-24T19:24:24.773 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.760+0000 7fb9a218b640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fb99c058da0 0x7fb99c1fa8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59262/0 (socket says 10.20.193.26:59262) 2026-02-24T19:24:24.773 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.760+0000 7fb9a218b640 1 -- 10.20.193.26:0/2447496960 learned_addr learned my addr 10.20.193.26:0/2447496960 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:24.773 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.761+0000 7fb982ffd640 10 client.?.objecter ms_handle_connect 0x7fb99c058da0 2026-02-24T19:24:24.773 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.761+0000 7fb982ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:24.773 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.761+0000 7fb982ffd640 10 client.?.objecter ms_handle_connect 0x7fb99c0b0410 2026-02-24T19:24:24.773 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.761+0000 7fb982ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:24.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.761+0000 7fb982ffd640 10 client.?.objecter ms_handle_connect 0x7fb99c1626a0 2026-02-24T19:24:24.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.761+0000 7fb982ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:24.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.762+0000 7fb982ffd640 1 -- 10.20.193.26:0/2447496960 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3433348836 0 0) 0x7fb99c137c10 con 0x7fb99c0b0410 2026-02-24T19:24:24.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.762+0000 7fb982ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:24.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.762+0000 7fb982ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:24.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.762+0000 7fb982ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:24.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.762+0000 7fb982ffd640 10 monclient(hunting): my global_id is 28024 2026-02-24T19:24:24.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.762+0000 7fb982ffd640 1 -- 10.20.193.26:0/2447496960 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb96c003610 con 0x7fb99c0b0410 2026-02-24T19:24:24.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.762+0000 7fb982ffd640 1 -- 10.20.193.26:0/2447496960 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3996753839 0 0) 0x7fb99c0b1590 con 0x7fb99c058da0 2026-02-24T19:24:24.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.762+0000 7fb982ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:24.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.762+0000 7fb982ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:24.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.762+0000 7fb982ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:24.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.762+0000 7fb982ffd640 10 monclient(hunting): my global_id is 30612 2026-02-24T19:24:24.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.762+0000 7fb982ffd640 1 -- 10.20.193.26:0/2447496960 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb99c137c10 con 0x7fb99c058da0 2026-02-24T19:24:24.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.762+0000 7fb982ffd640 1 -- 10.20.193.26:0/2447496960 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2327694356 0 0) 0x7fb99c137eb0 con 0x7fb99c1626a0 2026-02-24T19:24:24.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.762+0000 7fb982ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:24.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.762+0000 7fb982ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:24.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.762+0000 7fb982ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:24.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.762+0000 7fb982ffd640 10 monclient(hunting): my global_id is 29948 2026-02-24T19:24:24.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.762+0000 7fb982ffd640 1 -- 10.20.193.26:0/2447496960 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb99c0b1590 con 0x7fb99c1626a0 2026-02-24T19:24:24.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.764+0000 7fb982ffd640 1 -- 10.20.193.26:0/2447496960 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1014493446 0 0) 0x7fb99c137c10 con 0x7fb99c058da0 2026-02-24T19:24:24.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.764+0000 7fb982ffd640 1 -- 10.20.193.26:0/2447496960 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb99c137eb0 con 0x7fb99c058da0 2026-02-24T19:24:24.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.764+0000 7fb982ffd640 1 -- 10.20.193.26:0/2447496960 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fb98c003160 con 0x7fb99c058da0 2026-02-24T19:24:24.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.764+0000 7fb982ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:24.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.764+0000 7fb982ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:24.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.764+0000 7fb982ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:24.776 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:24.776 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:24.776 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:24.776 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:24.776 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:24.776 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:24.776 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:24.776 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:24.776 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:24.776 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:24.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.764+0000 7fb982ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:24.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.764+0000 7fb982ffd640 1 -- 10.20.193.26:0/2447496960 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 684961293 0 0) 0x7fb96c003610 con 0x7fb99c0b0410 2026-02-24T19:24:24.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.764+0000 7fb982ffd640 1 -- 10.20.193.26:0/2447496960 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb99c137c10 con 0x7fb99c0b0410 2026-02-24T19:24:24.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.764+0000 7fb982ffd640 1 -- 10.20.193.26:0/2447496960 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fb990003310 con 0x7fb99c0b0410 2026-02-24T19:24:24.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.764+0000 7fb982ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:24.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.764+0000 7fb982ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:24.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.764+0000 7fb982ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:24.777 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:24.777 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:24.777 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:24.777 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:24.777 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:24.777 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:24.777 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:24.777 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:24.777 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:24.778 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:24.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.765+0000 7fb982ffd640 1 -- 10.20.193.26:0/2447496960 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1152623315 0 0) 0x7fb99c0b1590 con 0x7fb99c1626a0 2026-02-24T19:24:24.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.765+0000 7fb982ffd640 1 -- 10.20.193.26:0/2447496960 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb96c003610 con 0x7fb99c1626a0 2026-02-24T19:24:24.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.765+0000 7fb982ffd640 1 -- 10.20.193.26:0/2447496960 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fb998003330 con 0x7fb99c1626a0 2026-02-24T19:24:24.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.765+0000 7fb982ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:24.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.765+0000 7fb982ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:24.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.765+0000 7fb982ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:24.778 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:24.778 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:24.778 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:24.778 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:24.778 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:24.778 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:24.779 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:24.779 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:24.779 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:24.779 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:24.780 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.766+0000 7fb982ffd640 1 -- 10.20.193.26:0/2447496960 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2714939435 0 0) 0x7fb99c137eb0 con 0x7fb99c058da0 2026-02-24T19:24:24.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.766+0000 7fb982ffd640 1 -- 10.20.193.26:0/2447496960 >> v1:10.20.193.103:6789/0 conn(0x7fb99c1626a0 legacy=0x7fb99c0af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:24.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.766+0000 7fb982ffd640 1 -- 10.20.193.26:0/2447496960 >> v1:10.20.193.70:6789/0 conn(0x7fb99c0b0410 legacy=0x7fb99c1fd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:24.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.766+0000 7fb982ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:24.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.766+0000 7fb982ffd640 1 monclient: found mon.a 2026-02-24T19:24:24.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.766+0000 7fb982ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:24.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.766+0000 7fb982ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:24.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.766+0000 7fb982ffd640 1 -- 10.20.193.26:0/2447496960 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99c138190 con 0x7fb99c058da0 2026-02-24T19:24:24.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.766+0000 7fb982ffd640 10 monclient: _finish_auth 0 2026-02-24T19:24:24.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.766+0000 7fb982ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:24.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.766+0000 7fb982ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:24.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.766+0000 7fb9a4416640 5 monclient: authenticate success, global_id 30612 2026-02-24T19:24:24.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.766+0000 7fb9a4416640 10 monclient: _renew_subs 2026-02-24T19:24:24.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.766+0000 7fb9a4416640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:24.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.766+0000 7fb9a4416640 1 -- 10.20.193.26:0/2447496960 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb99c138470 con 0x7fb99c058da0 2026-02-24T19:24:24.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.766+0000 7fb9a4416640 10 client.30612.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:24.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.766+0000 7fb9a4416640 10 monclient: _renew_subs 2026-02-24T19:24:24.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.766+0000 7fb9a4416640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:24.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.766+0000 7fb9a4416640 1 -- 10.20.193.26:0/2447496960 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb99c1fcba0 con 0x7fb99c058da0 2026-02-24T19:24:24.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.766+0000 7fb9a4416640 1 librados: init done 2026-02-24T19:24:24.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.766+0000 7fb9a4416640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:24.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.766+0000 7fb9a4416640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:24.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.766+0000 7fb9a4416640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:24.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.766+0000 7fb9a4416640 1 -- 10.20.193.26:0/2447496960 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb99c0b3dc0 con 0x7fb99c058da0 2026-02-24T19:24:24.862 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.860+0000 7fb982ffd640 1 -- 10.20.193.26:0/2447496960 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb98c0034d0 con 0x7fb99c058da0 2026-02-24T19:24:24.862 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.860+0000 7fb982ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:24.862 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.860+0000 7fb982ffd640 1 -- 10.20.193.26:0/2447496960 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fb98c003b50 con 0x7fb99c058da0 2026-02-24T19:24:24.862 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.860+0000 7fb982ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:24.862 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.860+0000 7fb982ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:24.862 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.860+0000 7fb982ffd640 10 monclient: dump: 2026-02-24T19:24:24.862 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:24.862 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:24.863 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:24.863 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:24.863 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:24.863 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:24.863 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:24.863 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:24.863 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:24.863 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:24.863 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.860+0000 7fb9a0988640 4 set_mon_vals no callback set 2026-02-24T19:24:24.864 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.861+0000 7fb982ffd640 1 -- 10.20.193.26:0/2447496960 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fb98c003d30 con 0x7fb99c058da0 2026-02-24T19:24:24.864 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.861+0000 7fb9a198a640 10 monclient: get_auth_request con 0x7fb96c077f60 auth_method 0 2026-02-24T19:24:24.864 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.862+0000 7fb982ffd640 10 client.30612.objecter ms_handle_connect 0x7fb96c077f60 2026-02-24T19:24:24.865 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.863+0000 7fb982ffd640 1 -- 10.20.193.26:0/2447496960 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7fb98c093230 con 0x7fb99c058da0 2026-02-24T19:24:24.865 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.863+0000 7fb982ffd640 10 client.30612.objecter ms_dispatch2 0x7fb99c000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:24.865 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.863+0000 7fb982ffd640 3 client.30612.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:24.865 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.863+0000 7fb982ffd640 3 client.30612.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:24.865 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.864+0000 7fb982ffd640 20 client.30612.objecter dump_active .. 0 homeless 2026-02-24T19:24:24.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.864+0000 7fb982ffd640 1 -- 10.20.193.26:0/2447496960 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fb99c0b3dc0 con 0x7fb99c058da0 2026-02-24T19:24:24.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.864+0000 7fb982ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:24.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.864+0000 7fb982ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:24.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.968+0000 7fb9a4416640 1 -- 10.20.193.26:0/2447496960 --> v1:10.20.193.162:6800/3889602630 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb99c059850 con 0x7fb96c077f60 2026-02-24T19:24:24.971 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.969+0000 7fb982ffd640 1 -- 10.20.193.26:0/2447496960 <== mgr.4107 v1:10.20.193.162:6800/3889602630 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125115 (unknown 2965378022 0 1449131831) 0x7fb99c059850 con 0x7fb96c077f60 2026-02-24T19:24:24.972 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:24:24.973 INFO:teuthology.orchestra.run.trial026.stderr:dumped all 2026-02-24T19:24:24.974 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.971+0000 7fb9a4416640 10 librados: watch_flush enter 2026-02-24T19:24:24.974 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.971+0000 7fb9a4416640 10 librados: watch_flush exit 2026-02-24T19:24:24.974 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.971+0000 7fb9a4416640 20 client.30612.objecter shutdown clearing up homeless session... 2026-02-24T19:24:24.974 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.971+0000 7fb9a4416640 10 client.30612.objecter successfully canceled tick 2026-02-24T19:24:24.974 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.971+0000 7fb9a4416640 1 -- 10.20.193.26:0/2447496960 >> v1:10.20.193.162:6800/3889602630 conn(0x7fb96c077f60 legacy=0x7fb96c098410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:24.975 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.971+0000 7fb9a4416640 10 monclient: shutdown 2026-02-24T19:24:24.975 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.971+0000 7fb9a4416640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:24.975 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.971+0000 7fb9a4416640 1 -- 10.20.193.26:0/2447496960 >> v1:10.20.193.26:6789/0 conn(0x7fb99c058da0 legacy=0x7fb99c1fa8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:24.975 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.971+0000 7fb9a4416640 1 -- 10.20.193.26:0/2447496960 shutdown_connections 2026-02-24T19:24:24.975 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.971+0000 7fb9a4416640 1 -- 10.20.193.26:0/2447496960 >> 10.20.193.26:0/2447496960 conn(0x7fb99c0b65f0 msgr2=0x7fb99c059bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:24.975 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.971+0000 7fb9a4416640 1 -- 10.20.193.26:0/2447496960 shutdown_connections 2026-02-24T19:24:24.975 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.971+0000 7fb9a4416640 1 -- 10.20.193.26:0/2447496960 wait complete. 2026-02-24T19:24:24.975 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:24.971+0000 7fb9a4416640 1 librados: shutdown 2026-02-24T19:24:24.982 INFO:teuthology.orchestra.run.trial026.stdout:{"pg_ready":true,"pg_map":{"version":544,"stamp":"2026-02-24T19:24:24.668976+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":559680,"kb_used_data":110272,"kb_used_omap":25576,"kb_used_meta":423575,"kb_avail":1509389760,"statfs":{"total":1546188226560,"available":1545615114240,"internally_reserved":0,"allocated":112918528,"data_stored":69901870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26190805,"internal_metadata":433740843},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001296"},"pg_stats":[{"pgid":"9.15","version":"0'0","reported_seq":628,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:20.723651+0000","last_change":"2026-02-24T19:18:45.993805+0000","last_active":"2026-02-24T19:24:20.723651+0000","last_peered":"2026-02-24T19:24:20.723651+0000","last_clean":"2026-02-24T19:24:20.723651+0000","last_became_active":"2026-02-24T19:18:45.991617+0000","last_became_peered":"2026-02-24T19:18:45.991617+0000","last_unstale":"2026-02-24T19:24:20.723651+0000","last_undegraded":"2026-02-24T19:24:20.723651+0000","last_fullsized":"2026-02-24T19:24:20.723651+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:00:31.861264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":627,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.176272+0000","last_change":"2026-02-24T19:18:45.686747+0000","last_active":"2026-02-24T19:24:19.176272+0000","last_peered":"2026-02-24T19:24:19.176272+0000","last_clean":"2026-02-24T19:24:19.176272+0000","last_became_active":"2026-02-24T19:18:45.681436+0000","last_became_peered":"2026-02-24T19:18:45.681436+0000","last_unstale":"2026-02-24T19:24:19.176272+0000","last_undegraded":"2026-02-24T19:24:19.176272+0000","last_fullsized":"2026-02-24T19:24:19.176272+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:49:11.919250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":632,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.227313+0000","last_change":"2026-02-24T19:18:46.870170+0000","last_active":"2026-02-24T19:24:21.227313+0000","last_peered":"2026-02-24T19:24:21.227313+0000","last_clean":"2026-02-24T19:24:21.227313+0000","last_became_active":"2026-02-24T19:18:46.867835+0000","last_became_peered":"2026-02-24T19:18:46.867835+0000","last_unstale":"2026-02-24T19:24:21.227313+0000","last_undegraded":"2026-02-24T19:24:21.227313+0000","last_fullsized":"2026-02-24T19:24:21.227313+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:26:18.415712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":626,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.557518+0000","last_change":"2026-02-24T19:18:46.457667+0000","last_active":"2026-02-24T19:24:21.557518+0000","last_peered":"2026-02-24T19:24:21.557518+0000","last_clean":"2026-02-24T19:24:21.557518+0000","last_became_active":"2026-02-24T19:18:46.452160+0000","last_became_peered":"2026-02-24T19:18:46.452160+0000","last_unstale":"2026-02-24T19:24:21.557518+0000","last_undegraded":"2026-02-24T19:24:21.557518+0000","last_fullsized":"2026-02-24T19:24:21.557518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:59:23.251747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":627,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.181177+0000","last_change":"2026-02-24T19:18:46.510024+0000","last_active":"2026-02-24T19:24:19.181177+0000","last_peered":"2026-02-24T19:24:19.181177+0000","last_clean":"2026-02-24T19:24:19.181177+0000","last_became_active":"2026-02-24T19:18:46.482414+0000","last_became_peered":"2026-02-24T19:18:46.482414+0000","last_unstale":"2026-02-24T19:24:19.181177+0000","last_undegraded":"2026-02-24T19:24:19.181177+0000","last_fullsized":"2026-02-24T19:24:19.181177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:12:29.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,13],"acting":[14,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":627,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.553723+0000","last_change":"2026-02-24T19:18:45.879863+0000","last_active":"2026-02-24T19:24:21.553723+0000","last_peered":"2026-02-24T19:24:21.553723+0000","last_clean":"2026-02-24T19:24:21.553723+0000","last_became_active":"2026-02-24T19:18:45.877648+0000","last_became_peered":"2026-02-24T19:18:45.877648+0000","last_unstale":"2026-02-24T19:24:21.553723+0000","last_undegraded":"2026-02-24T19:24:21.553723+0000","last_fullsized":"2026-02-24T19:24:21.553723+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:15:47.469119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":632,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.224638+0000","last_change":"2026-02-24T19:18:45.539139+0000","last_active":"2026-02-24T19:24:21.224638+0000","last_peered":"2026-02-24T19:24:21.224638+0000","last_clean":"2026-02-24T19:24:21.224638+0000","last_became_active":"2026-02-24T19:18:45.537014+0000","last_became_peered":"2026-02-24T19:18:45.537014+0000","last_unstale":"2026-02-24T19:24:21.224638+0000","last_undegraded":"2026-02-24T19:24:21.224638+0000","last_fullsized":"2026-02-24T19:24:21.224638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:53:12.241320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":631,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.458262+0000","last_change":"2026-02-24T19:18:46.437120+0000","last_active":"2026-02-24T19:24:21.458262+0000","last_peered":"2026-02-24T19:24:21.458262+0000","last_clean":"2026-02-24T19:24:21.458262+0000","last_became_active":"2026-02-24T19:18:46.435006+0000","last_became_peered":"2026-02-24T19:18:46.435006+0000","last_unstale":"2026-02-24T19:24:21.458262+0000","last_undegraded":"2026-02-24T19:24:21.458262+0000","last_fullsized":"2026-02-24T19:24:21.458262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:07:13.215303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,0],"acting":[12,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":624,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.128989+0000","last_change":"2026-02-24T19:18:47.214595+0000","last_active":"2026-02-24T19:24:19.128989+0000","last_peered":"2026-02-24T19:24:19.128989+0000","last_clean":"2026-02-24T19:24:19.128989+0000","last_became_active":"2026-02-24T19:18:47.212334+0000","last_became_peered":"2026-02-24T19:18:47.212334+0000","last_unstale":"2026-02-24T19:24:19.128989+0000","last_undegraded":"2026-02-24T19:24:19.128989+0000","last_fullsized":"2026-02-24T19:24:19.128989+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:28:19.454092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":630,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.480787+0000","last_change":"2026-02-24T19:18:45.704988+0000","last_active":"2026-02-24T19:24:21.480787+0000","last_peered":"2026-02-24T19:24:21.480787+0000","last_clean":"2026-02-24T19:24:21.480787+0000","last_became_active":"2026-02-24T19:18:45.702531+0000","last_became_peered":"2026-02-24T19:18:45.702531+0000","last_unstale":"2026-02-24T19:24:21.480787+0000","last_undegraded":"2026-02-24T19:24:21.480787+0000","last_fullsized":"2026-02-24T19:24:21.480787+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:40:40.455743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0],"acting":[10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":624,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.246402+0000","last_change":"2026-02-24T19:18:45.247267+0000","last_active":"2026-02-24T19:24:19.246402+0000","last_peered":"2026-02-24T19:24:19.246402+0000","last_clean":"2026-02-24T19:24:19.246402+0000","last_became_active":"2026-02-24T19:18:45.245053+0000","last_became_peered":"2026-02-24T19:18:45.245053+0000","last_unstale":"2026-02-24T19:24:19.246402+0000","last_undegraded":"2026-02-24T19:24:19.246402+0000","last_fullsized":"2026-02-24T19:24:19.246402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:11:55.548126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":632,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.225496+0000","last_change":"2026-02-24T19:18:45.470833+0000","last_active":"2026-02-24T19:24:21.225496+0000","last_peered":"2026-02-24T19:24:21.225496+0000","last_clean":"2026-02-24T19:24:21.225496+0000","last_became_active":"2026-02-24T19:18:45.468683+0000","last_became_peered":"2026-02-24T19:18:45.468683+0000","last_unstale":"2026-02-24T19:24:21.225496+0000","last_undegraded":"2026-02-24T19:24:21.225496+0000","last_fullsized":"2026-02-24T19:24:21.225496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:29:30.418354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":630,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:20.103133+0000","last_change":"2026-02-24T19:18:45.264091+0000","last_active":"2026-02-24T19:24:20.103133+0000","last_peered":"2026-02-24T19:24:20.103133+0000","last_clean":"2026-02-24T19:24:20.103133+0000","last_became_active":"2026-02-24T19:18:45.260524+0000","last_became_peered":"2026-02-24T19:18:45.260524+0000","last_unstale":"2026-02-24T19:24:20.103133+0000","last_undegraded":"2026-02-24T19:24:20.103133+0000","last_fullsized":"2026-02-24T19:24:20.103133+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:28:01.882056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":643,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.559025+0000","last_change":"2026-02-24T19:18:07.814826+0000","last_active":"2026-02-24T19:24:21.559025+0000","last_peered":"2026-02-24T19:24:21.559025+0000","last_clean":"2026-02-24T19:24:21.559025+0000","last_became_active":"2026-02-24T19:18:06.131387+0000","last_became_peered":"2026-02-24T19:18:06.131387+0000","last_unstale":"2026-02-24T19:24:21.559025+0000","last_undegraded":"2026-02-24T19:24:21.559025+0000","last_fullsized":"2026-02-24T19:24:21.559025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:38:29.559020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060150395000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":627,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:20.704257+0000","last_change":"2026-02-24T19:18:46.022578+0000","last_active":"2026-02-24T19:24:20.704257+0000","last_peered":"2026-02-24T19:24:20.704257+0000","last_clean":"2026-02-24T19:24:20.704257+0000","last_became_active":"2026-02-24T19:18:46.019677+0000","last_became_peered":"2026-02-24T19:18:46.019677+0000","last_unstale":"2026-02-24T19:24:20.704257+0000","last_undegraded":"2026-02-24T19:24:20.704257+0000","last_fullsized":"2026-02-24T19:24:20.704257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:32:42.029209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,13],"acting":[6,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":648,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.217952+0000","last_change":"2026-02-24T19:18:08.286588+0000","last_active":"2026-02-24T19:24:21.217952+0000","last_peered":"2026-02-24T19:24:21.217952+0000","last_clean":"2026-02-24T19:24:21.217952+0000","last_became_active":"2026-02-24T19:18:05.714006+0000","last_became_peered":"2026-02-24T19:18:05.714006+0000","last_unstale":"2026-02-24T19:24:21.217952+0000","last_undegraded":"2026-02-24T19:24:21.217952+0000","last_fullsized":"2026-02-24T19:24:21.217952+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:57:02.402866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030292255000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,10],"acting":[15,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":630,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.477610+0000","last_change":"2026-02-24T19:18:46.052119+0000","last_active":"2026-02-24T19:24:21.477610+0000","last_peered":"2026-02-24T19:24:21.477610+0000","last_clean":"2026-02-24T19:24:21.477610+0000","last_became_active":"2026-02-24T19:18:46.049357+0000","last_became_peered":"2026-02-24T19:18:46.049357+0000","last_unstale":"2026-02-24T19:24:21.477610+0000","last_undegraded":"2026-02-24T19:24:21.477610+0000","last_fullsized":"2026-02-24T19:24:21.477610+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:14:48.414481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,7],"acting":[10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":645,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.180858+0000","last_change":"2026-02-24T19:18:07.750038+0000","last_active":"2026-02-24T19:24:19.180858+0000","last_peered":"2026-02-24T19:24:19.180858+0000","last_clean":"2026-02-24T19:24:19.180858+0000","last_became_active":"2026-02-24T19:18:06.025485+0000","last_became_peered":"2026-02-24T19:18:06.025485+0000","last_unstale":"2026-02-24T19:24:19.180858+0000","last_undegraded":"2026-02-24T19:24:19.180858+0000","last_fullsized":"2026-02-24T19:24:19.180858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:00:12.835602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.040704530000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":627,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:20.708188+0000","last_change":"2026-02-24T19:18:45.751018+0000","last_active":"2026-02-24T19:24:20.708188+0000","last_peered":"2026-02-24T19:24:20.708188+0000","last_clean":"2026-02-24T19:24:20.708188+0000","last_became_active":"2026-02-24T19:18:45.739451+0000","last_became_peered":"2026-02-24T19:18:45.739451+0000","last_unstale":"2026-02-24T19:24:20.708188+0000","last_undegraded":"2026-02-24T19:24:20.708188+0000","last_fullsized":"2026-02-24T19:24:20.708188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:58:38.717085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":645,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.175707+0000","last_change":"2026-02-24T19:18:07.747179+0000","last_active":"2026-02-24T19:24:19.175707+0000","last_peered":"2026-02-24T19:24:19.175707+0000","last_clean":"2026-02-24T19:24:19.175707+0000","last_became_active":"2026-02-24T19:18:05.911513+0000","last_became_peered":"2026-02-24T19:18:05.911513+0000","last_unstale":"2026-02-24T19:24:19.175707+0000","last_undegraded":"2026-02-24T19:24:19.175707+0000","last_fullsized":"2026-02-24T19:24:19.175707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:16:20.335977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027602962000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":629,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.545191+0000","last_change":"2026-02-24T19:18:45.328853+0000","last_active":"2026-02-24T19:24:21.545191+0000","last_peered":"2026-02-24T19:24:21.545191+0000","last_clean":"2026-02-24T19:24:21.545191+0000","last_became_active":"2026-02-24T19:18:45.316395+0000","last_became_peered":"2026-02-24T19:18:45.316395+0000","last_unstale":"2026-02-24T19:24:21.545191+0000","last_undegraded":"2026-02-24T19:24:21.545191+0000","last_fullsized":"2026-02-24T19:24:21.545191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:15:16.945455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.2","version":"29'2","reported_seq":646,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.553089+0000","last_change":"2026-02-24T19:18:07.812765+0000","last_active":"2026-02-24T19:24:21.553089+0000","last_peered":"2026-02-24T19:24:21.553089+0000","last_clean":"2026-02-24T19:24:21.553089+0000","last_became_active":"2026-02-24T19:18:06.102285+0000","last_became_peered":"2026-02-24T19:18:06.102285+0000","last_unstale":"2026-02-24T19:24:21.553089+0000","last_undegraded":"2026-02-24T19:24:21.553089+0000","last_fullsized":"2026-02-24T19:24:21.553089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T07:17:19.620766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071463911000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":626,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.553628+0000","last_change":"2026-02-24T19:18:46.227053+0000","last_active":"2026-02-24T19:24:21.553628+0000","last_peered":"2026-02-24T19:24:21.553628+0000","last_clean":"2026-02-24T19:24:21.553628+0000","last_became_active":"2026-02-24T19:18:46.224954+0000","last_became_peered":"2026-02-24T19:18:46.224954+0000","last_unstale":"2026-02-24T19:24:21.553628+0000","last_undegraded":"2026-02-24T19:24:21.553628+0000","last_fullsized":"2026-02-24T19:24:21.553628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:09:45.760181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":647,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.544073+0000","last_change":"2026-02-24T19:18:08.293695+0000","last_active":"2026-02-24T19:24:21.544073+0000","last_peered":"2026-02-24T19:24:21.544073+0000","last_clean":"2026-02-24T19:24:21.544073+0000","last_became_active":"2026-02-24T19:18:06.040390+0000","last_became_peered":"2026-02-24T19:18:06.040390+0000","last_unstale":"2026-02-24T19:24:21.544073+0000","last_undegraded":"2026-02-24T19:24:21.544073+0000","last_fullsized":"2026-02-24T19:24:21.544073+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:59:15.837152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.035880255999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":624,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.124087+0000","last_change":"2026-02-24T19:18:45.635906+0000","last_active":"2026-02-24T19:24:19.124087+0000","last_peered":"2026-02-24T19:24:19.124087+0000","last_clean":"2026-02-24T19:24:19.124087+0000","last_became_active":"2026-02-24T19:18:45.633612+0000","last_became_peered":"2026-02-24T19:18:45.633612+0000","last_unstale":"2026-02-24T19:24:19.124087+0000","last_undegraded":"2026-02-24T19:24:19.124087+0000","last_fullsized":"2026-02-24T19:24:19.124087+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:04:11.968601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":645,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:20.706417+0000","last_change":"2026-02-24T19:18:08.371822+0000","last_active":"2026-02-24T19:24:20.706417+0000","last_peered":"2026-02-24T19:24:20.706417+0000","last_clean":"2026-02-24T19:24:20.706417+0000","last_became_active":"2026-02-24T19:18:05.913043+0000","last_became_peered":"2026-02-24T19:18:05.913043+0000","last_unstale":"2026-02-24T19:24:20.706417+0000","last_undegraded":"2026-02-24T19:24:20.706417+0000","last_fullsized":"2026-02-24T19:24:20.706417+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:07:35.933859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030508101999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":628,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.219143+0000","last_change":"2026-02-24T19:18:46.152118+0000","last_active":"2026-02-24T19:24:21.219143+0000","last_peered":"2026-02-24T19:24:21.219143+0000","last_clean":"2026-02-24T19:24:21.219143+0000","last_became_active":"2026-02-24T19:18:46.150051+0000","last_became_peered":"2026-02-24T19:18:46.150051+0000","last_unstale":"2026-02-24T19:24:21.219143+0000","last_undegraded":"2026-02-24T19:24:21.219143+0000","last_fullsized":"2026-02-24T19:24:21.219143+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:17:04.915264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":645,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.556517+0000","last_change":"2026-02-24T19:18:07.773906+0000","last_active":"2026-02-24T19:24:21.556517+0000","last_peered":"2026-02-24T19:24:21.556517+0000","last_clean":"2026-02-24T19:24:21.556517+0000","last_became_active":"2026-02-24T19:18:05.910166+0000","last_became_peered":"2026-02-24T19:18:05.910166+0000","last_unstale":"2026-02-24T19:24:21.556517+0000","last_undegraded":"2026-02-24T19:24:21.556517+0000","last_fullsized":"2026-02-24T19:24:21.556517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:39:15.323606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036726662,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'32","reported_seq":694,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.457317+0000","last_change":"2026-02-24T19:17:58.600915+0000","last_active":"2026-02-24T19:24:21.457317+0000","last_peered":"2026-02-24T19:24:21.457317+0000","last_clean":"2026-02-24T19:24:21.457317+0000","last_became_active":"2026-02-24T19:17:58.584752+0000","last_became_peered":"2026-02-24T19:17:58.584752+0000","last_unstale":"2026-02-24T19:24:21.457317+0000","last_undegraded":"2026-02-24T19:24:21.457317+0000","last_fullsized":"2026-02-24T19:24:21.457317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:57.017986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:57.017986+0000","last_clean_scrub_stamp":"2026-02-24T19:17:57.017986+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:48:59.744548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,10],"acting":[12,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":630,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:20.101420+0000","last_change":"2026-02-24T19:18:45.767728+0000","last_active":"2026-02-24T19:24:20.101420+0000","last_peered":"2026-02-24T19:24:20.101420+0000","last_clean":"2026-02-24T19:24:20.101420+0000","last_became_active":"2026-02-24T19:18:45.762826+0000","last_became_peered":"2026-02-24T19:18:45.762826+0000","last_unstale":"2026-02-24T19:24:20.101420+0000","last_undegraded":"2026-02-24T19:24:20.101420+0000","last_fullsized":"2026-02-24T19:24:20.101420+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:51:03.107522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,13],"acting":[5,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":627,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:20.120006+0000","last_change":"2026-02-24T19:18:45.851171+0000","last_active":"2026-02-24T19:24:20.120006+0000","last_peered":"2026-02-24T19:24:20.120006+0000","last_clean":"2026-02-24T19:24:20.120006+0000","last_became_active":"2026-02-24T19:18:45.848885+0000","last_became_peered":"2026-02-24T19:18:45.848885+0000","last_unstale":"2026-02-24T19:24:20.120006+0000","last_undegraded":"2026-02-24T19:24:20.120006+0000","last_fullsized":"2026-02-24T19:24:20.120006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:33:05.467412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,12],"acting":[7,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":632,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.219572+0000","last_change":"2026-02-24T19:18:45.779094+0000","last_active":"2026-02-24T19:24:21.219572+0000","last_peered":"2026-02-24T19:24:21.219572+0000","last_clean":"2026-02-24T19:24:21.219572+0000","last_became_active":"2026-02-24T19:18:45.776560+0000","last_became_peered":"2026-02-24T19:18:45.776560+0000","last_unstale":"2026-02-24T19:24:21.219572+0000","last_undegraded":"2026-02-24T19:24:21.219572+0000","last_fullsized":"2026-02-24T19:24:21.219572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:41:36.699391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"9.1","version":"34'11","reported_seq":650,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.114808+0000","last_change":"2026-02-24T19:18:47.225931+0000","last_active":"2026-02-24T19:24:19.114808+0000","last_peered":"2026-02-24T19:24:19.114808+0000","last_clean":"2026-02-24T19:24:19.114808+0000","last_became_active":"2026-02-24T19:18:47.223324+0000","last_became_peered":"2026-02-24T19:18:47.223324+0000","last_unstale":"2026-02-24T19:24:19.114808+0000","last_undegraded":"2026-02-24T19:24:19.114808+0000","last_fullsized":"2026-02-24T19:24:19.114808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:12:24.845087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":627,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.184070+0000","last_change":"2026-02-24T19:18:46.077881+0000","last_active":"2026-02-24T19:24:19.184070+0000","last_peered":"2026-02-24T19:24:19.184070+0000","last_clean":"2026-02-24T19:24:19.184070+0000","last_became_active":"2026-02-24T19:18:46.075425+0000","last_became_peered":"2026-02-24T19:18:46.075425+0000","last_unstale":"2026-02-24T19:24:19.184070+0000","last_undegraded":"2026-02-24T19:24:19.184070+0000","last_fullsized":"2026-02-24T19:24:19.184070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:23:06.041454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,8],"acting":[14,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":627,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.188045+0000","last_change":"2026-02-24T19:18:45.984836+0000","last_active":"2026-02-24T19:24:19.188045+0000","last_peered":"2026-02-24T19:24:19.188045+0000","last_clean":"2026-02-24T19:24:19.188045+0000","last_became_active":"2026-02-24T19:18:45.978376+0000","last_became_peered":"2026-02-24T19:18:45.978376+0000","last_unstale":"2026-02-24T19:24:19.188045+0000","last_undegraded":"2026-02-24T19:24:19.188045+0000","last_fullsized":"2026-02-24T19:24:19.188045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:43:57.738043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,9],"acting":[14,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":627,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.182763+0000","last_change":"2026-02-24T19:18:46.028144+0000","last_active":"2026-02-24T19:24:19.182763+0000","last_peered":"2026-02-24T19:24:19.182763+0000","last_clean":"2026-02-24T19:24:19.182763+0000","last_became_active":"2026-02-24T19:18:46.025768+0000","last_became_peered":"2026-02-24T19:18:46.025768+0000","last_unstale":"2026-02-24T19:24:19.182763+0000","last_undegraded":"2026-02-24T19:24:19.182763+0000","last_fullsized":"2026-02-24T19:24:19.182763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:49:38.486896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,8],"acting":[14,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":627,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:20.122830+0000","last_change":"2026-02-24T19:18:45.820589+0000","last_active":"2026-02-24T19:24:20.122830+0000","last_peered":"2026-02-24T19:24:20.122830+0000","last_clean":"2026-02-24T19:24:20.122830+0000","last_became_active":"2026-02-24T19:18:45.818087+0000","last_became_peered":"2026-02-24T19:18:45.818087+0000","last_unstale":"2026-02-24T19:24:20.122830+0000","last_undegraded":"2026-02-24T19:24:20.122830+0000","last_fullsized":"2026-02-24T19:24:20.122830+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:57:48.688473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,12],"acting":[7,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":627,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.168828+0000","last_change":"2026-02-24T19:18:45.323793+0000","last_active":"2026-02-24T19:24:19.168828+0000","last_peered":"2026-02-24T19:24:19.168828+0000","last_clean":"2026-02-24T19:24:19.168828+0000","last_became_active":"2026-02-24T19:18:45.320912+0000","last_became_peered":"2026-02-24T19:18:45.320912+0000","last_unstale":"2026-02-24T19:24:19.168828+0000","last_undegraded":"2026-02-24T19:24:19.168828+0000","last_fullsized":"2026-02-24T19:24:19.168828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:36:16.467243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":628,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.221559+0000","last_change":"2026-02-24T19:18:45.406813+0000","last_active":"2026-02-24T19:24:21.221559+0000","last_peered":"2026-02-24T19:24:21.221559+0000","last_clean":"2026-02-24T19:24:21.221559+0000","last_became_active":"2026-02-24T19:18:45.399050+0000","last_became_peered":"2026-02-24T19:18:45.399050+0000","last_unstale":"2026-02-24T19:24:21.221559+0000","last_undegraded":"2026-02-24T19:24:21.221559+0000","last_fullsized":"2026-02-24T19:24:21.221559+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:31:08.031303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":628,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:20.719206+0000","last_change":"2026-02-24T19:18:45.727292+0000","last_active":"2026-02-24T19:24:20.719206+0000","last_peered":"2026-02-24T19:24:20.719206+0000","last_clean":"2026-02-24T19:24:20.719206+0000","last_became_active":"2026-02-24T19:18:45.721374+0000","last_became_peered":"2026-02-24T19:18:45.721374+0000","last_unstale":"2026-02-24T19:24:20.719206+0000","last_undegraded":"2026-02-24T19:24:20.719206+0000","last_fullsized":"2026-02-24T19:24:20.719206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:41:57.598852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,6],"acting":[13,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":627,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.169913+0000","last_change":"2026-02-24T19:18:45.558833+0000","last_active":"2026-02-24T19:24:19.169913+0000","last_peered":"2026-02-24T19:24:19.169913+0000","last_clean":"2026-02-24T19:24:19.169913+0000","last_became_active":"2026-02-24T19:18:45.553944+0000","last_became_peered":"2026-02-24T19:18:45.553944+0000","last_unstale":"2026-02-24T19:24:19.169913+0000","last_undegraded":"2026-02-24T19:24:19.169913+0000","last_fullsized":"2026-02-24T19:24:19.169913+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:02:54.257449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,13],"acting":[9,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":15},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":21,"seq":90194313296,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33828,"kb_used_data":6868,"kb_used_omap":212,"kb_used_meta":26731,"kb_avail":94338012,"statfs":{"total":96636764160,"available":96602124288,"internally_reserved":0,"allocated":7032832,"data_stored":4337010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":217625,"internal_metadata":27373031},"hb_peers":[0,2,3,4,6,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313295,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33796,"kb_used_data":6836,"kb_used_omap":3017,"kb_used_meta":23926,"kb_avail":94338044,"statfs":{"total":96636764160,"available":96602157056,"internally_reserved":0,"allocated":7000064,"data_stored":4315440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3089424,"internal_metadata":24501232},"hb_peers":[0,1,2,5,6,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313295,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":211,"kb_used_meta":26732,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4324823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":216553,"internal_metadata":27374103},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313295,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33800,"kb_used_data":6840,"kb_used_omap":206,"kb_used_meta":26737,"kb_avail":94338040,"statfs":{"total":96636764160,"available":96602152960,"internally_reserved":0,"allocated":7004160,"data_stored":4315445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":211771,"internal_metadata":27378885},"hb_peers":[1,3,4,5,6,7,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313296,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33796,"kb_used_data":6836,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94338044,"statfs":{"total":96636764160,"available":96602157056,"internally_reserved":0,"allocated":7000064,"data_stored":4315440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":214072,"internal_metadata":27376584},"hb_peers":[0,2,4,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313295,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51844,"kb_used_data":6836,"kb_used_omap":107,"kb_used_meta":44884,"kb_avail":94319996,"statfs":{"total":96636764160,"available":96583675904,"internally_reserved":0,"allocated":7000064,"data_stored":4315440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":110577,"internal_metadata":45961231},"hb_peers":[0,1,3,5,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313295,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":5821,"kb_used_meta":21122,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4324842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5960958,"internal_metadata":21629698},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313295,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33796,"kb_used_data":6836,"kb_used_omap":98,"kb_used_meta":26845,"kb_avail":94338044,"statfs":{"total":96636764160,"available":96602157056,"internally_reserved":0,"allocated":7000064,"data_stored":4315440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":100579,"internal_metadata":27490077},"hb_peers":[0,1,3,5,6,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313296,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":210,"kb_used_meta":26733,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4324823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":215533,"internal_metadata":27375123},"hb_peers":[0,1,4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313295,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33796,"kb_used_data":6836,"kb_used_omap":8631,"kb_used_meta":18312,"kb_avail":94338044,"statfs":{"total":96636764160,"available":96602157056,"internally_reserved":0,"allocated":7000064,"data_stored":4315440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8839068,"internal_metadata":18751588},"hb_peers":[1,2,4,5,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313295,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":208,"kb_used_meta":26735,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4324823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":213278,"internal_metadata":27377378},"hb_peers":[0,2,3,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313295,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33796,"kb_used_data":6836,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94338044,"statfs":{"total":96636764160,"available":96602157056,"internally_reserved":0,"allocated":7000064,"data_stored":4315440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":214294,"internal_metadata":27376362},"hb_peers":[0,1,2,3,4,5,6,7,9,10,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313295,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33796,"kb_used_data":6836,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94338044,"statfs":{"total":96636764160,"available":96602157056,"internally_reserved":0,"allocated":7000064,"data_stored":4315440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":214309,"internal_metadata":27376347},"hb_peers":[0,1,2,3,4,5,7,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313296,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34188,"kb_used_data":7228,"kb_used_omap":5827,"kb_used_meta":21116,"kb_avail":94337652,"statfs":{"total":96636764160,"available":96601755648,"internally_reserved":0,"allocated":7401472,"data_stored":4713280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5967048,"internal_metadata":21623608},"hb_peers":[0,1,3,4,5,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313296,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33804,"kb_used_data":6844,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94338036,"statfs":{"total":96636764160,"available":96602148864,"internally_reserved":0,"allocated":7008256,"data_stored":4315464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":215036,"internal_metadata":27375620},"hb_peers":[0,1,3,4,5,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313295,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34188,"kb_used_data":7228,"kb_used_omap":186,"kb_used_meta":26757,"kb_avail":94337652,"statfs":{"total":96636764160,"available":96601755648,"internally_reserved":0,"allocated":7401472,"data_stored":4713280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":190680,"internal_metadata":27399976},"hb_peers":[0,1,2,3,4,5,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T19:24:24.985 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-24T19:24:24.986 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T19:24:25.052 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.050+0000 7f301acf3640 10 monclient: get_monmap_and_config 2026-02-24T19:24:25.052 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.050+0000 7f301acf3640 10 monclient: build_initial_monmap 2026-02-24T19:24:25.053 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.050+0000 7f301acf3640 10 monclient: monmap: 2026-02-24T19:24:25.053 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:25.053 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:25.053 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:25.051615+0000 2026-02-24T19:24:25.053 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:25.051615+0000 2026-02-24T19:24:25.053 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:25.053 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:25.053 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:25.053 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:25.053 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:25.053 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:25.054 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.051+0000 7f301acf3640 1 Processor -- start 2026-02-24T19:24:25.054 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.051+0000 7f301acf3640 1 -- start start 2026-02-24T19:24:25.054 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.051+0000 7f301acf3640 10 monclient: init 2026-02-24T19:24:25.055 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.051+0000 7f301acf3640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:25.056 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.051+0000 7f301acf3640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:24:25.056 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.051+0000 7f301acf3640 10 monclient(hunting): picked mon.noname-b con 0x7f30141603a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:25.056 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.051+0000 7f301acf3640 10 monclient(hunting): picked mon.noname-a con 0x7f3014056690 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:25.056 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.051+0000 7f301acf3640 10 monclient(hunting): picked mon.noname-c con 0x7f30141613d0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:25.056 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.051+0000 7f301acf3640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3014161850 con 0x7f3014056690 2026-02-24T19:24:25.056 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.051+0000 7f301acf3640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30140592d0 con 0x7f30141603a0 2026-02-24T19:24:25.056 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.051+0000 7f301acf3640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30140595b0 con 0x7f30141613d0 2026-02-24T19:24:25.056 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.051+0000 7f301acf3640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:25.056 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.051+0000 7f301acf3640 10 monclient(hunting): authenticate will time out at 4047.733827s 2026-02-24T19:24:25.056 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.052+0000 7f3019269640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f30141613d0 0x7f30140b20c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58170/0 (socket says 10.20.193.26:58170) 2026-02-24T19:24:25.056 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.052+0000 7f300bfff640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f3014056690 0x7f3014057f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59268/0 (socket says 10.20.193.26:59268) 2026-02-24T19:24:25.057 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.052+0000 7f3019269640 1 -- 10.20.193.26:0/1345483688 learned_addr learned my addr 10.20.193.26:0/1345483688 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:25.057 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.053+0000 7f300b7fe640 1 -- 10.20.193.26:0/1345483688 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3988666769 0 0) 0x7f30140595b0 con 0x7f30141613d0 2026-02-24T19:24:25.057 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.053+0000 7f300b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:25.057 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.053+0000 7f300b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:25.057 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.053+0000 7f300b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:25.057 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.053+0000 7f300b7fe640 10 monclient(hunting): my global_id is 29951 2026-02-24T19:24:25.057 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.053+0000 7f300b7fe640 1 -- 10.20.193.26:0/1345483688 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3000003610 con 0x7f30141613d0 2026-02-24T19:24:25.057 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.053+0000 7f300b7fe640 1 -- 10.20.193.26:0/1345483688 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1174546197 0 0) 0x7f30140592d0 con 0x7f30141603a0 2026-02-24T19:24:25.057 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.053+0000 7f300b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:25.057 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.053+0000 7f300b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:25.057 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.053+0000 7f300b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:25.057 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.053+0000 7f300b7fe640 10 monclient(hunting): my global_id is 28027 2026-02-24T19:24:25.058 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.053+0000 7f300b7fe640 1 -- 10.20.193.26:0/1345483688 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30140595b0 con 0x7f30141603a0 2026-02-24T19:24:25.058 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.053+0000 7f300b7fe640 1 -- 10.20.193.26:0/1345483688 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1199652051 0 0) 0x7f2ffc002910 con 0x7f3014056690 2026-02-24T19:24:25.058 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.053+0000 7f300b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:25.058 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.053+0000 7f300b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:25.058 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.053+0000 7f300b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:25.058 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.053+0000 7f300b7fe640 10 monclient(hunting): my global_id is 30615 2026-02-24T19:24:25.058 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.053+0000 7f300b7fe640 1 -- 10.20.193.26:0/1345483688 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30140592d0 con 0x7f3014056690 2026-02-24T19:24:25.062 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.055+0000 7f300b7fe640 1 -- 10.20.193.26:0/1345483688 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 700092692 0 0) 0x7f3000003610 con 0x7f30141613d0 2026-02-24T19:24:25.063 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.055+0000 7f300b7fe640 1 -- 10.20.193.26:0/1345483688 >> v1:10.20.193.70:6789/0 conn(0x7f30141603a0 legacy=0x7f3014160770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:25.063 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.055+0000 7f300b7fe640 1 -- 10.20.193.26:0/1345483688 >> v1:10.20.193.26:6789/0 conn(0x7f3014056690 legacy=0x7f3014057f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:25.063 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.055+0000 7f300b7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:24:25.063 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.055+0000 7f300b7fe640 1 monclient: found mon.noname-c 2026-02-24T19:24:25.063 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.055+0000 7f300b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:25.063 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.055+0000 7f300b7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:24:25.063 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.055+0000 7f300b7fe640 1 -- 10.20.193.26:0/1345483688 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3014059890 con 0x7f30141613d0 2026-02-24T19:24:25.063 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.055+0000 7f300b7fe640 10 monclient: _finish_auth 0 2026-02-24T19:24:25.063 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.055+0000 7f300b7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:24:25.063 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.055+0000 7f300b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:25.063 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.055+0000 7f300b7fe640 1 -- 10.20.193.26:0/1345483688 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f3010003170 con 0x7f30141613d0 2026-02-24T19:24:25.064 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.055+0000 7f300b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:25.064 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.055+0000 7f300b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:25.064 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.055+0000 7f300b7fe640 10 monclient: dump: 2026-02-24T19:24:25.064 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:25.064 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:25.064 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:25.064 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:25.064 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:25.064 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:25.064 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:25.064 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:25.064 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:25.064 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:25.065 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.055+0000 7f301acf3640 5 monclient: authenticate success, global_id 29951 2026-02-24T19:24:25.065 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.055+0000 7f301acf3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:25.065 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.056+0000 7f300b7fe640 1 -- 10.20.193.26:0/1345483688 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3010003340 con 0x7f30141613d0 2026-02-24T19:24:25.065 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.056+0000 7f300b7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:25.065 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.056+0000 7f300b7fe640 1 -- 10.20.193.26:0/1345483688 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f3010003780 con 0x7f30141613d0 2026-02-24T19:24:25.065 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.056+0000 7f300b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:25.065 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.056+0000 7f300b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:25.065 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.056+0000 7f300b7fe640 10 monclient: dump: 2026-02-24T19:24:25.065 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:25.065 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:25.065 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:25.065 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:25.066 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:25.066 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:25.066 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:25.066 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:25.066 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:25.066 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:25.066 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.056+0000 7f301acf3640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:25.066 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.056+0000 7f301acf3640 4 set_mon_vals no callback set 2026-02-24T19:24:25.066 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.056+0000 7f301acf3640 10 monclient: shutdown 2026-02-24T19:24:25.066 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.056+0000 7f301acf3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:25.066 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.056+0000 7f301acf3640 1 -- 10.20.193.26:0/1345483688 >> v1:10.20.193.103:6789/0 conn(0x7f30141613d0 legacy=0x7f30140b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:25.066 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.056+0000 7f301acf3640 1 -- 10.20.193.26:0/1345483688 shutdown_connections 2026-02-24T19:24:25.066 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.056+0000 7f301acf3640 1 -- 10.20.193.26:0/1345483688 >> 10.20.193.26:0/1345483688 conn(0x7f30140b65f0 msgr2=0x7f30140b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:25.067 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.056+0000 7f301acf3640 1 -- 10.20.193.26:0/1345483688 shutdown_connections 2026-02-24T19:24:25.067 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.056+0000 7f301acf3640 1 -- 10.20.193.26:0/1345483688 wait complete. 2026-02-24T19:24:25.067 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.057+0000 7f301acf3640 10 monclient: build_initial_monmap 2026-02-24T19:24:25.067 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.057+0000 7f301acf3640 10 monclient: monmap: 2026-02-24T19:24:25.067 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:25.067 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:25.067 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:25.067 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:25.067 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:25.067 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:25.067 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:25.067 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:25.067 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:25.067 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:25.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.057+0000 7f301acf3640 1 librados: starting msgr at 2026-02-24T19:24:25.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.057+0000 7f301acf3640 1 librados: starting objecter 2026-02-24T19:24:25.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.057+0000 7f301acf3640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:25.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.057+0000 7f301acf3640 1 Processor -- start 2026-02-24T19:24:25.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.057+0000 7f301acf3640 1 -- start start 2026-02-24T19:24:25.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.057+0000 7f301acf3640 1 librados: setting wanted keys 2026-02-24T19:24:25.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.057+0000 7f301acf3640 1 librados: calling monclient init 2026-02-24T19:24:25.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.057+0000 7f301acf3640 10 monclient: init 2026-02-24T19:24:25.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.058+0000 7f301acf3640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:25.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.058+0000 7f301acf3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:25.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.058+0000 7f301acf3640 10 monclient(hunting): picked mon.noname-a con 0x7f3014056690 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:25.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.058+0000 7f301acf3640 10 monclient(hunting): picked mon.noname-c con 0x7f30141603a0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:25.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.058+0000 7f301acf3640 10 monclient(hunting): picked mon.noname-b con 0x7f30141613d0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:25.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.058+0000 7f301acf3640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3014136eb0 con 0x7f3014056690 2026-02-24T19:24:25.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.058+0000 7f301acf3640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3014137190 con 0x7f30141613d0 2026-02-24T19:24:25.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.058+0000 7f301acf3640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3014137470 con 0x7f30141603a0 2026-02-24T19:24:25.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.058+0000 7f301acf3640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:25.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.058+0000 7f301acf3640 10 monclient(hunting): authenticate will time out at 4047.740335s 2026-02-24T19:24:25.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.058+0000 7f300bfff640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f30141603a0 0x7f301413be30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58186/0 (socket says 10.20.193.26:58186) 2026-02-24T19:24:25.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.058+0000 7f300bfff640 1 -- 10.20.193.26:0/574973765 learned_addr learned my addr 10.20.193.26:0/574973765 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:25.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.058+0000 7f30097fa640 10 client.?.objecter ms_handle_connect 0x7f30141603a0 2026-02-24T19:24:25.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.058+0000 7f30097fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:25.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.058+0000 7f30097fa640 10 client.?.objecter ms_handle_connect 0x7f3014056690 2026-02-24T19:24:25.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.058+0000 7f30097fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:25.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.059+0000 7f30097fa640 10 client.?.objecter ms_handle_connect 0x7f30141613d0 2026-02-24T19:24:25.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.059+0000 7f30097fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:25.070 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.059+0000 7f30097fa640 1 -- 10.20.193.26:0/574973765 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1848929081 0 0) 0x7f3014137470 con 0x7f30141603a0 2026-02-24T19:24:25.070 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.059+0000 7f30097fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:25.070 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.059+0000 7f30097fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:25.070 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.059+0000 7f30097fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:25.070 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.059+0000 7f30097fa640 10 monclient(hunting): my global_id is 29954 2026-02-24T19:24:25.070 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.059+0000 7f30097fa640 1 -- 10.20.193.26:0/574973765 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fe4003610 con 0x7f30141603a0 2026-02-24T19:24:25.070 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.059+0000 7f30097fa640 1 -- 10.20.193.26:0/574973765 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3161486997 0 0) 0x7f3014136eb0 con 0x7f3014056690 2026-02-24T19:24:25.070 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.059+0000 7f30097fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:25.070 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.060+0000 7f30097fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:25.070 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.060+0000 7f30097fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:25.070 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.060+0000 7f30097fa640 10 monclient(hunting): my global_id is 30618 2026-02-24T19:24:25.070 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.060+0000 7f30097fa640 1 -- 10.20.193.26:0/574973765 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3014137470 con 0x7f3014056690 2026-02-24T19:24:25.071 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.060+0000 7f30097fa640 1 -- 10.20.193.26:0/574973765 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1093139382 0 0) 0x7f3014137190 con 0x7f30141613d0 2026-02-24T19:24:25.071 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.060+0000 7f30097fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:25.071 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.060+0000 7f30097fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:25.071 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.060+0000 7f30097fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:25.071 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.060+0000 7f30097fa640 10 monclient(hunting): my global_id is 28030 2026-02-24T19:24:25.071 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.060+0000 7f30097fa640 1 -- 10.20.193.26:0/574973765 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3014136eb0 con 0x7f30141613d0 2026-02-24T19:24:25.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.062+0000 7f30097fa640 1 -- 10.20.193.26:0/574973765 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1433671758 0 0) 0x7f2fe4003610 con 0x7f30141603a0 2026-02-24T19:24:25.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.062+0000 7f30097fa640 1 -- 10.20.193.26:0/574973765 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3014137190 con 0x7f30141603a0 2026-02-24T19:24:25.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.062+0000 7f30097fa640 1 -- 10.20.193.26:0/574973765 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2ffc003180 con 0x7f30141603a0 2026-02-24T19:24:25.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.062+0000 7f30097fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:25.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.062+0000 7f30097fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:25.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.062+0000 7f30097fa640 10 monclient(hunting): dump: 2026-02-24T19:24:25.074 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:25.074 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:25.074 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:25.074 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:25.075 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:25.075 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:25.075 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:25.075 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:25.075 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:25.075 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:25.075 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.062+0000 7f30097fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:25.075 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.062+0000 7f30097fa640 1 -- 10.20.193.26:0/574973765 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 910249955 0 0) 0x7f3014137470 con 0x7f3014056690 2026-02-24T19:24:25.075 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.062+0000 7f30097fa640 1 -- 10.20.193.26:0/574973765 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2fe4003610 con 0x7f3014056690 2026-02-24T19:24:25.075 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.062+0000 7f30097fa640 1 -- 10.20.193.26:0/574973765 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f3004003070 con 0x7f3014056690 2026-02-24T19:24:25.075 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.062+0000 7f30097fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:25.075 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.062+0000 7f30097fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:25.076 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.062+0000 7f30097fa640 10 monclient(hunting): dump: 2026-02-24T19:24:25.076 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:25.076 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:25.076 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:25.076 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:25.076 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:25.076 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:25.076 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:25.076 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:25.076 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:25.076 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:25.076 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.062+0000 7f30097fa640 1 -- 10.20.193.26:0/574973765 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1985639998 0 0) 0x7f3014136eb0 con 0x7f30141613d0 2026-02-24T19:24:25.076 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.062+0000 7f30097fa640 1 -- 10.20.193.26:0/574973765 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3014137470 con 0x7f30141613d0 2026-02-24T19:24:25.076 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.062+0000 7f30097fa640 1 -- 10.20.193.26:0/574973765 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f30100034f0 con 0x7f30141613d0 2026-02-24T19:24:25.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.062+0000 7f30097fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:25.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.062+0000 7f30097fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:25.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.062+0000 7f30097fa640 10 monclient(hunting): dump: 2026-02-24T19:24:25.077 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:25.077 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:25.077 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:25.077 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:25.077 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:25.077 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:25.077 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:25.077 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:25.077 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:25.078 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:25.078 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.064+0000 7f30097fa640 1 -- 10.20.193.26:0/574973765 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1788938950 0 0) 0x7f3014137190 con 0x7f30141603a0 2026-02-24T19:24:25.078 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.064+0000 7f30097fa640 1 -- 10.20.193.26:0/574973765 >> v1:10.20.193.70:6789/0 conn(0x7f30141613d0 legacy=0x7f30141fca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:25.078 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.064+0000 7f30097fa640 1 -- 10.20.193.26:0/574973765 >> v1:10.20.193.26:6789/0 conn(0x7f3014056690 legacy=0x7f30141fa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:25.078 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.064+0000 7f30097fa640 10 monclient: _finish_hunting 0 2026-02-24T19:24:25.078 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.064+0000 7f30097fa640 1 monclient: found mon.c 2026-02-24T19:24:25.078 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.064+0000 7f30097fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:25.078 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.064+0000 7f30097fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:25.078 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.064+0000 7f30097fa640 1 -- 10.20.193.26:0/574973765 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3014137750 con 0x7f30141603a0 2026-02-24T19:24:25.078 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.064+0000 7f30097fa640 10 monclient: _finish_auth 0 2026-02-24T19:24:25.078 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.064+0000 7f30097fa640 10 monclient: _check_auth_tickets 2026-02-24T19:24:25.078 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.064+0000 7f30097fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:25.078 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.064+0000 7f301acf3640 5 monclient: authenticate success, global_id 29954 2026-02-24T19:24:25.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.064+0000 7f301acf3640 10 monclient: _renew_subs 2026-02-24T19:24:25.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.064+0000 7f301acf3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:25.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.064+0000 7f301acf3640 1 -- 10.20.193.26:0/574973765 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3014137a30 con 0x7f30141603a0 2026-02-24T19:24:25.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.064+0000 7f301acf3640 10 client.29954.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:25.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.064+0000 7f301acf3640 10 monclient: _renew_subs 2026-02-24T19:24:25.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.064+0000 7f301acf3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:25.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.064+0000 7f301acf3640 1 -- 10.20.193.26:0/574973765 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3014138210 con 0x7f30141603a0 2026-02-24T19:24:25.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.064+0000 7f301acf3640 1 librados: init done 2026-02-24T19:24:25.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.064+0000 7f301acf3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:25.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.064+0000 7f301acf3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:25.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.064+0000 7f301acf3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:25.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.064+0000 7f301acf3640 1 -- 10.20.193.26:0/574973765 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3014163240 con 0x7f30141603a0 2026-02-24T19:24:25.158 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.156+0000 7f30097fa640 1 -- 10.20.193.26:0/574973765 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2ffc003450 con 0x7f30141603a0 2026-02-24T19:24:25.158 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.156+0000 7f30097fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:25.158 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.156+0000 7f30097fa640 1 -- 10.20.193.26:0/574973765 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2ffc004d20 con 0x7f30141603a0 2026-02-24T19:24:25.158 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.156+0000 7f30097fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:25.158 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.156+0000 7f300affd640 4 set_mon_vals no callback set 2026-02-24T19:24:25.158 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.156+0000 7f30097fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:25.158 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.156+0000 7f30097fa640 10 monclient: dump: 2026-02-24T19:24:25.158 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:25.158 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:25.158 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:25.158 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:25.159 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:25.159 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:25.159 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:25.159 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:25.159 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:25.159 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:25.160 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.157+0000 7f30097fa640 1 -- 10.20.193.26:0/574973765 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f2ffc01db90 con 0x7f30141603a0 2026-02-24T19:24:25.160 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.157+0000 7f3018a68640 10 monclient: get_auth_request con 0x7f2fe4077eb0 auth_method 0 2026-02-24T19:24:25.160 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.157+0000 7f30097fa640 10 client.29954.objecter ms_handle_connect 0x7f2fe4077eb0 2026-02-24T19:24:25.160 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.158+0000 7f30097fa640 1 -- 10.20.193.26:0/574973765 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7f2ffc093260 con 0x7f30141603a0 2026-02-24T19:24:25.160 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.158+0000 7f30097fa640 10 client.29954.objecter ms_dispatch2 0x7f3014000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:25.160 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.158+0000 7f30097fa640 3 client.29954.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:25.160 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.158+0000 7f30097fa640 3 client.29954.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:25.161 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.158+0000 7f30097fa640 20 client.29954.objecter dump_active .. 0 homeless 2026-02-24T19:24:25.162 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.160+0000 7f30097fa640 1 -- 10.20.193.26:0/574973765 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f3014161850 con 0x7f30141603a0 2026-02-24T19:24:25.162 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.160+0000 7f30097fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:25.162 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.160+0000 7f30097fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:25.264 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.262+0000 7f301acf3640 1 -- 10.20.193.26:0/574973765 --> v1:10.20.193.162:6800/3889602630 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3014138ec0 con 0x7f2fe4077eb0 2026-02-24T19:24:25.265 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.264+0000 7f30097fa640 1 -- 10.20.193.26:0/574973765 <== mgr.4107 v1:10.20.193.162:6800/3889602630 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125115 (unknown 2965378022 0 1449131831) 0x7f3014138ec0 con 0x7f2fe4077eb0 2026-02-24T19:24:25.266 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:24:25.267 INFO:teuthology.orchestra.run.trial026.stderr:dumped all 2026-02-24T19:24:25.269 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.265+0000 7f301acf3640 10 librados: watch_flush enter 2026-02-24T19:24:25.269 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.265+0000 7f301acf3640 10 librados: watch_flush exit 2026-02-24T19:24:25.269 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.265+0000 7f301acf3640 20 client.29954.objecter shutdown clearing up homeless session... 2026-02-24T19:24:25.269 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.265+0000 7f301acf3640 10 client.29954.objecter successfully canceled tick 2026-02-24T19:24:25.269 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.265+0000 7f301acf3640 1 -- 10.20.193.26:0/574973765 >> v1:10.20.193.162:6800/3889602630 conn(0x7f2fe4077eb0 legacy=0x7f2fe4098360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:25.269 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.265+0000 7f301acf3640 10 monclient: shutdown 2026-02-24T19:24:25.269 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.265+0000 7f301acf3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:25.269 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.265+0000 7f301acf3640 1 -- 10.20.193.26:0/574973765 >> v1:10.20.193.103:6789/0 conn(0x7f30141603a0 legacy=0x7f301413be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:25.270 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.265+0000 7f301acf3640 1 -- 10.20.193.26:0/574973765 shutdown_connections 2026-02-24T19:24:25.270 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.265+0000 7f301acf3640 1 -- 10.20.193.26:0/574973765 >> 10.20.193.26:0/574973765 conn(0x7f30140b65f0 msgr2=0x7f3014058b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:25.270 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.265+0000 7f301acf3640 1 -- 10.20.193.26:0/574973765 shutdown_connections 2026-02-24T19:24:25.270 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.265+0000 7f301acf3640 1 -- 10.20.193.26:0/574973765 wait complete. 2026-02-24T19:24:25.270 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.265+0000 7f301acf3640 1 librados: shutdown 2026-02-24T19:24:25.275 INFO:teuthology.orchestra.run.trial026.stdout:{"pg_ready":true,"pg_map":{"version":544,"stamp":"2026-02-24T19:24:24.668976+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":559680,"kb_used_data":110272,"kb_used_omap":25576,"kb_used_meta":423575,"kb_avail":1509389760,"statfs":{"total":1546188226560,"available":1545615114240,"internally_reserved":0,"allocated":112918528,"data_stored":69901870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26190805,"internal_metadata":433740843},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001296"},"pg_stats":[{"pgid":"9.15","version":"0'0","reported_seq":628,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:20.723651+0000","last_change":"2026-02-24T19:18:45.993805+0000","last_active":"2026-02-24T19:24:20.723651+0000","last_peered":"2026-02-24T19:24:20.723651+0000","last_clean":"2026-02-24T19:24:20.723651+0000","last_became_active":"2026-02-24T19:18:45.991617+0000","last_became_peered":"2026-02-24T19:18:45.991617+0000","last_unstale":"2026-02-24T19:24:20.723651+0000","last_undegraded":"2026-02-24T19:24:20.723651+0000","last_fullsized":"2026-02-24T19:24:20.723651+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:00:31.861264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":627,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.176272+0000","last_change":"2026-02-24T19:18:45.686747+0000","last_active":"2026-02-24T19:24:19.176272+0000","last_peered":"2026-02-24T19:24:19.176272+0000","last_clean":"2026-02-24T19:24:19.176272+0000","last_became_active":"2026-02-24T19:18:45.681436+0000","last_became_peered":"2026-02-24T19:18:45.681436+0000","last_unstale":"2026-02-24T19:24:19.176272+0000","last_undegraded":"2026-02-24T19:24:19.176272+0000","last_fullsized":"2026-02-24T19:24:19.176272+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:49:11.919250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":632,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.227313+0000","last_change":"2026-02-24T19:18:46.870170+0000","last_active":"2026-02-24T19:24:21.227313+0000","last_peered":"2026-02-24T19:24:21.227313+0000","last_clean":"2026-02-24T19:24:21.227313+0000","last_became_active":"2026-02-24T19:18:46.867835+0000","last_became_peered":"2026-02-24T19:18:46.867835+0000","last_unstale":"2026-02-24T19:24:21.227313+0000","last_undegraded":"2026-02-24T19:24:21.227313+0000","last_fullsized":"2026-02-24T19:24:21.227313+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:26:18.415712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":626,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.557518+0000","last_change":"2026-02-24T19:18:46.457667+0000","last_active":"2026-02-24T19:24:21.557518+0000","last_peered":"2026-02-24T19:24:21.557518+0000","last_clean":"2026-02-24T19:24:21.557518+0000","last_became_active":"2026-02-24T19:18:46.452160+0000","last_became_peered":"2026-02-24T19:18:46.452160+0000","last_unstale":"2026-02-24T19:24:21.557518+0000","last_undegraded":"2026-02-24T19:24:21.557518+0000","last_fullsized":"2026-02-24T19:24:21.557518+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:59:23.251747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":627,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.181177+0000","last_change":"2026-02-24T19:18:46.510024+0000","last_active":"2026-02-24T19:24:19.181177+0000","last_peered":"2026-02-24T19:24:19.181177+0000","last_clean":"2026-02-24T19:24:19.181177+0000","last_became_active":"2026-02-24T19:18:46.482414+0000","last_became_peered":"2026-02-24T19:18:46.482414+0000","last_unstale":"2026-02-24T19:24:19.181177+0000","last_undegraded":"2026-02-24T19:24:19.181177+0000","last_fullsized":"2026-02-24T19:24:19.181177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:12:29.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,13],"acting":[14,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":627,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.553723+0000","last_change":"2026-02-24T19:18:45.879863+0000","last_active":"2026-02-24T19:24:21.553723+0000","last_peered":"2026-02-24T19:24:21.553723+0000","last_clean":"2026-02-24T19:24:21.553723+0000","last_became_active":"2026-02-24T19:18:45.877648+0000","last_became_peered":"2026-02-24T19:18:45.877648+0000","last_unstale":"2026-02-24T19:24:21.553723+0000","last_undegraded":"2026-02-24T19:24:21.553723+0000","last_fullsized":"2026-02-24T19:24:21.553723+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:15:47.469119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":632,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.224638+0000","last_change":"2026-02-24T19:18:45.539139+0000","last_active":"2026-02-24T19:24:21.224638+0000","last_peered":"2026-02-24T19:24:21.224638+0000","last_clean":"2026-02-24T19:24:21.224638+0000","last_became_active":"2026-02-24T19:18:45.537014+0000","last_became_peered":"2026-02-24T19:18:45.537014+0000","last_unstale":"2026-02-24T19:24:21.224638+0000","last_undegraded":"2026-02-24T19:24:21.224638+0000","last_fullsized":"2026-02-24T19:24:21.224638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:53:12.241320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":631,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.458262+0000","last_change":"2026-02-24T19:18:46.437120+0000","last_active":"2026-02-24T19:24:21.458262+0000","last_peered":"2026-02-24T19:24:21.458262+0000","last_clean":"2026-02-24T19:24:21.458262+0000","last_became_active":"2026-02-24T19:18:46.435006+0000","last_became_peered":"2026-02-24T19:18:46.435006+0000","last_unstale":"2026-02-24T19:24:21.458262+0000","last_undegraded":"2026-02-24T19:24:21.458262+0000","last_fullsized":"2026-02-24T19:24:21.458262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:07:13.215303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,0],"acting":[12,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":624,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.128989+0000","last_change":"2026-02-24T19:18:47.214595+0000","last_active":"2026-02-24T19:24:19.128989+0000","last_peered":"2026-02-24T19:24:19.128989+0000","last_clean":"2026-02-24T19:24:19.128989+0000","last_became_active":"2026-02-24T19:18:47.212334+0000","last_became_peered":"2026-02-24T19:18:47.212334+0000","last_unstale":"2026-02-24T19:24:19.128989+0000","last_undegraded":"2026-02-24T19:24:19.128989+0000","last_fullsized":"2026-02-24T19:24:19.128989+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:28:19.454092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":630,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.480787+0000","last_change":"2026-02-24T19:18:45.704988+0000","last_active":"2026-02-24T19:24:21.480787+0000","last_peered":"2026-02-24T19:24:21.480787+0000","last_clean":"2026-02-24T19:24:21.480787+0000","last_became_active":"2026-02-24T19:18:45.702531+0000","last_became_peered":"2026-02-24T19:18:45.702531+0000","last_unstale":"2026-02-24T19:24:21.480787+0000","last_undegraded":"2026-02-24T19:24:21.480787+0000","last_fullsized":"2026-02-24T19:24:21.480787+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:40:40.455743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0],"acting":[10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":624,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.246402+0000","last_change":"2026-02-24T19:18:45.247267+0000","last_active":"2026-02-24T19:24:19.246402+0000","last_peered":"2026-02-24T19:24:19.246402+0000","last_clean":"2026-02-24T19:24:19.246402+0000","last_became_active":"2026-02-24T19:18:45.245053+0000","last_became_peered":"2026-02-24T19:18:45.245053+0000","last_unstale":"2026-02-24T19:24:19.246402+0000","last_undegraded":"2026-02-24T19:24:19.246402+0000","last_fullsized":"2026-02-24T19:24:19.246402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:11:55.548126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":632,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.225496+0000","last_change":"2026-02-24T19:18:45.470833+0000","last_active":"2026-02-24T19:24:21.225496+0000","last_peered":"2026-02-24T19:24:21.225496+0000","last_clean":"2026-02-24T19:24:21.225496+0000","last_became_active":"2026-02-24T19:18:45.468683+0000","last_became_peered":"2026-02-24T19:18:45.468683+0000","last_unstale":"2026-02-24T19:24:21.225496+0000","last_undegraded":"2026-02-24T19:24:21.225496+0000","last_fullsized":"2026-02-24T19:24:21.225496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:29:30.418354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":630,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:20.103133+0000","last_change":"2026-02-24T19:18:45.264091+0000","last_active":"2026-02-24T19:24:20.103133+0000","last_peered":"2026-02-24T19:24:20.103133+0000","last_clean":"2026-02-24T19:24:20.103133+0000","last_became_active":"2026-02-24T19:18:45.260524+0000","last_became_peered":"2026-02-24T19:18:45.260524+0000","last_unstale":"2026-02-24T19:24:20.103133+0000","last_undegraded":"2026-02-24T19:24:20.103133+0000","last_fullsized":"2026-02-24T19:24:20.103133+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:28:01.882056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":643,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.559025+0000","last_change":"2026-02-24T19:18:07.814826+0000","last_active":"2026-02-24T19:24:21.559025+0000","last_peered":"2026-02-24T19:24:21.559025+0000","last_clean":"2026-02-24T19:24:21.559025+0000","last_became_active":"2026-02-24T19:18:06.131387+0000","last_became_peered":"2026-02-24T19:18:06.131387+0000","last_unstale":"2026-02-24T19:24:21.559025+0000","last_undegraded":"2026-02-24T19:24:21.559025+0000","last_fullsized":"2026-02-24T19:24:21.559025+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:38:29.559020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060150395000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":627,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:20.704257+0000","last_change":"2026-02-24T19:18:46.022578+0000","last_active":"2026-02-24T19:24:20.704257+0000","last_peered":"2026-02-24T19:24:20.704257+0000","last_clean":"2026-02-24T19:24:20.704257+0000","last_became_active":"2026-02-24T19:18:46.019677+0000","last_became_peered":"2026-02-24T19:18:46.019677+0000","last_unstale":"2026-02-24T19:24:20.704257+0000","last_undegraded":"2026-02-24T19:24:20.704257+0000","last_fullsized":"2026-02-24T19:24:20.704257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:32:42.029209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,13],"acting":[6,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":648,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.217952+0000","last_change":"2026-02-24T19:18:08.286588+0000","last_active":"2026-02-24T19:24:21.217952+0000","last_peered":"2026-02-24T19:24:21.217952+0000","last_clean":"2026-02-24T19:24:21.217952+0000","last_became_active":"2026-02-24T19:18:05.714006+0000","last_became_peered":"2026-02-24T19:18:05.714006+0000","last_unstale":"2026-02-24T19:24:21.217952+0000","last_undegraded":"2026-02-24T19:24:21.217952+0000","last_fullsized":"2026-02-24T19:24:21.217952+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:57:02.402866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030292255000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,10],"acting":[15,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":630,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.477610+0000","last_change":"2026-02-24T19:18:46.052119+0000","last_active":"2026-02-24T19:24:21.477610+0000","last_peered":"2026-02-24T19:24:21.477610+0000","last_clean":"2026-02-24T19:24:21.477610+0000","last_became_active":"2026-02-24T19:18:46.049357+0000","last_became_peered":"2026-02-24T19:18:46.049357+0000","last_unstale":"2026-02-24T19:24:21.477610+0000","last_undegraded":"2026-02-24T19:24:21.477610+0000","last_fullsized":"2026-02-24T19:24:21.477610+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:14:48.414481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,7],"acting":[10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":645,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.180858+0000","last_change":"2026-02-24T19:18:07.750038+0000","last_active":"2026-02-24T19:24:19.180858+0000","last_peered":"2026-02-24T19:24:19.180858+0000","last_clean":"2026-02-24T19:24:19.180858+0000","last_became_active":"2026-02-24T19:18:06.025485+0000","last_became_peered":"2026-02-24T19:18:06.025485+0000","last_unstale":"2026-02-24T19:24:19.180858+0000","last_undegraded":"2026-02-24T19:24:19.180858+0000","last_fullsized":"2026-02-24T19:24:19.180858+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:00:12.835602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.040704530000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":627,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:20.708188+0000","last_change":"2026-02-24T19:18:45.751018+0000","last_active":"2026-02-24T19:24:20.708188+0000","last_peered":"2026-02-24T19:24:20.708188+0000","last_clean":"2026-02-24T19:24:20.708188+0000","last_became_active":"2026-02-24T19:18:45.739451+0000","last_became_peered":"2026-02-24T19:18:45.739451+0000","last_unstale":"2026-02-24T19:24:20.708188+0000","last_undegraded":"2026-02-24T19:24:20.708188+0000","last_fullsized":"2026-02-24T19:24:20.708188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:58:38.717085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":645,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.175707+0000","last_change":"2026-02-24T19:18:07.747179+0000","last_active":"2026-02-24T19:24:19.175707+0000","last_peered":"2026-02-24T19:24:19.175707+0000","last_clean":"2026-02-24T19:24:19.175707+0000","last_became_active":"2026-02-24T19:18:05.911513+0000","last_became_peered":"2026-02-24T19:18:05.911513+0000","last_unstale":"2026-02-24T19:24:19.175707+0000","last_undegraded":"2026-02-24T19:24:19.175707+0000","last_fullsized":"2026-02-24T19:24:19.175707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:16:20.335977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.027602962000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":629,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.545191+0000","last_change":"2026-02-24T19:18:45.328853+0000","last_active":"2026-02-24T19:24:21.545191+0000","last_peered":"2026-02-24T19:24:21.545191+0000","last_clean":"2026-02-24T19:24:21.545191+0000","last_became_active":"2026-02-24T19:18:45.316395+0000","last_became_peered":"2026-02-24T19:18:45.316395+0000","last_unstale":"2026-02-24T19:24:21.545191+0000","last_undegraded":"2026-02-24T19:24:21.545191+0000","last_fullsized":"2026-02-24T19:24:21.545191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:15:16.945455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.2","version":"29'2","reported_seq":646,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.553089+0000","last_change":"2026-02-24T19:18:07.812765+0000","last_active":"2026-02-24T19:24:21.553089+0000","last_peered":"2026-02-24T19:24:21.553089+0000","last_clean":"2026-02-24T19:24:21.553089+0000","last_became_active":"2026-02-24T19:18:06.102285+0000","last_became_peered":"2026-02-24T19:18:06.102285+0000","last_unstale":"2026-02-24T19:24:21.553089+0000","last_undegraded":"2026-02-24T19:24:21.553089+0000","last_fullsized":"2026-02-24T19:24:21.553089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T07:17:19.620766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071463911000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":626,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.553628+0000","last_change":"2026-02-24T19:18:46.227053+0000","last_active":"2026-02-24T19:24:21.553628+0000","last_peered":"2026-02-24T19:24:21.553628+0000","last_clean":"2026-02-24T19:24:21.553628+0000","last_became_active":"2026-02-24T19:18:46.224954+0000","last_became_peered":"2026-02-24T19:18:46.224954+0000","last_unstale":"2026-02-24T19:24:21.553628+0000","last_undegraded":"2026-02-24T19:24:21.553628+0000","last_fullsized":"2026-02-24T19:24:21.553628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:09:45.760181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":647,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.544073+0000","last_change":"2026-02-24T19:18:08.293695+0000","last_active":"2026-02-24T19:24:21.544073+0000","last_peered":"2026-02-24T19:24:21.544073+0000","last_clean":"2026-02-24T19:24:21.544073+0000","last_became_active":"2026-02-24T19:18:06.040390+0000","last_became_peered":"2026-02-24T19:18:06.040390+0000","last_unstale":"2026-02-24T19:24:21.544073+0000","last_undegraded":"2026-02-24T19:24:21.544073+0000","last_fullsized":"2026-02-24T19:24:21.544073+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:59:15.837152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.035880255999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":624,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.124087+0000","last_change":"2026-02-24T19:18:45.635906+0000","last_active":"2026-02-24T19:24:19.124087+0000","last_peered":"2026-02-24T19:24:19.124087+0000","last_clean":"2026-02-24T19:24:19.124087+0000","last_became_active":"2026-02-24T19:18:45.633612+0000","last_became_peered":"2026-02-24T19:18:45.633612+0000","last_unstale":"2026-02-24T19:24:19.124087+0000","last_undegraded":"2026-02-24T19:24:19.124087+0000","last_fullsized":"2026-02-24T19:24:19.124087+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:04:11.968601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":645,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:20.706417+0000","last_change":"2026-02-24T19:18:08.371822+0000","last_active":"2026-02-24T19:24:20.706417+0000","last_peered":"2026-02-24T19:24:20.706417+0000","last_clean":"2026-02-24T19:24:20.706417+0000","last_became_active":"2026-02-24T19:18:05.913043+0000","last_became_peered":"2026-02-24T19:18:05.913043+0000","last_unstale":"2026-02-24T19:24:20.706417+0000","last_undegraded":"2026-02-24T19:24:20.706417+0000","last_fullsized":"2026-02-24T19:24:20.706417+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:07:35.933859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030508101999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":628,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.219143+0000","last_change":"2026-02-24T19:18:46.152118+0000","last_active":"2026-02-24T19:24:21.219143+0000","last_peered":"2026-02-24T19:24:21.219143+0000","last_clean":"2026-02-24T19:24:21.219143+0000","last_became_active":"2026-02-24T19:18:46.150051+0000","last_became_peered":"2026-02-24T19:18:46.150051+0000","last_unstale":"2026-02-24T19:24:21.219143+0000","last_undegraded":"2026-02-24T19:24:21.219143+0000","last_fullsized":"2026-02-24T19:24:21.219143+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:17:04.915264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":645,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.556517+0000","last_change":"2026-02-24T19:18:07.773906+0000","last_active":"2026-02-24T19:24:21.556517+0000","last_peered":"2026-02-24T19:24:21.556517+0000","last_clean":"2026-02-24T19:24:21.556517+0000","last_became_active":"2026-02-24T19:18:05.910166+0000","last_became_peered":"2026-02-24T19:18:05.910166+0000","last_unstale":"2026-02-24T19:24:21.556517+0000","last_undegraded":"2026-02-24T19:24:21.556517+0000","last_fullsized":"2026-02-24T19:24:21.556517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:39:15.323606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036726662,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"26'32","reported_seq":694,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.457317+0000","last_change":"2026-02-24T19:17:58.600915+0000","last_active":"2026-02-24T19:24:21.457317+0000","last_peered":"2026-02-24T19:24:21.457317+0000","last_clean":"2026-02-24T19:24:21.457317+0000","last_became_active":"2026-02-24T19:17:58.584752+0000","last_became_peered":"2026-02-24T19:17:58.584752+0000","last_unstale":"2026-02-24T19:24:21.457317+0000","last_undegraded":"2026-02-24T19:24:21.457317+0000","last_fullsized":"2026-02-24T19:24:21.457317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:17:57.017986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:17:57.017986+0000","last_clean_scrub_stamp":"2026-02-24T19:17:57.017986+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:48:59.744548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,10],"acting":[12,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":630,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:20.101420+0000","last_change":"2026-02-24T19:18:45.767728+0000","last_active":"2026-02-24T19:24:20.101420+0000","last_peered":"2026-02-24T19:24:20.101420+0000","last_clean":"2026-02-24T19:24:20.101420+0000","last_became_active":"2026-02-24T19:18:45.762826+0000","last_became_peered":"2026-02-24T19:18:45.762826+0000","last_unstale":"2026-02-24T19:24:20.101420+0000","last_undegraded":"2026-02-24T19:24:20.101420+0000","last_fullsized":"2026-02-24T19:24:20.101420+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:51:03.107522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,13],"acting":[5,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":627,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:20.120006+0000","last_change":"2026-02-24T19:18:45.851171+0000","last_active":"2026-02-24T19:24:20.120006+0000","last_peered":"2026-02-24T19:24:20.120006+0000","last_clean":"2026-02-24T19:24:20.120006+0000","last_became_active":"2026-02-24T19:18:45.848885+0000","last_became_peered":"2026-02-24T19:18:45.848885+0000","last_unstale":"2026-02-24T19:24:20.120006+0000","last_undegraded":"2026-02-24T19:24:20.120006+0000","last_fullsized":"2026-02-24T19:24:20.120006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:33:05.467412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,12],"acting":[7,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":632,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.219572+0000","last_change":"2026-02-24T19:18:45.779094+0000","last_active":"2026-02-24T19:24:21.219572+0000","last_peered":"2026-02-24T19:24:21.219572+0000","last_clean":"2026-02-24T19:24:21.219572+0000","last_became_active":"2026-02-24T19:18:45.776560+0000","last_became_peered":"2026-02-24T19:18:45.776560+0000","last_unstale":"2026-02-24T19:24:21.219572+0000","last_undegraded":"2026-02-24T19:24:21.219572+0000","last_fullsized":"2026-02-24T19:24:21.219572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:41:36.699391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"9.1","version":"34'11","reported_seq":650,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.114808+0000","last_change":"2026-02-24T19:18:47.225931+0000","last_active":"2026-02-24T19:24:19.114808+0000","last_peered":"2026-02-24T19:24:19.114808+0000","last_clean":"2026-02-24T19:24:19.114808+0000","last_became_active":"2026-02-24T19:18:47.223324+0000","last_became_peered":"2026-02-24T19:18:47.223324+0000","last_unstale":"2026-02-24T19:24:19.114808+0000","last_undegraded":"2026-02-24T19:24:19.114808+0000","last_fullsized":"2026-02-24T19:24:19.114808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:12:24.845087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":627,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.184070+0000","last_change":"2026-02-24T19:18:46.077881+0000","last_active":"2026-02-24T19:24:19.184070+0000","last_peered":"2026-02-24T19:24:19.184070+0000","last_clean":"2026-02-24T19:24:19.184070+0000","last_became_active":"2026-02-24T19:18:46.075425+0000","last_became_peered":"2026-02-24T19:18:46.075425+0000","last_unstale":"2026-02-24T19:24:19.184070+0000","last_undegraded":"2026-02-24T19:24:19.184070+0000","last_fullsized":"2026-02-24T19:24:19.184070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:23:06.041454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,8],"acting":[14,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":627,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.188045+0000","last_change":"2026-02-24T19:18:45.984836+0000","last_active":"2026-02-24T19:24:19.188045+0000","last_peered":"2026-02-24T19:24:19.188045+0000","last_clean":"2026-02-24T19:24:19.188045+0000","last_became_active":"2026-02-24T19:18:45.978376+0000","last_became_peered":"2026-02-24T19:18:45.978376+0000","last_unstale":"2026-02-24T19:24:19.188045+0000","last_undegraded":"2026-02-24T19:24:19.188045+0000","last_fullsized":"2026-02-24T19:24:19.188045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:43:57.738043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,9],"acting":[14,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":627,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.182763+0000","last_change":"2026-02-24T19:18:46.028144+0000","last_active":"2026-02-24T19:24:19.182763+0000","last_peered":"2026-02-24T19:24:19.182763+0000","last_clean":"2026-02-24T19:24:19.182763+0000","last_became_active":"2026-02-24T19:18:46.025768+0000","last_became_peered":"2026-02-24T19:18:46.025768+0000","last_unstale":"2026-02-24T19:24:19.182763+0000","last_undegraded":"2026-02-24T19:24:19.182763+0000","last_fullsized":"2026-02-24T19:24:19.182763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:49:38.486896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,8],"acting":[14,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":627,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:20.122830+0000","last_change":"2026-02-24T19:18:45.820589+0000","last_active":"2026-02-24T19:24:20.122830+0000","last_peered":"2026-02-24T19:24:20.122830+0000","last_clean":"2026-02-24T19:24:20.122830+0000","last_became_active":"2026-02-24T19:18:45.818087+0000","last_became_peered":"2026-02-24T19:18:45.818087+0000","last_unstale":"2026-02-24T19:24:20.122830+0000","last_undegraded":"2026-02-24T19:24:20.122830+0000","last_fullsized":"2026-02-24T19:24:20.122830+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:57:48.688473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,12],"acting":[7,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":627,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.168828+0000","last_change":"2026-02-24T19:18:45.323793+0000","last_active":"2026-02-24T19:24:19.168828+0000","last_peered":"2026-02-24T19:24:19.168828+0000","last_clean":"2026-02-24T19:24:19.168828+0000","last_became_active":"2026-02-24T19:18:45.320912+0000","last_became_peered":"2026-02-24T19:18:45.320912+0000","last_unstale":"2026-02-24T19:24:19.168828+0000","last_undegraded":"2026-02-24T19:24:19.168828+0000","last_fullsized":"2026-02-24T19:24:19.168828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:36:16.467243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":628,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-24T19:24:21.221559+0000","last_change":"2026-02-24T19:18:45.406813+0000","last_active":"2026-02-24T19:24:21.221559+0000","last_peered":"2026-02-24T19:24:21.221559+0000","last_clean":"2026-02-24T19:24:21.221559+0000","last_became_active":"2026-02-24T19:18:45.399050+0000","last_became_peered":"2026-02-24T19:18:45.399050+0000","last_unstale":"2026-02-24T19:24:21.221559+0000","last_undegraded":"2026-02-24T19:24:21.221559+0000","last_fullsized":"2026-02-24T19:24:21.221559+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:31:08.031303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":628,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-24T19:24:20.719206+0000","last_change":"2026-02-24T19:18:45.727292+0000","last_active":"2026-02-24T19:24:20.719206+0000","last_peered":"2026-02-24T19:24:20.719206+0000","last_clean":"2026-02-24T19:24:20.719206+0000","last_became_active":"2026-02-24T19:18:45.721374+0000","last_became_peered":"2026-02-24T19:18:45.721374+0000","last_unstale":"2026-02-24T19:24:20.719206+0000","last_undegraded":"2026-02-24T19:24:20.719206+0000","last_fullsized":"2026-02-24T19:24:20.719206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:41:57.598852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,6],"acting":[13,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":627,"reported_epoch":341,"state":"active+clean","last_fresh":"2026-02-24T19:24:19.169913+0000","last_change":"2026-02-24T19:18:45.558833+0000","last_active":"2026-02-24T19:24:19.169913+0000","last_peered":"2026-02-24T19:24:19.169913+0000","last_clean":"2026-02-24T19:24:19.169913+0000","last_became_active":"2026-02-24T19:18:45.553944+0000","last_became_peered":"2026-02-24T19:18:45.553944+0000","last_unstale":"2026-02-24T19:24:19.169913+0000","last_undegraded":"2026-02-24T19:24:19.169913+0000","last_fullsized":"2026-02-24T19:24:19.169913+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:02:54.257449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,13],"acting":[9,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":15},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":21,"seq":90194313296,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33828,"kb_used_data":6868,"kb_used_omap":212,"kb_used_meta":26731,"kb_avail":94338012,"statfs":{"total":96636764160,"available":96602124288,"internally_reserved":0,"allocated":7032832,"data_stored":4337010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":217625,"internal_metadata":27373031},"hb_peers":[0,2,3,4,6,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313295,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33796,"kb_used_data":6836,"kb_used_omap":3017,"kb_used_meta":23926,"kb_avail":94338044,"statfs":{"total":96636764160,"available":96602157056,"internally_reserved":0,"allocated":7000064,"data_stored":4315440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3089424,"internal_metadata":24501232},"hb_peers":[0,1,2,5,6,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313295,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":211,"kb_used_meta":26732,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4324823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":216553,"internal_metadata":27374103},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313295,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33800,"kb_used_data":6840,"kb_used_omap":206,"kb_used_meta":26737,"kb_avail":94338040,"statfs":{"total":96636764160,"available":96602152960,"internally_reserved":0,"allocated":7004160,"data_stored":4315445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":211771,"internal_metadata":27378885},"hb_peers":[1,3,4,5,6,7,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313296,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33796,"kb_used_data":6836,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94338044,"statfs":{"total":96636764160,"available":96602157056,"internally_reserved":0,"allocated":7000064,"data_stored":4315440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":214072,"internal_metadata":27376584},"hb_peers":[0,2,4,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313295,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51844,"kb_used_data":6836,"kb_used_omap":107,"kb_used_meta":44884,"kb_avail":94319996,"statfs":{"total":96636764160,"available":96583675904,"internally_reserved":0,"allocated":7000064,"data_stored":4315440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":110577,"internal_metadata":45961231},"hb_peers":[0,1,3,5,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313295,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33816,"kb_used_data":6856,"kb_used_omap":5821,"kb_used_meta":21122,"kb_avail":94338024,"statfs":{"total":96636764160,"available":96602136576,"internally_reserved":0,"allocated":7020544,"data_stored":4324842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5960958,"internal_metadata":21629698},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313295,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33796,"kb_used_data":6836,"kb_used_omap":98,"kb_used_meta":26845,"kb_avail":94338044,"statfs":{"total":96636764160,"available":96602157056,"internally_reserved":0,"allocated":7000064,"data_stored":4315440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":100579,"internal_metadata":27490077},"hb_peers":[0,1,3,5,6,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313296,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":210,"kb_used_meta":26733,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4324823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":215533,"internal_metadata":27375123},"hb_peers":[0,1,4,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313295,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33796,"kb_used_data":6836,"kb_used_omap":8631,"kb_used_meta":18312,"kb_avail":94338044,"statfs":{"total":96636764160,"available":96602157056,"internally_reserved":0,"allocated":7000064,"data_stored":4315440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8839068,"internal_metadata":18751588},"hb_peers":[1,2,4,5,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313295,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33812,"kb_used_data":6852,"kb_used_omap":208,"kb_used_meta":26735,"kb_avail":94338028,"statfs":{"total":96636764160,"available":96602140672,"internally_reserved":0,"allocated":7016448,"data_stored":4324823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":213278,"internal_metadata":27377378},"hb_peers":[0,2,3,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313295,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33796,"kb_used_data":6836,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94338044,"statfs":{"total":96636764160,"available":96602157056,"internally_reserved":0,"allocated":7000064,"data_stored":4315440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":214294,"internal_metadata":27376362},"hb_peers":[0,1,2,3,4,5,6,7,9,10,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313295,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33796,"kb_used_data":6836,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94338044,"statfs":{"total":96636764160,"available":96602157056,"internally_reserved":0,"allocated":7000064,"data_stored":4315440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":214309,"internal_metadata":27376347},"hb_peers":[0,1,2,3,4,5,7,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313296,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34188,"kb_used_data":7228,"kb_used_omap":5827,"kb_used_meta":21116,"kb_avail":94337652,"statfs":{"total":96636764160,"available":96601755648,"internally_reserved":0,"allocated":7401472,"data_stored":4713280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5967048,"internal_metadata":21623608},"hb_peers":[0,1,3,4,5,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313296,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33804,"kb_used_data":6844,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94338036,"statfs":{"total":96636764160,"available":96602148864,"internally_reserved":0,"allocated":7008256,"data_stored":4315464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":215036,"internal_metadata":27375620},"hb_peers":[0,1,3,4,5,6,7,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313295,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34188,"kb_used_data":7228,"kb_used_omap":186,"kb_used_meta":26757,"kb_avail":94337652,"statfs":{"total":96636764160,"available":96601755648,"internally_reserved":0,"allocated":7401472,"data_stored":4713280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":190680,"internal_metadata":27399976},"hb_peers":[0,1,2,3,4,5,8,9,10,11,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T19:24:25.278 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-24T19:24:25.344 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.343+0000 7f9e8549f640 10 monclient: get_monmap_and_config 2026-02-24T19:24:25.345 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.343+0000 7f9e8549f640 10 monclient: build_initial_monmap 2026-02-24T19:24:25.345 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.343+0000 7f9e8549f640 10 monclient: monmap: 2026-02-24T19:24:25.345 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:25.345 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:25.345 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:25.344170+0000 2026-02-24T19:24:25.345 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:25.344170+0000 2026-02-24T19:24:25.345 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:25.345 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:25.345 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:25.345 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:25.346 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:25.346 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:25.348 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.343+0000 7f9e8549f640 1 Processor -- start 2026-02-24T19:24:25.348 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.343+0000 7f9e8549f640 1 -- start start 2026-02-24T19:24:25.348 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.343+0000 7f9e8549f640 10 monclient: init 2026-02-24T19:24:25.348 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.344+0000 7f9e8549f640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:25.348 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.344+0000 7f9e8549f640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:24:25.348 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.344+0000 7f9e8549f640 10 monclient(hunting): picked mon.noname-b con 0x7f9e80058da0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:25.348 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.344+0000 7f9e8549f640 10 monclient(hunting): picked mon.noname-a con 0x7f9e800b0410 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:25.348 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.344+0000 7f9e8549f640 10 monclient(hunting): picked mon.noname-c con 0x7f9e801626a0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:25.349 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.344+0000 7f9e8549f640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e801655c0 con 0x7f9e800b0410 2026-02-24T19:24:25.349 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.344+0000 7f9e8549f640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e800b12b0 con 0x7f9e80058da0 2026-02-24T19:24:25.349 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.344+0000 7f9e8549f640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e800b1590 con 0x7f9e801626a0 2026-02-24T19:24:25.349 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.344+0000 7f9e8549f640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:25.349 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.344+0000 7f9e8549f640 10 monclient(hunting): authenticate will time out at 4048.026356s 2026-02-24T19:24:25.349 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.344+0000 7f9e7f7fe640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f9e801626a0 0x7f9e801c6d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58202/0 (socket says 10.20.193.26:58202) 2026-02-24T19:24:25.349 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.344+0000 7f9e7f7fe640 1 -- 10.20.193.26:0/650896206 learned_addr learned my addr 10.20.193.26:0/650896206 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:25.349 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.346+0000 7f9e7dffb640 1 -- 10.20.193.26:0/650896206 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2295009440 0 0) 0x7f9e800b1590 con 0x7f9e801626a0 2026-02-24T19:24:25.349 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.346+0000 7f9e7dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:25.349 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.346+0000 7f9e7dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:25.349 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.346+0000 7f9e7dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:25.349 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.346+0000 7f9e7dffb640 10 monclient(hunting): my global_id is 29957 2026-02-24T19:24:25.350 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.346+0000 7f9e7dffb640 1 -- 10.20.193.26:0/650896206 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e6c003610 con 0x7f9e801626a0 2026-02-24T19:24:25.350 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.346+0000 7f9e7dffb640 1 -- 10.20.193.26:0/650896206 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 77376494 0 0) 0x7f9e800b12b0 con 0x7f9e80058da0 2026-02-24T19:24:25.350 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.346+0000 7f9e7dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:25.350 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.346+0000 7f9e7dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:25.350 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.346+0000 7f9e7dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:25.350 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.346+0000 7f9e7dffb640 10 monclient(hunting): my global_id is 28033 2026-02-24T19:24:25.350 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.346+0000 7f9e7dffb640 1 -- 10.20.193.26:0/650896206 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e800b1590 con 0x7f9e80058da0 2026-02-24T19:24:25.350 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.346+0000 7f9e7dffb640 1 -- 10.20.193.26:0/650896206 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 718581434 0 0) 0x7f9e801655c0 con 0x7f9e800b0410 2026-02-24T19:24:25.350 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.346+0000 7f9e7dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:25.350 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.346+0000 7f9e7dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:25.350 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.346+0000 7f9e7dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:25.350 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.346+0000 7f9e7dffb640 10 monclient(hunting): my global_id is 30621 2026-02-24T19:24:25.350 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.346+0000 7f9e7dffb640 1 -- 10.20.193.26:0/650896206 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e800b12b0 con 0x7f9e800b0410 2026-02-24T19:24:25.355 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.347+0000 7f9e7dffb640 1 -- 10.20.193.26:0/650896206 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2830807313 0 0) 0x7f9e6c003610 con 0x7f9e801626a0 2026-02-24T19:24:25.355 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.347+0000 7f9e7dffb640 1 -- 10.20.193.26:0/650896206 >> v1:10.20.193.70:6789/0 conn(0x7f9e80058da0 legacy=0x7f9e801647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:25.356 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.347+0000 7f9e7dffb640 1 -- 10.20.193.26:0/650896206 >> v1:10.20.193.26:6789/0 conn(0x7f9e800b0410 legacy=0x7f9e80164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:25.356 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.347+0000 7f9e7dffb640 10 monclient: _finish_hunting 0 2026-02-24T19:24:25.356 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.347+0000 7f9e7dffb640 1 monclient: found mon.noname-c 2026-02-24T19:24:25.356 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.347+0000 7f9e7dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:25.356 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.347+0000 7f9e7dffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:24:25.356 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.347+0000 7f9e7dffb640 1 -- 10.20.193.26:0/650896206 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e800b1870 con 0x7f9e801626a0 2026-02-24T19:24:25.356 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.347+0000 7f9e7dffb640 10 monclient: _finish_auth 0 2026-02-24T19:24:25.356 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.347+0000 7f9e7dffb640 10 monclient: _check_auth_tickets 2026-02-24T19:24:25.356 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.347+0000 7f9e7dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:25.356 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.347+0000 7f9e7dffb640 1 -- 10.20.193.26:0/650896206 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9e70003170 con 0x7f9e801626a0 2026-02-24T19:24:25.356 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.347+0000 7f9e8549f640 5 monclient: authenticate success, global_id 29957 2026-02-24T19:24:25.356 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.347+0000 7f9e7dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:25.357 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.347+0000 7f9e7dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:25.357 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.347+0000 7f9e7dffb640 10 monclient: dump: 2026-02-24T19:24:25.357 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:25.357 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:25.357 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:25.357 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:25.357 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:25.357 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:25.357 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:25.357 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:25.357 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:25.357 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:25.358 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.347+0000 7f9e8549f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:25.358 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.348+0000 7f9e7dffb640 1 -- 10.20.193.26:0/650896206 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9e70003340 con 0x7f9e801626a0 2026-02-24T19:24:25.358 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.348+0000 7f9e7dffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:25.358 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.348+0000 7f9e7dffb640 1 -- 10.20.193.26:0/650896206 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9e70003780 con 0x7f9e801626a0 2026-02-24T19:24:25.358 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.348+0000 7f9e7dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:25.358 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.348+0000 7f9e7dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:25.358 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.348+0000 7f9e7dffb640 10 monclient: dump: 2026-02-24T19:24:25.358 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:25.358 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:25.358 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:25.358 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:25.358 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:25.359 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:25.359 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:25.359 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:25.359 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:25.359 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:25.359 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.348+0000 7f9e8549f640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:25.359 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.348+0000 7f9e8549f640 4 set_mon_vals no callback set 2026-02-24T19:24:25.359 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.348+0000 7f9e8549f640 10 monclient: shutdown 2026-02-24T19:24:25.359 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.348+0000 7f9e8549f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:25.359 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.348+0000 7f9e8549f640 1 -- 10.20.193.26:0/650896206 >> v1:10.20.193.103:6789/0 conn(0x7f9e801626a0 legacy=0x7f9e801c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:25.359 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.349+0000 7f9e8549f640 1 -- 10.20.193.26:0/650896206 shutdown_connections 2026-02-24T19:24:25.359 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.349+0000 7f9e8549f640 1 -- 10.20.193.26:0/650896206 >> 10.20.193.26:0/650896206 conn(0x7f9e800b65f0 msgr2=0x7f9e800b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:25.359 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.349+0000 7f9e8549f640 1 -- 10.20.193.26:0/650896206 shutdown_connections 2026-02-24T19:24:25.360 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.349+0000 7f9e8549f640 1 -- 10.20.193.26:0/650896206 wait complete. 2026-02-24T19:24:25.360 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.349+0000 7f9e8549f640 10 monclient: build_initial_monmap 2026-02-24T19:24:25.360 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.349+0000 7f9e8549f640 10 monclient: monmap: 2026-02-24T19:24:25.360 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:25.360 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:25.360 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:25.360 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:25.360 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:25.360 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:25.360 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:25.360 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:25.360 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:25.360 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:25.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.349+0000 7f9e8549f640 1 librados: starting msgr at 2026-02-24T19:24:25.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.349+0000 7f9e8549f640 1 librados: starting objecter 2026-02-24T19:24:25.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.349+0000 7f9e8549f640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:25.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.349+0000 7f9e8549f640 1 Processor -- start 2026-02-24T19:24:25.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.349+0000 7f9e8549f640 1 -- start start 2026-02-24T19:24:25.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.349+0000 7f9e8549f640 1 librados: setting wanted keys 2026-02-24T19:24:25.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.349+0000 7f9e8549f640 1 librados: calling monclient init 2026-02-24T19:24:25.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.349+0000 7f9e8549f640 10 monclient: init 2026-02-24T19:24:25.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.350+0000 7f9e8549f640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:25.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.350+0000 7f9e8549f640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:25.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.350+0000 7f9e8549f640 10 monclient(hunting): picked mon.noname-c con 0x7f9e80058da0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:25.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.350+0000 7f9e8549f640 10 monclient(hunting): picked mon.noname-b con 0x7f9e800b0410 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:25.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.350+0000 7f9e8549f640 10 monclient(hunting): picked mon.noname-a con 0x7f9e801626a0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:25.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.350+0000 7f9e8549f640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e8013b7a0 con 0x7f9e801626a0 2026-02-24T19:24:25.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.350+0000 7f9e8549f640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e8013ba80 con 0x7f9e800b0410 2026-02-24T19:24:25.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.350+0000 7f9e8549f640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e8013bd60 con 0x7f9e80058da0 2026-02-24T19:24:25.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.350+0000 7f9e8549f640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:25.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.350+0000 7f9e8549f640 10 monclient(hunting): authenticate will time out at 4048.032183s 2026-02-24T19:24:25.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.350+0000 7f9e7f7fe640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f9e801626a0 0x7f9e80137d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59282/0 (socket says 10.20.193.26:59282) 2026-02-24T19:24:25.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.350+0000 7f9e7f7fe640 1 -- 10.20.193.26:0/1871919004 learned_addr learned my addr 10.20.193.26:0/1871919004 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:25.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.350+0000 7f9e5f7fe640 10 client.?.objecter ms_handle_connect 0x7f9e801626a0 2026-02-24T19:24:25.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.350+0000 7f9e5f7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:25.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.351+0000 7f9e5f7fe640 10 client.?.objecter ms_handle_connect 0x7f9e80058da0 2026-02-24T19:24:25.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.351+0000 7f9e5f7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:25.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.351+0000 7f9e5f7fe640 1 -- 10.20.193.26:0/1871919004 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 510338364 0 0) 0x7f9e8013b7a0 con 0x7f9e801626a0 2026-02-24T19:24:25.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.351+0000 7f9e5f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:25.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.351+0000 7f9e5f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:25.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.351+0000 7f9e5f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:25.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.351+0000 7f9e5f7fe640 10 monclient(hunting): my global_id is 30624 2026-02-24T19:24:25.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.351+0000 7f9e5f7fe640 1 -- 10.20.193.26:0/1871919004 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e4c003610 con 0x7f9e801626a0 2026-02-24T19:24:25.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.351+0000 7f9e5f7fe640 10 client.?.objecter ms_handle_connect 0x7f9e800b0410 2026-02-24T19:24:25.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.351+0000 7f9e5f7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:25.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.352+0000 7f9e5f7fe640 1 -- 10.20.193.26:0/1871919004 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 674646566 0 0) 0x7f9e8013bd60 con 0x7f9e80058da0 2026-02-24T19:24:25.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.352+0000 7f9e5f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:25.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.352+0000 7f9e5f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:25.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.352+0000 7f9e5f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:25.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.352+0000 7f9e5f7fe640 10 monclient(hunting): my global_id is 29960 2026-02-24T19:24:25.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.352+0000 7f9e5f7fe640 1 -- 10.20.193.26:0/1871919004 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e8013b7a0 con 0x7f9e80058da0 2026-02-24T19:24:25.364 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.352+0000 7f9e5f7fe640 1 -- 10.20.193.26:0/1871919004 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2446543809 0 0) 0x7f9e8013ba80 con 0x7f9e800b0410 2026-02-24T19:24:25.364 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.352+0000 7f9e5f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:25.364 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.352+0000 7f9e5f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:25.364 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.352+0000 7f9e5f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:25.364 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.352+0000 7f9e5f7fe640 10 monclient(hunting): my global_id is 28036 2026-02-24T19:24:25.364 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.352+0000 7f9e5f7fe640 1 -- 10.20.193.26:0/1871919004 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e8013bd60 con 0x7f9e800b0410 2026-02-24T19:24:25.364 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.353+0000 7f9e5f7fe640 1 -- 10.20.193.26:0/1871919004 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2449707277 0 0) 0x7f9e4c003610 con 0x7f9e801626a0 2026-02-24T19:24:25.364 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.353+0000 7f9e5f7fe640 1 -- 10.20.193.26:0/1871919004 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9e8013ba80 con 0x7f9e801626a0 2026-02-24T19:24:25.364 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.353+0000 7f9e5f7fe640 1 -- 10.20.193.26:0/1871919004 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9e70003690 con 0x7f9e801626a0 2026-02-24T19:24:25.364 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.353+0000 7f9e5f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:25.364 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.353+0000 7f9e5f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:25.364 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.353+0000 7f9e5f7fe640 10 monclient(hunting): dump: 2026-02-24T19:24:25.364 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:25.365 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:25.365 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:25.365 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:25.365 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:25.365 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:25.365 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:25.365 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:25.365 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:25.365 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:25.365 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.353+0000 7f9e5f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:25.367 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.354+0000 7f9e5f7fe640 1 -- 10.20.193.26:0/1871919004 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2195465468 0 0) 0x7f9e8013bd60 con 0x7f9e800b0410 2026-02-24T19:24:25.367 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.354+0000 7f9e5f7fe640 1 -- 10.20.193.26:0/1871919004 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9e4c003610 con 0x7f9e800b0410 2026-02-24T19:24:25.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.354+0000 7f9e5f7fe640 1 -- 10.20.193.26:0/1871919004 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9e68003060 con 0x7f9e800b0410 2026-02-24T19:24:25.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.354+0000 7f9e5f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:25.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.354+0000 7f9e5f7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:25.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.354+0000 7f9e5f7fe640 10 monclient(hunting): dump: 2026-02-24T19:24:25.368 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:25.368 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:25.368 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:25.368 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:25.368 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:25.368 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:25.368 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:25.369 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:25.369 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:25.369 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:25.369 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.354+0000 7f9e5f7fe640 1 -- 10.20.193.26:0/1871919004 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3562156348 0 0) 0x7f9e8013b7a0 con 0x7f9e80058da0 2026-02-24T19:24:25.369 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.354+0000 7f9e5f7fe640 1 -- 10.20.193.26:0/1871919004 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9e8013bd60 con 0x7f9e80058da0 2026-02-24T19:24:25.369 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.354+0000 7f9e5f7fe640 1 -- 10.20.193.26:0/1871919004 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9e740030b0 con 0x7f9e80058da0 2026-02-24T19:24:25.369 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.354+0000 7f9e5f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:25.369 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.354+0000 7f9e5f7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:25.369 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.354+0000 7f9e5f7fe640 10 monclient(hunting): dump: 2026-02-24T19:24:25.369 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:25.369 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:25.369 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:25.370 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:25.370 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:25.370 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:25.370 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:25.370 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:25.370 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:25.370 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:25.370 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.355+0000 7f9e5f7fe640 1 -- 10.20.193.26:0/1871919004 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4225403472 0 0) 0x7f9e8013ba80 con 0x7f9e801626a0 2026-02-24T19:24:25.370 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.355+0000 7f9e5f7fe640 1 -- 10.20.193.26:0/1871919004 >> v1:10.20.193.103:6789/0 conn(0x7f9e80058da0 legacy=0x7f9e801f9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:25.370 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.355+0000 7f9e5f7fe640 1 -- 10.20.193.26:0/1871919004 >> v1:10.20.193.70:6789/0 conn(0x7f9e800b0410 legacy=0x7f9e801fbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:25.370 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.355+0000 7f9e5f7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:24:25.370 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.355+0000 7f9e5f7fe640 1 monclient: found mon.a 2026-02-24T19:24:25.370 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.355+0000 7f9e5f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:25.371 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.355+0000 7f9e5f7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:25.371 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.355+0000 7f9e5f7fe640 1 -- 10.20.193.26:0/1871919004 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8013c040 con 0x7f9e801626a0 2026-02-24T19:24:25.371 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.355+0000 7f9e5f7fe640 10 monclient: _finish_auth 0 2026-02-24T19:24:25.371 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.355+0000 7f9e5f7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:24:25.371 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.355+0000 7f9e5f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:25.371 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.355+0000 7f9e8549f640 5 monclient: authenticate success, global_id 30624 2026-02-24T19:24:25.371 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.355+0000 7f9e8549f640 10 monclient: _renew_subs 2026-02-24T19:24:25.371 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.355+0000 7f9e8549f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:25.371 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.355+0000 7f9e8549f640 1 -- 10.20.193.26:0/1871919004 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9e8013c320 con 0x7f9e801626a0 2026-02-24T19:24:25.371 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.355+0000 7f9e8549f640 10 client.30624.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:25.371 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.355+0000 7f9e8549f640 10 monclient: _renew_subs 2026-02-24T19:24:25.371 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.355+0000 7f9e8549f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:25.371 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.355+0000 7f9e8549f640 1 -- 10.20.193.26:0/1871919004 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9e801fa480 con 0x7f9e801626a0 2026-02-24T19:24:25.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.355+0000 7f9e8549f640 1 librados: init done 2026-02-24T19:24:25.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.356+0000 7f9e8549f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:25.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.356+0000 7f9e8549f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:25.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.356+0000 7f9e8549f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:25.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.356+0000 7f9e8549f640 1 -- 10.20.193.26:0/1871919004 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e800b6e40 con 0x7f9e801626a0 2026-02-24T19:24:25.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.446+0000 7f9e5f7fe640 1 -- 10.20.193.26:0/1871919004 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9e700032f0 con 0x7f9e801626a0 2026-02-24T19:24:25.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.446+0000 7f9e5f7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:25.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.446+0000 7f9e5f7fe640 1 -- 10.20.193.26:0/1871919004 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9e70004f00 con 0x7f9e801626a0 2026-02-24T19:24:25.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.446+0000 7f9e5f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:25.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.446+0000 7f9e5f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:25.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.446+0000 7f9e7d7fa640 4 set_mon_vals no callback set 2026-02-24T19:24:25.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.446+0000 7f9e5f7fe640 10 monclient: dump: 2026-02-24T19:24:25.448 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:25.448 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:25.448 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:25.448 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:25.449 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:25.449 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:25.449 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:25.449 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:25.449 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:25.449 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:25.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.447+0000 7f9e5f7fe640 1 -- 10.20.193.26:0/1871919004 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f9e7001dd70 con 0x7f9e801626a0 2026-02-24T19:24:25.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.447+0000 7f9e7effd640 10 monclient: get_auth_request con 0x7f9e4c077dd0 auth_method 0 2026-02-24T19:24:25.450 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.448+0000 7f9e5f7fe640 10 client.30624.objecter ms_handle_connect 0x7f9e4c077dd0 2026-02-24T19:24:25.451 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.450+0000 7f9e5f7fe640 1 -- 10.20.193.26:0/1871919004 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7f9e700933b0 con 0x7f9e801626a0 2026-02-24T19:24:25.451 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.450+0000 7f9e5f7fe640 10 client.30624.objecter ms_dispatch2 0x7f9e80000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:25.452 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.450+0000 7f9e5f7fe640 3 client.30624.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:25.452 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.450+0000 7f9e5f7fe640 3 client.30624.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:25.452 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.450+0000 7f9e5f7fe640 20 client.30624.objecter dump_active .. 0 homeless 2026-02-24T19:24:25.452 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.450+0000 7f9e5f7fe640 1 -- 10.20.193.26:0/1871919004 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f9e7005dde0 con 0x7f9e801626a0 2026-02-24T19:24:25.452 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.450+0000 7f9e5f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:25.452 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.450+0000 7f9e5f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:25.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.554+0000 7f9e8549f640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:24:25.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.554+0000 7f9e8549f640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:24:25.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.554+0000 7f9e8549f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:25.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.554+0000 7f9e8549f640 1 -- 10.20.193.26:0/1871919004 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e800b6b60 con 0x7f9e801626a0 2026-02-24T19:24:25.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.570+0000 7f9e5f7fe640 1 -- 10.20.193.26:0/1871919004 <== mon.0 v1:10.20.193.26:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v346) ==== 74+0+23653 (unknown 4026614446 0 3128169070) 0x7f9e7005d6e0 con 0x7f9e801626a0 2026-02-24T19:24:25.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.570+0000 7f9e5f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-24T19:24:25.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.570+0000 7f9e5f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:24:25.572 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:24:25.572 INFO:teuthology.orchestra.run.trial026.stdout:{"epoch":346,"fsid":"33b2b598-dbc5-4d7a-8df7-657f0501fe9e","created":"2026-02-24T19:17:21.810535+0000","modified":"2026-02-24T19:24:23.811295+0000","last_up_change":"2026-02-24T19:17:54.877686+0000","last_in_change":"2026-02-24T19:17:28.575109+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":104,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":268,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-24T19:17:56.803348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-24T19:18:02.876352+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":29,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5.9899997711181641,"score_stable":5.9899997711181641,"optimal_score":0.68999999761581421,"raw_score_acting":4.130000114440918,"raw_score_stable":4.130000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"ceph_test_rados_api_asio","create_time":"2026-02-24T19:18:42.159605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.93999999761581421,"raw_score_acting":1.8700000047683716,"raw_score_stable":1.8700000047683716,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e08ffdb8-0db6-4356-88b5-54397e40be58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":344,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6808","nonce":4098203721}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6809","nonce":4098203721}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6811","nonce":4098203721}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6810","nonce":4098203721}]},"public_addr":"10.20.193.26:6808/4098203721","cluster_addr":"10.20.193.26:6809/4098203721","heartbeat_back_addr":"10.20.193.26:6811/4098203721","heartbeat_front_addr":"10.20.193.26:6810/4098203721","state":["exists","up"]},{"osd":1,"uuid":"08b117f7-0152-42bb-8a51-220b41a964ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":344,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6800","nonce":268803542}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6801","nonce":268803542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6803","nonce":268803542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6802","nonce":268803542}]},"public_addr":"10.20.193.70:6800/268803542","cluster_addr":"10.20.193.70:6801/268803542","heartbeat_back_addr":"10.20.193.70:6803/268803542","heartbeat_front_addr":"10.20.193.70:6802/268803542","state":["exists","up"]},{"osd":2,"uuid":"3c37f6aa-25cb-43be-a75a-86a246086a85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":344,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6800","nonce":3800806982}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6802","nonce":3800806982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6806","nonce":3800806982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6804","nonce":3800806982}]},"public_addr":"10.20.193.103:6800/3800806982","cluster_addr":"10.20.193.103:6802/3800806982","heartbeat_back_addr":"10.20.193.103:6806/3800806982","heartbeat_front_addr":"10.20.193.103:6804/3800806982","state":["exists","up"]},{"osd":3,"uuid":"a7e3939e-f8f5-4216-9700-27e229d1c4d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":344,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6805","nonce":920272754}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6806","nonce":920272754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6808","nonce":920272754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6807","nonce":920272754}]},"public_addr":"10.20.193.162:6805/920272754","cluster_addr":"10.20.193.162:6806/920272754","heartbeat_back_addr":"10.20.193.162:6808/920272754","heartbeat_front_addr":"10.20.193.162:6807/920272754","state":["exists","up"]},{"osd":4,"uuid":"445d43ab-a28c-4afa-90ff-e451602e494f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":344,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6800","nonce":3717327686}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6801","nonce":3717327686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6803","nonce":3717327686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6802","nonce":3717327686}]},"public_addr":"10.20.193.26:6800/3717327686","cluster_addr":"10.20.193.26:6801/3717327686","heartbeat_back_addr":"10.20.193.26:6803/3717327686","heartbeat_front_addr":"10.20.193.26:6802/3717327686","state":["exists","up"]},{"osd":5,"uuid":"37303b3f-6b88-4c73-aaff-10055ec5cc85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":344,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6812","nonce":1419227842}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6813","nonce":1419227842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6815","nonce":1419227842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6814","nonce":1419227842}]},"public_addr":"10.20.193.70:6812/1419227842","cluster_addr":"10.20.193.70:6813/1419227842","heartbeat_back_addr":"10.20.193.70:6815/1419227842","heartbeat_front_addr":"10.20.193.70:6814/1419227842","state":["exists","up"]},{"osd":6,"uuid":"ef2c9883-f17f-41ec-96b7-dbbe936b77d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":299,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6808","nonce":3149418268}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6809","nonce":3149418268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6811","nonce":3149418268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6810","nonce":3149418268}]},"public_addr":"10.20.193.103:6808/3149418268","cluster_addr":"10.20.193.103:6809/3149418268","heartbeat_back_addr":"10.20.193.103:6811/3149418268","heartbeat_front_addr":"10.20.193.103:6810/3149418268","state":["exists","up"]},{"osd":7,"uuid":"3e4a495e-c742-43fc-991a-371a47ff87bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":344,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6809","nonce":2963240067}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6810","nonce":2963240067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6812","nonce":2963240067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6811","nonce":2963240067}]},"public_addr":"10.20.193.162:6809/2963240067","cluster_addr":"10.20.193.162:6810/2963240067","heartbeat_back_addr":"10.20.193.162:6812/2963240067","heartbeat_front_addr":"10.20.193.162:6811/2963240067","state":["exists","up"]},{"osd":8,"uuid":"fb377a45-1ce5-4e07-92cd-7f546cfad57f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":344,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6812","nonce":1933830164}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6813","nonce":1933830164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6815","nonce":1933830164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6814","nonce":1933830164}]},"public_addr":"10.20.193.26:6812/1933830164","cluster_addr":"10.20.193.26:6813/1933830164","heartbeat_back_addr":"10.20.193.26:6815/1933830164","heartbeat_front_addr":"10.20.193.26:6814/1933830164","state":["exists","up"]},{"osd":9,"uuid":"8079b2ca-96c3-4321-9f24-a87e8ea1e883","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":344,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6804","nonce":3709696191}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6805","nonce":3709696191}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6807","nonce":3709696191}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6806","nonce":3709696191}]},"public_addr":"10.20.193.70:6804/3709696191","cluster_addr":"10.20.193.70:6805/3709696191","heartbeat_back_addr":"10.20.193.70:6807/3709696191","heartbeat_front_addr":"10.20.193.70:6806/3709696191","state":["exists","up"]},{"osd":10,"uuid":"8df004a9-88e3-43f5-833d-dfc73a658ec3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":344,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6801","nonce":3185480373}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6803","nonce":3185480373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6807","nonce":3185480373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6805","nonce":3185480373}]},"public_addr":"10.20.193.103:6801/3185480373","cluster_addr":"10.20.193.103:6803/3185480373","heartbeat_back_addr":"10.20.193.103:6807/3185480373","heartbeat_front_addr":"10.20.193.103:6805/3185480373","state":["exists","up"]},{"osd":11,"uuid":"f3cf3a4b-1c26-480c-ba10-178f8542c1e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":344,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6813","nonce":1717662802}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6814","nonce":1717662802}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6816","nonce":1717662802}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6815","nonce":1717662802}]},"public_addr":"10.20.193.162:6813/1717662802","cluster_addr":"10.20.193.162:6814/1717662802","heartbeat_back_addr":"10.20.193.162:6816/1717662802","heartbeat_front_addr":"10.20.193.162:6815/1717662802","state":["exists","up"]},{"osd":12,"uuid":"0e06b2e9-9b29-4c6e-ab44-77fd24d945af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":344,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6804","nonce":2128192173}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6805","nonce":2128192173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6807","nonce":2128192173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.26:6806","nonce":2128192173}]},"public_addr":"10.20.193.26:6804/2128192173","cluster_addr":"10.20.193.26:6805/2128192173","heartbeat_back_addr":"10.20.193.26:6807/2128192173","heartbeat_front_addr":"10.20.193.26:6806/2128192173","state":["exists","up"]},{"osd":13,"uuid":"b1cbaf8b-36e9-4196-a08d-e6e72c2229e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":344,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6808","nonce":2949423039}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6809","nonce":2949423039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6811","nonce":2949423039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.70:6810","nonce":2949423039}]},"public_addr":"10.20.193.70:6808/2949423039","cluster_addr":"10.20.193.70:6809/2949423039","heartbeat_back_addr":"10.20.193.70:6811/2949423039","heartbeat_front_addr":"10.20.193.70:6810/2949423039","state":["exists","up"]},{"osd":14,"uuid":"214e8bfc-c78d-45ac-9ec3-7685dd5684cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":344,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6812","nonce":1276189911}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6813","nonce":1276189911}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6815","nonce":1276189911}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.103:6814","nonce":1276189911}]},"public_addr":"10.20.193.103:6812/1276189911","cluster_addr":"10.20.193.103:6813/1276189911","heartbeat_back_addr":"10.20.193.103:6815/1276189911","heartbeat_front_addr":"10.20.193.103:6814/1276189911","state":["exists","up"]},{"osd":15,"uuid":"8c2eb0c6-abf0-42a7-bcab-83d0c9cf797b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":344,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6801","nonce":3445416924}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6802","nonce":3445416924}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6804","nonce":3445416924}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.162:6803","nonce":3445416924}]},"public_addr":"10.20.193.162:6801/3445416924","cluster_addr":"10.20.193.162:6802/3445416924","heartbeat_back_addr":"10.20.193.162:6804/3445416924","heartbeat_front_addr":"10.20.193.162:6803/3445416924","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.943088+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.818374+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.712635+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:53.063441+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.745019+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:53.046388+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.670956+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:53.091882+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:53.000309+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.773039+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.840607+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:53.229086+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.734626+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.874415+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.926522+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-24T19:17:52.903220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":22,"snaps":[{"begin":2,"length":3}]},{"pool":24,"snaps":[{"begin":1,"length":1}]},{"pool":29,"snaps":[{"begin":4,"length":3}]},{"pool":62,"snaps":[{"begin":1,"length":1}]},{"pool":91,"snaps":[{"begin":7,"length":2}]},{"pool":101,"snaps":[{"begin":9,"length":2},{"begin":14,"length":1}]},{"pool":102,"snaps":[{"begin":1,"length":1}]},{"pool":116,"snaps":[{"begin":1,"length":2}]},{"pool":131,"snaps":[{"begin":3,"length":1}]},{"pool":140,"snaps":[{"begin":2,"length":2}]},{"pool":142,"snaps":[{"begin":2,"length":3}]},{"pool":154,"snaps":[{"begin":2,"length":3}]},{"pool":162,"snaps":[{"begin":2,"length":1}]},{"pool":167,"snaps":[{"begin":2,"length":2}]},{"pool":170,"snaps":[{"begin":2,"length":1},{"begin":4,"length":2}]},{"pool":172,"snaps":[{"begin":1,"length":4}]},{"pool":185,"snaps":[{"begin":4,"length":1},{"begin":6,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-24T19:24:25.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.571+0000 7f9e8549f640 10 librados: watch_flush enter 2026-02-24T19:24:25.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.571+0000 7f9e8549f640 10 librados: watch_flush exit 2026-02-24T19:24:25.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.571+0000 7f9e8549f640 20 client.30624.objecter shutdown clearing up homeless session... 2026-02-24T19:24:25.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.571+0000 7f9e8549f640 10 client.30624.objecter successfully canceled tick 2026-02-24T19:24:25.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.571+0000 7f9e8549f640 1 -- 10.20.193.26:0/1871919004 >> v1:10.20.193.162:6800/3889602630 conn(0x7f9e4c077dd0 legacy=0x7f9e4c098280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:25.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.571+0000 7f9e8549f640 10 monclient: shutdown 2026-02-24T19:24:25.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.571+0000 7f9e8549f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:25.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.571+0000 7f9e8549f640 1 -- 10.20.193.26:0/1871919004 >> v1:10.20.193.26:6789/0 conn(0x7f9e801626a0 legacy=0x7f9e80137d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:25.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.571+0000 7f9e8549f640 1 -- 10.20.193.26:0/1871919004 shutdown_connections 2026-02-24T19:24:25.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.571+0000 7f9e8549f640 1 -- 10.20.193.26:0/1871919004 >> 10.20.193.26:0/1871919004 conn(0x7f9e800b65f0 msgr2=0x7f9e80164430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:25.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.571+0000 7f9e8549f640 1 -- 10.20.193.26:0/1871919004 shutdown_connections 2026-02-24T19:24:25.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.571+0000 7f9e8549f640 1 -- 10.20.193.26:0/1871919004 wait complete. 2026-02-24T19:24:25.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:25.571+0000 7f9e8549f640 1 librados: shutdown 2026-02-24T19:24:26.583 INFO:tasks.ceph:Scrubbing osd.0 2026-02-24T19:24:26.583 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:26.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.651+0000 7f5988a55640 10 monclient: get_monmap_and_config 2026-02-24T19:24:26.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.651+0000 7f5988a55640 10 monclient: build_initial_monmap 2026-02-24T19:24:26.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.651+0000 7f5988a55640 10 monclient: monmap: 2026-02-24T19:24:26.653 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:26.653 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:26.653 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:26.652592+0000 2026-02-24T19:24:26.654 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:26.652592+0000 2026-02-24T19:24:26.654 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:26.654 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:26.654 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:26.654 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:26.654 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:26.654 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:26.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.652+0000 7f5988a55640 1 Processor -- start 2026-02-24T19:24:26.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.652+0000 7f5988a55640 1 -- start start 2026-02-24T19:24:26.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.652+0000 7f5988a55640 10 monclient: init 2026-02-24T19:24:26.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.652+0000 7f5988a55640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:26.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.652+0000 7f5988a55640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:24:26.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.652+0000 7f5988a55640 10 monclient(hunting): picked mon.noname-b con 0x7f598415e2a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:26.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.652+0000 7f5988a55640 10 monclient(hunting): picked mon.noname-a con 0x7f5984059e10 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:26.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.652+0000 7f5988a55640 10 monclient(hunting): picked mon.noname-c con 0x7f59841a5660 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:26.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.652+0000 7f5988a55640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5984162df0 con 0x7f5984059e10 2026-02-24T19:24:26.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.652+0000 7f5988a55640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59841630d0 con 0x7f598415e2a0 2026-02-24T19:24:26.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.652+0000 7f5988a55640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59841633b0 con 0x7f59841a5660 2026-02-24T19:24:26.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.652+0000 7f5988a55640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:26.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.652+0000 7f5988a55640 10 monclient(hunting): authenticate will time out at 4049.334840s 2026-02-24T19:24:26.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.653+0000 7f5982d76640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f59841a5660 0x7f59841c5a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58208/0 (socket says 10.20.193.26:58208) 2026-02-24T19:24:26.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.653+0000 7f5982d76640 1 -- 10.20.193.26:0/1814326167 learned_addr learned my addr 10.20.193.26:0/1814326167 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:26.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.654+0000 7f5981573640 1 -- 10.20.193.26:0/1814326167 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 176056942 0 0) 0x7f59841633b0 con 0x7f59841a5660 2026-02-24T19:24:26.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.654+0000 7f5981573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:26.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.654+0000 7f5981573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:26.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.654+0000 7f5981573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:26.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.654+0000 7f5981573640 10 monclient(hunting): my global_id is 29963 2026-02-24T19:24:26.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.654+0000 7f5981573640 1 -- 10.20.193.26:0/1814326167 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5970003610 con 0x7f59841a5660 2026-02-24T19:24:26.658 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.654+0000 7f5981573640 1 -- 10.20.193.26:0/1814326167 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 365224006 0 0) 0x7f5984162df0 con 0x7f5984059e10 2026-02-24T19:24:26.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.654+0000 7f5981573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:26.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.654+0000 7f5981573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:26.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.654+0000 7f5981573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:26.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.654+0000 7f5981573640 10 monclient(hunting): my global_id is 30627 2026-02-24T19:24:26.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.654+0000 7f5981573640 1 -- 10.20.193.26:0/1814326167 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59841633b0 con 0x7f5984059e10 2026-02-24T19:24:26.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.654+0000 7f5981573640 1 -- 10.20.193.26:0/1814326167 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 952089911 0 0) 0x7f59841630d0 con 0x7f598415e2a0 2026-02-24T19:24:26.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.654+0000 7f5981573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:26.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.654+0000 7f5981573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:26.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.654+0000 7f5981573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:26.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.654+0000 7f5981573640 10 monclient(hunting): my global_id is 28039 2026-02-24T19:24:26.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.654+0000 7f5981573640 1 -- 10.20.193.26:0/1814326167 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5984162df0 con 0x7f598415e2a0 2026-02-24T19:24:26.665 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.656+0000 7f5981573640 1 -- 10.20.193.26:0/1814326167 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1102503255 0 0) 0x7f5970003610 con 0x7f59841a5660 2026-02-24T19:24:26.665 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.656+0000 7f5981573640 1 -- 10.20.193.26:0/1814326167 >> v1:10.20.193.70:6789/0 conn(0x7f598415e2a0 legacy=0x7f598405da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:26.665 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.656+0000 7f5981573640 1 -- 10.20.193.26:0/1814326167 >> v1:10.20.193.26:6789/0 conn(0x7f5984059e10 legacy=0x7f598415ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:26.665 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.656+0000 7f5981573640 10 monclient: _finish_hunting 0 2026-02-24T19:24:26.665 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.656+0000 7f5981573640 1 monclient: found mon.noname-c 2026-02-24T19:24:26.665 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.656+0000 7f5981573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:26.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.656+0000 7f5981573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:24:26.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.656+0000 7f5981573640 1 -- 10.20.193.26:0/1814326167 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5984163690 con 0x7f59841a5660 2026-02-24T19:24:26.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.656+0000 7f5981573640 10 monclient: _finish_auth 0 2026-02-24T19:24:26.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.656+0000 7f5981573640 10 monclient: _check_auth_tickets 2026-02-24T19:24:26.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.656+0000 7f5981573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:26.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.656+0000 7f5981573640 1 -- 10.20.193.26:0/1814326167 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f5974003170 con 0x7f59841a5660 2026-02-24T19:24:26.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.656+0000 7f5988a55640 5 monclient: authenticate success, global_id 29963 2026-02-24T19:24:26.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.656+0000 7f5988a55640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:26.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.656+0000 7f5981573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:26.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.656+0000 7f5981573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:26.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.656+0000 7f5981573640 10 monclient: dump: 2026-02-24T19:24:26.666 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:26.667 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:26.667 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:26.667 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:26.667 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:26.667 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:26.667 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:26.667 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:26.667 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:26.667 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:26.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.656+0000 7f5988a55640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:26.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.657+0000 7f5981573640 1 -- 10.20.193.26:0/1814326167 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5974003340 con 0x7f59841a5660 2026-02-24T19:24:26.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.657+0000 7f5981573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:26.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.657+0000 7f5981573640 1 -- 10.20.193.26:0/1814326167 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f5974003780 con 0x7f59841a5660 2026-02-24T19:24:26.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.657+0000 7f5981573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:26.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.657+0000 7f5981573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:26.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.657+0000 7f5981573640 10 monclient: dump: 2026-02-24T19:24:26.668 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:26.668 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:26.668 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:26.668 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:26.668 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:26.668 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:26.668 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:26.668 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:26.669 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:26.669 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:26.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.657+0000 7f5988a55640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:26.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.657+0000 7f5988a55640 4 set_mon_vals no callback set 2026-02-24T19:24:26.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.657+0000 7f5988a55640 10 monclient: shutdown 2026-02-24T19:24:26.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.657+0000 7f5988a55640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:26.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.657+0000 7f5988a55640 1 -- 10.20.193.26:0/1814326167 >> v1:10.20.193.103:6789/0 conn(0x7f59841a5660 legacy=0x7f59841c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:26.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.657+0000 7f5988a55640 1 -- 10.20.193.26:0/1814326167 shutdown_connections 2026-02-24T19:24:26.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.657+0000 7f5988a55640 1 -- 10.20.193.26:0/1814326167 >> 10.20.193.26:0/1814326167 conn(0x7f59840b2f60 msgr2=0x7f59840b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:26.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.657+0000 7f5988a55640 1 -- 10.20.193.26:0/1814326167 shutdown_connections 2026-02-24T19:24:26.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.657+0000 7f5988a55640 1 -- 10.20.193.26:0/1814326167 wait complete. 2026-02-24T19:24:26.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.658+0000 7f5988a55640 10 monclient: build_initial_monmap 2026-02-24T19:24:26.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.658+0000 7f5988a55640 10 monclient: monmap: 2026-02-24T19:24:26.670 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:26.670 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:26.670 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:26.670 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:26.670 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:26.670 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:26.670 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:26.670 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:26.670 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:26.670 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:26.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.658+0000 7f5988a55640 1 librados: starting msgr at 2026-02-24T19:24:26.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.658+0000 7f5988a55640 1 librados: starting objecter 2026-02-24T19:24:26.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.658+0000 7f5988a55640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:26.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.658+0000 7f5988a55640 1 Processor -- start 2026-02-24T19:24:26.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.658+0000 7f5988a55640 1 -- start start 2026-02-24T19:24:26.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.658+0000 7f5988a55640 1 librados: setting wanted keys 2026-02-24T19:24:26.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.658+0000 7f5988a55640 1 librados: calling monclient init 2026-02-24T19:24:26.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.658+0000 7f5988a55640 10 monclient: init 2026-02-24T19:24:26.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.659+0000 7f5988a55640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:26.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.659+0000 7f5988a55640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:24:26.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.659+0000 7f5988a55640 10 monclient(hunting): picked mon.noname-c con 0x7f5984059e10 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:26.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.659+0000 7f5988a55640 10 monclient(hunting): picked mon.noname-a con 0x7f598415e2a0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:26.671 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.659+0000 7f5988a55640 10 monclient(hunting): picked mon.noname-b con 0x7f59841a5660 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:26.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.659+0000 7f5988a55640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f598412afd0 con 0x7f598415e2a0 2026-02-24T19:24:26.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.659+0000 7f5988a55640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59840a78e0 con 0x7f59841a5660 2026-02-24T19:24:26.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.659+0000 7f5988a55640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59840a7bc0 con 0x7f5984059e10 2026-02-24T19:24:26.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.659+0000 7f5988a55640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:26.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.659+0000 7f5988a55640 10 monclient(hunting): authenticate will time out at 4049.341165s 2026-02-24T19:24:26.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.659+0000 7f5982575640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f5984059e10 0x7f59841241f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58214/0 (socket says 10.20.193.26:58214) 2026-02-24T19:24:26.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.659+0000 7f5982575640 1 -- 10.20.193.26:0/1203871952 learned_addr learned my addr 10.20.193.26:0/1203871952 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:26.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.659+0000 7f596affd640 10 client.?.objecter ms_handle_connect 0x7f598415e2a0 2026-02-24T19:24:26.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.659+0000 7f596affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:26.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.659+0000 7f596affd640 10 client.?.objecter ms_handle_connect 0x7f5984059e10 2026-02-24T19:24:26.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.659+0000 7f596affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:26.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.660+0000 7f596affd640 10 client.?.objecter ms_handle_connect 0x7f59841a5660 2026-02-24T19:24:26.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.660+0000 7f596affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:26.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.660+0000 7f596affd640 1 -- 10.20.193.26:0/1203871952 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 484144225 0 0) 0x7f598412afd0 con 0x7f598415e2a0 2026-02-24T19:24:26.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.660+0000 7f596affd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:26.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.660+0000 7f596affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:26.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.660+0000 7f596affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:26.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.660+0000 7f596affd640 10 monclient(hunting): my global_id is 30630 2026-02-24T19:24:26.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.660+0000 7f596affd640 1 -- 10.20.193.26:0/1203871952 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5950003610 con 0x7f598415e2a0 2026-02-24T19:24:26.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.660+0000 7f596affd640 1 -- 10.20.193.26:0/1203871952 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1414539565 0 0) 0x7f59840a7bc0 con 0x7f5984059e10 2026-02-24T19:24:26.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.660+0000 7f596affd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:26.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.660+0000 7f596affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:26.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.660+0000 7f596affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:26.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.660+0000 7f596affd640 10 monclient(hunting): my global_id is 29966 2026-02-24T19:24:26.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.660+0000 7f596affd640 1 -- 10.20.193.26:0/1203871952 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f598412afd0 con 0x7f5984059e10 2026-02-24T19:24:26.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.661+0000 7f596affd640 1 -- 10.20.193.26:0/1203871952 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2726169130 0 0) 0x7f59840a78e0 con 0x7f59841a5660 2026-02-24T19:24:26.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.661+0000 7f596affd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:26.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.661+0000 7f596affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:26.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.661+0000 7f596affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:26.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.661+0000 7f596affd640 10 monclient(hunting): my global_id is 28042 2026-02-24T19:24:26.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.661+0000 7f596affd640 1 -- 10.20.193.26:0/1203871952 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59840a7bc0 con 0x7f59841a5660 2026-02-24T19:24:26.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.662+0000 7f596affd640 1 -- 10.20.193.26:0/1203871952 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2562459385 0 0) 0x7f5950003610 con 0x7f598415e2a0 2026-02-24T19:24:26.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.662+0000 7f596affd640 1 -- 10.20.193.26:0/1203871952 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59840a78e0 con 0x7f598415e2a0 2026-02-24T19:24:26.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.662+0000 7f596affd640 1 -- 10.20.193.26:0/1203871952 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f596c002ff0 con 0x7f598415e2a0 2026-02-24T19:24:26.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.662+0000 7f596affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:26.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.662+0000 7f596affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:26.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.662+0000 7f596affd640 10 monclient(hunting): dump: 2026-02-24T19:24:26.674 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:26.675 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:26.675 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:26.675 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:26.675 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:26.675 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:26.675 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:26.675 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:26.675 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:26.675 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:26.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.662+0000 7f596affd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:26.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.663+0000 7f596affd640 1 -- 10.20.193.26:0/1203871952 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2325265567 0 0) 0x7f598412afd0 con 0x7f5984059e10 2026-02-24T19:24:26.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.663+0000 7f596affd640 1 -- 10.20.193.26:0/1203871952 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5950003610 con 0x7f5984059e10 2026-02-24T19:24:26.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.663+0000 7f596affd640 1 -- 10.20.193.26:0/1203871952 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f5978003170 con 0x7f5984059e10 2026-02-24T19:24:26.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.663+0000 7f596affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:26.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.663+0000 7f596affd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:26.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.663+0000 7f596affd640 10 monclient(hunting): dump: 2026-02-24T19:24:26.676 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:26.676 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:26.676 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:26.676 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:26.676 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:26.676 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:26.676 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:26.676 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:26.677 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:26.677 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:26.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.663+0000 7f596affd640 1 -- 10.20.193.26:0/1203871952 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2577366623 0 0) 0x7f59840a7bc0 con 0x7f59841a5660 2026-02-24T19:24:26.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.663+0000 7f596affd640 1 -- 10.20.193.26:0/1203871952 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f598412afd0 con 0x7f59841a5660 2026-02-24T19:24:26.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.663+0000 7f596affd640 1 -- 10.20.193.26:0/1203871952 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f59740034f0 con 0x7f59841a5660 2026-02-24T19:24:26.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.663+0000 7f596affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:26.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.663+0000 7f596affd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:26.677 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.663+0000 7f596affd640 10 monclient(hunting): dump: 2026-02-24T19:24:26.677 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:26.677 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:26.677 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:26.677 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:26.678 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:26.678 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:26.678 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:26.678 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:26.678 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:26.678 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:26.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.664+0000 7f596affd640 1 -- 10.20.193.26:0/1203871952 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 496782355 0 0) 0x7f59840a78e0 con 0x7f598415e2a0 2026-02-24T19:24:26.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.664+0000 7f596affd640 1 -- 10.20.193.26:0/1203871952 >> v1:10.20.193.103:6789/0 conn(0x7f5984059e10 legacy=0x7f59841241f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:26.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.664+0000 7f596affd640 1 -- 10.20.193.26:0/1203871952 >> v1:10.20.193.70:6789/0 conn(0x7f59841a5660 legacy=0x7f59840b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:26.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.664+0000 7f596affd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:26.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.664+0000 7f596affd640 1 monclient: found mon.a 2026-02-24T19:24:26.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.664+0000 7f596affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:26.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.664+0000 7f596affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:26.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.664+0000 7f596affd640 1 -- 10.20.193.26:0/1203871952 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59840a7ea0 con 0x7f598415e2a0 2026-02-24T19:24:26.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.664+0000 7f596affd640 10 monclient: _finish_auth 0 2026-02-24T19:24:26.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.664+0000 7f596affd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:26.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.664+0000 7f596affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:26.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.664+0000 7f5988a55640 5 monclient: authenticate success, global_id 30630 2026-02-24T19:24:26.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.664+0000 7f5988a55640 10 monclient: _renew_subs 2026-02-24T19:24:26.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.664+0000 7f5988a55640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:26.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.664+0000 7f5988a55640 1 -- 10.20.193.26:0/1203871952 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f59840a8180 con 0x7f598415e2a0 2026-02-24T19:24:26.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.664+0000 7f5988a55640 10 client.30630.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:26.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.664+0000 7f5988a55640 10 monclient: _renew_subs 2026-02-24T19:24:26.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.664+0000 7f5988a55640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:26.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.664+0000 7f5988a55640 1 -- 10.20.193.26:0/1203871952 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f59840a9270 con 0x7f598415e2a0 2026-02-24T19:24:26.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.664+0000 7f5988a55640 1 librados: init done 2026-02-24T19:24:26.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.664+0000 7f5988a55640 10 client.30630.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:26.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.664+0000 7f5988a55640 15 client.30630.objecter _session_command_op_assign -1 1 2026-02-24T19:24:26.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.664+0000 7f5988a55640 20 client.30630.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:26.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.664+0000 7f5988a55640 10 client.30630.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:26.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.664+0000 7f5988a55640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:26.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.664+0000 7f5988a55640 1 -- 10.20.193.26:0/1203871952 --> v1:10.20.193.26:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f598415fc20 con 0x7f598415e2a0 2026-02-24T19:24:26.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.676+0000 7f596affd640 1 -- 10.20.193.26:0/1203871952 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f598415fc20 con 0x7f598415e2a0 2026-02-24T19:24:26.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.676+0000 7f596affd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:26.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.676+0000 7f596affd640 1 -- 10.20.193.26:0/1203871952 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f596c003670 con 0x7f598415e2a0 2026-02-24T19:24:26.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.676+0000 7f596affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:26.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.676+0000 7f596affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:26.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.676+0000 7f596affd640 10 monclient: dump: 2026-02-24T19:24:26.684 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:26.684 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:26.684 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:26.684 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:26.684 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:26.684 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:26.684 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:26.684 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:26.685 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:26.685 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:26.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.676+0000 7f5980d72640 4 set_mon_vals no callback set 2026-02-24T19:24:26.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.677+0000 7f596affd640 1 -- 10.20.193.26:0/1203871952 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f596c01c550 con 0x7f598415e2a0 2026-02-24T19:24:26.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.677+0000 7f5982575640 10 monclient: get_auth_request con 0x7f5950077e70 auth_method 0 2026-02-24T19:24:26.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.677+0000 7f596affd640 10 client.30630.objecter ms_handle_connect 0x7f5950077e70 2026-02-24T19:24:26.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.678+0000 7f596affd640 1 -- 10.20.193.26:0/1203871952 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7f596c091d90 con 0x7f598415e2a0 2026-02-24T19:24:26.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.678+0000 7f596affd640 10 client.30630.objecter ms_dispatch2 0x7f5984000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:26.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.678+0000 7f596affd640 3 client.30630.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:26.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.678+0000 7f596affd640 3 client.30630.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:26.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.679+0000 7f596affd640 10 client.30630.objecter checking command 1 2026-02-24T19:24:26.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.679+0000 7f596affd640 20 client.30630.objecter _get_session s=0x7f59500a21d0 osd=0 3 2026-02-24T19:24:26.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.679+0000 7f596affd640 20 client.30630.objecter put_session s=0x7f59500a21d0 osd=0 3 2026-02-24T19:24:26.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.679+0000 7f596affd640 15 client.30630.objecter _session_command_op_remove -1 1 2026-02-24T19:24:26.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.679+0000 7f596affd640 20 client.30630.objecter _get_session s=0x7f59500a21d0 osd=0 3 2026-02-24T19:24:26.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.679+0000 7f596affd640 20 client.30630.objecter get_session s=0x7f59500a21d0 osd=0 3 2026-02-24T19:24:26.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.679+0000 7f596affd640 15 client.30630.objecter _session_command_op_assign 0 1 2026-02-24T19:24:26.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.679+0000 7f596affd640 20 client.30630.objecter put_session s=0x7f59500a21d0 osd=0 4 2026-02-24T19:24:26.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.679+0000 7f596affd640 10 client.30630.objecter _send_command 1 2026-02-24T19:24:26.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.679+0000 7f596affd640 1 -- 10.20.193.26:0/1203871952 --> v1:10.20.193.26:6808/4098203721 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f59500c44e0 con 0x7f59500a2880 2026-02-24T19:24:26.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.679+0000 7f596affd640 20 client.30630.objecter dump_active .. 0 homeless 2026-02-24T19:24:26.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.679+0000 7f596affd640 1 -- 10.20.193.26:0/1203871952 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_get_version_reply(handle=1 version=346) ==== 24+0+0 (unknown 2991753921 0 0) 0x7f596c05b7c0 con 0x7f598415e2a0 2026-02-24T19:24:26.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.679+0000 7f596affd640 10 monclient: handle_get_version_reply finishing 1 version 346 2026-02-24T19:24:26.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.679+0000 7f5982d76640 10 monclient: get_auth_request con 0x7f59500a2880 auth_method 0 2026-02-24T19:24:26.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.680+0000 7f596affd640 10 client.30630.objecter ms_handle_connect 0x7f59500a2880 2026-02-24T19:24:26.692 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.690+0000 7f596affd640 1 -- 10.20.193.26:0/1203871952 <== osd.0 v1:10.20.193.26:6808/4098203721 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f59500c44e0 con 0x7f59500a2880 2026-02-24T19:24:26.692 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.690+0000 7f596affd640 10 client.30630.objecter ms_dispatch2 0x7f5984000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:26.692 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.690+0000 7f596affd640 10 client.30630.objecter _finish_command 1 = system:0 2026-02-24T19:24:26.692 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.690+0000 7f596affd640 20 client.30630.objecter put_session s=0x7f59500a21d0 osd=0 4 2026-02-24T19:24:26.692 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.690+0000 7f596affd640 15 client.30630.objecter _session_command_op_remove 0 1 2026-02-24T19:24:26.698 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.697+0000 7f5988a55640 10 client.30630.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:26.698 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.697+0000 7f5988a55640 15 client.30630.objecter _session_command_op_assign -1 2 2026-02-24T19:24:26.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.697+0000 7f5988a55640 20 client.30630.objecter _get_session s=0x7f59500a21d0 osd=0 3 2026-02-24T19:24:26.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.697+0000 7f5988a55640 20 client.30630.objecter put_session s=0x7f59500a21d0 osd=0 3 2026-02-24T19:24:26.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.697+0000 7f5988a55640 20 client.30630.objecter _get_session s=0x7f59500a21d0 osd=0 3 2026-02-24T19:24:26.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.697+0000 7f5988a55640 15 client.30630.objecter _session_command_op_remove -1 2 2026-02-24T19:24:26.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.697+0000 7f5988a55640 20 client.30630.objecter get_session s=0x7f59500a21d0 osd=0 3 2026-02-24T19:24:26.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.697+0000 7f5988a55640 15 client.30630.objecter _session_command_op_assign 0 2 2026-02-24T19:24:26.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.697+0000 7f5988a55640 20 client.30630.objecter put_session s=0x7f59500a21d0 osd=0 4 2026-02-24T19:24:26.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.697+0000 7f5988a55640 10 client.30630.objecter _send_command 2 2026-02-24T19:24:26.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.697+0000 7f5988a55640 1 -- 10.20.193.26:0/1203871952 --> v1:10.20.193.26:6808/4098203721 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f598415f940 con 0x7f59500a2880 2026-02-24T19:24:26.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.711+0000 7f596affd640 1 -- 10.20.193.26:0/1203871952 <== osd.0 v1:10.20.193.26:6808/4098203721 2 ==== command_reply(tid 2: 0 ) ==== 8+0+712 (unknown 0 0 714369635) 0x7f598415f940 con 0x7f59500a2880 2026-02-24T19:24:26.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.711+0000 7f596affd640 10 client.30630.objecter ms_dispatch2 0x7f5984000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:26.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.711+0000 7f596affd640 10 client.30630.objecter _finish_command 2 = system:0 2026-02-24T19:24:26.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.711+0000 7f596affd640 20 client.30630.objecter put_session s=0x7f59500a21d0 osd=0 4 2026-02-24T19:24:26.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.711+0000 7f596affd640 15 client.30630.objecter _session_command_op_remove 0 2 2026-02-24T19:24:26.714 INFO:teuthology.orchestra.run.trial026.stdout:{ 2026-02-24T19:24:26.714 INFO:teuthology.orchestra.run.trial026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-24T19:24:26.714 INFO:teuthology.orchestra.run.trial026.stdout:} 2026-02-24T19:24:26.715 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.711+0000 7f5988a55640 10 librados: watch_flush enter 2026-02-24T19:24:26.715 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.711+0000 7f5988a55640 10 librados: watch_flush exit 2026-02-24T19:24:26.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.711+0000 7f5988a55640 10 client.30630.objecter close_session for osd.0 2026-02-24T19:24:26.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.711+0000 7f5988a55640 1 -- 10.20.193.26:0/1203871952 >> v1:10.20.193.26:6808/4098203721 conn(0x7f59500a2880 legacy=0x7f59500c2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:26.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.711+0000 7f5988a55640 20 client.30630.objecter put_session s=0x7f59500a21d0 osd=0 1 2026-02-24T19:24:26.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.711+0000 7f5988a55640 20 client.30630.objecter shutdown clearing up homeless session... 2026-02-24T19:24:26.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.711+0000 7f5988a55640 10 client.30630.objecter successfully canceled tick 2026-02-24T19:24:26.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.711+0000 7f5988a55640 1 -- 10.20.193.26:0/1203871952 >> v1:10.20.193.162:6800/3889602630 conn(0x7f5950077e70 legacy=0x7f5950098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:26.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.711+0000 7f5988a55640 10 monclient: shutdown 2026-02-24T19:24:26.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.711+0000 7f5988a55640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:26.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.711+0000 7f5988a55640 1 -- 10.20.193.26:0/1203871952 >> v1:10.20.193.26:6789/0 conn(0x7f598415e2a0 legacy=0x7f59840a8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:26.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.711+0000 7f5982d76640 1 -- 10.20.193.26:0/1203871952 reap_dead start 2026-02-24T19:24:26.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.711+0000 7f5988a55640 1 -- 10.20.193.26:0/1203871952 shutdown_connections 2026-02-24T19:24:26.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.711+0000 7f5988a55640 1 -- 10.20.193.26:0/1203871952 >> 10.20.193.26:0/1203871952 conn(0x7f59840b2f60 msgr2=0x7f5984160140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:26.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.711+0000 7f5988a55640 1 -- 10.20.193.26:0/1203871952 shutdown_connections 2026-02-24T19:24:26.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.711+0000 7f5988a55640 1 -- 10.20.193.26:0/1203871952 wait complete. 2026-02-24T19:24:26.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.711+0000 7f5988a55640 1 librados: shutdown 2026-02-24T19:24:26.721 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-24T19:24:26.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.788+0000 7f49340d0640 10 monclient: get_monmap_and_config 2026-02-24T19:24:26.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.788+0000 7f49340d0640 10 monclient: build_initial_monmap 2026-02-24T19:24:26.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.788+0000 7f49340d0640 10 monclient: monmap: 2026-02-24T19:24:26.790 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:26.790 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:26.790 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:26.788888+0000 2026-02-24T19:24:26.790 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:26.788888+0000 2026-02-24T19:24:26.790 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:26.790 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:26.790 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:26.790 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:26.790 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:26.790 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:26.793 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.788+0000 7f49340d0640 1 Processor -- start 2026-02-24T19:24:26.793 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.788+0000 7f49340d0640 1 -- start start 2026-02-24T19:24:26.793 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.788+0000 7f49340d0640 10 monclient: init 2026-02-24T19:24:26.793 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.789+0000 7f49340d0640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:26.793 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.789+0000 7f49340d0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:26.793 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.789+0000 7f49340d0640 10 monclient(hunting): picked mon.noname-a con 0x7f492c157780 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:26.793 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.789+0000 7f49340d0640 10 monclient(hunting): picked mon.noname-c con 0x7f492c157b50 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:26.793 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.789+0000 7f49340d0640 10 monclient(hunting): picked mon.noname-b con 0x7f492c164d00 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:26.793 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.789+0000 7f49340d0640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492c05de70 con 0x7f492c157780 2026-02-24T19:24:26.793 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.789+0000 7f49340d0640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492c055b20 con 0x7f492c164d00 2026-02-24T19:24:26.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.789+0000 7f49340d0640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492c055e00 con 0x7f492c157b50 2026-02-24T19:24:26.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.789+0000 7f49340d0640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:26.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.789+0000 7f49340d0640 10 monclient(hunting): authenticate will time out at 4049.471166s 2026-02-24T19:24:26.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.789+0000 7f4931e45640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f492c157780 0x7f492c056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59320/0 (socket says 10.20.193.26:59320) 2026-02-24T19:24:26.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.789+0000 7f4931e45640 1 -- 10.20.193.26:0/1384083560 learned_addr learned my addr 10.20.193.26:0/1384083560 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:26.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.790+0000 7f4930e43640 1 -- 10.20.193.26:0/1384083560 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4136640212 0 0) 0x7f492c05de70 con 0x7f492c157780 2026-02-24T19:24:26.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.790+0000 7f4930e43640 10 monclient(hunting): _negotiate 2026-02-24T19:24:26.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.790+0000 7f4930e43640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:26.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.790+0000 7f4930e43640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:26.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.790+0000 7f4930e43640 10 monclient(hunting): my global_id is 30633 2026-02-24T19:24:26.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.791+0000 7f4930e43640 1 -- 10.20.193.26:0/1384083560 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4914003610 con 0x7f492c157780 2026-02-24T19:24:26.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.791+0000 7f4930e43640 1 -- 10.20.193.26:0/1384083560 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 81902539 0 0) 0x7f492c055e00 con 0x7f492c157b50 2026-02-24T19:24:26.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.791+0000 7f4930e43640 10 monclient(hunting): _negotiate 2026-02-24T19:24:26.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.791+0000 7f4930e43640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:26.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.791+0000 7f4930e43640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:26.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.791+0000 7f4930e43640 10 monclient(hunting): my global_id is 29969 2026-02-24T19:24:26.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.791+0000 7f4930e43640 1 -- 10.20.193.26:0/1384083560 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f492c05de70 con 0x7f492c157b50 2026-02-24T19:24:26.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.791+0000 7f4930e43640 1 -- 10.20.193.26:0/1384083560 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 846520968 0 0) 0x7f492c055b20 con 0x7f492c164d00 2026-02-24T19:24:26.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.791+0000 7f4930e43640 10 monclient(hunting): _negotiate 2026-02-24T19:24:26.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.791+0000 7f4930e43640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:26.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.791+0000 7f4930e43640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:26.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.791+0000 7f4930e43640 10 monclient(hunting): my global_id is 28045 2026-02-24T19:24:26.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.791+0000 7f4930e43640 1 -- 10.20.193.26:0/1384083560 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f492c055e00 con 0x7f492c164d00 2026-02-24T19:24:26.800 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.792+0000 7f4930e43640 1 -- 10.20.193.26:0/1384083560 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2188116015 0 0) 0x7f492c05de70 con 0x7f492c157b50 2026-02-24T19:24:26.800 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.792+0000 7f4930e43640 1 -- 10.20.193.26:0/1384083560 >> v1:10.20.193.70:6789/0 conn(0x7f492c164d00 legacy=0x7f492c1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:26.800 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.792+0000 7f4930e43640 1 -- 10.20.193.26:0/1384083560 >> v1:10.20.193.26:6789/0 conn(0x7f492c157780 legacy=0x7f492c056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:26.800 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.792+0000 7f4930e43640 10 monclient: _finish_hunting 0 2026-02-24T19:24:26.800 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.792+0000 7f4930e43640 1 monclient: found mon.noname-c 2026-02-24T19:24:26.800 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.792+0000 7f4930e43640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:26.800 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.792+0000 7f4930e43640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:24:26.800 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.792+0000 7f4930e43640 1 -- 10.20.193.26:0/1384083560 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492c0560e0 con 0x7f492c157b50 2026-02-24T19:24:26.800 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.792+0000 7f4930e43640 10 monclient: _finish_auth 0 2026-02-24T19:24:26.800 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.792+0000 7f4930e43640 10 monclient: _check_auth_tickets 2026-02-24T19:24:26.801 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.792+0000 7f4930e43640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:26.801 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.792+0000 7f4930e43640 1 -- 10.20.193.26:0/1384083560 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f4920002df0 con 0x7f492c157b50 2026-02-24T19:24:26.801 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.792+0000 7f4930e43640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:26.801 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.792+0000 7f4930e43640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:26.801 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.792+0000 7f4930e43640 10 monclient: dump: 2026-02-24T19:24:26.801 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:26.801 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:26.801 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:26.801 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:26.801 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:26.801 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:26.801 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:26.802 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:26.802 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:26.802 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:26.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.792+0000 7f49340d0640 5 monclient: authenticate success, global_id 29969 2026-02-24T19:24:26.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.792+0000 7f49340d0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:26.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.793+0000 7f4930e43640 1 -- 10.20.193.26:0/1384083560 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4920002fc0 con 0x7f492c157b50 2026-02-24T19:24:26.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.793+0000 7f4930e43640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:26.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.793+0000 7f4930e43640 1 -- 10.20.193.26:0/1384083560 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f4920003400 con 0x7f492c157b50 2026-02-24T19:24:26.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.793+0000 7f49340d0640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:26.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.793+0000 7f49340d0640 4 set_mon_vals no callback set 2026-02-24T19:24:26.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.793+0000 7f4930e43640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:26.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.793+0000 7f4930e43640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:26.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.793+0000 7f4930e43640 10 monclient: dump: 2026-02-24T19:24:26.803 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:26.803 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:26.803 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:26.803 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:26.803 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:26.803 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:26.803 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:26.803 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:26.803 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:26.803 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:26.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.793+0000 7f49340d0640 10 monclient: shutdown 2026-02-24T19:24:26.804 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.793+0000 7f49340d0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:26.804 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.793+0000 7f49340d0640 1 -- 10.20.193.26:0/1384083560 >> v1:10.20.193.103:6789/0 conn(0x7f492c157b50 legacy=0x7f492c1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:26.804 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.793+0000 7f49340d0640 1 -- 10.20.193.26:0/1384083560 shutdown_connections 2026-02-24T19:24:26.804 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.794+0000 7f49340d0640 1 -- 10.20.193.26:0/1384083560 >> 10.20.193.26:0/1384083560 conn(0x7f492c0b2ef0 msgr2=0x7f492c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:26.804 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.794+0000 7f49340d0640 1 -- 10.20.193.26:0/1384083560 shutdown_connections 2026-02-24T19:24:26.804 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.794+0000 7f49340d0640 1 -- 10.20.193.26:0/1384083560 wait complete. 2026-02-24T19:24:26.804 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.794+0000 7f49340d0640 10 monclient: build_initial_monmap 2026-02-24T19:24:26.804 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.794+0000 7f49340d0640 10 monclient: monmap: 2026-02-24T19:24:26.804 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:26.804 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:26.804 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:26.804 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:26.804 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:26.805 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:26.805 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:26.805 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:26.805 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:26.805 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:26.805 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.794+0000 7f49340d0640 1 librados: starting msgr at 2026-02-24T19:24:26.805 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.794+0000 7f49340d0640 1 librados: starting objecter 2026-02-24T19:24:26.805 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.794+0000 7f49340d0640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:26.805 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.794+0000 7f49340d0640 1 Processor -- start 2026-02-24T19:24:26.805 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.794+0000 7f49340d0640 1 -- start start 2026-02-24T19:24:26.805 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.794+0000 7f49340d0640 1 librados: setting wanted keys 2026-02-24T19:24:26.805 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.794+0000 7f49340d0640 1 librados: calling monclient init 2026-02-24T19:24:26.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.794+0000 7f49340d0640 10 monclient: init 2026-02-24T19:24:26.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.795+0000 7f49340d0640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:26.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.795+0000 7f49340d0640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:26.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.795+0000 7f49340d0640 10 monclient(hunting): picked mon.noname-c con 0x7f492c157780 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:26.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.795+0000 7f49340d0640 10 monclient(hunting): picked mon.noname-b con 0x7f492c157b50 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:26.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.795+0000 7f49340d0640 10 monclient(hunting): picked mon.noname-a con 0x7f492c164d00 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:26.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.795+0000 7f49340d0640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492c1487c0 con 0x7f492c164d00 2026-02-24T19:24:26.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.795+0000 7f49340d0640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492c148aa0 con 0x7f492c157b50 2026-02-24T19:24:26.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.795+0000 7f49340d0640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492c148d80 con 0x7f492c157780 2026-02-24T19:24:26.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.795+0000 7f49340d0640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:26.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.795+0000 7f49340d0640 10 monclient(hunting): authenticate will time out at 4049.477140s 2026-02-24T19:24:26.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.795+0000 7f4931e45640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f492c157780 0x7f492c05c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58230/0 (socket says 10.20.193.26:58230) 2026-02-24T19:24:26.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.795+0000 7f4931e45640 1 -- 10.20.193.26:0/3694045742 learned_addr learned my addr 10.20.193.26:0/3694045742 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:26.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.795+0000 7f491a7fc640 10 client.?.objecter ms_handle_connect 0x7f492c157780 2026-02-24T19:24:26.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.795+0000 7f491a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:26.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.796+0000 7f491a7fc640 10 client.?.objecter ms_handle_connect 0x7f492c157b50 2026-02-24T19:24:26.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.796+0000 7f491a7fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:26.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.796+0000 7f491a7fc640 1 -- 10.20.193.26:0/3694045742 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3789377555 0 0) 0x7f492c148d80 con 0x7f492c157780 2026-02-24T19:24:26.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.796+0000 7f491a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:26.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.796+0000 7f491a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:26.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.796+0000 7f491a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:26.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.796+0000 7f491a7fc640 10 monclient(hunting): my global_id is 29972 2026-02-24T19:24:26.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.796+0000 7f491a7fc640 1 -- 10.20.193.26:0/3694045742 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48fc003610 con 0x7f492c157780 2026-02-24T19:24:26.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.797+0000 7f491a7fc640 1 -- 10.20.193.26:0/3694045742 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2750750572 0 0) 0x7f492c148aa0 con 0x7f492c157b50 2026-02-24T19:24:26.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.797+0000 7f491a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:26.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.797+0000 7f491a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:26.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.797+0000 7f491a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:26.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.797+0000 7f491a7fc640 10 monclient(hunting): my global_id is 28048 2026-02-24T19:24:26.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.797+0000 7f491a7fc640 1 -- 10.20.193.26:0/3694045742 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f492c148d80 con 0x7f492c157b50 2026-02-24T19:24:26.810 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.799+0000 7f491a7fc640 1 -- 10.20.193.26:0/3694045742 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2627033096 0 0) 0x7f48fc003610 con 0x7f492c157780 2026-02-24T19:24:26.810 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.799+0000 7f491a7fc640 1 -- 10.20.193.26:0/3694045742 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f492c148aa0 con 0x7f492c157780 2026-02-24T19:24:26.811 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.799+0000 7f491a7fc640 1 -- 10.20.193.26:0/3694045742 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f491c0030b0 con 0x7f492c157780 2026-02-24T19:24:26.811 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.799+0000 7f491a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:26.811 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.799+0000 7f491a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:26.811 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.799+0000 7f491a7fc640 10 monclient(hunting): dump: 2026-02-24T19:24:26.811 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:26.811 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:26.811 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:26.811 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:26.811 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:26.811 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:26.811 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:26.811 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:26.812 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:26.812 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:26.812 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.799+0000 7f491a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:26.812 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.800+0000 7f491a7fc640 1 -- 10.20.193.26:0/3694045742 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 752375616 0 0) 0x7f492c148d80 con 0x7f492c157b50 2026-02-24T19:24:26.812 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.800+0000 7f491a7fc640 1 -- 10.20.193.26:0/3694045742 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48fc003610 con 0x7f492c157b50 2026-02-24T19:24:26.812 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.800+0000 7f491a7fc640 1 -- 10.20.193.26:0/3694045742 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f4920003310 con 0x7f492c157b50 2026-02-24T19:24:26.812 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.800+0000 7f491a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:26.812 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.800+0000 7f491a7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:26.812 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.800+0000 7f491a7fc640 10 monclient(hunting): dump: 2026-02-24T19:24:26.812 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:26.812 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:26.812 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:26.813 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:26.813 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:26.813 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:26.813 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:26.813 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:26.813 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:26.813 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:26.813 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.800+0000 7f491a7fc640 1 -- 10.20.193.26:0/3694045742 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4157498907 0 0) 0x7f492c148aa0 con 0x7f492c157780 2026-02-24T19:24:26.813 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.800+0000 7f491a7fc640 1 -- 10.20.193.26:0/3694045742 >> v1:10.20.193.70:6789/0 conn(0x7f492c157b50 legacy=0x7f492c058b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:26.813 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.800+0000 7f491a7fc640 1 -- 10.20.193.26:0/3694045742 >> v1:10.20.193.26:6789/0 conn(0x7f492c164d00 legacy=0x7f492c128150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:26.813 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.800+0000 7f491a7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:24:26.813 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.800+0000 7f491a7fc640 1 monclient: found mon.c 2026-02-24T19:24:26.813 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.800+0000 7f491a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:26.814 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.800+0000 7f491a7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:26.814 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.800+0000 7f491a7fc640 1 -- 10.20.193.26:0/3694045742 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492c05b900 con 0x7f492c157780 2026-02-24T19:24:26.814 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.800+0000 7f491a7fc640 10 monclient: _finish_auth 0 2026-02-24T19:24:26.814 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.800+0000 7f491a7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:24:26.814 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.800+0000 7f491a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:26.814 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.800+0000 7f49340d0640 5 monclient: authenticate success, global_id 29972 2026-02-24T19:24:26.814 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.800+0000 7f49340d0640 10 monclient: _renew_subs 2026-02-24T19:24:26.814 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.800+0000 7f49340d0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:26.814 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.800+0000 7f49340d0640 1 -- 10.20.193.26:0/3694045742 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f492c148290 con 0x7f492c157780 2026-02-24T19:24:26.814 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.800+0000 7f49340d0640 10 client.29972.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:26.814 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.800+0000 7f49340d0640 10 monclient: _renew_subs 2026-02-24T19:24:26.814 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.800+0000 7f49340d0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:26.814 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.800+0000 7f49340d0640 1 -- 10.20.193.26:0/3694045742 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f492c05c9f0 con 0x7f492c157780 2026-02-24T19:24:26.815 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.800+0000 7f49340d0640 1 librados: init done 2026-02-24T19:24:26.815 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.801+0000 7f49340d0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:26.815 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.801+0000 7f49340d0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:26.815 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.801+0000 7f49340d0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:26.815 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.801+0000 7f49340d0640 1 -- 10.20.193.26:0/3694045742 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f492c148f50 con 0x7f492c157780 2026-02-24T19:24:26.815 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.808+0000 7f491a7fc640 1 -- 10.20.193.26:0/3694045742 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f491c0048d0 con 0x7f492c157780 2026-02-24T19:24:26.815 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.808+0000 7f491a7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:26.815 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.808+0000 7f491a7fc640 1 -- 10.20.193.26:0/3694045742 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f491c004c20 con 0x7f492c157780 2026-02-24T19:24:26.815 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.808+0000 7f491a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:26.815 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.808+0000 7f491a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:26.815 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.808+0000 7f491a7fc640 10 monclient: dump: 2026-02-24T19:24:26.815 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:26.815 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:26.816 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:26.816 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:26.816 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:26.816 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:26.816 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:26.816 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:26.816 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:26.816 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:26.816 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.808+0000 7f491bfff640 4 set_mon_vals no callback set 2026-02-24T19:24:26.816 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.809+0000 7f491a7fc640 1 -- 10.20.193.26:0/3694045742 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f491c01da90 con 0x7f492c157780 2026-02-24T19:24:26.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.809+0000 7f4931644640 10 monclient: get_auth_request con 0x7f48fc077ba0 auth_method 0 2026-02-24T19:24:26.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.810+0000 7f491a7fc640 10 client.29972.objecter ms_handle_connect 0x7f48fc077ba0 2026-02-24T19:24:26.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.810+0000 7f491a7fc640 1 -- 10.20.193.26:0/3694045742 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7f491c093400 con 0x7f492c157780 2026-02-24T19:24:26.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.810+0000 7f491a7fc640 10 client.29972.objecter ms_dispatch2 0x7f492c000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:26.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.810+0000 7f491a7fc640 3 client.29972.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:26.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.810+0000 7f491a7fc640 3 client.29972.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:26.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.810+0000 7f491a7fc640 20 client.29972.objecter dump_active .. 0 homeless 2026-02-24T19:24:26.898 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.897+0000 7f491a7fc640 1 -- 10.20.193.26:0/3694045742 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f491c05de30 con 0x7f492c157780 2026-02-24T19:24:26.898 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.897+0000 7f491a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:26.898 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:26.897+0000 7f491a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:26.900 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:07:24.874 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:26.925 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:07:24.861 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:26.926 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:07:24.863 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:26.927 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:07:24.901 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:26.945 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:07:24.881 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:26.949 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:07:24.924 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:26.955 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:07:24.926 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:26.957 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:07:24.928 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:26.976 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:07:24.946 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:27.006 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.004+0000 7f49340d0640 1 -- 10.20.193.26:0/3694045742 --> v1:10.20.193.162:6800/3889602630 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f492c05b740 con 0x7f48fc077ba0 2026-02-24T19:24:27.006 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.005+0000 7f491a7fc640 1 -- 10.20.193.26:0/3694045742 <== mgr.4107 v1:10.20.193.162:6800/3889602630 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (unknown 2057319476 0 0) 0x7f49200048c0 con 0x7f48fc077ba0 2026-02-24T19:24:27.006 INFO:teuthology.orchestra.run.trial026.stderr:instructed osd(s) 0 to deep-scrub 2026-02-24T19:24:27.009 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.007+0000 7f49340d0640 10 librados: watch_flush enter 2026-02-24T19:24:27.009 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.007+0000 7f49340d0640 10 librados: watch_flush exit 2026-02-24T19:24:27.009 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.007+0000 7f49340d0640 20 client.29972.objecter shutdown clearing up homeless session... 2026-02-24T19:24:27.010 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.007+0000 7f49340d0640 10 client.29972.objecter successfully canceled tick 2026-02-24T19:24:27.010 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.007+0000 7f49340d0640 1 -- 10.20.193.26:0/3694045742 >> v1:10.20.193.162:6800/3889602630 conn(0x7f48fc077ba0 legacy=0x7f48fc098050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.010 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.007+0000 7f49340d0640 10 monclient: shutdown 2026-02-24T19:24:27.010 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.007+0000 7f49340d0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:27.010 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.007+0000 7f49340d0640 1 -- 10.20.193.26:0/3694045742 >> v1:10.20.193.103:6789/0 conn(0x7f492c157780 legacy=0x7f492c05c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.010 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.007+0000 7f49340d0640 1 -- 10.20.193.26:0/3694045742 shutdown_connections 2026-02-24T19:24:27.010 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.007+0000 7f49340d0640 1 -- 10.20.193.26:0/3694045742 >> 10.20.193.26:0/3694045742 conn(0x7f492c0b2ef0 msgr2=0x7f492c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:27.010 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.007+0000 7f49340d0640 1 -- 10.20.193.26:0/3694045742 shutdown_connections 2026-02-24T19:24:27.010 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.007+0000 7f49340d0640 1 -- 10.20.193.26:0/3694045742 wait complete. 2026-02-24T19:24:27.010 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.007+0000 7f49340d0640 1 librados: shutdown 2026-02-24T19:24:27.017 INFO:tasks.ceph:Scrubbing osd.4 2026-02-24T19:24:27.018 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:27.086 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.084+0000 7f06f1371640 10 monclient: get_monmap_and_config 2026-02-24T19:24:27.086 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.084+0000 7f06f1371640 10 monclient: build_initial_monmap 2026-02-24T19:24:27.086 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.084+0000 7f06f1371640 10 monclient: monmap: 2026-02-24T19:24:27.086 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:27.086 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.086 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:27.085476+0000 2026-02-24T19:24:27.086 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:27.085476+0000 2026-02-24T19:24:27.087 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:27.087 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.087 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:27.087 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:27.087 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:27.087 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.085+0000 7f06f1371640 1 Processor -- start 2026-02-24T19:24:27.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.085+0000 7f06f1371640 1 -- start start 2026-02-24T19:24:27.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.085+0000 7f06f1371640 10 monclient: init 2026-02-24T19:24:27.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.085+0000 7f06f1371640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:27.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.085+0000 7f06f1371640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:24:27.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.085+0000 7f06f1371640 10 monclient(hunting): picked mon.noname-b con 0x7f06ec15e2a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:27.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.086+0000 7f06f1371640 10 monclient(hunting): picked mon.noname-c con 0x7f06ec059e10 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:27.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.086+0000 7f06f1371640 10 monclient(hunting): picked mon.noname-a con 0x7f06ec1a5660 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:27.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.086+0000 7f06f1371640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06ec162df0 con 0x7f06ec1a5660 2026-02-24T19:24:27.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.086+0000 7f06f1371640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06ec1630d0 con 0x7f06ec15e2a0 2026-02-24T19:24:27.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.086+0000 7f06f1371640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06ec1633b0 con 0x7f06ec059e10 2026-02-24T19:24:27.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.086+0000 7f06f1371640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:27.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.086+0000 7f06f1371640 10 monclient(hunting): authenticate will time out at 4049.768057s 2026-02-24T19:24:27.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.087+0000 7f06ea7fc640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f06ec059e10 0x7f06ec15ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58246/0 (socket says 10.20.193.26:58246) 2026-02-24T19:24:27.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.087+0000 7f06ea7fc640 1 -- 10.20.193.26:0/4141525507 learned_addr learned my addr 10.20.193.26:0/4141525507 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:27.091 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.089+0000 7f06e9ffb640 1 -- 10.20.193.26:0/4141525507 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1061557069 0 0) 0x7f06ec1630d0 con 0x7f06ec15e2a0 2026-02-24T19:24:27.091 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.090+0000 7f06e9ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.091 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.090+0000 7f06e9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.091 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.090+0000 7f06e9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.092 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.090+0000 7f06e9ffb640 10 monclient(hunting): my global_id is 28051 2026-02-24T19:24:27.092 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.090+0000 7f06e9ffb640 1 -- 10.20.193.26:0/4141525507 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06d8003610 con 0x7f06ec15e2a0 2026-02-24T19:24:27.092 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.090+0000 7f06e9ffb640 1 -- 10.20.193.26:0/4141525507 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3298662737 0 0) 0x7f06ec1633b0 con 0x7f06ec059e10 2026-02-24T19:24:27.092 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.090+0000 7f06e9ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.092 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.090+0000 7f06e9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.092 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.090+0000 7f06e9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.092 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.090+0000 7f06e9ffb640 10 monclient(hunting): my global_id is 29975 2026-02-24T19:24:27.093 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.090+0000 7f06e9ffb640 1 -- 10.20.193.26:0/4141525507 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06ec1630d0 con 0x7f06ec059e10 2026-02-24T19:24:27.093 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.091+0000 7f06e9ffb640 1 -- 10.20.193.26:0/4141525507 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2279179030 0 0) 0x7f06ec162df0 con 0x7f06ec1a5660 2026-02-24T19:24:27.093 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.091+0000 7f06e9ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.093 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.091+0000 7f06e9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.093 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.091+0000 7f06e9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.094 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.091+0000 7f06e9ffb640 10 monclient(hunting): my global_id is 30636 2026-02-24T19:24:27.094 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.091+0000 7f06e9ffb640 1 -- 10.20.193.26:0/4141525507 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06ec1633b0 con 0x7f06ec1a5660 2026-02-24T19:24:27.095 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.093+0000 7f06e9ffb640 1 -- 10.20.193.26:0/4141525507 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2668369817 0 0) 0x7f06d8003610 con 0x7f06ec15e2a0 2026-02-24T19:24:27.095 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.093+0000 7f06e9ffb640 1 -- 10.20.193.26:0/4141525507 >> v1:10.20.193.103:6789/0 conn(0x7f06ec059e10 legacy=0x7f06ec15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.095 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.093+0000 7f06e9ffb640 1 -- 10.20.193.26:0/4141525507 >> v1:10.20.193.26:6789/0 conn(0x7f06ec1a5660 legacy=0x7f06ec1c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.095 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.093+0000 7f06e9ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:24:27.096 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.093+0000 7f06e9ffb640 1 monclient: found mon.noname-b 2026-02-24T19:24:27.096 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.093+0000 7f06e9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:27.096 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.093+0000 7f06e9ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:24:27.096 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.093+0000 7f06e9ffb640 1 -- 10.20.193.26:0/4141525507 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ec163690 con 0x7f06ec15e2a0 2026-02-24T19:24:27.096 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.093+0000 7f06e9ffb640 10 monclient: _finish_auth 0 2026-02-24T19:24:27.096 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.093+0000 7f06e9ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:24:27.096 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.093+0000 7f06e9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:27.096 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.093+0000 7f06f1371640 5 monclient: authenticate success, global_id 28051 2026-02-24T19:24:27.096 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.093+0000 7f06f1371640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:27.096 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.093+0000 7f06e9ffb640 1 -- 10.20.193.26:0/4141525507 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f06e0002df0 con 0x7f06ec15e2a0 2026-02-24T19:24:27.096 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.093+0000 7f06e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:27.096 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.093+0000 7f06e9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:27.097 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.093+0000 7f06e9ffb640 10 monclient: dump: 2026-02-24T19:24:27.097 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:27.097 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.097 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.097 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.097 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:27.097 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.097 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:27.097 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:27.097 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:27.097 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.097 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.093+0000 7f06f1371640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:27.100 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.096+0000 7f06e9ffb640 1 -- 10.20.193.26:0/4141525507 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f06e0003040 con 0x7f06ec15e2a0 2026-02-24T19:24:27.100 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.096+0000 7f06e9ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:27.100 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.096+0000 7f06e9ffb640 1 -- 10.20.193.26:0/4141525507 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f06e0003440 con 0x7f06ec15e2a0 2026-02-24T19:24:27.101 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.096+0000 7f06e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:27.101 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.096+0000 7f06e9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:27.101 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.096+0000 7f06e9ffb640 10 monclient: dump: 2026-02-24T19:24:27.101 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:27.101 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.101 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.101 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.101 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:27.101 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.101 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:27.101 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:27.102 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:27.102 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.102 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.096+0000 7f06f1371640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:27.102 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.096+0000 7f06f1371640 4 set_mon_vals no callback set 2026-02-24T19:24:27.102 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.096+0000 7f06f1371640 10 monclient: shutdown 2026-02-24T19:24:27.102 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.096+0000 7f06f1371640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:27.102 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.096+0000 7f06f1371640 1 -- 10.20.193.26:0/4141525507 >> v1:10.20.193.70:6789/0 conn(0x7f06ec15e2a0 legacy=0x7f06ec05da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.102 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.096+0000 7f06f1371640 1 -- 10.20.193.26:0/4141525507 shutdown_connections 2026-02-24T19:24:27.102 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.096+0000 7f06f1371640 1 -- 10.20.193.26:0/4141525507 >> 10.20.193.26:0/4141525507 conn(0x7f06ec0b2f60 msgr2=0x7f06ec0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:27.102 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.096+0000 7f06f1371640 1 -- 10.20.193.26:0/4141525507 shutdown_connections 2026-02-24T19:24:27.102 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.096+0000 7f06f1371640 1 -- 10.20.193.26:0/4141525507 wait complete. 2026-02-24T19:24:27.102 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.097+0000 7f06f1371640 10 monclient: build_initial_monmap 2026-02-24T19:24:27.102 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.097+0000 7f06f1371640 10 monclient: monmap: 2026-02-24T19:24:27.103 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:27.103 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:27.103 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:27.103 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:27.103 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:27.103 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:27.103 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:27.103 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:27.103 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:27.103 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.103 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.097+0000 7f06f1371640 1 librados: starting msgr at 2026-02-24T19:24:27.103 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.097+0000 7f06f1371640 1 librados: starting objecter 2026-02-24T19:24:27.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.097+0000 7f06f1371640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:27.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.097+0000 7f06f1371640 1 Processor -- start 2026-02-24T19:24:27.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.097+0000 7f06f1371640 1 -- start start 2026-02-24T19:24:27.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.097+0000 7f06f1371640 1 librados: setting wanted keys 2026-02-24T19:24:27.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.097+0000 7f06f1371640 1 librados: calling monclient init 2026-02-24T19:24:27.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.097+0000 7f06f1371640 10 monclient: init 2026-02-24T19:24:27.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.098+0000 7f06f1371640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:27.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.098+0000 7f06f1371640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:27.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.098+0000 7f06f1371640 10 monclient(hunting): picked mon.noname-c con 0x7f06ec059e10 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:27.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.098+0000 7f06f1371640 10 monclient(hunting): picked mon.noname-b con 0x7f06ec15e2a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:27.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.098+0000 7f06f1371640 10 monclient(hunting): picked mon.noname-a con 0x7f06ec1a5660 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:27.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.098+0000 7f06f1371640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06ec128dc0 con 0x7f06ec1a5660 2026-02-24T19:24:27.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.098+0000 7f06f1371640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06ec1296e0 con 0x7f06ec15e2a0 2026-02-24T19:24:27.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.098+0000 7f06f1371640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06ec1299c0 con 0x7f06ec059e10 2026-02-24T19:24:27.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.098+0000 7f06f1371640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:27.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.098+0000 7f06f1371640 10 monclient(hunting): authenticate will time out at 4049.780189s 2026-02-24T19:24:27.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.099+0000 7f06eaffd640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f06ec059e10 0x7f06ec11e7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58260/0 (socket says 10.20.193.26:58260) 2026-02-24T19:24:27.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.099+0000 7f06eaffd640 1 -- 10.20.193.26:0/2160364655 learned_addr learned my addr 10.20.193.26:0/2160364655 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:27.107 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.099+0000 7f06cb7fe640 10 client.?.objecter ms_handle_connect 0x7f06ec059e10 2026-02-24T19:24:27.107 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.099+0000 7f06cb7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:27.107 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.100+0000 7f06cb7fe640 10 client.?.objecter ms_handle_connect 0x7f06ec1a5660 2026-02-24T19:24:27.107 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.100+0000 7f06cb7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:27.107 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.100+0000 7f06cb7fe640 10 client.?.objecter ms_handle_connect 0x7f06ec15e2a0 2026-02-24T19:24:27.107 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.100+0000 7f06cb7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:27.107 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.101+0000 7f06cb7fe640 1 -- 10.20.193.26:0/2160364655 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3246709814 0 0) 0x7f06ec1299c0 con 0x7f06ec059e10 2026-02-24T19:24:27.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.101+0000 7f06cb7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.101+0000 7f06cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.101+0000 7f06cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.101+0000 7f06cb7fe640 10 monclient(hunting): my global_id is 29978 2026-02-24T19:24:27.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.101+0000 7f06cb7fe640 1 -- 10.20.193.26:0/2160364655 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06b8003610 con 0x7f06ec059e10 2026-02-24T19:24:27.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.102+0000 7f06cb7fe640 1 -- 10.20.193.26:0/2160364655 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1205249128 0 0) 0x7f06ec1296e0 con 0x7f06ec15e2a0 2026-02-24T19:24:27.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.102+0000 7f06cb7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.102+0000 7f06cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.102+0000 7f06cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.102+0000 7f06cb7fe640 10 monclient(hunting): my global_id is 28054 2026-02-24T19:24:27.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.102+0000 7f06cb7fe640 1 -- 10.20.193.26:0/2160364655 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06ec1299c0 con 0x7f06ec15e2a0 2026-02-24T19:24:27.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.102+0000 7f06cb7fe640 1 -- 10.20.193.26:0/2160364655 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3746984734 0 0) 0x7f06ec128dc0 con 0x7f06ec1a5660 2026-02-24T19:24:27.109 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.102+0000 7f06cb7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.109 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.102+0000 7f06cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.109 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.102+0000 7f06cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.109 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.102+0000 7f06cb7fe640 10 monclient(hunting): my global_id is 30639 2026-02-24T19:24:27.109 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.102+0000 7f06cb7fe640 1 -- 10.20.193.26:0/2160364655 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06ec1296e0 con 0x7f06ec1a5660 2026-02-24T19:24:27.109 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.105+0000 7f06cb7fe640 1 -- 10.20.193.26:0/2160364655 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2271622057 0 0) 0x7f06b8003610 con 0x7f06ec059e10 2026-02-24T19:24:27.109 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.105+0000 7f06cb7fe640 1 -- 10.20.193.26:0/2160364655 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f06ec128dc0 con 0x7f06ec059e10 2026-02-24T19:24:27.109 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.105+0000 7f06cb7fe640 1 -- 10.20.193.26:0/2160364655 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f06e00033d0 con 0x7f06ec059e10 2026-02-24T19:24:27.109 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.105+0000 7f06cb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:27.109 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.105+0000 7f06cb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:27.109 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.105+0000 7f06cb7fe640 10 monclient(hunting): dump: 2026-02-24T19:24:27.109 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:27.109 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.110 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.110 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.110 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:27.110 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.110 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:27.110 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:27.110 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:27.110 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.110 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.105+0000 7f06cb7fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:27.112 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.106+0000 7f06cb7fe640 1 -- 10.20.193.26:0/2160364655 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1731648045 0 0) 0x7f06ec1299c0 con 0x7f06ec15e2a0 2026-02-24T19:24:27.112 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.106+0000 7f06cb7fe640 1 -- 10.20.193.26:0/2160364655 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f06b8003610 con 0x7f06ec15e2a0 2026-02-24T19:24:27.113 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.106+0000 7f06cb7fe640 1 -- 10.20.193.26:0/2160364655 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f06d4002f10 con 0x7f06ec15e2a0 2026-02-24T19:24:27.113 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.106+0000 7f06cb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:27.113 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.106+0000 7f06cb7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:27.113 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.106+0000 7f06cb7fe640 10 monclient(hunting): dump: 2026-02-24T19:24:27.113 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:27.113 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.113 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.113 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.113 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:27.113 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.113 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:27.114 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:27.114 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:27.114 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.114 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.107+0000 7f06cb7fe640 1 -- 10.20.193.26:0/2160364655 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1862602811 0 0) 0x7f06ec1296e0 con 0x7f06ec1a5660 2026-02-24T19:24:27.114 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.107+0000 7f06cb7fe640 1 -- 10.20.193.26:0/2160364655 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f06ec1299c0 con 0x7f06ec1a5660 2026-02-24T19:24:27.114 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.107+0000 7f06cb7fe640 1 -- 10.20.193.26:0/2160364655 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f06dc003410 con 0x7f06ec1a5660 2026-02-24T19:24:27.114 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.107+0000 7f06cb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:27.114 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.107+0000 7f06cb7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:27.114 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.107+0000 7f06cb7fe640 10 monclient(hunting): dump: 2026-02-24T19:24:27.114 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:27.114 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.114 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.115 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.115 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:27.115 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.115 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:27.115 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:27.115 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:27.115 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.115 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.110+0000 7f06cb7fe640 1 -- 10.20.193.26:0/2160364655 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1070328654 0 0) 0x7f06b8003610 con 0x7f06ec15e2a0 2026-02-24T19:24:27.115 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.110+0000 7f06cb7fe640 1 -- 10.20.193.26:0/2160364655 >> v1:10.20.193.103:6789/0 conn(0x7f06ec059e10 legacy=0x7f06ec11e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.115 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.110+0000 7f06cb7fe640 1 -- 10.20.193.26:0/2160364655 >> v1:10.20.193.26:6789/0 conn(0x7f06ec1a5660 legacy=0x7f06ec0b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.115 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.110+0000 7f06cb7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:24:27.115 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.110+0000 7f06cb7fe640 1 monclient: found mon.b 2026-02-24T19:24:27.116 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.110+0000 7f06cb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:27.116 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.110+0000 7f06cb7fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:27.116 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.110+0000 7f06cb7fe640 1 -- 10.20.193.26:0/2160364655 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ec129ca0 con 0x7f06ec15e2a0 2026-02-24T19:24:27.116 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.110+0000 7f06cb7fe640 10 monclient: _finish_auth 0 2026-02-24T19:24:27.116 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.110+0000 7f06cb7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:24:27.116 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.110+0000 7f06cb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:27.116 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.110+0000 7f06f1371640 5 monclient: authenticate success, global_id 28054 2026-02-24T19:24:27.116 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.110+0000 7f06f1371640 10 monclient: _renew_subs 2026-02-24T19:24:27.116 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.110+0000 7f06f1371640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:27.116 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.110+0000 7f06f1371640 1 -- 10.20.193.26:0/2160364655 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f06ec129f80 con 0x7f06ec15e2a0 2026-02-24T19:24:27.116 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.110+0000 7f06f1371640 10 client.28054.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:27.116 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.110+0000 7f06f1371640 10 monclient: _renew_subs 2026-02-24T19:24:27.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.110+0000 7f06f1371640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:27.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.110+0000 7f06f1371640 1 -- 10.20.193.26:0/2160364655 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f06ec12ae90 con 0x7f06ec15e2a0 2026-02-24T19:24:27.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.110+0000 7f06f1371640 1 librados: init done 2026-02-24T19:24:27.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.110+0000 7f06f1371640 10 client.28054.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:27.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.110+0000 7f06f1371640 15 client.28054.objecter _session_command_op_assign -1 1 2026-02-24T19:24:27.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.110+0000 7f06f1371640 20 client.28054.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:27.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.110+0000 7f06f1371640 10 client.28054.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:27.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.110+0000 7f06f1371640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:27.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.110+0000 7f06f1371640 1 -- 10.20.193.26:0/2160364655 --> v1:10.20.193.70:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f06ec161cf0 con 0x7f06ec15e2a0 2026-02-24T19:24:27.122 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.120+0000 7f06cb7fe640 1 -- 10.20.193.26:0/2160364655 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f06ec161cf0 con 0x7f06ec15e2a0 2026-02-24T19:24:27.122 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.120+0000 7f06cb7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:27.122 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.120+0000 7f06cb7fe640 1 -- 10.20.193.26:0/2160364655 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f06d40048d0 con 0x7f06ec15e2a0 2026-02-24T19:24:27.122 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.120+0000 7f06cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:27.122 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.120+0000 7f06cb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:27.122 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.120+0000 7f06e97fa640 4 set_mon_vals no callback set 2026-02-24T19:24:27.122 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.120+0000 7f06cb7fe640 10 monclient: dump: 2026-02-24T19:24:27.123 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:27.123 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.123 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.123 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.123 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:27.123 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.123 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:27.123 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:27.123 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:27.123 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.124 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.121+0000 7f06cb7fe640 1 -- 10.20.193.26:0/2160364655 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f06d401d740 con 0x7f06ec15e2a0 2026-02-24T19:24:27.124 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.122+0000 7f06eaffd640 10 monclient: get_auth_request con 0x7f06b8077e50 auth_method 0 2026-02-24T19:24:27.124 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.122+0000 7f06cb7fe640 10 client.28054.objecter ms_handle_connect 0x7f06b8077e50 2026-02-24T19:24:27.125 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.123+0000 7f06cb7fe640 1 -- 10.20.193.26:0/2160364655 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7f06d4092e30 con 0x7f06ec15e2a0 2026-02-24T19:24:27.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.123+0000 7f06cb7fe640 10 client.28054.objecter ms_dispatch2 0x7f06ec000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:27.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.123+0000 7f06cb7fe640 3 client.28054.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:27.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.123+0000 7f06cb7fe640 3 client.28054.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:27.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.123+0000 7f06cb7fe640 10 client.28054.objecter checking command 1 2026-02-24T19:24:27.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.123+0000 7f06cb7fe640 20 client.28054.objecter _get_session s=0x7f06b80a21b0 osd=4 3 2026-02-24T19:24:27.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.123+0000 7f06cb7fe640 20 client.28054.objecter put_session s=0x7f06b80a21b0 osd=4 3 2026-02-24T19:24:27.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.123+0000 7f06cb7fe640 15 client.28054.objecter _session_command_op_remove -1 1 2026-02-24T19:24:27.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.123+0000 7f06cb7fe640 20 client.28054.objecter _get_session s=0x7f06b80a21b0 osd=4 3 2026-02-24T19:24:27.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.123+0000 7f06cb7fe640 20 client.28054.objecter get_session s=0x7f06b80a21b0 osd=4 3 2026-02-24T19:24:27.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.123+0000 7f06cb7fe640 15 client.28054.objecter _session_command_op_assign 4 1 2026-02-24T19:24:27.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.123+0000 7f06cb7fe640 20 client.28054.objecter put_session s=0x7f06b80a21b0 osd=4 4 2026-02-24T19:24:27.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.123+0000 7f06cb7fe640 10 client.28054.objecter _send_command 1 2026-02-24T19:24:27.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.123+0000 7f06cb7fe640 1 -- 10.20.193.26:0/2160364655 --> v1:10.20.193.26:6800/3717327686 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f06b80c4560 con 0x7f06b80a2860 2026-02-24T19:24:27.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.123+0000 7f06cb7fe640 20 client.28054.objecter dump_active .. 0 homeless 2026-02-24T19:24:27.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.124+0000 7f06cb7fe640 1 -- 10.20.193.26:0/2160364655 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_get_version_reply(handle=1 version=346) ==== 24+0+0 (unknown 2991753921 0 0) 0x7f06d405cf30 con 0x7f06ec15e2a0 2026-02-24T19:24:27.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.124+0000 7f06cb7fe640 10 monclient: handle_get_version_reply finishing 1 version 346 2026-02-24T19:24:27.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.124+0000 7f06eb7fe640 10 monclient: get_auth_request con 0x7f06b80a2860 auth_method 0 2026-02-24T19:24:27.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.125+0000 7f06cb7fe640 10 client.28054.objecter ms_handle_connect 0x7f06b80a2860 2026-02-24T19:24:27.137 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.135+0000 7f06cb7fe640 1 -- 10.20.193.26:0/2160364655 <== osd.4 v1:10.20.193.26:6800/3717327686 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f06b80c4560 con 0x7f06b80a2860 2026-02-24T19:24:27.137 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.135+0000 7f06cb7fe640 10 client.28054.objecter ms_dispatch2 0x7f06ec000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:27.137 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.135+0000 7f06cb7fe640 10 client.28054.objecter _finish_command 1 = system:0 2026-02-24T19:24:27.137 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.135+0000 7f06cb7fe640 20 client.28054.objecter put_session s=0x7f06b80a21b0 osd=4 4 2026-02-24T19:24:27.137 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.135+0000 7f06cb7fe640 15 client.28054.objecter _session_command_op_remove 4 1 2026-02-24T19:24:27.144 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.142+0000 7f06f1371640 10 client.28054.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:27.144 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.142+0000 7f06f1371640 15 client.28054.objecter _session_command_op_assign -1 2 2026-02-24T19:24:27.144 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.142+0000 7f06f1371640 20 client.28054.objecter _get_session s=0x7f06b80a21b0 osd=4 3 2026-02-24T19:24:27.144 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.142+0000 7f06f1371640 20 client.28054.objecter put_session s=0x7f06b80a21b0 osd=4 3 2026-02-24T19:24:27.144 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.142+0000 7f06f1371640 20 client.28054.objecter _get_session s=0x7f06b80a21b0 osd=4 3 2026-02-24T19:24:27.145 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.142+0000 7f06f1371640 15 client.28054.objecter _session_command_op_remove -1 2 2026-02-24T19:24:27.145 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.142+0000 7f06f1371640 20 client.28054.objecter get_session s=0x7f06b80a21b0 osd=4 3 2026-02-24T19:24:27.145 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.142+0000 7f06f1371640 15 client.28054.objecter _session_command_op_assign 4 2 2026-02-24T19:24:27.145 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.142+0000 7f06f1371640 20 client.28054.objecter put_session s=0x7f06b80a21b0 osd=4 4 2026-02-24T19:24:27.145 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.142+0000 7f06f1371640 10 client.28054.objecter _send_command 2 2026-02-24T19:24:27.145 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.142+0000 7f06f1371640 1 -- 10.20.193.26:0/2160364655 --> v1:10.20.193.26:6800/3717327686 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f06ec1645f0 con 0x7f06b80a2860 2026-02-24T19:24:27.160 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.159+0000 7f06cb7fe640 1 -- 10.20.193.26:0/2160364655 <== osd.4 v1:10.20.193.26:6800/3717327686 2 ==== command_reply(tid 2: 0 ) ==== 8+0+712 (unknown 0 0 714369635) 0x7f06ec1645f0 con 0x7f06b80a2860 2026-02-24T19:24:27.160 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.159+0000 7f06cb7fe640 10 client.28054.objecter ms_dispatch2 0x7f06ec000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:27.161 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.159+0000 7f06cb7fe640 10 client.28054.objecter _finish_command 2 = system:0 2026-02-24T19:24:27.161 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.159+0000 7f06cb7fe640 20 client.28054.objecter put_session s=0x7f06b80a21b0 osd=4 4 2026-02-24T19:24:27.161 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.159+0000 7f06cb7fe640 15 client.28054.objecter _session_command_op_remove 4 2 2026-02-24T19:24:27.161 INFO:teuthology.orchestra.run.trial026.stdout:{ 2026-02-24T19:24:27.161 INFO:teuthology.orchestra.run.trial026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-24T19:24:27.161 INFO:teuthology.orchestra.run.trial026.stdout:} 2026-02-24T19:24:27.163 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.159+0000 7f06f1371640 10 librados: watch_flush enter 2026-02-24T19:24:27.163 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.159+0000 7f06f1371640 10 librados: watch_flush exit 2026-02-24T19:24:27.163 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.159+0000 7f06f1371640 10 client.28054.objecter close_session for osd.4 2026-02-24T19:24:27.163 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.159+0000 7f06f1371640 1 -- 10.20.193.26:0/2160364655 >> v1:10.20.193.26:6800/3717327686 conn(0x7f06b80a2860 legacy=0x7f06b80c2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.163 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.159+0000 7f06f1371640 20 client.28054.objecter put_session s=0x7f06b80a21b0 osd=4 1 2026-02-24T19:24:27.163 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.159+0000 7f06f1371640 20 client.28054.objecter shutdown clearing up homeless session... 2026-02-24T19:24:27.163 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.159+0000 7f06f1371640 10 client.28054.objecter successfully canceled tick 2026-02-24T19:24:27.163 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.159+0000 7f06f1371640 1 -- 10.20.193.26:0/2160364655 >> v1:10.20.193.162:6800/3889602630 conn(0x7f06b8077e50 legacy=0x7f06b8098300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.163 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.159+0000 7f06f1371640 10 monclient: shutdown 2026-02-24T19:24:27.163 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.159+0000 7f06f1371640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:27.164 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.159+0000 7f06f1371640 1 -- 10.20.193.26:0/2160364655 >> v1:10.20.193.70:6789/0 conn(0x7f06ec15e2a0 legacy=0x7f06ec12a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.164 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.159+0000 7f06eb7fe640 1 -- 10.20.193.26:0/2160364655 reap_dead start 2026-02-24T19:24:27.164 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.159+0000 7f06f1371640 1 -- 10.20.193.26:0/2160364655 shutdown_connections 2026-02-24T19:24:27.164 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.159+0000 7f06f1371640 1 -- 10.20.193.26:0/2160364655 >> 10.20.193.26:0/2160364655 conn(0x7f06ec0b2f60 msgr2=0x7f06ec1a4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:27.164 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.159+0000 7f06f1371640 1 -- 10.20.193.26:0/2160364655 shutdown_connections 2026-02-24T19:24:27.164 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.159+0000 7f06f1371640 1 -- 10.20.193.26:0/2160364655 wait complete. 2026-02-24T19:24:27.164 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.159+0000 7f06f1371640 1 librados: shutdown 2026-02-24T19:24:27.169 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-24T19:24:27.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.235+0000 7f71775e0640 10 monclient: get_monmap_and_config 2026-02-24T19:24:27.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.235+0000 7f71775e0640 10 monclient: build_initial_monmap 2026-02-24T19:24:27.237 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.235+0000 7f71775e0640 10 monclient: monmap: 2026-02-24T19:24:27.237 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:27.237 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.237 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:27.236026+0000 2026-02-24T19:24:27.237 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:27.236026+0000 2026-02-24T19:24:27.237 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:27.237 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.237 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:27.237 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:27.237 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:27.237 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.239 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.235+0000 7f71775e0640 1 Processor -- start 2026-02-24T19:24:27.239 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.235+0000 7f71775e0640 1 -- start start 2026-02-24T19:24:27.239 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.235+0000 7f71775e0640 10 monclient: init 2026-02-24T19:24:27.239 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.236+0000 7f71775e0640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:27.239 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.236+0000 7f71775e0640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:24:27.239 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.236+0000 7f71775e0640 10 monclient(hunting): picked mon.noname-b con 0x7f71700b9f80 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:27.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.236+0000 7f71775e0640 10 monclient(hunting): picked mon.noname-c con 0x7f71700ba350 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:27.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.236+0000 7f71775e0640 10 monclient(hunting): picked mon.noname-a con 0x7f71700585e0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:27.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.236+0000 7f71775e0640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7170163930 con 0x7f71700585e0 2026-02-24T19:24:27.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.236+0000 7f71775e0640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7170163bb0 con 0x7f71700b9f80 2026-02-24T19:24:27.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.236+0000 7f71775e0640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7170163e90 con 0x7f71700ba350 2026-02-24T19:24:27.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.236+0000 7f71775e0640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:27.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.236+0000 7f71775e0640 10 monclient(hunting): authenticate will time out at 4049.918447s 2026-02-24T19:24:27.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.237+0000 7f7175355640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f71700b9f80 0x7f7170163220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:38164/0 (socket says 10.20.193.26:38164) 2026-02-24T19:24:27.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.237+0000 7f7175355640 1 -- 10.20.193.26:0/1812339783 learned_addr learned my addr 10.20.193.26:0/1812339783 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:27.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.240+0000 7f715ffff640 1 -- 10.20.193.26:0/1812339783 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3969897614 0 0) 0x7f7170163e90 con 0x7f71700ba350 2026-02-24T19:24:27.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.240+0000 7f715ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.240+0000 7f715ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.240+0000 7f715ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.240+0000 7f715ffff640 10 monclient(hunting): my global_id is 29981 2026-02-24T19:24:27.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.240+0000 7f715ffff640 1 -- 10.20.193.26:0/1812339783 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7158003610 con 0x7f71700ba350 2026-02-24T19:24:27.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.240+0000 7f715ffff640 1 -- 10.20.193.26:0/1812339783 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 222653573 0 0) 0x7f7170163bb0 con 0x7f71700b9f80 2026-02-24T19:24:27.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.240+0000 7f715ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.240+0000 7f715ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.240+0000 7f715ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.243 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.240+0000 7f715ffff640 10 monclient(hunting): my global_id is 28057 2026-02-24T19:24:27.243 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.240+0000 7f715ffff640 1 -- 10.20.193.26:0/1812339783 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7170163e90 con 0x7f71700b9f80 2026-02-24T19:24:27.243 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.242+0000 7f715ffff640 1 -- 10.20.193.26:0/1812339783 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 299126119 0 0) 0x7f716c002c90 con 0x7f71700585e0 2026-02-24T19:24:27.243 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.242+0000 7f715ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.244 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.242+0000 7f715ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.244 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.242+0000 7f715ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.244 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.242+0000 7f715ffff640 10 monclient(hunting): my global_id is 30642 2026-02-24T19:24:27.244 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.242+0000 7f715ffff640 1 -- 10.20.193.26:0/1812339783 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7170163bb0 con 0x7f71700585e0 2026-02-24T19:24:27.246 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.244+0000 7f715ffff640 1 -- 10.20.193.26:0/1812339783 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 953067684 0 0) 0x7f7158003610 con 0x7f71700ba350 2026-02-24T19:24:27.246 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.244+0000 7f715ffff640 1 -- 10.20.193.26:0/1812339783 >> v1:10.20.193.70:6789/0 conn(0x7f71700b9f80 legacy=0x7f7170163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.246 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.244+0000 7f715ffff640 1 -- 10.20.193.26:0/1812339783 >> v1:10.20.193.26:6789/0 conn(0x7f71700585e0 legacy=0x7f7170166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.246 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.244+0000 7f715ffff640 10 monclient: _finish_hunting 0 2026-02-24T19:24:27.246 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.244+0000 7f715ffff640 1 monclient: found mon.noname-c 2026-02-24T19:24:27.246 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.244+0000 7f715ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:27.246 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.244+0000 7f715ffff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:24:27.246 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.244+0000 7f715ffff640 1 -- 10.20.193.26:0/1812339783 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71700573f0 con 0x7f71700ba350 2026-02-24T19:24:27.246 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.244+0000 7f715ffff640 10 monclient: _finish_auth 0 2026-02-24T19:24:27.246 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.244+0000 7f715ffff640 10 monclient: _check_auth_tickets 2026-02-24T19:24:27.246 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.244+0000 7f715ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:27.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.244+0000 7f71775e0640 5 monclient: authenticate success, global_id 29981 2026-02-24T19:24:27.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.244+0000 7f715ffff640 1 -- 10.20.193.26:0/1812339783 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7164002df0 con 0x7f71700ba350 2026-02-24T19:24:27.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.244+0000 7f715ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:27.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.244+0000 7f715ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:27.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.244+0000 7f715ffff640 10 monclient: dump: 2026-02-24T19:24:27.247 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:27.247 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.247 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.247 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.247 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:27.247 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.247 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:27.247 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:27.248 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:27.248 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.244+0000 7f71775e0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:27.250 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.246+0000 7f715ffff640 1 -- 10.20.193.26:0/1812339783 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7164002fc0 con 0x7f71700ba350 2026-02-24T19:24:27.251 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.246+0000 7f715ffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:27.251 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.246+0000 7f715ffff640 1 -- 10.20.193.26:0/1812339783 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7164003400 con 0x7f71700ba350 2026-02-24T19:24:27.251 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.246+0000 7f715ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:27.251 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.246+0000 7f715ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:27.251 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.246+0000 7f715ffff640 10 monclient: dump: 2026-02-24T19:24:27.251 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:27.251 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.251 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.251 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.251 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:27.251 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.251 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:27.252 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:27.252 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:27.252 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.252 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.246+0000 7f71775e0640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:27.252 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.246+0000 7f71775e0640 4 set_mon_vals no callback set 2026-02-24T19:24:27.252 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.247+0000 7f71775e0640 10 monclient: shutdown 2026-02-24T19:24:27.252 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.247+0000 7f71775e0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:27.252 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.247+0000 7f71775e0640 1 -- 10.20.193.26:0/1812339783 >> v1:10.20.193.103:6789/0 conn(0x7f71700ba350 legacy=0x7f7170057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.252 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.247+0000 7f71775e0640 1 -- 10.20.193.26:0/1812339783 shutdown_connections 2026-02-24T19:24:27.252 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.247+0000 7f71775e0640 1 -- 10.20.193.26:0/1812339783 >> 10.20.193.26:0/1812339783 conn(0x7f71700b7990 msgr2=0x7f71700b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:27.252 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.247+0000 7f71775e0640 1 -- 10.20.193.26:0/1812339783 shutdown_connections 2026-02-24T19:24:27.252 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.247+0000 7f71775e0640 1 -- 10.20.193.26:0/1812339783 wait complete. 2026-02-24T19:24:27.253 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.247+0000 7f71775e0640 10 monclient: build_initial_monmap 2026-02-24T19:24:27.253 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.247+0000 7f71775e0640 10 monclient: monmap: 2026-02-24T19:24:27.253 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:27.253 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:27.253 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:27.253 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:27.253 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:27.253 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:27.253 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:27.253 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:27.253 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:27.253 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.253 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.248+0000 7f71775e0640 1 librados: starting msgr at 2026-02-24T19:24:27.254 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.248+0000 7f71775e0640 1 librados: starting objecter 2026-02-24T19:24:27.254 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.248+0000 7f71775e0640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:27.254 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.248+0000 7f71775e0640 1 Processor -- start 2026-02-24T19:24:27.254 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.248+0000 7f71775e0640 1 -- start start 2026-02-24T19:24:27.254 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.248+0000 7f71775e0640 1 librados: setting wanted keys 2026-02-24T19:24:27.254 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.248+0000 7f71775e0640 1 librados: calling monclient init 2026-02-24T19:24:27.254 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.248+0000 7f71775e0640 10 monclient: init 2026-02-24T19:24:27.254 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.248+0000 7f71775e0640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:27.254 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.248+0000 7f71775e0640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:24:27.254 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.248+0000 7f71775e0640 10 monclient(hunting): picked mon.noname-b con 0x7f71700585e0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:27.254 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.248+0000 7f71775e0640 10 monclient(hunting): picked mon.noname-a con 0x7f71700b9f80 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:27.254 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.248+0000 7f71775e0640 10 monclient(hunting): picked mon.noname-c con 0x7f71700ba350 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:27.254 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.248+0000 7f71775e0640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7170161500 con 0x7f71700b9f80 2026-02-24T19:24:27.255 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.248+0000 7f71775e0640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f717015f760 con 0x7f71700585e0 2026-02-24T19:24:27.255 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.248+0000 7f71775e0640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f717015fa40 con 0x7f71700ba350 2026-02-24T19:24:27.255 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.248+0000 7f71775e0640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:27.255 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.248+0000 7f71775e0640 10 monclient(hunting): authenticate will time out at 4049.930585s 2026-02-24T19:24:27.257 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.249+0000 7f7174b54640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f71700b9f80 0x7f71701564b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59356/0 (socket says 10.20.193.26:59356) 2026-02-24T19:24:27.257 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.249+0000 7f7174b54640 1 -- 10.20.193.26:0/797477398 learned_addr learned my addr 10.20.193.26:0/797477398 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:27.257 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.250+0000 7f715dffb640 10 client.?.objecter ms_handle_connect 0x7f71700b9f80 2026-02-24T19:24:27.257 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.250+0000 7f715dffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:27.257 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.250+0000 7f715dffb640 10 client.?.objecter ms_handle_connect 0x7f71700ba350 2026-02-24T19:24:27.257 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.250+0000 7f715dffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:27.257 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.251+0000 7f715dffb640 10 client.?.objecter ms_handle_connect 0x7f71700585e0 2026-02-24T19:24:27.257 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.251+0000 7f715dffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:27.257 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.252+0000 7f715dffb640 1 -- 10.20.193.26:0/797477398 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4058635217 0 0) 0x7f7170161500 con 0x7f71700b9f80 2026-02-24T19:24:27.257 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.252+0000 7f715dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.257 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.252+0000 7f715dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.252+0000 7f715dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.252+0000 7f715dffb640 10 monclient(hunting): my global_id is 30645 2026-02-24T19:24:27.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.252+0000 7f715dffb640 1 -- 10.20.193.26:0/797477398 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7140003610 con 0x7f71700b9f80 2026-02-24T19:24:27.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.253+0000 7f715dffb640 1 -- 10.20.193.26:0/797477398 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3052381700 0 0) 0x7f717015fa40 con 0x7f71700ba350 2026-02-24T19:24:27.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.253+0000 7f715dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.253+0000 7f715dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.253+0000 7f715dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.253+0000 7f715dffb640 10 monclient(hunting): my global_id is 29984 2026-02-24T19:24:27.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.253+0000 7f715dffb640 1 -- 10.20.193.26:0/797477398 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7170161500 con 0x7f71700ba350 2026-02-24T19:24:27.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.253+0000 7f715dffb640 1 -- 10.20.193.26:0/797477398 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3803382334 0 0) 0x7f717015f760 con 0x7f71700585e0 2026-02-24T19:24:27.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.253+0000 7f715dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.253+0000 7f715dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.253+0000 7f715dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.253+0000 7f715dffb640 10 monclient(hunting): my global_id is 28060 2026-02-24T19:24:27.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.253+0000 7f715dffb640 1 -- 10.20.193.26:0/797477398 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f717015fa40 con 0x7f71700585e0 2026-02-24T19:24:27.260 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.257+0000 7f715dffb640 1 -- 10.20.193.26:0/797477398 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1433982728 0 0) 0x7f7170161500 con 0x7f71700ba350 2026-02-24T19:24:27.260 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.257+0000 7f715dffb640 1 -- 10.20.193.26:0/797477398 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f717015f760 con 0x7f71700ba350 2026-02-24T19:24:27.260 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.257+0000 7f715dffb640 1 -- 10.20.193.26:0/797477398 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f716c0035e0 con 0x7f71700ba350 2026-02-24T19:24:27.260 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.257+0000 7f715dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:27.260 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.257+0000 7f715dffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:27.260 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.257+0000 7f715dffb640 10 monclient(hunting): dump: 2026-02-24T19:24:27.260 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:27.260 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.260 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.260 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.261 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:27.261 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.261 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:27.261 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:27.261 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:27.261 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.261 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.257+0000 7f715dffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:27.261 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.258+0000 7f715dffb640 1 -- 10.20.193.26:0/797477398 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2714373945 0 0) 0x7f7140003610 con 0x7f71700b9f80 2026-02-24T19:24:27.261 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.258+0000 7f715dffb640 1 -- 10.20.193.26:0/797477398 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7170161500 con 0x7f71700b9f80 2026-02-24T19:24:27.261 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.258+0000 7f715dffb640 1 -- 10.20.193.26:0/797477398 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7164003310 con 0x7f71700b9f80 2026-02-24T19:24:27.261 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.258+0000 7f715dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:27.262 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.258+0000 7f715dffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:27.262 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.258+0000 7f715dffb640 10 monclient(hunting): dump: 2026-02-24T19:24:27.262 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:27.262 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.262 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.262 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.262 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:27.262 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.262 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:27.262 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:27.262 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:27.262 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.264 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.259+0000 7f715dffb640 1 -- 10.20.193.26:0/797477398 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2740436291 0 0) 0x7f717015f760 con 0x7f71700ba350 2026-02-24T19:24:27.264 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.259+0000 7f715dffb640 1 -- 10.20.193.26:0/797477398 >> v1:10.20.193.70:6789/0 conn(0x7f71700585e0 legacy=0x7f7170160df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.264 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.259+0000 7f715dffb640 1 -- 10.20.193.26:0/797477398 >> v1:10.20.193.26:6789/0 conn(0x7f71700b9f80 legacy=0x7f71701564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.264 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.259+0000 7f715dffb640 10 monclient: _finish_hunting 0 2026-02-24T19:24:27.264 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.259+0000 7f715dffb640 1 monclient: found mon.c 2026-02-24T19:24:27.264 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.259+0000 7f715dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:27.264 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.259+0000 7f715dffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:27.265 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.259+0000 7f715dffb640 1 -- 10.20.193.26:0/797477398 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717015fd20 con 0x7f71700ba350 2026-02-24T19:24:27.265 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.259+0000 7f715dffb640 10 monclient: _finish_auth 0 2026-02-24T19:24:27.265 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.259+0000 7f715dffb640 10 monclient: _check_auth_tickets 2026-02-24T19:24:27.265 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.259+0000 7f715dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:27.265 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.259+0000 7f71775e0640 5 monclient: authenticate success, global_id 29984 2026-02-24T19:24:27.265 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.259+0000 7f71775e0640 10 monclient: _renew_subs 2026-02-24T19:24:27.265 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.259+0000 7f71775e0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:27.265 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.259+0000 7f71775e0640 1 -- 10.20.193.26:0/797477398 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7170160000 con 0x7f71700ba350 2026-02-24T19:24:27.265 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.259+0000 7f71775e0640 10 client.29984.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:27.265 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.259+0000 7f71775e0640 10 monclient: _renew_subs 2026-02-24T19:24:27.265 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.259+0000 7f71775e0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:27.265 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.259+0000 7f71775e0640 1 -- 10.20.193.26:0/797477398 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f71701605c0 con 0x7f71700ba350 2026-02-24T19:24:27.265 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.259+0000 7f71775e0640 1 librados: init done 2026-02-24T19:24:27.266 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.259+0000 7f71775e0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:27.266 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.260+0000 7f71775e0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:27.266 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.260+0000 7f71775e0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:27.266 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.260+0000 7f71775e0640 1 -- 10.20.193.26:0/797477398 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7170056500 con 0x7f71700ba350 2026-02-24T19:24:27.354 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.353+0000 7f715dffb640 1 -- 10.20.193.26:0/797477398 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f716c002ba0 con 0x7f71700ba350 2026-02-24T19:24:27.354 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.353+0000 7f715dffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:27.354 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.353+0000 7f715dffb640 1 -- 10.20.193.26:0/797477398 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f716c003c20 con 0x7f71700ba350 2026-02-24T19:24:27.354 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.353+0000 7f715dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:27.354 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.353+0000 7f715dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:27.354 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.353+0000 7f715dffb640 10 monclient: dump: 2026-02-24T19:24:27.354 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:27.355 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.355 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.355 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.355 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:27.355 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.355 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:27.355 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:27.355 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:27.355 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.355 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.353+0000 7f715f7fe640 4 set_mon_vals no callback set 2026-02-24T19:24:27.356 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.353+0000 7f715dffb640 1 -- 10.20.193.26:0/797477398 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f716c003e00 con 0x7f71700ba350 2026-02-24T19:24:27.356 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.354+0000 7f7175355640 10 monclient: get_auth_request con 0x7f7140077c90 auth_method 0 2026-02-24T19:24:27.356 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.354+0000 7f715dffb640 10 client.29984.objecter ms_handle_connect 0x7f7140077c90 2026-02-24T19:24:27.357 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.354+0000 7f715dffb640 1 -- 10.20.193.26:0/797477398 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7f716c092410 con 0x7f71700ba350 2026-02-24T19:24:27.357 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.354+0000 7f715dffb640 10 client.29984.objecter ms_dispatch2 0x7f7170000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:27.357 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.354+0000 7f715dffb640 3 client.29984.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:27.357 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.354+0000 7f715dffb640 3 client.29984.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:27.357 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.354+0000 7f715dffb640 20 client.29984.objecter dump_active .. 0 homeless 2026-02-24T19:24:27.358 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.356+0000 7f715dffb640 1 -- 10.20.193.26:0/797477398 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f7170056500 con 0x7f71700ba350 2026-02-24T19:24:27.358 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.356+0000 7f715dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:27.358 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.356+0000 7f715dffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:27.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.463+0000 7f71775e0640 1 -- 10.20.193.26:0/797477398 --> v1:10.20.193.162:6800/3889602630 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f71700b64c0 con 0x7f7140077c90 2026-02-24T19:24:27.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.463+0000 7f715dffb640 1 -- 10.20.193.26:0/797477398 <== mgr.4107 v1:10.20.193.162:6800/3889602630 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (unknown 3782719169 0 0) 0x7f71700b64c0 con 0x7f7140077c90 2026-02-24T19:24:27.465 INFO:teuthology.orchestra.run.trial026.stderr:instructed osd(s) 4 to deep-scrub 2026-02-24T19:24:27.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.464+0000 7f71775e0640 10 librados: watch_flush enter 2026-02-24T19:24:27.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.464+0000 7f71775e0640 10 librados: watch_flush exit 2026-02-24T19:24:27.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.464+0000 7f71775e0640 20 client.29984.objecter shutdown clearing up homeless session... 2026-02-24T19:24:27.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.464+0000 7f71775e0640 10 client.29984.objecter successfully canceled tick 2026-02-24T19:24:27.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.464+0000 7f71775e0640 1 -- 10.20.193.26:0/797477398 >> v1:10.20.193.162:6800/3889602630 conn(0x7f7140077c90 legacy=0x7f7140098140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.464+0000 7f71775e0640 10 monclient: shutdown 2026-02-24T19:24:27.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.464+0000 7f71775e0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:27.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.464+0000 7f71775e0640 1 -- 10.20.193.26:0/797477398 >> v1:10.20.193.103:6789/0 conn(0x7f71700ba350 legacy=0x7f7170162ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.464+0000 7f71775e0640 1 -- 10.20.193.26:0/797477398 shutdown_connections 2026-02-24T19:24:27.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.464+0000 7f71775e0640 1 -- 10.20.193.26:0/797477398 >> 10.20.193.26:0/797477398 conn(0x7f71700b7990 msgr2=0x7f7170056830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:27.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.464+0000 7f71775e0640 1 -- 10.20.193.26:0/797477398 shutdown_connections 2026-02-24T19:24:27.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.464+0000 7f71775e0640 1 -- 10.20.193.26:0/797477398 wait complete. 2026-02-24T19:24:27.467 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.464+0000 7f71775e0640 1 librados: shutdown 2026-02-24T19:24:27.474 INFO:tasks.ceph:Scrubbing osd.8 2026-02-24T19:24:27.474 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:27.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.542+0000 7fd1ee224640 10 monclient: get_monmap_and_config 2026-02-24T19:24:27.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.542+0000 7fd1ee224640 10 monclient: build_initial_monmap 2026-02-24T19:24:27.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.542+0000 7fd1ee224640 10 monclient: monmap: 2026-02-24T19:24:27.544 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:27.544 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.545 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:27.543697+0000 2026-02-24T19:24:27.545 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:27.543697+0000 2026-02-24T19:24:27.545 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:27.545 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.545 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:27.545 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:27.545 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:27.545 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.543+0000 7fd1ee224640 1 Processor -- start 2026-02-24T19:24:27.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.543+0000 7fd1ee224640 1 -- start start 2026-02-24T19:24:27.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.543+0000 7fd1ee224640 10 monclient: init 2026-02-24T19:24:27.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.543+0000 7fd1ee224640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:27.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.543+0000 7fd1ee224640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:24:27.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.543+0000 7fd1ee224640 10 monclient(hunting): picked mon.noname-a con 0x7fd1e815e2a0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:27.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.543+0000 7fd1ee224640 10 monclient(hunting): picked mon.noname-b con 0x7fd1e8059e10 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:27.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.543+0000 7fd1ee224640 10 monclient(hunting): picked mon.noname-c con 0x7fd1e81a5660 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:27.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.543+0000 7fd1ee224640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1e8162df0 con 0x7fd1e815e2a0 2026-02-24T19:24:27.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.543+0000 7fd1ee224640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1e81630d0 con 0x7fd1e8059e10 2026-02-24T19:24:27.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.543+0000 7fd1ee224640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1e81633b0 con 0x7fd1e81a5660 2026-02-24T19:24:27.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.543+0000 7fd1ee224640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:27.548 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.543+0000 7fd1ee224640 10 monclient(hunting): authenticate will time out at 4050.225902s 2026-02-24T19:24:27.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.544+0000 7fd1e7fff640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fd1e81a5660 0x7fd1e81c5a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58292/0 (socket says 10.20.193.26:58292) 2026-02-24T19:24:27.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.544+0000 7fd1e7fff640 1 -- 10.20.193.26:0/2651978318 learned_addr learned my addr 10.20.193.26:0/2651978318 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:27.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.545+0000 7fd1e67fc640 1 -- 10.20.193.26:0/2651978318 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 588990431 0 0) 0x7fd1e81630d0 con 0x7fd1e8059e10 2026-02-24T19:24:27.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.545+0000 7fd1e67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.545+0000 7fd1e67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.545+0000 7fd1e67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.545+0000 7fd1e67fc640 10 monclient(hunting): my global_id is 28063 2026-02-24T19:24:27.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.545+0000 7fd1e67fc640 1 -- 10.20.193.26:0/2651978318 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1cc003610 con 0x7fd1e8059e10 2026-02-24T19:24:27.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.545+0000 7fd1e67fc640 1 -- 10.20.193.26:0/2651978318 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2886339386 0 0) 0x7fd1e81633b0 con 0x7fd1e81a5660 2026-02-24T19:24:27.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.545+0000 7fd1e67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.545+0000 7fd1e67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.545+0000 7fd1e67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.545+0000 7fd1e67fc640 10 monclient(hunting): my global_id is 29987 2026-02-24T19:24:27.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.545+0000 7fd1e67fc640 1 -- 10.20.193.26:0/2651978318 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1e81630d0 con 0x7fd1e81a5660 2026-02-24T19:24:27.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.545+0000 7fd1e67fc640 1 -- 10.20.193.26:0/2651978318 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1056068140 0 0) 0x7fd1e8162df0 con 0x7fd1e815e2a0 2026-02-24T19:24:27.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.545+0000 7fd1e67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.545+0000 7fd1e67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.545+0000 7fd1e67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.545+0000 7fd1e67fc640 10 monclient(hunting): my global_id is 30648 2026-02-24T19:24:27.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.545+0000 7fd1e67fc640 1 -- 10.20.193.26:0/2651978318 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1e81633b0 con 0x7fd1e815e2a0 2026-02-24T19:24:27.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.547+0000 7fd1e67fc640 1 -- 10.20.193.26:0/2651978318 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2331347272 0 0) 0x7fd1cc003610 con 0x7fd1e8059e10 2026-02-24T19:24:27.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.547+0000 7fd1e67fc640 1 -- 10.20.193.26:0/2651978318 >> v1:10.20.193.103:6789/0 conn(0x7fd1e81a5660 legacy=0x7fd1e81c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.547+0000 7fd1e67fc640 1 -- 10.20.193.26:0/2651978318 >> v1:10.20.193.26:6789/0 conn(0x7fd1e815e2a0 legacy=0x7fd1e805da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.547+0000 7fd1e67fc640 10 monclient: _finish_hunting 0 2026-02-24T19:24:27.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.547+0000 7fd1e67fc640 1 monclient: found mon.noname-b 2026-02-24T19:24:27.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.547+0000 7fd1e67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:27.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.547+0000 7fd1e67fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:24:27.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.547+0000 7fd1e67fc640 1 -- 10.20.193.26:0/2651978318 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e8163690 con 0x7fd1e8059e10 2026-02-24T19:24:27.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.547+0000 7fd1e67fc640 10 monclient: _finish_auth 0 2026-02-24T19:24:27.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.547+0000 7fd1e67fc640 10 monclient: _check_auth_tickets 2026-02-24T19:24:27.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.547+0000 7fd1e67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:27.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.547+0000 7fd1e67fc640 1 -- 10.20.193.26:0/2651978318 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd1d8002df0 con 0x7fd1e8059e10 2026-02-24T19:24:27.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.547+0000 7fd1e67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:27.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.547+0000 7fd1e67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:27.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.547+0000 7fd1e67fc640 10 monclient: dump: 2026-02-24T19:24:27.556 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:27.556 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.556 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.556 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.556 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:27.557 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.557 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:27.557 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:27.557 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:27.557 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.547+0000 7fd1ee224640 5 monclient: authenticate success, global_id 28063 2026-02-24T19:24:27.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.547+0000 7fd1ee224640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:27.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.548+0000 7fd1e67fc640 1 -- 10.20.193.26:0/2651978318 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd1d8002fc0 con 0x7fd1e8059e10 2026-02-24T19:24:27.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.548+0000 7fd1e67fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:27.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.548+0000 7fd1e67fc640 1 -- 10.20.193.26:0/2651978318 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd1d8003400 con 0x7fd1e8059e10 2026-02-24T19:24:27.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.548+0000 7fd1e67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:27.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.548+0000 7fd1e67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:27.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.548+0000 7fd1e67fc640 10 monclient: dump: 2026-02-24T19:24:27.558 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:27.558 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.558 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.558 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.558 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:27.558 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.558 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:27.558 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:27.558 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:27.558 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.548+0000 7fd1ee224640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:27.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.548+0000 7fd1ee224640 4 set_mon_vals no callback set 2026-02-24T19:24:27.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.548+0000 7fd1ee224640 10 monclient: shutdown 2026-02-24T19:24:27.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.548+0000 7fd1ee224640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:27.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.548+0000 7fd1ee224640 1 -- 10.20.193.26:0/2651978318 >> v1:10.20.193.70:6789/0 conn(0x7fd1e8059e10 legacy=0x7fd1e815ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.548+0000 7fd1ee224640 1 -- 10.20.193.26:0/2651978318 shutdown_connections 2026-02-24T19:24:27.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.548+0000 7fd1ee224640 1 -- 10.20.193.26:0/2651978318 >> 10.20.193.26:0/2651978318 conn(0x7fd1e80b2f60 msgr2=0x7fd1e80b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:27.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.548+0000 7fd1ee224640 1 -- 10.20.193.26:0/2651978318 shutdown_connections 2026-02-24T19:24:27.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.548+0000 7fd1ee224640 1 -- 10.20.193.26:0/2651978318 wait complete. 2026-02-24T19:24:27.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.549+0000 7fd1ee224640 10 monclient: build_initial_monmap 2026-02-24T19:24:27.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.549+0000 7fd1ee224640 10 monclient: monmap: 2026-02-24T19:24:27.559 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:27.559 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:27.559 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:27.560 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:27.560 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:27.560 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:27.560 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:27.560 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:27.560 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:27.560 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.549+0000 7fd1ee224640 1 librados: starting msgr at 2026-02-24T19:24:27.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.549+0000 7fd1ee224640 1 librados: starting objecter 2026-02-24T19:24:27.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.549+0000 7fd1ee224640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:27.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.549+0000 7fd1ee224640 1 Processor -- start 2026-02-24T19:24:27.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.549+0000 7fd1ee224640 1 -- start start 2026-02-24T19:24:27.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.549+0000 7fd1ee224640 1 librados: setting wanted keys 2026-02-24T19:24:27.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.549+0000 7fd1ee224640 1 librados: calling monclient init 2026-02-24T19:24:27.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.549+0000 7fd1ee224640 10 monclient: init 2026-02-24T19:24:27.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.550+0000 7fd1ee224640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:27.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.550+0000 7fd1ee224640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:27.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.550+0000 7fd1ee224640 10 monclient(hunting): picked mon.noname-c con 0x7fd1e8059e10 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:27.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.550+0000 7fd1ee224640 10 monclient(hunting): picked mon.noname-b con 0x7fd1e815e2a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:27.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.550+0000 7fd1ee224640 10 monclient(hunting): picked mon.noname-a con 0x7fd1e81a5660 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:27.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.550+0000 7fd1ee224640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1e812da50 con 0x7fd1e81a5660 2026-02-24T19:24:27.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.550+0000 7fd1ee224640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1e812dd30 con 0x7fd1e815e2a0 2026-02-24T19:24:27.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.550+0000 7fd1ee224640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1e812e010 con 0x7fd1e8059e10 2026-02-24T19:24:27.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.550+0000 7fd1ee224640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:27.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.550+0000 7fd1ee224640 10 monclient(hunting): authenticate will time out at 4050.232281s 2026-02-24T19:24:27.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.550+0000 7fd1e7fff640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fd1e81a5660 0x7fd1e8190e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59368/0 (socket says 10.20.193.26:59368) 2026-02-24T19:24:27.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.550+0000 7fd1e7fff640 1 -- 10.20.193.26:0/2346238533 learned_addr learned my addr 10.20.193.26:0/2346238533 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:27.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.550+0000 7fd1c3fff640 10 client.?.objecter ms_handle_connect 0x7fd1e81a5660 2026-02-24T19:24:27.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.550+0000 7fd1c3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:27.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.550+0000 7fd1c3fff640 10 client.?.objecter ms_handle_connect 0x7fd1e8059e10 2026-02-24T19:24:27.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.550+0000 7fd1c3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:27.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.551+0000 7fd1c3fff640 10 client.?.objecter ms_handle_connect 0x7fd1e815e2a0 2026-02-24T19:24:27.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.551+0000 7fd1c3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:27.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.551+0000 7fd1c3fff640 1 -- 10.20.193.26:0/2346238533 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2208871219 0 0) 0x7fd1e812da50 con 0x7fd1e81a5660 2026-02-24T19:24:27.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.551+0000 7fd1c3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.551+0000 7fd1c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.551+0000 7fd1c3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.551+0000 7fd1c3fff640 10 monclient(hunting): my global_id is 30651 2026-02-24T19:24:27.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.551+0000 7fd1c3fff640 1 -- 10.20.193.26:0/2346238533 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1b8003610 con 0x7fd1e81a5660 2026-02-24T19:24:27.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.551+0000 7fd1c3fff640 1 -- 10.20.193.26:0/2346238533 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3465838623 0 0) 0x7fd1e812e010 con 0x7fd1e8059e10 2026-02-24T19:24:27.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.551+0000 7fd1c3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.551+0000 7fd1c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.551+0000 7fd1c3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.551+0000 7fd1c3fff640 10 monclient(hunting): my global_id is 29990 2026-02-24T19:24:27.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.551+0000 7fd1c3fff640 1 -- 10.20.193.26:0/2346238533 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1e812da50 con 0x7fd1e8059e10 2026-02-24T19:24:27.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.552+0000 7fd1c3fff640 1 -- 10.20.193.26:0/2346238533 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3706533402 0 0) 0x7fd1e812dd30 con 0x7fd1e815e2a0 2026-02-24T19:24:27.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.552+0000 7fd1c3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.552+0000 7fd1c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.552+0000 7fd1c3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.552+0000 7fd1c3fff640 10 monclient(hunting): my global_id is 28066 2026-02-24T19:24:27.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.552+0000 7fd1c3fff640 1 -- 10.20.193.26:0/2346238533 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1e812e010 con 0x7fd1e815e2a0 2026-02-24T19:24:27.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.554+0000 7fd1c3fff640 1 -- 10.20.193.26:0/2346238533 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3936570164 0 0) 0x7fd1b8003610 con 0x7fd1e81a5660 2026-02-24T19:24:27.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.554+0000 7fd1c3fff640 1 -- 10.20.193.26:0/2346238533 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd1e812dd30 con 0x7fd1e81a5660 2026-02-24T19:24:27.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.554+0000 7fd1c3fff640 1 -- 10.20.193.26:0/2346238533 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1033670473 0 0) 0x7fd1e812da50 con 0x7fd1e8059e10 2026-02-24T19:24:27.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.554+0000 7fd1c3fff640 1 -- 10.20.193.26:0/2346238533 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd1b8003610 con 0x7fd1e8059e10 2026-02-24T19:24:27.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.554+0000 7fd1c3fff640 1 -- 10.20.193.26:0/2346238533 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd1dc003430 con 0x7fd1e81a5660 2026-02-24T19:24:27.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.554+0000 7fd1c3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:27.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.554+0000 7fd1c3fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:27.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.554+0000 7fd1c3fff640 10 monclient(hunting): dump: 2026-02-24T19:24:27.567 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:27.567 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.567 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.567 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.567 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:27.567 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.567 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:27.567 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:27.567 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:27.568 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.554+0000 7fd1c3fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:27.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.554+0000 7fd1c3fff640 1 -- 10.20.193.26:0/2346238533 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd1d4003120 con 0x7fd1e8059e10 2026-02-24T19:24:27.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.554+0000 7fd1c3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:27.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.554+0000 7fd1c3fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:27.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.554+0000 7fd1c3fff640 10 monclient(hunting): dump: 2026-02-24T19:24:27.568 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:27.568 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.568 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.568 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.568 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:27.568 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.568 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:27.569 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:27.569 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:27.569 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.554+0000 7fd1c3fff640 1 -- 10.20.193.26:0/2346238533 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 367432023 0 0) 0x7fd1e812e010 con 0x7fd1e815e2a0 2026-02-24T19:24:27.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.554+0000 7fd1c3fff640 1 -- 10.20.193.26:0/2346238533 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd1e812da50 con 0x7fd1e815e2a0 2026-02-24T19:24:27.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.554+0000 7fd1c3fff640 1 -- 10.20.193.26:0/2346238533 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd1d8003310 con 0x7fd1e815e2a0 2026-02-24T19:24:27.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.554+0000 7fd1c3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:27.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.554+0000 7fd1c3fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:27.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.554+0000 7fd1c3fff640 10 monclient(hunting): dump: 2026-02-24T19:24:27.569 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:27.569 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.569 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.570 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.570 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:27.570 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.570 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:27.570 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:27.570 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:27.570 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.556+0000 7fd1c3fff640 1 -- 10.20.193.26:0/2346238533 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3614889914 0 0) 0x7fd1e812dd30 con 0x7fd1e81a5660 2026-02-24T19:24:27.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.556+0000 7fd1c3fff640 1 -- 10.20.193.26:0/2346238533 >> v1:10.20.193.103:6789/0 conn(0x7fd1e8059e10 legacy=0x7fd1e8120a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.556+0000 7fd1c3fff640 1 -- 10.20.193.26:0/2346238533 >> v1:10.20.193.70:6789/0 conn(0x7fd1e815e2a0 legacy=0x7fd1e812a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.556+0000 7fd1c3fff640 10 monclient: _finish_hunting 0 2026-02-24T19:24:27.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.556+0000 7fd1c3fff640 1 monclient: found mon.a 2026-02-24T19:24:27.570 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.556+0000 7fd1c3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:27.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.556+0000 7fd1c3fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:27.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.556+0000 7fd1c3fff640 1 -- 10.20.193.26:0/2346238533 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e812e2f0 con 0x7fd1e81a5660 2026-02-24T19:24:27.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.556+0000 7fd1c3fff640 10 monclient: _finish_auth 0 2026-02-24T19:24:27.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.556+0000 7fd1c3fff640 10 monclient: _check_auth_tickets 2026-02-24T19:24:27.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.556+0000 7fd1c3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:27.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.556+0000 7fd1ee224640 5 monclient: authenticate success, global_id 30651 2026-02-24T19:24:27.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.556+0000 7fd1ee224640 10 monclient: _renew_subs 2026-02-24T19:24:27.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.556+0000 7fd1ee224640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:27.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.556+0000 7fd1ee224640 1 -- 10.20.193.26:0/2346238533 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd1e812d6d0 con 0x7fd1e81a5660 2026-02-24T19:24:27.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.556+0000 7fd1ee224640 10 client.30651.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:27.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.556+0000 7fd1ee224640 10 monclient: _renew_subs 2026-02-24T19:24:27.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.556+0000 7fd1ee224640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:27.571 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.556+0000 7fd1ee224640 1 -- 10.20.193.26:0/2346238533 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd1e812aeb0 con 0x7fd1e81a5660 2026-02-24T19:24:27.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.556+0000 7fd1ee224640 1 librados: init done 2026-02-24T19:24:27.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.556+0000 7fd1ee224640 10 client.30651.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:27.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.556+0000 7fd1ee224640 15 client.30651.objecter _session_command_op_assign -1 1 2026-02-24T19:24:27.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.556+0000 7fd1ee224640 20 client.30651.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:27.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.556+0000 7fd1ee224640 10 client.30651.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:27.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.556+0000 7fd1ee224640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:27.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.556+0000 7fd1ee224640 1 -- 10.20.193.26:0/2346238533 --> v1:10.20.193.26:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fd1e81647d0 con 0x7fd1e81a5660 2026-02-24T19:24:27.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.565+0000 7fd1c3fff640 1 -- 10.20.193.26:0/2346238533 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd1e81647d0 con 0x7fd1e81a5660 2026-02-24T19:24:27.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.565+0000 7fd1c3fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:27.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.565+0000 7fd1c3fff640 1 -- 10.20.193.26:0/2346238533 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd1dc004f00 con 0x7fd1e81a5660 2026-02-24T19:24:27.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.565+0000 7fd1c3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:27.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.565+0000 7fd1c3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:27.574 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.565+0000 7fd1e5ffb640 4 set_mon_vals no callback set 2026-02-24T19:24:27.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.565+0000 7fd1c3fff640 10 monclient: dump: 2026-02-24T19:24:27.575 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:27.575 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.575 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.575 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.575 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:27.575 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.575 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:27.575 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:27.575 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:27.575 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.566+0000 7fd1c3fff640 1 -- 10.20.193.26:0/2346238533 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fd1dc01dd70 con 0x7fd1e81a5660 2026-02-24T19:24:27.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.567+0000 7fd1e77fe640 10 monclient: get_auth_request con 0x7fd1b8077d20 auth_method 0 2026-02-24T19:24:27.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.567+0000 7fd1c3fff640 10 client.30651.objecter ms_handle_connect 0x7fd1b8077d20 2026-02-24T19:24:27.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.568+0000 7fd1c3fff640 1 -- 10.20.193.26:0/2346238533 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7fd1dc059640 con 0x7fd1e81a5660 2026-02-24T19:24:27.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.568+0000 7fd1c3fff640 10 client.30651.objecter ms_dispatch2 0x7fd1e8000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:27.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.568+0000 7fd1c3fff640 3 client.30651.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:27.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.568+0000 7fd1c3fff640 3 client.30651.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:27.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.568+0000 7fd1c3fff640 10 client.30651.objecter checking command 1 2026-02-24T19:24:27.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.568+0000 7fd1c3fff640 20 client.30651.objecter _get_session s=0x7fd1b80a2030 osd=8 3 2026-02-24T19:24:27.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.568+0000 7fd1c3fff640 20 client.30651.objecter put_session s=0x7fd1b80a2030 osd=8 3 2026-02-24T19:24:27.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.568+0000 7fd1c3fff640 15 client.30651.objecter _session_command_op_remove -1 1 2026-02-24T19:24:27.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.568+0000 7fd1c3fff640 20 client.30651.objecter _get_session s=0x7fd1b80a2030 osd=8 3 2026-02-24T19:24:27.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.568+0000 7fd1c3fff640 20 client.30651.objecter get_session s=0x7fd1b80a2030 osd=8 3 2026-02-24T19:24:27.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.568+0000 7fd1c3fff640 15 client.30651.objecter _session_command_op_assign 8 1 2026-02-24T19:24:27.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.568+0000 7fd1c3fff640 20 client.30651.objecter put_session s=0x7fd1b80a2030 osd=8 4 2026-02-24T19:24:27.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.568+0000 7fd1c3fff640 10 client.30651.objecter _send_command 1 2026-02-24T19:24:27.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.568+0000 7fd1c3fff640 1 -- 10.20.193.26:0/2346238533 --> v1:10.20.193.26:6812/1933830164 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd1b80c43e0 con 0x7fd1b80a26e0 2026-02-24T19:24:27.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.568+0000 7fd1c3fff640 20 client.30651.objecter dump_active .. 0 homeless 2026-02-24T19:24:27.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.568+0000 7fd1c3fff640 1 -- 10.20.193.26:0/2346238533 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_get_version_reply(handle=1 version=346) ==== 24+0+0 (unknown 2991753921 0 0) 0x7fd1dc059a20 con 0x7fd1e81a5660 2026-02-24T19:24:27.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.568+0000 7fd1c3fff640 10 monclient: handle_get_version_reply finishing 1 version 346 2026-02-24T19:24:27.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.568+0000 7fd1e6ffd640 10 monclient: get_auth_request con 0x7fd1b80a26e0 auth_method 0 2026-02-24T19:24:27.577 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.569+0000 7fd1c3fff640 10 client.30651.objecter ms_handle_connect 0x7fd1b80a26e0 2026-02-24T19:24:27.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.578+0000 7fd1c3fff640 1 -- 10.20.193.26:0/2346238533 <== osd.8 v1:10.20.193.26:6812/1933830164 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fd1b80c43e0 con 0x7fd1b80a26e0 2026-02-24T19:24:27.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.578+0000 7fd1c3fff640 10 client.30651.objecter ms_dispatch2 0x7fd1e8000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:27.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.578+0000 7fd1c3fff640 10 client.30651.objecter _finish_command 1 = system:0 2026-02-24T19:24:27.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.578+0000 7fd1c3fff640 20 client.30651.objecter put_session s=0x7fd1b80a2030 osd=8 4 2026-02-24T19:24:27.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.578+0000 7fd1c3fff640 15 client.30651.objecter _session_command_op_remove 8 1 2026-02-24T19:24:27.587 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.585+0000 7fd1ee224640 10 client.30651.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:27.587 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.585+0000 7fd1ee224640 15 client.30651.objecter _session_command_op_assign -1 2 2026-02-24T19:24:27.587 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.585+0000 7fd1ee224640 20 client.30651.objecter _get_session s=0x7fd1b80a2030 osd=8 3 2026-02-24T19:24:27.587 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.585+0000 7fd1ee224640 20 client.30651.objecter put_session s=0x7fd1b80a2030 osd=8 3 2026-02-24T19:24:27.587 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.585+0000 7fd1ee224640 20 client.30651.objecter _get_session s=0x7fd1b80a2030 osd=8 3 2026-02-24T19:24:27.587 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.585+0000 7fd1ee224640 15 client.30651.objecter _session_command_op_remove -1 2 2026-02-24T19:24:27.587 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.585+0000 7fd1ee224640 20 client.30651.objecter get_session s=0x7fd1b80a2030 osd=8 3 2026-02-24T19:24:27.587 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.585+0000 7fd1ee224640 15 client.30651.objecter _session_command_op_assign 8 2 2026-02-24T19:24:27.587 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.585+0000 7fd1ee224640 20 client.30651.objecter put_session s=0x7fd1b80a2030 osd=8 4 2026-02-24T19:24:27.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.585+0000 7fd1ee224640 10 client.30651.objecter _send_command 2 2026-02-24T19:24:27.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.585+0000 7fd1ee224640 1 -- 10.20.193.26:0/2346238533 --> v1:10.20.193.26:6812/1933830164 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd1e81644f0 con 0x7fd1b80a26e0 2026-02-24T19:24:27.594 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.592+0000 7fd1c3fff640 1 -- 10.20.193.26:0/2346238533 <== osd.8 v1:10.20.193.26:6812/1933830164 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fd1e81644f0 con 0x7fd1b80a26e0 2026-02-24T19:24:27.594 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.592+0000 7fd1c3fff640 10 client.30651.objecter ms_dispatch2 0x7fd1e8000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:27.594 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.592+0000 7fd1c3fff640 10 client.30651.objecter _finish_command 2 = system:0 2026-02-24T19:24:27.594 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.592+0000 7fd1c3fff640 20 client.30651.objecter put_session s=0x7fd1b80a2030 osd=8 4 2026-02-24T19:24:27.594 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.592+0000 7fd1c3fff640 15 client.30651.objecter _session_command_op_remove 8 2 2026-02-24T19:24:27.595 INFO:teuthology.orchestra.run.trial026.stdout:{ 2026-02-24T19:24:27.595 INFO:teuthology.orchestra.run.trial026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:27.595 INFO:teuthology.orchestra.run.trial026.stdout:} 2026-02-24T19:24:27.597 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.593+0000 7fd1ee224640 10 librados: watch_flush enter 2026-02-24T19:24:27.597 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.593+0000 7fd1ee224640 10 librados: watch_flush exit 2026-02-24T19:24:27.597 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.593+0000 7fd1ee224640 10 client.30651.objecter close_session for osd.8 2026-02-24T19:24:27.597 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.593+0000 7fd1ee224640 1 -- 10.20.193.26:0/2346238533 >> v1:10.20.193.26:6812/1933830164 conn(0x7fd1b80a26e0 legacy=0x7fd1b80c2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.597 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.593+0000 7fd1ee224640 20 client.30651.objecter put_session s=0x7fd1b80a2030 osd=8 1 2026-02-24T19:24:27.597 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.593+0000 7fd1ee224640 20 client.30651.objecter shutdown clearing up homeless session... 2026-02-24T19:24:27.597 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.593+0000 7fd1ee224640 10 client.30651.objecter successfully canceled tick 2026-02-24T19:24:27.597 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.593+0000 7fd1ee224640 1 -- 10.20.193.26:0/2346238533 >> v1:10.20.193.162:6800/3889602630 conn(0x7fd1b8077d20 legacy=0x7fd1b80981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.597 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.593+0000 7fd1ee224640 10 monclient: shutdown 2026-02-24T19:24:27.597 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.593+0000 7fd1ee224640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:27.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.593+0000 7fd1ee224640 1 -- 10.20.193.26:0/2346238533 >> v1:10.20.193.26:6789/0 conn(0x7fd1e81a5660 legacy=0x7fd1e8190e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.593+0000 7fd1e7fff640 1 -- 10.20.193.26:0/2346238533 reap_dead start 2026-02-24T19:24:27.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.593+0000 7fd1ee224640 1 -- 10.20.193.26:0/2346238533 shutdown_connections 2026-02-24T19:24:27.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.593+0000 7fd1ee224640 1 -- 10.20.193.26:0/2346238533 >> 10.20.193.26:0/2346238533 conn(0x7fd1e80b2f60 msgr2=0x7fd1e8195d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:27.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.593+0000 7fd1ee224640 1 -- 10.20.193.26:0/2346238533 shutdown_connections 2026-02-24T19:24:27.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.593+0000 7fd1ee224640 1 -- 10.20.193.26:0/2346238533 wait complete. 2026-02-24T19:24:27.598 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.593+0000 7fd1ee224640 1 librados: shutdown 2026-02-24T19:24:27.602 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2026-02-24T19:24:27.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.668+0000 7f9181afe640 10 monclient: get_monmap_and_config 2026-02-24T19:24:27.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.668+0000 7f9181afe640 10 monclient: build_initial_monmap 2026-02-24T19:24:27.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.668+0000 7f9181afe640 10 monclient: monmap: 2026-02-24T19:24:27.670 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:27.670 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.670 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:27.668991+0000 2026-02-24T19:24:27.670 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:27.668991+0000 2026-02-24T19:24:27.670 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:27.670 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.670 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:27.670 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:27.670 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:27.670 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.672 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.668+0000 7f9181afe640 1 Processor -- start 2026-02-24T19:24:27.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.668+0000 7f9181afe640 1 -- start start 2026-02-24T19:24:27.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.668+0000 7f9181afe640 10 monclient: init 2026-02-24T19:24:27.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.669+0000 7f9181afe640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:27.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.669+0000 7f9181afe640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:24:27.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.669+0000 7f9181afe640 10 monclient(hunting): picked mon.noname-b con 0x7f917c157780 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:27.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.669+0000 7f9181afe640 10 monclient(hunting): picked mon.noname-a con 0x7f917c157b50 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:27.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.669+0000 7f9181afe640 10 monclient(hunting): picked mon.noname-c con 0x7f917c164d00 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:27.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.669+0000 7f9181afe640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f917c05de70 con 0x7f917c157b50 2026-02-24T19:24:27.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.669+0000 7f9181afe640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f917c055b20 con 0x7f917c157780 2026-02-24T19:24:27.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.669+0000 7f9181afe640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f917c055e00 con 0x7f917c164d00 2026-02-24T19:24:27.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.669+0000 7f9181afe640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:27.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.669+0000 7f9181afe640 10 monclient(hunting): authenticate will time out at 4050.351269s 2026-02-24T19:24:27.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.669+0000 7f917bfff640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f917c164d00 0x7f917c1c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58300/0 (socket says 10.20.193.26:58300) 2026-02-24T19:24:27.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.669+0000 7f917bfff640 1 -- 10.20.193.26:0/1325605119 learned_addr learned my addr 10.20.193.26:0/1325605119 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:27.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.670+0000 7f917a7fc640 1 -- 10.20.193.26:0/1325605119 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 330248024 0 0) 0x7f917c055b20 con 0x7f917c157780 2026-02-24T19:24:27.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.670+0000 7f917a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.670+0000 7f917a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.670+0000 7f917a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.670+0000 7f917a7fc640 10 monclient(hunting): my global_id is 28069 2026-02-24T19:24:27.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.670+0000 7f917a7fc640 1 -- 10.20.193.26:0/1325605119 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9160003610 con 0x7f917c157780 2026-02-24T19:24:27.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.671+0000 7f917a7fc640 1 -- 10.20.193.26:0/1325605119 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 158173616 0 0) 0x7f917c055e00 con 0x7f917c164d00 2026-02-24T19:24:27.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.671+0000 7f917a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.671+0000 7f917a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.671+0000 7f917a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.671+0000 7f917a7fc640 10 monclient(hunting): my global_id is 29993 2026-02-24T19:24:27.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.671+0000 7f917a7fc640 1 -- 10.20.193.26:0/1325605119 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f917c055b20 con 0x7f917c164d00 2026-02-24T19:24:27.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.671+0000 7f917a7fc640 1 -- 10.20.193.26:0/1325605119 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 397817341 0 0) 0x7f917c05de70 con 0x7f917c157b50 2026-02-24T19:24:27.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.671+0000 7f917a7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.671+0000 7f917a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.671+0000 7f917a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.671+0000 7f917a7fc640 10 monclient(hunting): my global_id is 30654 2026-02-24T19:24:27.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.671+0000 7f917a7fc640 1 -- 10.20.193.26:0/1325605119 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f917c055e00 con 0x7f917c157b50 2026-02-24T19:24:27.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.672+0000 7f917a7fc640 1 -- 10.20.193.26:0/1325605119 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1829096146 0 0) 0x7f9160003610 con 0x7f917c157780 2026-02-24T19:24:27.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.672+0000 7f917a7fc640 1 -- 10.20.193.26:0/1325605119 >> v1:10.20.193.103:6789/0 conn(0x7f917c164d00 legacy=0x7f917c1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.672+0000 7f917a7fc640 1 -- 10.20.193.26:0/1325605119 >> v1:10.20.193.26:6789/0 conn(0x7f917c157b50 legacy=0x7f917c1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.672+0000 7f917a7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:24:27.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.672+0000 7f917a7fc640 1 monclient: found mon.noname-b 2026-02-24T19:24:27.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.672+0000 7f917a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:27.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.672+0000 7f917a7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:24:27.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.672+0000 7f917a7fc640 1 -- 10.20.193.26:0/1325605119 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f917c0560e0 con 0x7f917c157780 2026-02-24T19:24:27.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.672+0000 7f917a7fc640 10 monclient: _finish_auth 0 2026-02-24T19:24:27.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.672+0000 7f917a7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:24:27.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.672+0000 7f917a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:27.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.672+0000 7f917a7fc640 1 -- 10.20.193.26:0/1325605119 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9168002df0 con 0x7f917c157780 2026-02-24T19:24:27.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.672+0000 7f917a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:27.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.672+0000 7f917a7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:27.680 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.672+0000 7f917a7fc640 10 monclient: dump: 2026-02-24T19:24:27.681 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:27.681 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.681 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.681 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.681 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:27.681 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.681 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:27.681 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:27.681 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:27.681 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.672+0000 7f9181afe640 5 monclient: authenticate success, global_id 28069 2026-02-24T19:24:27.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.672+0000 7f9181afe640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:27.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.673+0000 7f917a7fc640 1 -- 10.20.193.26:0/1325605119 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9168002fc0 con 0x7f917c157780 2026-02-24T19:24:27.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.673+0000 7f917a7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:27.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.673+0000 7f917a7fc640 1 -- 10.20.193.26:0/1325605119 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9168003400 con 0x7f917c157780 2026-02-24T19:24:27.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.673+0000 7f917a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:27.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.673+0000 7f917a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:27.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.673+0000 7f917a7fc640 10 monclient: dump: 2026-02-24T19:24:27.682 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:27.682 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.682 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.682 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.682 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:27.682 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.682 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:27.683 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:27.683 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:27.683 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.673+0000 7f9181afe640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:27.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.673+0000 7f9181afe640 4 set_mon_vals no callback set 2026-02-24T19:24:27.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.673+0000 7f9181afe640 10 monclient: shutdown 2026-02-24T19:24:27.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.673+0000 7f9181afe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:27.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.673+0000 7f9181afe640 1 -- 10.20.193.26:0/1325605119 >> v1:10.20.193.70:6789/0 conn(0x7f917c157780 legacy=0x7f917c056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.673+0000 7f9181afe640 1 -- 10.20.193.26:0/1325605119 shutdown_connections 2026-02-24T19:24:27.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.673+0000 7f9181afe640 1 -- 10.20.193.26:0/1325605119 >> 10.20.193.26:0/1325605119 conn(0x7f917c0b2ef0 msgr2=0x7f917c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:27.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.673+0000 7f9181afe640 1 -- 10.20.193.26:0/1325605119 shutdown_connections 2026-02-24T19:24:27.683 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.673+0000 7f9181afe640 1 -- 10.20.193.26:0/1325605119 wait complete. 2026-02-24T19:24:27.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.674+0000 7f9181afe640 10 monclient: build_initial_monmap 2026-02-24T19:24:27.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.674+0000 7f9181afe640 10 monclient: monmap: 2026-02-24T19:24:27.684 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:27.684 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:27.684 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:27.684 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:27.684 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:27.684 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:27.684 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:27.684 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:27.684 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:27.684 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.674+0000 7f9181afe640 1 librados: starting msgr at 2026-02-24T19:24:27.684 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.674+0000 7f9181afe640 1 librados: starting objecter 2026-02-24T19:24:27.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.674+0000 7f9181afe640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:27.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.674+0000 7f9181afe640 1 Processor -- start 2026-02-24T19:24:27.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.674+0000 7f9181afe640 1 -- start start 2026-02-24T19:24:27.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.674+0000 7f9181afe640 1 librados: setting wanted keys 2026-02-24T19:24:27.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.674+0000 7f9181afe640 1 librados: calling monclient init 2026-02-24T19:24:27.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.674+0000 7f9181afe640 10 monclient: init 2026-02-24T19:24:27.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.674+0000 7f9181afe640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:27.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.674+0000 7f9181afe640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:24:27.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.674+0000 7f9181afe640 10 monclient(hunting): picked mon.noname-b con 0x7f917c157780 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:27.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.674+0000 7f9181afe640 10 monclient(hunting): picked mon.noname-c con 0x7f917c157b50 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:27.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.674+0000 7f9181afe640 10 monclient(hunting): picked mon.noname-a con 0x7f917c164d00 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:27.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.674+0000 7f9181afe640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f917c14a6c0 con 0x7f917c164d00 2026-02-24T19:24:27.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.674+0000 7f9181afe640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f917c146660 con 0x7f917c157780 2026-02-24T19:24:27.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.674+0000 7f9181afe640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f917c146940 con 0x7f917c157b50 2026-02-24T19:24:27.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.674+0000 7f9181afe640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:27.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.674+0000 7f9181afe640 10 monclient(hunting): authenticate will time out at 4050.356983s 2026-02-24T19:24:27.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.675+0000 7f917bfff640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f917c164d00 0x7f917c1499b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59388/0 (socket says 10.20.193.26:59388) 2026-02-24T19:24:27.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.675+0000 7f917bfff640 1 -- 10.20.193.26:0/338338790 learned_addr learned my addr 10.20.193.26:0/338338790 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:27.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.675+0000 7f9157fff640 10 client.?.objecter ms_handle_connect 0x7f917c164d00 2026-02-24T19:24:27.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.675+0000 7f9157fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:27.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.675+0000 7f9157fff640 10 client.?.objecter ms_handle_connect 0x7f917c157b50 2026-02-24T19:24:27.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.675+0000 7f9157fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:27.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.675+0000 7f9157fff640 10 client.?.objecter ms_handle_connect 0x7f917c157780 2026-02-24T19:24:27.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.675+0000 7f9157fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:27.686 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.676+0000 7f9157fff640 1 -- 10.20.193.26:0/338338790 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1476360163 0 0) 0x7f917c14a6c0 con 0x7f917c164d00 2026-02-24T19:24:27.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.676+0000 7f9157fff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.676+0000 7f9157fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.676+0000 7f9157fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.676+0000 7f9157fff640 10 monclient(hunting): my global_id is 30657 2026-02-24T19:24:27.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.676+0000 7f9157fff640 1 -- 10.20.193.26:0/338338790 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f914c003610 con 0x7f917c164d00 2026-02-24T19:24:27.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.676+0000 7f9157fff640 1 -- 10.20.193.26:0/338338790 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1467873629 0 0) 0x7f917c146940 con 0x7f917c157b50 2026-02-24T19:24:27.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.676+0000 7f9157fff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.676+0000 7f9157fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.676+0000 7f9157fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.676+0000 7f9157fff640 10 monclient(hunting): my global_id is 29996 2026-02-24T19:24:27.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.676+0000 7f9157fff640 1 -- 10.20.193.26:0/338338790 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f917c14a6c0 con 0x7f917c157b50 2026-02-24T19:24:27.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.676+0000 7f9157fff640 1 -- 10.20.193.26:0/338338790 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 676202927 0 0) 0x7f917c146660 con 0x7f917c157780 2026-02-24T19:24:27.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.676+0000 7f9157fff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.688 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.676+0000 7f9157fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.688 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.676+0000 7f9157fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.688 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.676+0000 7f9157fff640 10 monclient(hunting): my global_id is 28072 2026-02-24T19:24:27.688 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.676+0000 7f9157fff640 1 -- 10.20.193.26:0/338338790 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f917c146940 con 0x7f917c157780 2026-02-24T19:24:27.691 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.678+0000 7f9157fff640 1 -- 10.20.193.26:0/338338790 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 272834156 0 0) 0x7f914c003610 con 0x7f917c164d00 2026-02-24T19:24:27.691 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.678+0000 7f9157fff640 1 -- 10.20.193.26:0/338338790 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f917c146660 con 0x7f917c164d00 2026-02-24T19:24:27.691 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.678+0000 7f9157fff640 1 -- 10.20.193.26:0/338338790 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f91700032f0 con 0x7f917c164d00 2026-02-24T19:24:27.691 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.678+0000 7f9157fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:27.691 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.678+0000 7f9157fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:27.691 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.678+0000 7f9157fff640 10 monclient(hunting): dump: 2026-02-24T19:24:27.691 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:27.691 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.692 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.692 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.692 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:27.692 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.692 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:27.692 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:27.692 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:27.692 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.692 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.678+0000 7f9157fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:27.692 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.679+0000 7f9157fff640 1 -- 10.20.193.26:0/338338790 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4204782741 0 0) 0x7f917c14a6c0 con 0x7f917c157b50 2026-02-24T19:24:27.692 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.679+0000 7f9157fff640 1 -- 10.20.193.26:0/338338790 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f914c003610 con 0x7f917c157b50 2026-02-24T19:24:27.692 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.679+0000 7f9157fff640 1 -- 10.20.193.26:0/338338790 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f916c003060 con 0x7f917c157b50 2026-02-24T19:24:27.692 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.679+0000 7f9157fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:27.693 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.679+0000 7f9157fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:27.693 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.679+0000 7f9157fff640 10 monclient(hunting): dump: 2026-02-24T19:24:27.693 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:27.693 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.693 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.693 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.693 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:27.693 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.693 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:27.693 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:27.693 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:27.693 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.679+0000 7f9157fff640 1 -- 10.20.193.26:0/338338790 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 891124 0 0) 0x7f917c146940 con 0x7f917c157780 2026-02-24T19:24:27.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.679+0000 7f9157fff640 1 -- 10.20.193.26:0/338338790 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f917c14a6c0 con 0x7f917c157780 2026-02-24T19:24:27.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.679+0000 7f9157fff640 1 -- 10.20.193.26:0/338338790 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9168003310 con 0x7f917c157780 2026-02-24T19:24:27.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.679+0000 7f9157fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:27.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.679+0000 7f9157fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:27.694 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.679+0000 7f9157fff640 10 monclient(hunting): dump: 2026-02-24T19:24:27.694 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:27.694 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.694 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.694 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.694 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:27.694 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.694 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:27.695 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:27.695 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:27.695 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.680+0000 7f9157fff640 1 -- 10.20.193.26:0/338338790 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4146402188 0 0) 0x7f914c003610 con 0x7f917c157b50 2026-02-24T19:24:27.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.680+0000 7f9157fff640 1 -- 10.20.193.26:0/338338790 >> v1:10.20.193.70:6789/0 conn(0x7f917c157780 legacy=0x7f917c1377a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.680+0000 7f9157fff640 1 -- 10.20.193.26:0/338338790 >> v1:10.20.193.26:6789/0 conn(0x7f917c164d00 legacy=0x7f917c1499b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.680+0000 7f9157fff640 10 monclient: _finish_hunting 0 2026-02-24T19:24:27.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.680+0000 7f9157fff640 1 monclient: found mon.c 2026-02-24T19:24:27.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.680+0000 7f9157fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:27.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.680+0000 7f9157fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:27.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.680+0000 7f9157fff640 1 -- 10.20.193.26:0/338338790 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f917c146c20 con 0x7f917c157b50 2026-02-24T19:24:27.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.680+0000 7f9157fff640 10 monclient: _finish_auth 0 2026-02-24T19:24:27.695 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.680+0000 7f9157fff640 10 monclient: _check_auth_tickets 2026-02-24T19:24:27.696 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.680+0000 7f9157fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:27.696 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.680+0000 7f9181afe640 5 monclient: authenticate success, global_id 29996 2026-02-24T19:24:27.696 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.680+0000 7f9181afe640 10 monclient: _renew_subs 2026-02-24T19:24:27.696 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.680+0000 7f9181afe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:27.696 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.680+0000 7f9181afe640 1 -- 10.20.193.26:0/338338790 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f917c146f00 con 0x7f917c157b50 2026-02-24T19:24:27.696 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.680+0000 7f9181afe640 10 client.29996.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:27.696 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.680+0000 7f9181afe640 10 monclient: _renew_subs 2026-02-24T19:24:27.696 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.680+0000 7f9181afe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:27.696 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.680+0000 7f9181afe640 1 -- 10.20.193.26:0/338338790 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f917c135bc0 con 0x7f917c157b50 2026-02-24T19:24:27.696 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.680+0000 7f9181afe640 1 librados: init done 2026-02-24T19:24:27.696 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.681+0000 7f9181afe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:27.696 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.681+0000 7f9181afe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:27.696 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.681+0000 7f9181afe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:27.696 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.681+0000 7f9181afe640 1 -- 10.20.193.26:0/338338790 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f917c165740 con 0x7f917c157b50 2026-02-24T19:24:27.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.686+0000 7f9157fff640 1 -- 10.20.193.26:0/338338790 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f916c003700 con 0x7f917c157b50 2026-02-24T19:24:27.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.686+0000 7f9157fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:27.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.686+0000 7f9157fff640 1 -- 10.20.193.26:0/338338790 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f916c003a50 con 0x7f917c157b50 2026-02-24T19:24:27.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.686+0000 7f9157fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:27.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.686+0000 7f9157fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:27.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.686+0000 7f9157fff640 10 monclient: dump: 2026-02-24T19:24:27.697 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:27.697 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.697 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.697 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.697 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:27.697 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.697 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:27.698 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:27.698 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:27.698 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.698 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.686+0000 7f9179ffb640 4 set_mon_vals no callback set 2026-02-24T19:24:27.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.691+0000 7f9157fff640 1 -- 10.20.193.26:0/338338790 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f916c01c720 con 0x7f917c157b50 2026-02-24T19:24:27.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.691+0000 7f917b7fe640 10 monclient: get_auth_request con 0x7f914c077f70 auth_method 0 2026-02-24T19:24:27.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.692+0000 7f9157fff640 10 client.29996.objecter ms_handle_connect 0x7f914c077f70 2026-02-24T19:24:27.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.692+0000 7f9157fff640 1 -- 10.20.193.26:0/338338790 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7f916c091f50 con 0x7f917c157b50 2026-02-24T19:24:27.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.692+0000 7f9157fff640 10 client.29996.objecter ms_dispatch2 0x7f917c000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:27.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.692+0000 7f9157fff640 3 client.29996.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:27.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.692+0000 7f9157fff640 3 client.29996.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:27.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.692+0000 7f9157fff640 20 client.29996.objecter dump_active .. 0 homeless 2026-02-24T19:24:27.779 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.777+0000 7f9157fff640 1 -- 10.20.193.26:0/338338790 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f917c165740 con 0x7f917c157b50 2026-02-24T19:24:27.779 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.777+0000 7f9157fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:27.779 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.777+0000 7f9157fff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:27.889 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.888+0000 7f9181afe640 1 -- 10.20.193.26:0/338338790 --> v1:10.20.193.162:6800/3889602630 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "8", "target": ["mon-mgr", ""]}) -- 0x7f917c05e250 con 0x7f914c077f70 2026-02-24T19:24:27.890 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.888+0000 7f9157fff640 1 -- 10.20.193.26:0/338338790 <== mgr.4107 v1:10.20.193.162:6800/3889602630 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 8 to deep-scrub) ==== 41+0+0 (unknown 1222854447 0 0) 0x7f917c05e250 con 0x7f914c077f70 2026-02-24T19:24:27.890 INFO:teuthology.orchestra.run.trial026.stderr:instructed osd(s) 8 to deep-scrub 2026-02-24T19:24:27.892 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.890+0000 7f9181afe640 10 librados: watch_flush enter 2026-02-24T19:24:27.892 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.890+0000 7f9181afe640 10 librados: watch_flush exit 2026-02-24T19:24:27.892 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.890+0000 7f9181afe640 20 client.29996.objecter shutdown clearing up homeless session... 2026-02-24T19:24:27.893 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.890+0000 7f9181afe640 10 client.29996.objecter successfully canceled tick 2026-02-24T19:24:27.893 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.890+0000 7f9181afe640 1 -- 10.20.193.26:0/338338790 >> v1:10.20.193.162:6800/3889602630 conn(0x7f914c077f70 legacy=0x7f914c098420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.893 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.890+0000 7f9181afe640 10 monclient: shutdown 2026-02-24T19:24:27.893 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.890+0000 7f9181afe640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:27.893 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.890+0000 7f9181afe640 1 -- 10.20.193.26:0/338338790 >> v1:10.20.193.103:6789/0 conn(0x7f917c157b50 legacy=0x7f917c0577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.893 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.890+0000 7f9181afe640 1 -- 10.20.193.26:0/338338790 shutdown_connections 2026-02-24T19:24:27.893 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.890+0000 7f9181afe640 1 -- 10.20.193.26:0/338338790 >> 10.20.193.26:0/338338790 conn(0x7f917c0b2ef0 msgr2=0x7f917c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:27.893 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.890+0000 7f9181afe640 1 -- 10.20.193.26:0/338338790 shutdown_connections 2026-02-24T19:24:27.893 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.890+0000 7f9181afe640 1 -- 10.20.193.26:0/338338790 wait complete. 2026-02-24T19:24:27.893 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.890+0000 7f9181afe640 1 librados: shutdown 2026-02-24T19:24:27.901 INFO:tasks.ceph:Scrubbing osd.12 2026-02-24T19:24:27.901 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:27.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.968+0000 7ffbb2067640 10 monclient: get_monmap_and_config 2026-02-24T19:24:27.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.968+0000 7ffbb2067640 10 monclient: build_initial_monmap 2026-02-24T19:24:27.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.968+0000 7ffbb2067640 10 monclient: monmap: 2026-02-24T19:24:27.970 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:27.970 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.970 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:27.969048+0000 2026-02-24T19:24:27.970 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:27.969048+0000 2026-02-24T19:24:27.970 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:27.970 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.970 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:27.970 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:27.970 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:27.970 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.968+0000 7ffbb2067640 1 Processor -- start 2026-02-24T19:24:27.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.968+0000 7ffbb2067640 1 -- start start 2026-02-24T19:24:27.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.968+0000 7ffbb2067640 10 monclient: init 2026-02-24T19:24:27.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.969+0000 7ffbb2067640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:27.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.969+0000 7ffbb2067640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:24:27.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.969+0000 7ffbb2067640 10 monclient(hunting): picked mon.noname-b con 0x7ffbac15e2a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:27.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.969+0000 7ffbb2067640 10 monclient(hunting): picked mon.noname-a con 0x7ffbac059e10 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:27.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.969+0000 7ffbb2067640 10 monclient(hunting): picked mon.noname-c con 0x7ffbac1a5660 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:27.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.969+0000 7ffbb2067640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbac162df0 con 0x7ffbac059e10 2026-02-24T19:24:27.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.969+0000 7ffbb2067640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbac1630d0 con 0x7ffbac15e2a0 2026-02-24T19:24:27.973 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.969+0000 7ffbb2067640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbac1633b0 con 0x7ffbac1a5660 2026-02-24T19:24:27.973 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.969+0000 7ffbb2067640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:27.973 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.969+0000 7ffbb2067640 10 monclient(hunting): authenticate will time out at 4050.651388s 2026-02-24T19:24:27.973 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.969+0000 7ffbabfff640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7ffbac1a5660 0x7ffbac1c5a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58310/0 (socket says 10.20.193.26:58310) 2026-02-24T19:24:27.973 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.969+0000 7ffbabfff640 1 -- 10.20.193.26:0/3216399208 learned_addr learned my addr 10.20.193.26:0/3216399208 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:27.977 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.971+0000 7ffbaa7fc640 1 -- 10.20.193.26:0/3216399208 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3853815115 0 0) 0x7ffbac1633b0 con 0x7ffbac1a5660 2026-02-24T19:24:27.977 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.971+0000 7ffbaa7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.977 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.971+0000 7ffbaa7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.977 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.971+0000 7ffbaa7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.977 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.971+0000 7ffbaa7fc640 10 monclient(hunting): my global_id is 29999 2026-02-24T19:24:27.977 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.971+0000 7ffbaa7fc640 1 -- 10.20.193.26:0/3216399208 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb90003610 con 0x7ffbac1a5660 2026-02-24T19:24:27.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.971+0000 7ffbaa7fc640 1 -- 10.20.193.26:0/3216399208 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4182645961 0 0) 0x7ffbac1630d0 con 0x7ffbac15e2a0 2026-02-24T19:24:27.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.971+0000 7ffbaa7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.971+0000 7ffbaa7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.971+0000 7ffbaa7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.971+0000 7ffbaa7fc640 10 monclient(hunting): my global_id is 28075 2026-02-24T19:24:27.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.971+0000 7ffbaa7fc640 1 -- 10.20.193.26:0/3216399208 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbac1633b0 con 0x7ffbac15e2a0 2026-02-24T19:24:27.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.971+0000 7ffbaa7fc640 1 -- 10.20.193.26:0/3216399208 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 839915946 0 0) 0x7ffbac162df0 con 0x7ffbac059e10 2026-02-24T19:24:27.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.971+0000 7ffbaa7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.971+0000 7ffbaa7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.971+0000 7ffbaa7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.971+0000 7ffbaa7fc640 10 monclient(hunting): my global_id is 30660 2026-02-24T19:24:27.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.971+0000 7ffbaa7fc640 1 -- 10.20.193.26:0/3216399208 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbac1630d0 con 0x7ffbac059e10 2026-02-24T19:24:27.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.972+0000 7ffbaa7fc640 1 -- 10.20.193.26:0/3216399208 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3898571411 0 0) 0x7ffb90003610 con 0x7ffbac1a5660 2026-02-24T19:24:27.979 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.972+0000 7ffbaa7fc640 1 -- 10.20.193.26:0/3216399208 >> v1:10.20.193.70:6789/0 conn(0x7ffbac15e2a0 legacy=0x7ffbac05da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.979 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.972+0000 7ffbaa7fc640 1 -- 10.20.193.26:0/3216399208 >> v1:10.20.193.26:6789/0 conn(0x7ffbac059e10 legacy=0x7ffbac15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.979 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.972+0000 7ffbaa7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:24:27.979 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.972+0000 7ffbaa7fc640 1 monclient: found mon.noname-c 2026-02-24T19:24:27.979 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.972+0000 7ffbaa7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:27.979 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.972+0000 7ffbaa7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:24:27.979 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.972+0000 7ffbaa7fc640 1 -- 10.20.193.26:0/3216399208 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbac163690 con 0x7ffbac1a5660 2026-02-24T19:24:27.979 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.972+0000 7ffbaa7fc640 10 monclient: _finish_auth 0 2026-02-24T19:24:27.979 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.972+0000 7ffbaa7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:24:27.979 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.972+0000 7ffbaa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:27.979 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.972+0000 7ffbaa7fc640 1 -- 10.20.193.26:0/3216399208 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ffba0003170 con 0x7ffbac1a5660 2026-02-24T19:24:27.979 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.972+0000 7ffbaa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:27.980 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.972+0000 7ffbaa7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:27.980 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.972+0000 7ffbaa7fc640 10 monclient: dump: 2026-02-24T19:24:27.980 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:27.980 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.980 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.980 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.980 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:27.980 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.980 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:27.980 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:27.980 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:27.980 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.980 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.972+0000 7ffbb2067640 5 monclient: authenticate success, global_id 29999 2026-02-24T19:24:27.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.972+0000 7ffbb2067640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:27.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.973+0000 7ffbaa7fc640 1 -- 10.20.193.26:0/3216399208 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffba0003340 con 0x7ffbac1a5660 2026-02-24T19:24:27.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.973+0000 7ffbaa7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:27.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.973+0000 7ffbaa7fc640 1 -- 10.20.193.26:0/3216399208 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ffba0003780 con 0x7ffbac1a5660 2026-02-24T19:24:27.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.973+0000 7ffbb2067640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:27.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.973+0000 7ffbaa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:27.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.973+0000 7ffbb2067640 4 set_mon_vals no callback set 2026-02-24T19:24:27.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.973+0000 7ffbaa7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:27.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.973+0000 7ffbaa7fc640 10 monclient: dump: 2026-02-24T19:24:27.981 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:27.981 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.981 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.981 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.982 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:27.982 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.982 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:27.982 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:27.982 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:27.982 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.973+0000 7ffbb2067640 10 monclient: shutdown 2026-02-24T19:24:27.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.973+0000 7ffbb2067640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:27.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.973+0000 7ffbb2067640 1 -- 10.20.193.26:0/3216399208 >> v1:10.20.193.103:6789/0 conn(0x7ffbac1a5660 legacy=0x7ffbac1c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:27.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.974+0000 7ffbb2067640 1 -- 10.20.193.26:0/3216399208 shutdown_connections 2026-02-24T19:24:27.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.974+0000 7ffbb2067640 1 -- 10.20.193.26:0/3216399208 >> 10.20.193.26:0/3216399208 conn(0x7ffbac0b2f60 msgr2=0x7ffbac0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:27.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.974+0000 7ffbb2067640 1 -- 10.20.193.26:0/3216399208 shutdown_connections 2026-02-24T19:24:27.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.974+0000 7ffbb2067640 1 -- 10.20.193.26:0/3216399208 wait complete. 2026-02-24T19:24:27.983 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.974+0000 7ffbb2067640 10 monclient: build_initial_monmap 2026-02-24T19:24:27.983 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.974+0000 7ffbb2067640 10 monclient: monmap: 2026-02-24T19:24:27.983 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:27.983 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:27.983 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:27.983 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:27.983 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:27.983 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:27.983 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:27.983 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:27.983 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:27.983 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.983 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.974+0000 7ffbb2067640 1 librados: starting msgr at 2026-02-24T19:24:27.984 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.974+0000 7ffbb2067640 1 librados: starting objecter 2026-02-24T19:24:27.984 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.974+0000 7ffbb2067640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:27.984 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.974+0000 7ffbb2067640 1 Processor -- start 2026-02-24T19:24:27.984 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.974+0000 7ffbb2067640 1 -- start start 2026-02-24T19:24:27.984 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.974+0000 7ffbb2067640 1 librados: setting wanted keys 2026-02-24T19:24:27.984 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.974+0000 7ffbb2067640 1 librados: calling monclient init 2026-02-24T19:24:27.984 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.974+0000 7ffbb2067640 10 monclient: init 2026-02-24T19:24:27.984 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.975+0000 7ffbb2067640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:27.984 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.975+0000 7ffbb2067640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:27.984 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.975+0000 7ffbb2067640 10 monclient(hunting): picked mon.noname-a con 0x7ffbac059e10 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:27.984 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.975+0000 7ffbb2067640 10 monclient(hunting): picked mon.noname-c con 0x7ffbac15e2a0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:27.984 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.975+0000 7ffbb2067640 10 monclient(hunting): picked mon.noname-b con 0x7ffbac1a5660 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:27.984 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.975+0000 7ffbb2067640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbac194770 con 0x7ffbac059e10 2026-02-24T19:24:27.985 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.975+0000 7ffbb2067640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbac0b1490 con 0x7ffbac1a5660 2026-02-24T19:24:27.985 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.975+0000 7ffbb2067640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbac194a30 con 0x7ffbac15e2a0 2026-02-24T19:24:27.985 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.975+0000 7ffbb2067640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:27.985 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.975+0000 7ffbb2067640 10 monclient(hunting): authenticate will time out at 4050.657260s 2026-02-24T19:24:27.985 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.975+0000 7ffbaaffd640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7ffbac15e2a0 0x7ffbac0b0d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58314/0 (socket says 10.20.193.26:58314) 2026-02-24T19:24:27.985 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.975+0000 7ffbaaffd640 1 -- 10.20.193.26:0/3898641363 learned_addr learned my addr 10.20.193.26:0/3898641363 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:27.985 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.975+0000 7ffb87fff640 10 client.?.objecter ms_handle_connect 0x7ffbac15e2a0 2026-02-24T19:24:27.985 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.975+0000 7ffb87fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:27.985 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.975+0000 7ffb87fff640 10 client.?.objecter ms_handle_connect 0x7ffbac1a5660 2026-02-24T19:24:27.985 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.975+0000 7ffb87fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:27.987 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.976+0000 7ffb87fff640 10 client.?.objecter ms_handle_connect 0x7ffbac059e10 2026-02-24T19:24:27.987 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.976+0000 7ffb87fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:27.987 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.976+0000 7ffb87fff640 1 -- 10.20.193.26:0/3898641363 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3105685424 0 0) 0x7ffbac194a30 con 0x7ffbac15e2a0 2026-02-24T19:24:27.987 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.976+0000 7ffb87fff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.987 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.976+0000 7ffb87fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.987 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.976+0000 7ffb87fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.988 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.976+0000 7ffb87fff640 10 monclient(hunting): my global_id is 30002 2026-02-24T19:24:27.988 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.976+0000 7ffb87fff640 1 -- 10.20.193.26:0/3898641363 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb7c003610 con 0x7ffbac15e2a0 2026-02-24T19:24:27.988 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.977+0000 7ffb87fff640 1 -- 10.20.193.26:0/3898641363 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1415503790 0 0) 0x7ffbac0b1490 con 0x7ffbac1a5660 2026-02-24T19:24:27.988 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.977+0000 7ffb87fff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.988 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.977+0000 7ffb87fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.988 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.977+0000 7ffb87fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.988 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.977+0000 7ffb87fff640 10 monclient(hunting): my global_id is 28078 2026-02-24T19:24:27.988 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.977+0000 7ffb87fff640 1 -- 10.20.193.26:0/3898641363 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbac194a30 con 0x7ffbac1a5660 2026-02-24T19:24:27.988 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.977+0000 7ffb87fff640 1 -- 10.20.193.26:0/3898641363 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3548690741 0 0) 0x7ffbac194770 con 0x7ffbac059e10 2026-02-24T19:24:27.988 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.977+0000 7ffb87fff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:27.988 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.977+0000 7ffb87fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:27.988 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.977+0000 7ffb87fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:27.988 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.977+0000 7ffb87fff640 10 monclient(hunting): my global_id is 30663 2026-02-24T19:24:27.989 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.977+0000 7ffb87fff640 1 -- 10.20.193.26:0/3898641363 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbac0b1490 con 0x7ffbac059e10 2026-02-24T19:24:27.989 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.981+0000 7ffb87fff640 1 -- 10.20.193.26:0/3898641363 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2274933260 0 0) 0x7ffbac0b1490 con 0x7ffbac059e10 2026-02-24T19:24:27.989 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.981+0000 7ffb87fff640 1 -- 10.20.193.26:0/3898641363 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffbac194770 con 0x7ffbac059e10 2026-02-24T19:24:27.989 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.981+0000 7ffb87fff640 1 -- 10.20.193.26:0/3898641363 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ffb980030b0 con 0x7ffbac059e10 2026-02-24T19:24:27.989 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.981+0000 7ffb87fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:27.989 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.981+0000 7ffb87fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:27.989 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.981+0000 7ffb87fff640 10 monclient(hunting): dump: 2026-02-24T19:24:27.989 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:27.989 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:27.989 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.989 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:27.989 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:27.989 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:27.990 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:27.990 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:27.990 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:27.990 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:27.990 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:27.981+0000 7ffb87fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:28.016 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.013+0000 7ffb87fff640 1 -- 10.20.193.26:0/3898641363 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3012343625 0 0) 0x7ffbac194770 con 0x7ffbac059e10 2026-02-24T19:24:28.016 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.013+0000 7ffb87fff640 1 -- 10.20.193.26:0/3898641363 >> v1:10.20.193.103:6789/0 conn(0x7ffbac15e2a0 legacy=0x7ffbac0b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.016 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.013+0000 7ffb87fff640 1 -- 10.20.193.26:0/3898641363 >> v1:10.20.193.70:6789/0 conn(0x7ffbac1a5660 legacy=0x7ffbac195db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.016 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.013+0000 7ffb87fff640 10 monclient: _finish_hunting 0 2026-02-24T19:24:28.016 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.013+0000 7ffb87fff640 1 monclient: found mon.a 2026-02-24T19:24:28.016 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.013+0000 7ffb87fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:28.016 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.013+0000 7ffb87fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:28.016 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.013+0000 7ffb87fff640 1 -- 10.20.193.26:0/3898641363 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbac194d10 con 0x7ffbac059e10 2026-02-24T19:24:28.016 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.013+0000 7ffb87fff640 10 monclient: _finish_auth 0 2026-02-24T19:24:28.016 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.013+0000 7ffb87fff640 10 monclient: _check_auth_tickets 2026-02-24T19:24:28.016 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.013+0000 7ffb87fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:28.017 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.013+0000 7ffbb2067640 5 monclient: authenticate success, global_id 30663 2026-02-24T19:24:28.017 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.013+0000 7ffbb2067640 10 monclient: _renew_subs 2026-02-24T19:24:28.017 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.013+0000 7ffbb2067640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:28.017 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.013+0000 7ffbb2067640 1 -- 10.20.193.26:0/3898641363 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffbac194ff0 con 0x7ffbac059e10 2026-02-24T19:24:28.017 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.013+0000 7ffbb2067640 10 client.30663.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:28.017 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.013+0000 7ffbb2067640 10 monclient: _renew_subs 2026-02-24T19:24:28.017 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.013+0000 7ffbb2067640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:28.017 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.013+0000 7ffbb2067640 1 -- 10.20.193.26:0/3898641363 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ffbac1955b0 con 0x7ffbac059e10 2026-02-24T19:24:28.017 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.013+0000 7ffbb2067640 1 librados: init done 2026-02-24T19:24:28.017 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.014+0000 7ffbb2067640 10 client.30663.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:28.017 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.014+0000 7ffbb2067640 15 client.30663.objecter _session_command_op_assign -1 1 2026-02-24T19:24:28.017 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.014+0000 7ffbb2067640 20 client.30663.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:28.017 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.014+0000 7ffbb2067640 10 client.30663.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:28.018 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.014+0000 7ffbb2067640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:28.018 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.014+0000 7ffbb2067640 1 -- 10.20.193.26:0/3898641363 --> v1:10.20.193.26:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7ffbac162df0 con 0x7ffbac059e10 2026-02-24T19:24:28.024 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.022+0000 7ffb87fff640 1 -- 10.20.193.26:0/3898641363 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffbac162df0 con 0x7ffbac059e10 2026-02-24T19:24:28.024 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.022+0000 7ffb87fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:28.024 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.022+0000 7ffb87fff640 1 -- 10.20.193.26:0/3898641363 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7ffb980037d0 con 0x7ffbac059e10 2026-02-24T19:24:28.024 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.022+0000 7ffb87fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:28.025 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.022+0000 7ffb87fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:28.025 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.022+0000 7ffb87fff640 10 monclient: dump: 2026-02-24T19:24:28.025 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.025 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.025 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.025 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.025 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.025 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.025 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.025 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.025 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.025 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.026 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.022+0000 7ffba9ffb640 4 set_mon_vals no callback set 2026-02-24T19:24:28.027 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.023+0000 7ffb87fff640 1 -- 10.20.193.26:0/3898641363 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7ffb980039e0 con 0x7ffbac059e10 2026-02-24T19:24:28.027 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.024+0000 7ffbaaffd640 10 monclient: get_auth_request con 0x7ffb7c077d90 auth_method 0 2026-02-24T19:24:28.027 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.024+0000 7ffb87fff640 10 client.30663.objecter ms_handle_connect 0x7ffb7c077d90 2026-02-24T19:24:28.028 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.024+0000 7ffb87fff640 1 -- 10.20.193.26:0/3898641363 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7ffb98091fe0 con 0x7ffbac059e10 2026-02-24T19:24:28.028 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.024+0000 7ffb87fff640 10 client.30663.objecter ms_dispatch2 0x7ffbac000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:28.028 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.024+0000 7ffb87fff640 3 client.30663.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:28.028 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.024+0000 7ffb87fff640 3 client.30663.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:28.028 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.024+0000 7ffb87fff640 10 client.30663.objecter checking command 1 2026-02-24T19:24:28.028 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.024+0000 7ffb87fff640 20 client.30663.objecter _get_session s=0x7ffb7c0a20d0 osd=12 3 2026-02-24T19:24:28.028 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.024+0000 7ffb87fff640 20 client.30663.objecter put_session s=0x7ffb7c0a20d0 osd=12 3 2026-02-24T19:24:28.028 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.024+0000 7ffb87fff640 15 client.30663.objecter _session_command_op_remove -1 1 2026-02-24T19:24:28.028 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.024+0000 7ffb87fff640 20 client.30663.objecter _get_session s=0x7ffb7c0a20d0 osd=12 3 2026-02-24T19:24:28.028 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.024+0000 7ffb87fff640 20 client.30663.objecter get_session s=0x7ffb7c0a20d0 osd=12 3 2026-02-24T19:24:28.028 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.024+0000 7ffb87fff640 15 client.30663.objecter _session_command_op_assign 12 1 2026-02-24T19:24:28.028 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.024+0000 7ffb87fff640 20 client.30663.objecter put_session s=0x7ffb7c0a20d0 osd=12 4 2026-02-24T19:24:28.029 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.024+0000 7ffb87fff640 10 client.30663.objecter _send_command 1 2026-02-24T19:24:28.029 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.024+0000 7ffb87fff640 1 -- 10.20.193.26:0/3898641363 --> v1:10.20.193.26:6804/2128192173 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffb7c0c43e0 con 0x7ffb7c0a2780 2026-02-24T19:24:28.029 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.024+0000 7ffb87fff640 20 client.30663.objecter dump_active .. 0 homeless 2026-02-24T19:24:28.029 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.024+0000 7ffb87fff640 1 -- 10.20.193.26:0/3898641363 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_get_version_reply(handle=1 version=346) ==== 24+0+0 (unknown 2991753921 0 0) 0x7ffb9805c0e0 con 0x7ffbac059e10 2026-02-24T19:24:28.029 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.024+0000 7ffb87fff640 10 monclient: handle_get_version_reply finishing 1 version 346 2026-02-24T19:24:28.029 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.025+0000 7ffbabfff640 10 monclient: get_auth_request con 0x7ffb7c0a2780 auth_method 0 2026-02-24T19:24:28.029 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.026+0000 7ffb87fff640 10 client.30663.objecter ms_handle_connect 0x7ffb7c0a2780 2026-02-24T19:24:28.037 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.035+0000 7ffb87fff640 1 -- 10.20.193.26:0/3898641363 <== osd.12 v1:10.20.193.26:6804/2128192173 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7ffb7c0c43e0 con 0x7ffb7c0a2780 2026-02-24T19:24:28.037 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.035+0000 7ffb87fff640 10 client.30663.objecter ms_dispatch2 0x7ffbac000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:28.037 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.035+0000 7ffb87fff640 10 client.30663.objecter _finish_command 1 = system:0 2026-02-24T19:24:28.037 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.035+0000 7ffb87fff640 20 client.30663.objecter put_session s=0x7ffb7c0a20d0 osd=12 4 2026-02-24T19:24:28.037 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.035+0000 7ffb87fff640 15 client.30663.objecter _session_command_op_remove 12 1 2026-02-24T19:24:28.043 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.042+0000 7ffbb2067640 10 client.30663.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:28.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.042+0000 7ffbb2067640 15 client.30663.objecter _session_command_op_assign -1 2 2026-02-24T19:24:28.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.042+0000 7ffbb2067640 20 client.30663.objecter _get_session s=0x7ffb7c0a20d0 osd=12 3 2026-02-24T19:24:28.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.042+0000 7ffbb2067640 20 client.30663.objecter put_session s=0x7ffb7c0a20d0 osd=12 3 2026-02-24T19:24:28.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.042+0000 7ffbb2067640 20 client.30663.objecter _get_session s=0x7ffb7c0a20d0 osd=12 3 2026-02-24T19:24:28.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.042+0000 7ffbb2067640 15 client.30663.objecter _session_command_op_remove -1 2 2026-02-24T19:24:28.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.042+0000 7ffbb2067640 20 client.30663.objecter get_session s=0x7ffb7c0a20d0 osd=12 3 2026-02-24T19:24:28.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.042+0000 7ffbb2067640 15 client.30663.objecter _session_command_op_assign 12 2 2026-02-24T19:24:28.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.042+0000 7ffbb2067640 20 client.30663.objecter put_session s=0x7ffb7c0a20d0 osd=12 4 2026-02-24T19:24:28.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.042+0000 7ffbb2067640 10 client.30663.objecter _send_command 2 2026-02-24T19:24:28.044 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.042+0000 7ffbb2067640 1 -- 10.20.193.26:0/3898641363 --> v1:10.20.193.26:6804/2128192173 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ffbac0b2a20 con 0x7ffb7c0a2780 2026-02-24T19:24:28.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.049+0000 7ffb87fff640 1 -- 10.20.193.26:0/3898641363 <== osd.12 v1:10.20.193.26:6804/2128192173 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7ffbac0b2a20 con 0x7ffb7c0a2780 2026-02-24T19:24:28.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.049+0000 7ffb87fff640 10 client.30663.objecter ms_dispatch2 0x7ffbac000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:28.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.049+0000 7ffb87fff640 10 client.30663.objecter _finish_command 2 = system:0 2026-02-24T19:24:28.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.049+0000 7ffb87fff640 20 client.30663.objecter put_session s=0x7ffb7c0a20d0 osd=12 4 2026-02-24T19:24:28.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.049+0000 7ffb87fff640 15 client.30663.objecter _session_command_op_remove 12 2 2026-02-24T19:24:28.051 INFO:teuthology.orchestra.run.trial026.stdout:{ 2026-02-24T19:24:28.052 INFO:teuthology.orchestra.run.trial026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:28.052 INFO:teuthology.orchestra.run.trial026.stdout:} 2026-02-24T19:24:28.053 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.049+0000 7ffbb2067640 10 librados: watch_flush enter 2026-02-24T19:24:28.053 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.049+0000 7ffbb2067640 10 librados: watch_flush exit 2026-02-24T19:24:28.053 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.049+0000 7ffbb2067640 10 client.30663.objecter close_session for osd.12 2026-02-24T19:24:28.053 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.049+0000 7ffbb2067640 1 -- 10.20.193.26:0/3898641363 >> v1:10.20.193.26:6804/2128192173 conn(0x7ffb7c0a2780 legacy=0x7ffb7c0c2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.053 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.049+0000 7ffbb2067640 20 client.30663.objecter put_session s=0x7ffb7c0a20d0 osd=12 1 2026-02-24T19:24:28.054 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.049+0000 7ffbb2067640 20 client.30663.objecter shutdown clearing up homeless session... 2026-02-24T19:24:28.054 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.049+0000 7ffbb2067640 10 client.30663.objecter successfully canceled tick 2026-02-24T19:24:28.054 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.049+0000 7ffbb2067640 1 -- 10.20.193.26:0/3898641363 >> v1:10.20.193.162:6800/3889602630 conn(0x7ffb7c077d90 legacy=0x7ffb7c098240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.054 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.049+0000 7ffbb2067640 10 monclient: shutdown 2026-02-24T19:24:28.054 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.049+0000 7ffbb2067640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:28.054 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.049+0000 7ffbb2067640 1 -- 10.20.193.26:0/3898641363 >> v1:10.20.193.26:6789/0 conn(0x7ffbac059e10 legacy=0x7ffbac0b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.054 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.049+0000 7ffbabfff640 1 -- 10.20.193.26:0/3898641363 reap_dead start 2026-02-24T19:24:28.054 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.050+0000 7ffbb2067640 1 -- 10.20.193.26:0/3898641363 shutdown_connections 2026-02-24T19:24:28.054 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.050+0000 7ffbb2067640 1 -- 10.20.193.26:0/3898641363 >> 10.20.193.26:0/3898641363 conn(0x7ffbac0b2f60 msgr2=0x7ffbac15e670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:28.054 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.050+0000 7ffbb2067640 1 -- 10.20.193.26:0/3898641363 shutdown_connections 2026-02-24T19:24:28.054 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.050+0000 7ffbb2067640 1 -- 10.20.193.26:0/3898641363 wait complete. 2026-02-24T19:24:28.054 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.050+0000 7ffbb2067640 1 librados: shutdown 2026-02-24T19:24:28.060 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 12 2026-02-24T19:24:28.125 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.123+0000 7f3b825d9640 10 monclient: get_monmap_and_config 2026-02-24T19:24:28.125 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.123+0000 7f3b825d9640 10 monclient: build_initial_monmap 2026-02-24T19:24:28.125 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.123+0000 7f3b825d9640 10 monclient: monmap: 2026-02-24T19:24:28.125 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:28.125 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.125 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:28.124614+0000 2026-02-24T19:24:28.126 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:28.124614+0000 2026-02-24T19:24:28.126 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:28.126 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.126 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:28.126 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:28.126 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:28.126 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.128 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.124+0000 7f3b825d9640 1 Processor -- start 2026-02-24T19:24:28.128 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.124+0000 7f3b825d9640 1 -- start start 2026-02-24T19:24:28.128 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.124+0000 7f3b825d9640 10 monclient: init 2026-02-24T19:24:28.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.124+0000 7f3b825d9640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:28.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.124+0000 7f3b825d9640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:28.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.124+0000 7f3b825d9640 10 monclient(hunting): picked mon.noname-c con 0x7f3b7c157780 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:28.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.124+0000 7f3b825d9640 10 monclient(hunting): picked mon.noname-b con 0x7f3b7c157b50 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:28.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.124+0000 7f3b825d9640 10 monclient(hunting): picked mon.noname-a con 0x7f3b7c164d00 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:28.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.124+0000 7f3b825d9640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b7c05de70 con 0x7f3b7c164d00 2026-02-24T19:24:28.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.124+0000 7f3b825d9640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b7c055b20 con 0x7f3b7c157b50 2026-02-24T19:24:28.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.124+0000 7f3b825d9640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b7c055e00 con 0x7f3b7c157780 2026-02-24T19:24:28.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.124+0000 7f3b825d9640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:28.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.124+0000 7f3b825d9640 10 monclient(hunting): authenticate will time out at 4050.806847s 2026-02-24T19:24:28.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.125+0000 7f3b7bfff640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f3b7c157780 0x7f3b7c056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58324/0 (socket says 10.20.193.26:58324) 2026-02-24T19:24:28.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.125+0000 7f3b80b4f640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f3b7c164d00 0x7f3b7c1c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59410/0 (socket says 10.20.193.26:59410) 2026-02-24T19:24:28.130 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.125+0000 7f3b7bfff640 1 -- 10.20.193.26:0/2661014936 learned_addr learned my addr 10.20.193.26:0/2661014936 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:28.130 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.126+0000 7f3b7affd640 1 -- 10.20.193.26:0/2661014936 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2294253119 0 0) 0x7f3b7c05de70 con 0x7f3b7c164d00 2026-02-24T19:24:28.130 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.126+0000 7f3b7affd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.130 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.126+0000 7f3b7affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.130 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.126+0000 7f3b7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.130 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.126+0000 7f3b7affd640 10 monclient(hunting): my global_id is 30666 2026-02-24T19:24:28.130 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.126+0000 7f3b7affd640 1 -- 10.20.193.26:0/2661014936 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b60003610 con 0x7f3b7c164d00 2026-02-24T19:24:28.130 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.127+0000 7f3b7affd640 1 -- 10.20.193.26:0/2661014936 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 153782206 0 0) 0x7f3b7c055b20 con 0x7f3b7c157b50 2026-02-24T19:24:28.130 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.127+0000 7f3b7affd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.130 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.127+0000 7f3b7affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.130 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.127+0000 7f3b7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.130 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.127+0000 7f3b7affd640 10 monclient(hunting): my global_id is 28081 2026-02-24T19:24:28.131 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.127+0000 7f3b7affd640 1 -- 10.20.193.26:0/2661014936 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b7c05de70 con 0x7f3b7c157b50 2026-02-24T19:24:28.135 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.127+0000 7f3b7affd640 1 -- 10.20.193.26:0/2661014936 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 154051856 0 0) 0x7f3b7c055e00 con 0x7f3b7c157780 2026-02-24T19:24:28.135 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.127+0000 7f3b7affd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.135 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.127+0000 7f3b7affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.135 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.127+0000 7f3b7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.135 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.127+0000 7f3b7affd640 10 monclient(hunting): my global_id is 30005 2026-02-24T19:24:28.135 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.127+0000 7f3b7affd640 1 -- 10.20.193.26:0/2661014936 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b7c055b20 con 0x7f3b7c157780 2026-02-24T19:24:28.136 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.128+0000 7f3b7affd640 1 -- 10.20.193.26:0/2661014936 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2312648652 0 0) 0x7f3b60003610 con 0x7f3b7c164d00 2026-02-24T19:24:28.136 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.128+0000 7f3b7affd640 1 -- 10.20.193.26:0/2661014936 >> v1:10.20.193.103:6789/0 conn(0x7f3b7c157780 legacy=0x7f3b7c056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.136 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.128+0000 7f3b7affd640 1 -- 10.20.193.26:0/2661014936 >> v1:10.20.193.70:6789/0 conn(0x7f3b7c157b50 legacy=0x7f3b7c1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.136 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.128+0000 7f3b7affd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:28.136 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.128+0000 7f3b7affd640 1 monclient: found mon.noname-a 2026-02-24T19:24:28.136 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.128+0000 7f3b7affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:28.136 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.128+0000 7f3b7affd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:24:28.136 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.128+0000 7f3b7affd640 1 -- 10.20.193.26:0/2661014936 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7c0560e0 con 0x7f3b7c164d00 2026-02-24T19:24:28.136 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.128+0000 7f3b7affd640 10 monclient: _finish_auth 0 2026-02-24T19:24:28.136 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.128+0000 7f3b7affd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:28.136 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.128+0000 7f3b7affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:28.136 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.128+0000 7f3b7affd640 1 -- 10.20.193.26:0/2661014936 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f3b70003170 con 0x7f3b7c164d00 2026-02-24T19:24:28.136 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.128+0000 7f3b7affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:28.137 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.128+0000 7f3b7affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:28.137 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.128+0000 7f3b7affd640 10 monclient: dump: 2026-02-24T19:24:28.137 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.137 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.137 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.137 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.137 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.137 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.137 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.137 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.137 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.137 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.138 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.128+0000 7f3b825d9640 5 monclient: authenticate success, global_id 30666 2026-02-24T19:24:28.138 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.128+0000 7f3b825d9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:28.138 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.129+0000 7f3b7affd640 1 -- 10.20.193.26:0/2661014936 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3b700033c0 con 0x7f3b7c164d00 2026-02-24T19:24:28.138 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.129+0000 7f3b7affd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:28.138 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.129+0000 7f3b7affd640 1 -- 10.20.193.26:0/2661014936 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f3b70003800 con 0x7f3b7c164d00 2026-02-24T19:24:28.138 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.129+0000 7f3b7affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:28.138 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.129+0000 7f3b7affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:28.138 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.129+0000 7f3b7affd640 10 monclient: dump: 2026-02-24T19:24:28.138 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.138 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.138 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.138 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.138 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.139 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.139 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.139 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.139 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.139 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.139 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.129+0000 7f3b825d9640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:28.139 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.129+0000 7f3b825d9640 4 set_mon_vals no callback set 2026-02-24T19:24:28.139 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.129+0000 7f3b825d9640 10 monclient: shutdown 2026-02-24T19:24:28.139 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.129+0000 7f3b825d9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:28.139 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.129+0000 7f3b825d9640 1 -- 10.20.193.26:0/2661014936 >> v1:10.20.193.26:6789/0 conn(0x7f3b7c164d00 legacy=0x7f3b7c1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.139 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.129+0000 7f3b825d9640 1 -- 10.20.193.26:0/2661014936 shutdown_connections 2026-02-24T19:24:28.139 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.129+0000 7f3b825d9640 1 -- 10.20.193.26:0/2661014936 >> 10.20.193.26:0/2661014936 conn(0x7f3b7c0b2ef0 msgr2=0x7f3b7c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:28.139 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.129+0000 7f3b825d9640 1 -- 10.20.193.26:0/2661014936 shutdown_connections 2026-02-24T19:24:28.140 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.129+0000 7f3b825d9640 1 -- 10.20.193.26:0/2661014936 wait complete. 2026-02-24T19:24:28.140 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.130+0000 7f3b825d9640 10 monclient: build_initial_monmap 2026-02-24T19:24:28.140 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.130+0000 7f3b825d9640 10 monclient: monmap: 2026-02-24T19:24:28.140 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:28.140 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:28.140 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:28.140 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:28.140 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:28.140 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:28.140 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:28.140 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:28.140 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:28.140 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.141 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.130+0000 7f3b825d9640 1 librados: starting msgr at 2026-02-24T19:24:28.141 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.130+0000 7f3b825d9640 1 librados: starting objecter 2026-02-24T19:24:28.141 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.130+0000 7f3b825d9640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:28.141 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.130+0000 7f3b825d9640 1 Processor -- start 2026-02-24T19:24:28.141 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.130+0000 7f3b825d9640 1 -- start start 2026-02-24T19:24:28.141 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.130+0000 7f3b825d9640 1 librados: setting wanted keys 2026-02-24T19:24:28.141 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.130+0000 7f3b825d9640 1 librados: calling monclient init 2026-02-24T19:24:28.141 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.130+0000 7f3b825d9640 10 monclient: init 2026-02-24T19:24:28.141 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.130+0000 7f3b825d9640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:28.141 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.130+0000 7f3b825d9640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:24:28.141 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.130+0000 7f3b825d9640 10 monclient(hunting): picked mon.noname-b con 0x7f3b7c157780 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:28.141 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.130+0000 7f3b825d9640 10 monclient(hunting): picked mon.noname-a con 0x7f3b7c157b50 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:28.142 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.130+0000 7f3b825d9640 10 monclient(hunting): picked mon.noname-c con 0x7f3b7c164d00 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:28.142 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.130+0000 7f3b825d9640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b7c146150 con 0x7f3b7c157b50 2026-02-24T19:24:28.142 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.130+0000 7f3b825d9640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b7c146430 con 0x7f3b7c157780 2026-02-24T19:24:28.142 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.130+0000 7f3b825d9640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b7c146710 con 0x7f3b7c164d00 2026-02-24T19:24:28.142 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.130+0000 7f3b825d9640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:28.142 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.130+0000 7f3b825d9640 10 monclient(hunting): authenticate will time out at 4050.812844s 2026-02-24T19:24:28.142 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.131+0000 7f3b7b7fe640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f3b7c157b50 0x7f3b7c0b0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59414/0 (socket says 10.20.193.26:59414) 2026-02-24T19:24:28.142 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.131+0000 7f3b7b7fe640 1 -- 10.20.193.26:0/1702607654 learned_addr learned my addr 10.20.193.26:0/1702607654 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:28.142 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.131+0000 7f3b78ff9640 10 client.?.objecter ms_handle_connect 0x7f3b7c157b50 2026-02-24T19:24:28.142 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.131+0000 7f3b78ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:28.142 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.131+0000 7f3b78ff9640 10 client.?.objecter ms_handle_connect 0x7f3b7c164d00 2026-02-24T19:24:28.142 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.131+0000 7f3b78ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:28.142 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.131+0000 7f3b78ff9640 10 client.?.objecter ms_handle_connect 0x7f3b7c157780 2026-02-24T19:24:28.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.131+0000 7f3b78ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:28.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.132+0000 7f3b78ff9640 1 -- 10.20.193.26:0/1702607654 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3949426747 0 0) 0x7f3b7c146150 con 0x7f3b7c157b50 2026-02-24T19:24:28.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.132+0000 7f3b78ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.132+0000 7f3b78ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.132+0000 7f3b78ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.132+0000 7f3b78ff9640 10 monclient(hunting): my global_id is 30669 2026-02-24T19:24:28.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.132+0000 7f3b78ff9640 1 -- 10.20.193.26:0/1702607654 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b4c003610 con 0x7f3b7c157b50 2026-02-24T19:24:28.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.132+0000 7f3b78ff9640 1 -- 10.20.193.26:0/1702607654 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 838813281 0 0) 0x7f3b7c146430 con 0x7f3b7c157780 2026-02-24T19:24:28.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.132+0000 7f3b78ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.132+0000 7f3b78ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.132+0000 7f3b78ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.132+0000 7f3b78ff9640 10 monclient(hunting): my global_id is 28084 2026-02-24T19:24:28.143 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.132+0000 7f3b78ff9640 1 -- 10.20.193.26:0/1702607654 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b7c146150 con 0x7f3b7c157780 2026-02-24T19:24:28.144 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.132+0000 7f3b78ff9640 1 -- 10.20.193.26:0/1702607654 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2590817890 0 0) 0x7f3b7c146710 con 0x7f3b7c164d00 2026-02-24T19:24:28.144 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.132+0000 7f3b78ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.144 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.132+0000 7f3b78ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.144 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.132+0000 7f3b78ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.144 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.132+0000 7f3b78ff9640 10 monclient(hunting): my global_id is 30008 2026-02-24T19:24:28.144 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.132+0000 7f3b78ff9640 1 -- 10.20.193.26:0/1702607654 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b7c146430 con 0x7f3b7c164d00 2026-02-24T19:24:28.146 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.134+0000 7f3b78ff9640 1 -- 10.20.193.26:0/1702607654 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4143498080 0 0) 0x7f3b4c003610 con 0x7f3b7c157b50 2026-02-24T19:24:28.146 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.134+0000 7f3b78ff9640 1 -- 10.20.193.26:0/1702607654 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3b7c146710 con 0x7f3b7c157b50 2026-02-24T19:24:28.146 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.134+0000 7f3b78ff9640 1 -- 10.20.193.26:0/1702607654 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f3b6c0030e0 con 0x7f3b7c157b50 2026-02-24T19:24:28.146 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.134+0000 7f3b78ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:28.147 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.134+0000 7f3b78ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:28.147 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.134+0000 7f3b78ff9640 10 monclient(hunting): dump: 2026-02-24T19:24:28.147 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.147 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.147 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.147 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.147 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.147 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.147 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.147 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.147 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.147 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.148 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.134+0000 7f3b78ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:28.148 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.134+0000 7f3b78ff9640 1 -- 10.20.193.26:0/1702607654 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2792070248 0 0) 0x7f3b7c146430 con 0x7f3b7c164d00 2026-02-24T19:24:28.148 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.134+0000 7f3b78ff9640 1 -- 10.20.193.26:0/1702607654 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3b4c003610 con 0x7f3b7c164d00 2026-02-24T19:24:28.148 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.134+0000 7f3b78ff9640 1 -- 10.20.193.26:0/1702607654 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f3b70003710 con 0x7f3b7c164d00 2026-02-24T19:24:28.148 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.134+0000 7f3b78ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:28.148 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.134+0000 7f3b78ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:28.148 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.134+0000 7f3b78ff9640 10 monclient(hunting): dump: 2026-02-24T19:24:28.148 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.148 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.148 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.148 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.148 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.149 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.149 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.149 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.149 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.149 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.149 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.134+0000 7f3b78ff9640 1 -- 10.20.193.26:0/1702607654 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1306857653 0 0) 0x7f3b7c146150 con 0x7f3b7c157780 2026-02-24T19:24:28.149 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.134+0000 7f3b78ff9640 1 -- 10.20.193.26:0/1702607654 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3b7c146430 con 0x7f3b7c157780 2026-02-24T19:24:28.149 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.134+0000 7f3b78ff9640 1 -- 10.20.193.26:0/1702607654 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f3b68003060 con 0x7f3b7c157780 2026-02-24T19:24:28.149 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.134+0000 7f3b78ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:28.149 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.134+0000 7f3b78ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:28.149 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.134+0000 7f3b78ff9640 10 monclient(hunting): dump: 2026-02-24T19:24:28.149 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.149 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.150 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.150 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.150 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.150 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.150 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.150 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.150 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.150 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.150 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.136+0000 7f3b78ff9640 1 -- 10.20.193.26:0/1702607654 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4156657676 0 0) 0x7f3b7c146710 con 0x7f3b7c157b50 2026-02-24T19:24:28.150 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.136+0000 7f3b78ff9640 1 -- 10.20.193.26:0/1702607654 >> v1:10.20.193.103:6789/0 conn(0x7f3b7c164d00 legacy=0x7f3b7c05c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.150 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.136+0000 7f3b78ff9640 1 -- 10.20.193.26:0/1702607654 >> v1:10.20.193.70:6789/0 conn(0x7f3b7c157780 legacy=0x7f3b7c1604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.150 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.136+0000 7f3b78ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:24:28.150 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.136+0000 7f3b78ff9640 1 monclient: found mon.a 2026-02-24T19:24:28.151 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.136+0000 7f3b78ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:28.151 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.136+0000 7f3b78ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:28.151 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.136+0000 7f3b78ff9640 1 -- 10.20.193.26:0/1702607654 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7c1469f0 con 0x7f3b7c157b50 2026-02-24T19:24:28.151 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.136+0000 7f3b78ff9640 10 monclient: _finish_auth 0 2026-02-24T19:24:28.151 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.136+0000 7f3b78ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:24:28.151 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.136+0000 7f3b78ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:28.151 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.136+0000 7f3b825d9640 5 monclient: authenticate success, global_id 30669 2026-02-24T19:24:28.151 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.136+0000 7f3b825d9640 10 monclient: _renew_subs 2026-02-24T19:24:28.151 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.136+0000 7f3b825d9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:28.151 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.136+0000 7f3b825d9640 1 -- 10.20.193.26:0/1702607654 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3b7c146cd0 con 0x7f3b7c157b50 2026-02-24T19:24:28.151 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.136+0000 7f3b825d9640 10 client.30669.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:28.151 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.136+0000 7f3b825d9640 10 monclient: _renew_subs 2026-02-24T19:24:28.151 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.136+0000 7f3b825d9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:28.152 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.136+0000 7f3b825d9640 1 -- 10.20.193.26:0/1702607654 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3b7c160db0 con 0x7f3b7c157b50 2026-02-24T19:24:28.152 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.136+0000 7f3b825d9640 1 librados: init done 2026-02-24T19:24:28.152 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.136+0000 7f3b825d9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:28.152 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.136+0000 7f3b825d9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:28.152 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.136+0000 7f3b825d9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:28.152 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.136+0000 7f3b825d9640 1 -- 10.20.193.26:0/1702607654 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b7c146f10 con 0x7f3b7c157b50 2026-02-24T19:24:28.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.225+0000 7f3b78ff9640 1 -- 10.20.193.26:0/1702607654 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3b6c003280 con 0x7f3b7c157b50 2026-02-24T19:24:28.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.225+0000 7f3b78ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:28.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.225+0000 7f3b78ff9640 1 -- 10.20.193.26:0/1702607654 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f3b6c0039b0 con 0x7f3b7c157b50 2026-02-24T19:24:28.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.225+0000 7f3b78ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:28.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.225+0000 7f3b78ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:28.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.225+0000 7f3b7a7fc640 4 set_mon_vals no callback set 2026-02-24T19:24:28.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.225+0000 7f3b78ff9640 10 monclient: dump: 2026-02-24T19:24:28.227 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.227 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.228 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.228 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.228 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.228 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.228 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.228 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.228 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.228 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.226+0000 7f3b78ff9640 1 -- 10.20.193.26:0/1702607654 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f3b6c003b90 con 0x7f3b7c157b50 2026-02-24T19:24:28.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.226+0000 7f3b7bfff640 10 monclient: get_auth_request con 0x7f3b4c077dd0 auth_method 0 2026-02-24T19:24:28.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.227+0000 7f3b78ff9640 10 client.30669.objecter ms_handle_connect 0x7f3b4c077dd0 2026-02-24T19:24:28.230 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.228+0000 7f3b78ff9640 1 -- 10.20.193.26:0/1702607654 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7f3b6c0931e0 con 0x7f3b7c157b50 2026-02-24T19:24:28.230 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.228+0000 7f3b78ff9640 10 client.30669.objecter ms_dispatch2 0x7f3b7c000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:28.230 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.228+0000 7f3b78ff9640 3 client.30669.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:28.230 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.228+0000 7f3b78ff9640 3 client.30669.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:28.230 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.228+0000 7f3b78ff9640 20 client.30669.objecter dump_active .. 0 homeless 2026-02-24T19:24:28.230 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.228+0000 7f3b78ff9640 1 -- 10.20.193.26:0/1702607654 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f3b7c146f10 con 0x7f3b7c157b50 2026-02-24T19:24:28.230 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.228+0000 7f3b78ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:28.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.228+0000 7f3b78ff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:28.335 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.333+0000 7f3b825d9640 1 -- 10.20.193.26:0/1702607654 --> v1:10.20.193.162:6800/3889602630 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "12", "target": ["mon-mgr", ""]}) -- 0x7f3b7c0b43e0 con 0x7f3b4c077dd0 2026-02-24T19:24:28.335 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.334+0000 7f3b78ff9640 1 -- 10.20.193.26:0/1702607654 <== mgr.4107 v1:10.20.193.162:6800/3889602630 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 12 to deep-scrub) ==== 42+0+0 (unknown 660425183 0 0) 0x7f3b7c0b43e0 con 0x7f3b4c077dd0 2026-02-24T19:24:28.335 INFO:teuthology.orchestra.run.trial026.stderr:instructed osd(s) 12 to deep-scrub 2026-02-24T19:24:28.337 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.335+0000 7f3b825d9640 10 librados: watch_flush enter 2026-02-24T19:24:28.337 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.335+0000 7f3b825d9640 10 librados: watch_flush exit 2026-02-24T19:24:28.337 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.335+0000 7f3b825d9640 20 client.30669.objecter shutdown clearing up homeless session... 2026-02-24T19:24:28.337 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.335+0000 7f3b825d9640 10 client.30669.objecter successfully canceled tick 2026-02-24T19:24:28.338 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.335+0000 7f3b825d9640 1 -- 10.20.193.26:0/1702607654 >> v1:10.20.193.162:6800/3889602630 conn(0x7f3b4c077dd0 legacy=0x7f3b4c098280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.338 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.335+0000 7f3b825d9640 10 monclient: shutdown 2026-02-24T19:24:28.338 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.335+0000 7f3b825d9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:28.338 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.335+0000 7f3b825d9640 1 -- 10.20.193.26:0/1702607654 >> v1:10.20.193.26:6789/0 conn(0x7f3b7c157b50 legacy=0x7f3b7c0b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.338 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.335+0000 7f3b825d9640 1 -- 10.20.193.26:0/1702607654 shutdown_connections 2026-02-24T19:24:28.338 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.335+0000 7f3b825d9640 1 -- 10.20.193.26:0/1702607654 >> 10.20.193.26:0/1702607654 conn(0x7f3b7c0b2ef0 msgr2=0x7f3b7c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:28.338 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.335+0000 7f3b825d9640 1 -- 10.20.193.26:0/1702607654 shutdown_connections 2026-02-24T19:24:28.338 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.335+0000 7f3b825d9640 1 -- 10.20.193.26:0/1702607654 wait complete. 2026-02-24T19:24:28.338 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.335+0000 7f3b825d9640 1 librados: shutdown 2026-02-24T19:24:28.345 INFO:tasks.ceph:Scrubbing osd.1 2026-02-24T19:24:28.345 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:28.414 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.413+0000 7f220aa3a640 10 monclient: get_monmap_and_config 2026-02-24T19:24:28.414 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.413+0000 7f220aa3a640 10 monclient: build_initial_monmap 2026-02-24T19:24:28.415 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.413+0000 7f220aa3a640 10 monclient: monmap: 2026-02-24T19:24:28.415 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:28.415 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.415 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:28.413978+0000 2026-02-24T19:24:28.415 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:28.413978+0000 2026-02-24T19:24:28.415 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:28.415 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.415 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:28.415 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:28.415 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:28.415 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.418 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.413+0000 7f220aa3a640 1 Processor -- start 2026-02-24T19:24:28.418 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.413+0000 7f220aa3a640 1 -- start start 2026-02-24T19:24:28.418 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.413+0000 7f220aa3a640 10 monclient: init 2026-02-24T19:24:28.418 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.414+0000 7f220aa3a640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:28.418 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.414+0000 7f220aa3a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:24:28.418 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.414+0000 7f220aa3a640 10 monclient(hunting): picked mon.noname-c con 0x7f2204159e10 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:28.418 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.414+0000 7f220aa3a640 10 monclient(hunting): picked mon.noname-a con 0x7f220415a1e0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:28.418 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.414+0000 7f220aa3a640 10 monclient(hunting): picked mon.noname-b con 0x7f2204161ac0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:28.419 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.414+0000 7f220aa3a640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2204055ab0 con 0x7f220415a1e0 2026-02-24T19:24:28.419 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.414+0000 7f220aa3a640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2204055d50 con 0x7f2204161ac0 2026-02-24T19:24:28.419 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.414+0000 7f220aa3a640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2204056030 con 0x7f2204159e10 2026-02-24T19:24:28.419 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.414+0000 7f220aa3a640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:28.419 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.414+0000 7f220aa3a640 10 monclient(hunting): authenticate will time out at 4051.096345s 2026-02-24T19:24:28.419 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.414+0000 7f22037fe640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f220415a1e0 0x7f22041613b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59426/0 (socket says 10.20.193.26:59426) 2026-02-24T19:24:28.419 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.414+0000 7f22037fe640 1 -- 10.20.193.26:0/1612352806 learned_addr learned my addr 10.20.193.26:0/1612352806 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:28.419 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.414+0000 7f2203fff640 1 --1- 10.20.193.26:0/1612352806 >> v1:10.20.193.103:6789/0 conn(0x7f2204159e10 0x7f2204059c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58348/0 (socket says 10.20.193.26:58348) 2026-02-24T19:24:28.419 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.416+0000 7f2202ffd640 1 -- 10.20.193.26:0/1612352806 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 390694335 0 0) 0x7f2204056030 con 0x7f2204159e10 2026-02-24T19:24:28.419 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.416+0000 7f2202ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.419 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.416+0000 7f2202ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.419 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.416+0000 7f2202ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.419 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.416+0000 7f2202ffd640 10 monclient(hunting): my global_id is 30011 2026-02-24T19:24:28.420 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.416+0000 7f2202ffd640 1 -- 10.20.193.26:0/1612352806 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21e8003610 con 0x7f2204159e10 2026-02-24T19:24:28.420 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.416+0000 7f2202ffd640 1 -- 10.20.193.26:0/1612352806 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1229539538 0 0) 0x7f2204055ab0 con 0x7f220415a1e0 2026-02-24T19:24:28.420 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.416+0000 7f2202ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.420 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.416+0000 7f2202ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.420 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.416+0000 7f2202ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.420 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.416+0000 7f2202ffd640 10 monclient(hunting): my global_id is 30672 2026-02-24T19:24:28.420 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.416+0000 7f2202ffd640 1 -- 10.20.193.26:0/1612352806 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2204056030 con 0x7f220415a1e0 2026-02-24T19:24:28.420 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.416+0000 7f2202ffd640 1 -- 10.20.193.26:0/1612352806 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2453139663 0 0) 0x7f2204055d50 con 0x7f2204161ac0 2026-02-24T19:24:28.420 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.416+0000 7f2202ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.420 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.416+0000 7f2202ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.420 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.416+0000 7f2202ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.420 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.416+0000 7f2202ffd640 10 monclient(hunting): my global_id is 28087 2026-02-24T19:24:28.420 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.416+0000 7f2202ffd640 1 -- 10.20.193.26:0/1612352806 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2204055ab0 con 0x7f2204161ac0 2026-02-24T19:24:28.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.418+0000 7f2202ffd640 1 -- 10.20.193.26:0/1612352806 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 921605187 0 0) 0x7f21e8003610 con 0x7f2204159e10 2026-02-24T19:24:28.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.418+0000 7f2202ffd640 1 -- 10.20.193.26:0/1612352806 >> v1:10.20.193.70:6789/0 conn(0x7f2204161ac0 legacy=0x7f220415fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.418+0000 7f2202ffd640 1 -- 10.20.193.26:0/1612352806 >> v1:10.20.193.26:6789/0 conn(0x7f220415a1e0 legacy=0x7f22041613b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.425 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.418+0000 7f2202ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:28.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.418+0000 7f2202ffd640 1 monclient: found mon.noname-c 2026-02-24T19:24:28.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.418+0000 7f2202ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:28.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.418+0000 7f2202ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:24:28.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.418+0000 7f2202ffd640 1 -- 10.20.193.26:0/1612352806 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2204056310 con 0x7f2204159e10 2026-02-24T19:24:28.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.418+0000 7f2202ffd640 10 monclient: _finish_auth 0 2026-02-24T19:24:28.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.418+0000 7f2202ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:28.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.418+0000 7f2202ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:28.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.418+0000 7f2202ffd640 1 -- 10.20.193.26:0/1612352806 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f21f0002de0 con 0x7f2204159e10 2026-02-24T19:24:28.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.418+0000 7f2202ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:28.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.418+0000 7f2202ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:28.426 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.418+0000 7f2202ffd640 10 monclient: dump: 2026-02-24T19:24:28.426 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.427 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.427 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.427 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.427 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.427 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.427 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.427 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.427 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.427 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.427 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.418+0000 7f220aa3a640 5 monclient: authenticate success, global_id 30011 2026-02-24T19:24:28.427 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.418+0000 7f220aa3a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:28.427 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.418+0000 7f2202ffd640 1 -- 10.20.193.26:0/1612352806 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f21f0002fb0 con 0x7f2204159e10 2026-02-24T19:24:28.427 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.418+0000 7f2202ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:28.428 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.418+0000 7f2202ffd640 1 -- 10.20.193.26:0/1612352806 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f21f00033f0 con 0x7f2204159e10 2026-02-24T19:24:28.428 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.418+0000 7f220aa3a640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:28.428 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.418+0000 7f220aa3a640 4 set_mon_vals no callback set 2026-02-24T19:24:28.428 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.418+0000 7f2202ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:28.428 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.418+0000 7f2202ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:28.428 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.418+0000 7f2202ffd640 10 monclient: dump: 2026-02-24T19:24:28.428 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.428 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.428 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.428 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.428 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.428 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.429 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.429 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.429 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.429 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.419+0000 7f220aa3a640 10 monclient: shutdown 2026-02-24T19:24:28.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.419+0000 7f220aa3a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:28.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.419+0000 7f220aa3a640 1 -- 10.20.193.26:0/1612352806 >> v1:10.20.193.103:6789/0 conn(0x7f2204159e10 legacy=0x7f2204059c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.419+0000 7f220aa3a640 1 -- 10.20.193.26:0/1612352806 shutdown_connections 2026-02-24T19:24:28.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.419+0000 7f220aa3a640 1 -- 10.20.193.26:0/1612352806 >> 10.20.193.26:0/1612352806 conn(0x7f22040b2f60 msgr2=0x7f22040b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:28.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.419+0000 7f220aa3a640 1 -- 10.20.193.26:0/1612352806 shutdown_connections 2026-02-24T19:24:28.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.419+0000 7f220aa3a640 1 -- 10.20.193.26:0/1612352806 wait complete. 2026-02-24T19:24:28.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.419+0000 7f220aa3a640 10 monclient: build_initial_monmap 2026-02-24T19:24:28.429 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.419+0000 7f220aa3a640 10 monclient: monmap: 2026-02-24T19:24:28.430 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:28.430 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:28.430 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:28.430 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:28.430 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:28.430 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:28.430 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:28.430 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:28.430 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:28.430 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.430 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.420+0000 7f220aa3a640 1 librados: starting msgr at 2026-02-24T19:24:28.430 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.420+0000 7f220aa3a640 1 librados: starting objecter 2026-02-24T19:24:28.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.420+0000 7f220aa3a640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:28.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.420+0000 7f220aa3a640 1 Processor -- start 2026-02-24T19:24:28.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.420+0000 7f220aa3a640 1 -- start start 2026-02-24T19:24:28.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.420+0000 7f220aa3a640 1 librados: setting wanted keys 2026-02-24T19:24:28.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.420+0000 7f220aa3a640 1 librados: calling monclient init 2026-02-24T19:24:28.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.420+0000 7f220aa3a640 10 monclient: init 2026-02-24T19:24:28.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.420+0000 7f220aa3a640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:28.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.420+0000 7f220aa3a640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:24:28.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.420+0000 7f220aa3a640 10 monclient(hunting): picked mon.noname-b con 0x7f2204159e10 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:28.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.420+0000 7f220aa3a640 10 monclient(hunting): picked mon.noname-a con 0x7f220415a1e0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:28.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.420+0000 7f220aa3a640 10 monclient(hunting): picked mon.noname-c con 0x7f2204161ac0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:28.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.420+0000 7f220aa3a640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22040b3cb0 con 0x7f220415a1e0 2026-02-24T19:24:28.431 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.420+0000 7f220aa3a640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22041faac0 con 0x7f2204159e10 2026-02-24T19:24:28.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.420+0000 7f220aa3a640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22041f6a60 con 0x7f2204161ac0 2026-02-24T19:24:28.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.420+0000 7f220aa3a640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:28.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.420+0000 7f220aa3a640 10 monclient(hunting): authenticate will time out at 4051.102620s 2026-02-24T19:24:28.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.420+0000 7f2208fb0640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f2204161ac0 0x7f22040b35a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58362/0 (socket says 10.20.193.26:58362) 2026-02-24T19:24:28.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.420+0000 7f2208fb0640 1 -- 10.20.193.26:0/4157665718 learned_addr learned my addr 10.20.193.26:0/4157665718 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:28.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.421+0000 7f2200ff9640 10 client.?.objecter ms_handle_connect 0x7f220415a1e0 2026-02-24T19:24:28.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.421+0000 7f2200ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:28.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.421+0000 7f2200ff9640 10 client.?.objecter ms_handle_connect 0x7f2204161ac0 2026-02-24T19:24:28.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.421+0000 7f2200ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:28.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.421+0000 7f2200ff9640 10 client.?.objecter ms_handle_connect 0x7f2204159e10 2026-02-24T19:24:28.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.421+0000 7f2200ff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:28.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.422+0000 7f2200ff9640 1 -- 10.20.193.26:0/4157665718 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 615105099 0 0) 0x7f22040b3cb0 con 0x7f220415a1e0 2026-02-24T19:24:28.432 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.422+0000 7f2200ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.422+0000 7f2200ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.422+0000 7f2200ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.422+0000 7f2200ff9640 10 monclient(hunting): my global_id is 30675 2026-02-24T19:24:28.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.422+0000 7f2200ff9640 1 -- 10.20.193.26:0/4157665718 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21d4003610 con 0x7f220415a1e0 2026-02-24T19:24:28.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.422+0000 7f2200ff9640 1 -- 10.20.193.26:0/4157665718 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4186117937 0 0) 0x7f22041f6a60 con 0x7f2204161ac0 2026-02-24T19:24:28.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.422+0000 7f2200ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.422+0000 7f2200ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.422+0000 7f2200ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.422+0000 7f2200ff9640 10 monclient(hunting): my global_id is 30014 2026-02-24T19:24:28.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.422+0000 7f2200ff9640 1 -- 10.20.193.26:0/4157665718 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22040b3cb0 con 0x7f2204161ac0 2026-02-24T19:24:28.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.422+0000 7f2200ff9640 1 -- 10.20.193.26:0/4157665718 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3264431977 0 0) 0x7f22041faac0 con 0x7f2204159e10 2026-02-24T19:24:28.433 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.422+0000 7f2200ff9640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.434 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.422+0000 7f2200ff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.434 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.422+0000 7f2200ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.434 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.422+0000 7f2200ff9640 10 monclient(hunting): my global_id is 28090 2026-02-24T19:24:28.434 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.422+0000 7f2200ff9640 1 -- 10.20.193.26:0/4157665718 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22041f6a60 con 0x7f2204159e10 2026-02-24T19:24:28.436 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.424+0000 7f2200ff9640 1 -- 10.20.193.26:0/4157665718 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3758120823 0 0) 0x7f22040b3cb0 con 0x7f2204161ac0 2026-02-24T19:24:28.437 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.424+0000 7f2200ff9640 1 -- 10.20.193.26:0/4157665718 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f22041faac0 con 0x7f2204161ac0 2026-02-24T19:24:28.437 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.424+0000 7f2200ff9640 1 -- 10.20.193.26:0/4157665718 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f21f80033c0 con 0x7f2204161ac0 2026-02-24T19:24:28.437 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.424+0000 7f2200ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:28.437 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.424+0000 7f2200ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:28.437 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.424+0000 7f2200ff9640 10 monclient(hunting): dump: 2026-02-24T19:24:28.437 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.437 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.437 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.437 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.437 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.437 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.438 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.438 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.438 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.438 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.438 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.424+0000 7f2200ff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:28.438 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.424+0000 7f2200ff9640 1 -- 10.20.193.26:0/4157665718 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4213703955 0 0) 0x7f21d4003610 con 0x7f220415a1e0 2026-02-24T19:24:28.438 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.424+0000 7f2200ff9640 1 -- 10.20.193.26:0/4157665718 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f22040b3cb0 con 0x7f220415a1e0 2026-02-24T19:24:28.438 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.424+0000 7f2200ff9640 1 -- 10.20.193.26:0/4157665718 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f21f4003040 con 0x7f220415a1e0 2026-02-24T19:24:28.438 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.424+0000 7f2200ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:28.438 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.424+0000 7f2200ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:28.438 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.424+0000 7f2200ff9640 10 monclient(hunting): dump: 2026-02-24T19:24:28.438 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.439 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.439 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.439 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.439 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.439 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.439 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.439 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.439 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.439 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.425+0000 7f2200ff9640 1 -- 10.20.193.26:0/4157665718 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2716507078 0 0) 0x7f22041f6a60 con 0x7f2204159e10 2026-02-24T19:24:28.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.425+0000 7f2200ff9640 1 -- 10.20.193.26:0/4157665718 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f21d4003610 con 0x7f2204159e10 2026-02-24T19:24:28.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.425+0000 7f2200ff9640 1 -- 10.20.193.26:0/4157665718 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f21f0003300 con 0x7f2204159e10 2026-02-24T19:24:28.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.425+0000 7f2200ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:28.440 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.425+0000 7f2200ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:28.440 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.425+0000 7f2200ff9640 10 monclient(hunting): dump: 2026-02-24T19:24:28.440 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.440 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.440 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.440 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.440 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.440 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.440 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.440 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.440 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.440 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.426+0000 7f2200ff9640 1 -- 10.20.193.26:0/4157665718 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3136032492 0 0) 0x7f22041faac0 con 0x7f2204161ac0 2026-02-24T19:24:28.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.426+0000 7f2200ff9640 1 -- 10.20.193.26:0/4157665718 >> v1:10.20.193.70:6789/0 conn(0x7f2204159e10 legacy=0x7f2204162600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.426+0000 7f2200ff9640 1 -- 10.20.193.26:0/4157665718 >> v1:10.20.193.26:6789/0 conn(0x7f220415a1e0 legacy=0x7f22041f7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.426+0000 7f2200ff9640 10 monclient: _finish_hunting 0 2026-02-24T19:24:28.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.426+0000 7f2200ff9640 1 monclient: found mon.c 2026-02-24T19:24:28.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.426+0000 7f2200ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:28.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.426+0000 7f2200ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:28.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.426+0000 7f2200ff9640 1 -- 10.20.193.26:0/4157665718 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22041f6d40 con 0x7f2204161ac0 2026-02-24T19:24:28.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.426+0000 7f2200ff9640 10 monclient: _finish_auth 0 2026-02-24T19:24:28.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.426+0000 7f2200ff9640 10 monclient: _check_auth_tickets 2026-02-24T19:24:28.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.426+0000 7f2200ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:28.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.426+0000 7f220aa3a640 5 monclient: authenticate success, global_id 30014 2026-02-24T19:24:28.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.426+0000 7f220aa3a640 10 monclient: _renew_subs 2026-02-24T19:24:28.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.426+0000 7f220aa3a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:28.442 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.426+0000 7f220aa3a640 1 -- 10.20.193.26:0/4157665718 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f22041f7020 con 0x7f2204161ac0 2026-02-24T19:24:28.442 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.426+0000 7f220aa3a640 10 client.30014.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:28.442 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.426+0000 7f220aa3a640 10 monclient: _renew_subs 2026-02-24T19:24:28.442 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.426+0000 7f220aa3a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:28.442 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.426+0000 7f220aa3a640 1 -- 10.20.193.26:0/4157665718 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f22041f7820 con 0x7f2204161ac0 2026-02-24T19:24:28.442 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.426+0000 7f220aa3a640 1 librados: init done 2026-02-24T19:24:28.442 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.426+0000 7f220aa3a640 10 client.30014.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:28.442 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.426+0000 7f220aa3a640 15 client.30014.objecter _session_command_op_assign -1 1 2026-02-24T19:24:28.442 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.426+0000 7f220aa3a640 20 client.30014.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:28.442 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.426+0000 7f220aa3a640 10 client.30014.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:28.442 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.426+0000 7f220aa3a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:28.442 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.426+0000 7f220aa3a640 1 -- 10.20.193.26:0/4157665718 --> v1:10.20.193.103:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f2204139040 con 0x7f2204161ac0 2026-02-24T19:24:28.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.434+0000 7f2200ff9640 1 -- 10.20.193.26:0/4157665718 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2204139040 con 0x7f2204161ac0 2026-02-24T19:24:28.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.434+0000 7f2200ff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:28.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.434+0000 7f2200ff9640 1 -- 10.20.193.26:0/4157665718 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f21f8003c20 con 0x7f2204161ac0 2026-02-24T19:24:28.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.434+0000 7f2200ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:28.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.434+0000 7f2200ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:28.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.434+0000 7f2200ff9640 10 monclient: dump: 2026-02-24T19:24:28.443 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.443 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.443 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.443 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.443 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.443 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.443 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.443 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.444 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.444 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.444 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.434+0000 7f22027fc640 4 set_mon_vals no callback set 2026-02-24T19:24:28.444 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.435+0000 7f2200ff9640 1 -- 10.20.193.26:0/4157665718 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f21f8003e30 con 0x7f2204161ac0 2026-02-24T19:24:28.445 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.435+0000 7f2203fff640 10 monclient: get_auth_request con 0x7f21d4077e70 auth_method 0 2026-02-24T19:24:28.446 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.435+0000 7f2200ff9640 1 -- 10.20.193.26:0/4157665718 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7f21f80248c0 con 0x7f2204161ac0 2026-02-24T19:24:28.446 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.435+0000 7f2200ff9640 10 client.30014.objecter ms_dispatch2 0x7f2204000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:28.446 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.435+0000 7f2200ff9640 3 client.30014.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:28.446 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.435+0000 7f2200ff9640 3 client.30014.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:28.446 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.435+0000 7f2200ff9640 10 client.30014.objecter checking command 1 2026-02-24T19:24:28.446 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.435+0000 7f2200ff9640 20 client.30014.objecter _get_session s=0x7f21d40a21d0 osd=1 3 2026-02-24T19:24:28.446 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.435+0000 7f2200ff9640 20 client.30014.objecter put_session s=0x7f21d40a21d0 osd=1 3 2026-02-24T19:24:28.446 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.435+0000 7f2200ff9640 15 client.30014.objecter _session_command_op_remove -1 1 2026-02-24T19:24:28.446 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.435+0000 7f2200ff9640 20 client.30014.objecter _get_session s=0x7f21d40a21d0 osd=1 3 2026-02-24T19:24:28.446 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.435+0000 7f2200ff9640 20 client.30014.objecter get_session s=0x7f21d40a21d0 osd=1 3 2026-02-24T19:24:28.446 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.435+0000 7f2200ff9640 15 client.30014.objecter _session_command_op_assign 1 1 2026-02-24T19:24:28.446 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.435+0000 7f2200ff9640 20 client.30014.objecter put_session s=0x7f21d40a21d0 osd=1 4 2026-02-24T19:24:28.446 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.435+0000 7f2200ff9640 10 client.30014.objecter _send_command 1 2026-02-24T19:24:28.447 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.435+0000 7f2200ff9640 1 -- 10.20.193.26:0/4157665718 --> v1:10.20.193.70:6800/268803542 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f21d40c44e0 con 0x7f21d40a2880 2026-02-24T19:24:28.447 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.435+0000 7f2200ff9640 20 client.30014.objecter dump_active .. 0 homeless 2026-02-24T19:24:28.447 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.436+0000 7f2200ff9640 10 client.30014.objecter ms_handle_connect 0x7f21d4077e70 2026-02-24T19:24:28.447 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.436+0000 7f22037fe640 10 monclient: get_auth_request con 0x7f21d40a2880 auth_method 0 2026-02-24T19:24:28.447 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.436+0000 7f2200ff9640 1 -- 10.20.193.26:0/4157665718 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_get_version_reply(handle=1 version=346) ==== 24+0+0 (unknown 2991753921 0 0) 0x7f21f8059950 con 0x7f2204161ac0 2026-02-24T19:24:28.447 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.436+0000 7f2200ff9640 10 monclient: handle_get_version_reply finishing 1 version 346 2026-02-24T19:24:28.447 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.437+0000 7f2200ff9640 10 client.30014.objecter ms_handle_connect 0x7f21d40a2880 2026-02-24T19:24:28.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.446+0000 7f2200ff9640 1 -- 10.20.193.26:0/4157665718 <== osd.1 v1:10.20.193.70:6800/268803542 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f21d40c44e0 con 0x7f21d40a2880 2026-02-24T19:24:28.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.446+0000 7f2200ff9640 10 client.30014.objecter ms_dispatch2 0x7f2204000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:28.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.446+0000 7f2200ff9640 10 client.30014.objecter _finish_command 1 = system:0 2026-02-24T19:24:28.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.446+0000 7f2200ff9640 20 client.30014.objecter put_session s=0x7f21d40a21d0 osd=1 4 2026-02-24T19:24:28.448 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.446+0000 7f2200ff9640 15 client.30014.objecter _session_command_op_remove 1 1 2026-02-24T19:24:28.454 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.453+0000 7f220aa3a640 10 client.30014.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:28.454 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.453+0000 7f220aa3a640 15 client.30014.objecter _session_command_op_assign -1 2 2026-02-24T19:24:28.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.453+0000 7f220aa3a640 20 client.30014.objecter _get_session s=0x7f21d40a21d0 osd=1 3 2026-02-24T19:24:28.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.453+0000 7f220aa3a640 20 client.30014.objecter put_session s=0x7f21d40a21d0 osd=1 3 2026-02-24T19:24:28.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.453+0000 7f220aa3a640 20 client.30014.objecter _get_session s=0x7f21d40a21d0 osd=1 3 2026-02-24T19:24:28.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.453+0000 7f220aa3a640 15 client.30014.objecter _session_command_op_remove -1 2 2026-02-24T19:24:28.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.453+0000 7f220aa3a640 20 client.30014.objecter get_session s=0x7f21d40a21d0 osd=1 3 2026-02-24T19:24:28.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.453+0000 7f220aa3a640 15 client.30014.objecter _session_command_op_assign 1 2 2026-02-24T19:24:28.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.453+0000 7f220aa3a640 20 client.30014.objecter put_session s=0x7f21d40a21d0 osd=1 4 2026-02-24T19:24:28.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.453+0000 7f220aa3a640 10 client.30014.objecter _send_command 2 2026-02-24T19:24:28.455 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.453+0000 7f220aa3a640 1 -- 10.20.193.26:0/4157665718 --> v1:10.20.193.70:6800/268803542 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2204056c80 con 0x7f21d40a2880 2026-02-24T19:24:28.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.461+0000 7f2200ff9640 1 -- 10.20.193.26:0/4157665718 <== osd.1 v1:10.20.193.70:6800/268803542 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f2204056c80 con 0x7f21d40a2880 2026-02-24T19:24:28.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.461+0000 7f2200ff9640 10 client.30014.objecter ms_dispatch2 0x7f2204000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:28.462 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.461+0000 7f2200ff9640 10 client.30014.objecter _finish_command 2 = system:0 2026-02-24T19:24:28.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.461+0000 7f2200ff9640 20 client.30014.objecter put_session s=0x7f21d40a21d0 osd=1 4 2026-02-24T19:24:28.463 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.461+0000 7f2200ff9640 15 client.30014.objecter _session_command_op_remove 1 2 2026-02-24T19:24:28.463 INFO:teuthology.orchestra.run.trial026.stdout:{ 2026-02-24T19:24:28.463 INFO:teuthology.orchestra.run.trial026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:28.463 INFO:teuthology.orchestra.run.trial026.stdout:} 2026-02-24T19:24:28.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.461+0000 7f220aa3a640 10 librados: watch_flush enter 2026-02-24T19:24:28.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.461+0000 7f220aa3a640 10 librados: watch_flush exit 2026-02-24T19:24:28.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.461+0000 7f220aa3a640 10 client.30014.objecter close_session for osd.1 2026-02-24T19:24:28.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.461+0000 7f220aa3a640 1 -- 10.20.193.26:0/4157665718 >> v1:10.20.193.70:6800/268803542 conn(0x7f21d40a2880 legacy=0x7f21d40c2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.461+0000 7f220aa3a640 20 client.30014.objecter put_session s=0x7f21d40a21d0 osd=1 1 2026-02-24T19:24:28.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.461+0000 7f220aa3a640 20 client.30014.objecter shutdown clearing up homeless session... 2026-02-24T19:24:28.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.461+0000 7f220aa3a640 10 client.30014.objecter successfully canceled tick 2026-02-24T19:24:28.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.461+0000 7f220aa3a640 1 -- 10.20.193.26:0/4157665718 >> v1:10.20.193.162:6800/3889602630 conn(0x7f21d4077e70 legacy=0x7f21d4098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.461+0000 7f220aa3a640 10 monclient: shutdown 2026-02-24T19:24:28.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.461+0000 7f220aa3a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:28.465 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.461+0000 7f220aa3a640 1 -- 10.20.193.26:0/4157665718 >> v1:10.20.193.103:6789/0 conn(0x7f2204161ac0 legacy=0x7f22040b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.461+0000 7f2208fb0640 1 -- 10.20.193.26:0/4157665718 reap_dead start 2026-02-24T19:24:28.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.461+0000 7f220aa3a640 1 -- 10.20.193.26:0/4157665718 shutdown_connections 2026-02-24T19:24:28.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.461+0000 7f220aa3a640 1 -- 10.20.193.26:0/4157665718 >> 10.20.193.26:0/4157665718 conn(0x7f22040b2f60 msgr2=0x7f2204059c20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:28.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.461+0000 7f220aa3a640 1 -- 10.20.193.26:0/4157665718 shutdown_connections 2026-02-24T19:24:28.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.461+0000 7f220aa3a640 1 -- 10.20.193.26:0/4157665718 wait complete. 2026-02-24T19:24:28.466 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.461+0000 7f220aa3a640 1 librados: shutdown 2026-02-24T19:24:28.470 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-24T19:24:28.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.537+0000 7fd6f43fa640 10 monclient: get_monmap_and_config 2026-02-24T19:24:28.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.537+0000 7fd6f43fa640 10 monclient: build_initial_monmap 2026-02-24T19:24:28.539 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.537+0000 7fd6f43fa640 10 monclient: monmap: 2026-02-24T19:24:28.539 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:28.539 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.539 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:28.538488+0000 2026-02-24T19:24:28.539 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:28.538488+0000 2026-02-24T19:24:28.540 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:28.540 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.540 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:28.540 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:28.540 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:28.540 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.538+0000 7fd6f43fa640 1 Processor -- start 2026-02-24T19:24:28.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.538+0000 7fd6f43fa640 1 -- start start 2026-02-24T19:24:28.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.538+0000 7fd6f43fa640 10 monclient: init 2026-02-24T19:24:28.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.538+0000 7fd6f43fa640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:28.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.538+0000 7fd6f43fa640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:24:28.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.538+0000 7fd6f43fa640 10 monclient(hunting): picked mon.noname-a con 0x7fd6ec157780 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:28.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.538+0000 7fd6f43fa640 10 monclient(hunting): picked mon.noname-b con 0x7fd6ec157b50 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:28.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.538+0000 7fd6f43fa640 10 monclient(hunting): picked mon.noname-c con 0x7fd6ec164d00 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:28.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.538+0000 7fd6f43fa640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6ec05de70 con 0x7fd6ec157780 2026-02-24T19:24:28.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.538+0000 7fd6f43fa640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6ec055b20 con 0x7fd6ec157b50 2026-02-24T19:24:28.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.538+0000 7fd6f43fa640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6ec055e00 con 0x7fd6ec164d00 2026-02-24T19:24:28.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.538+0000 7fd6f43fa640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:28.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.538+0000 7fd6f43fa640 10 monclient(hunting): authenticate will time out at 4051.220714s 2026-02-24T19:24:28.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.539+0000 7fd6f2970640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fd6ec164d00 0x7fd6ec1c5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58374/0 (socket says 10.20.193.26:58374) 2026-02-24T19:24:28.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.539+0000 7fd6f2970640 1 -- 10.20.193.26:0/3187560541 learned_addr learned my addr 10.20.193.26:0/3187560541 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:28.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.539+0000 7fd6f216f640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fd6ec157780 0x7fd6ec056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59452/0 (socket says 10.20.193.26:59452) 2026-02-24T19:24:28.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.540+0000 7fd6f116d640 1 -- 10.20.193.26:0/3187560541 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3626721246 0 0) 0x7fd6ec05de70 con 0x7fd6ec157780 2026-02-24T19:24:28.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.540+0000 7fd6f116d640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.540+0000 7fd6f116d640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.540+0000 7fd6f116d640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.540+0000 7fd6f116d640 10 monclient(hunting): my global_id is 30678 2026-02-24T19:24:28.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.540+0000 7fd6f116d640 1 -- 10.20.193.26:0/3187560541 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6d4003610 con 0x7fd6ec157780 2026-02-24T19:24:28.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.540+0000 7fd6f116d640 1 -- 10.20.193.26:0/3187560541 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2423639427 0 0) 0x7fd6ec055b20 con 0x7fd6ec157b50 2026-02-24T19:24:28.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.540+0000 7fd6f116d640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.540+0000 7fd6f116d640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.540+0000 7fd6f116d640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.540+0000 7fd6f116d640 10 monclient(hunting): my global_id is 28093 2026-02-24T19:24:28.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.540+0000 7fd6f116d640 1 -- 10.20.193.26:0/3187560541 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6ec05de70 con 0x7fd6ec157b50 2026-02-24T19:24:28.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.540+0000 7fd6f116d640 1 -- 10.20.193.26:0/3187560541 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2547325146 0 0) 0x7fd6ec055e00 con 0x7fd6ec164d00 2026-02-24T19:24:28.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.540+0000 7fd6f116d640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.540+0000 7fd6f116d640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.540+0000 7fd6f116d640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.540+0000 7fd6f116d640 10 monclient(hunting): my global_id is 30017 2026-02-24T19:24:28.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.540+0000 7fd6f116d640 1 -- 10.20.193.26:0/3187560541 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6ec055b20 con 0x7fd6ec164d00 2026-02-24T19:24:28.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.542+0000 7fd6f116d640 1 -- 10.20.193.26:0/3187560541 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2643636045 0 0) 0x7fd6d4003610 con 0x7fd6ec157780 2026-02-24T19:24:28.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.542+0000 7fd6f116d640 1 -- 10.20.193.26:0/3187560541 >> v1:10.20.193.103:6789/0 conn(0x7fd6ec164d00 legacy=0x7fd6ec1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.542+0000 7fd6f116d640 1 -- 10.20.193.26:0/3187560541 >> v1:10.20.193.70:6789/0 conn(0x7fd6ec157b50 legacy=0x7fd6ec1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.542+0000 7fd6f116d640 10 monclient: _finish_hunting 0 2026-02-24T19:24:28.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.542+0000 7fd6f116d640 1 monclient: found mon.noname-a 2026-02-24T19:24:28.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.542+0000 7fd6f116d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:28.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.542+0000 7fd6f116d640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:24:28.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.542+0000 7fd6f116d640 1 -- 10.20.193.26:0/3187560541 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6ec0560e0 con 0x7fd6ec157780 2026-02-24T19:24:28.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.542+0000 7fd6f116d640 10 monclient: _finish_auth 0 2026-02-24T19:24:28.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.542+0000 7fd6f116d640 10 monclient: _check_auth_tickets 2026-02-24T19:24:28.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.542+0000 7fd6f116d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:28.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.542+0000 7fd6f116d640 1 -- 10.20.193.26:0/3187560541 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd6dc002df0 con 0x7fd6ec157780 2026-02-24T19:24:28.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.542+0000 7fd6f116d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:28.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.542+0000 7fd6f116d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:28.553 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.542+0000 7fd6f116d640 10 monclient: dump: 2026-02-24T19:24:28.553 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.553 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.553 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.553 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.553 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.553 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.553 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.554 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.554 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.554 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.542+0000 7fd6f43fa640 5 monclient: authenticate success, global_id 30678 2026-02-24T19:24:28.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.542+0000 7fd6f43fa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:28.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.542+0000 7fd6f116d640 1 -- 10.20.193.26:0/3187560541 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd6dc002fc0 con 0x7fd6ec157780 2026-02-24T19:24:28.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.542+0000 7fd6f116d640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:28.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.542+0000 7fd6f116d640 1 -- 10.20.193.26:0/3187560541 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd6dc003400 con 0x7fd6ec157780 2026-02-24T19:24:28.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.542+0000 7fd6f116d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:28.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.542+0000 7fd6f116d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:28.554 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.542+0000 7fd6f116d640 10 monclient: dump: 2026-02-24T19:24:28.554 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.555 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.555 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.555 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.555 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.555 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.555 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.555 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.555 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.555 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.542+0000 7fd6f43fa640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:28.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.542+0000 7fd6f43fa640 4 set_mon_vals no callback set 2026-02-24T19:24:28.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.543+0000 7fd6f43fa640 10 monclient: shutdown 2026-02-24T19:24:28.555 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.543+0000 7fd6f43fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:28.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.543+0000 7fd6f43fa640 1 -- 10.20.193.26:0/3187560541 >> v1:10.20.193.26:6789/0 conn(0x7fd6ec157780 legacy=0x7fd6ec056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.543+0000 7fd6f43fa640 1 -- 10.20.193.26:0/3187560541 shutdown_connections 2026-02-24T19:24:28.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.543+0000 7fd6f43fa640 1 -- 10.20.193.26:0/3187560541 >> 10.20.193.26:0/3187560541 conn(0x7fd6ec0b2ef0 msgr2=0x7fd6ec0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:28.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.543+0000 7fd6f43fa640 1 -- 10.20.193.26:0/3187560541 shutdown_connections 2026-02-24T19:24:28.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.543+0000 7fd6f43fa640 1 -- 10.20.193.26:0/3187560541 wait complete. 2026-02-24T19:24:28.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.543+0000 7fd6f43fa640 10 monclient: build_initial_monmap 2026-02-24T19:24:28.556 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.543+0000 7fd6f43fa640 10 monclient: monmap: 2026-02-24T19:24:28.556 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:28.556 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:28.556 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:28.556 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:28.556 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:28.556 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:28.557 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:28.557 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:28.557 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:28.557 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.543+0000 7fd6f43fa640 1 librados: starting msgr at 2026-02-24T19:24:28.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.543+0000 7fd6f43fa640 1 librados: starting objecter 2026-02-24T19:24:28.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.543+0000 7fd6f43fa640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:28.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.543+0000 7fd6f43fa640 1 Processor -- start 2026-02-24T19:24:28.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.543+0000 7fd6f43fa640 1 -- start start 2026-02-24T19:24:28.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.543+0000 7fd6f43fa640 1 librados: setting wanted keys 2026-02-24T19:24:28.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.543+0000 7fd6f43fa640 1 librados: calling monclient init 2026-02-24T19:24:28.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.543+0000 7fd6f43fa640 10 monclient: init 2026-02-24T19:24:28.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.544+0000 7fd6f43fa640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:28.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.544+0000 7fd6f43fa640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:28.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.544+0000 7fd6f43fa640 10 monclient(hunting): picked mon.noname-a con 0x7fd6ec157780 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:28.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.544+0000 7fd6f43fa640 10 monclient(hunting): picked mon.noname-c con 0x7fd6ec157b50 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:28.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.544+0000 7fd6f43fa640 10 monclient(hunting): picked mon.noname-b con 0x7fd6ec164d00 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:28.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.544+0000 7fd6f43fa640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6ec135e80 con 0x7fd6ec157780 2026-02-24T19:24:28.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.544+0000 7fd6f43fa640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6ec136160 con 0x7fd6ec164d00 2026-02-24T19:24:28.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.544+0000 7fd6f43fa640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6ec136440 con 0x7fd6ec157b50 2026-02-24T19:24:28.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.544+0000 7fd6f43fa640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:28.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.544+0000 7fd6f43fa640 10 monclient(hunting): authenticate will time out at 4051.226337s 2026-02-24T19:24:28.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.544+0000 7fd6f216f640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fd6ec157780 0x7fd6ec13a2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59468/0 (socket says 10.20.193.26:59468) 2026-02-24T19:24:28.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.544+0000 7fd6f216f640 1 -- 10.20.193.26:0/664092499 learned_addr learned my addr 10.20.193.26:0/664092499 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:28.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.544+0000 7fd6d2ffd640 10 client.?.objecter ms_handle_connect 0x7fd6ec157780 2026-02-24T19:24:28.558 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.544+0000 7fd6d2ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:28.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.544+0000 7fd6d2ffd640 10 client.?.objecter ms_handle_connect 0x7fd6ec157b50 2026-02-24T19:24:28.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.544+0000 7fd6d2ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:28.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.545+0000 7fd6d2ffd640 10 client.?.objecter ms_handle_connect 0x7fd6ec164d00 2026-02-24T19:24:28.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.545+0000 7fd6d2ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:28.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.545+0000 7fd6d2ffd640 1 -- 10.20.193.26:0/664092499 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1334571926 0 0) 0x7fd6ec135e80 con 0x7fd6ec157780 2026-02-24T19:24:28.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.545+0000 7fd6d2ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.545+0000 7fd6d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.545+0000 7fd6d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.545+0000 7fd6d2ffd640 10 monclient(hunting): my global_id is 30681 2026-02-24T19:24:28.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.545+0000 7fd6d2ffd640 1 -- 10.20.193.26:0/664092499 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6bc003610 con 0x7fd6ec157780 2026-02-24T19:24:28.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.545+0000 7fd6d2ffd640 1 -- 10.20.193.26:0/664092499 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 610468008 0 0) 0x7fd6ec136440 con 0x7fd6ec157b50 2026-02-24T19:24:28.559 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.545+0000 7fd6d2ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.545+0000 7fd6d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.545+0000 7fd6d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.545+0000 7fd6d2ffd640 10 monclient(hunting): my global_id is 30020 2026-02-24T19:24:28.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.545+0000 7fd6d2ffd640 1 -- 10.20.193.26:0/664092499 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6ec135e80 con 0x7fd6ec157b50 2026-02-24T19:24:28.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.546+0000 7fd6d2ffd640 1 -- 10.20.193.26:0/664092499 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3417619241 0 0) 0x7fd6ec136160 con 0x7fd6ec164d00 2026-02-24T19:24:28.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.546+0000 7fd6d2ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.546+0000 7fd6d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.546+0000 7fd6d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.546+0000 7fd6d2ffd640 10 monclient(hunting): my global_id is 28096 2026-02-24T19:24:28.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.546+0000 7fd6d2ffd640 1 -- 10.20.193.26:0/664092499 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6ec136440 con 0x7fd6ec164d00 2026-02-24T19:24:28.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.548+0000 7fd6d2ffd640 1 -- 10.20.193.26:0/664092499 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2308089294 0 0) 0x7fd6bc003610 con 0x7fd6ec157780 2026-02-24T19:24:28.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.548+0000 7fd6d2ffd640 1 -- 10.20.193.26:0/664092499 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd6ec136160 con 0x7fd6ec157780 2026-02-24T19:24:28.560 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.548+0000 7fd6d2ffd640 1 -- 10.20.193.26:0/664092499 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd6dc003310 con 0x7fd6ec157780 2026-02-24T19:24:28.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.548+0000 7fd6d2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:28.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.548+0000 7fd6d2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:28.561 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.548+0000 7fd6d2ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:28.561 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.561 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.561 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.561 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.561 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.561 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.561 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.561 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.561 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.561 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.548+0000 7fd6d2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:28.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.548+0000 7fd6d2ffd640 1 -- 10.20.193.26:0/664092499 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3063711108 0 0) 0x7fd6ec135e80 con 0x7fd6ec157b50 2026-02-24T19:24:28.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.548+0000 7fd6d2ffd640 1 -- 10.20.193.26:0/664092499 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd6bc003610 con 0x7fd6ec157b50 2026-02-24T19:24:28.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.548+0000 7fd6d2ffd640 1 -- 10.20.193.26:0/664092499 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd6e00030b0 con 0x7fd6ec157b50 2026-02-24T19:24:28.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.548+0000 7fd6d2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:28.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.548+0000 7fd6d2ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:28.562 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.548+0000 7fd6d2ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:28.562 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.562 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.562 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.562 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.562 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.562 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.563 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.563 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.563 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.563 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.548+0000 7fd6d2ffd640 1 -- 10.20.193.26:0/664092499 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 340538663 0 0) 0x7fd6ec136440 con 0x7fd6ec164d00 2026-02-24T19:24:28.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.548+0000 7fd6d2ffd640 1 -- 10.20.193.26:0/664092499 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd6ec135e80 con 0x7fd6ec164d00 2026-02-24T19:24:28.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.548+0000 7fd6d2ffd640 1 -- 10.20.193.26:0/664092499 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd6e80033d0 con 0x7fd6ec164d00 2026-02-24T19:24:28.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.548+0000 7fd6d2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:28.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.548+0000 7fd6d2ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:28.563 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.548+0000 7fd6d2ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:28.563 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.563 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.563 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.564 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.564 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.564 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.564 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.564 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.564 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.564 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.549+0000 7fd6d2ffd640 1 -- 10.20.193.26:0/664092499 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3502552461 0 0) 0x7fd6ec136160 con 0x7fd6ec157780 2026-02-24T19:24:28.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.549+0000 7fd6d2ffd640 1 -- 10.20.193.26:0/664092499 >> v1:10.20.193.103:6789/0 conn(0x7fd6ec157b50 legacy=0x7fd6ec149b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.549+0000 7fd6d2ffd640 1 -- 10.20.193.26:0/664092499 >> v1:10.20.193.70:6789/0 conn(0x7fd6ec164d00 legacy=0x7fd6ec146330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.549+0000 7fd6d2ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:28.564 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.549+0000 7fd6d2ffd640 1 monclient: found mon.a 2026-02-24T19:24:28.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.549+0000 7fd6d2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:28.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.549+0000 7fd6d2ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:28.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.549+0000 7fd6d2ffd640 1 -- 10.20.193.26:0/664092499 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6ec136720 con 0x7fd6ec157780 2026-02-24T19:24:28.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.549+0000 7fd6d2ffd640 10 monclient: _finish_auth 0 2026-02-24T19:24:28.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.549+0000 7fd6d2ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:28.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.549+0000 7fd6d2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:28.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.549+0000 7fd6f43fa640 5 monclient: authenticate success, global_id 30681 2026-02-24T19:24:28.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.549+0000 7fd6f43fa640 10 monclient: _renew_subs 2026-02-24T19:24:28.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.549+0000 7fd6f43fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:28.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.549+0000 7fd6f43fa640 1 -- 10.20.193.26:0/664092499 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd6ec136a00 con 0x7fd6ec157780 2026-02-24T19:24:28.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.549+0000 7fd6f43fa640 10 client.30681.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:28.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.549+0000 7fd6f43fa640 10 monclient: _renew_subs 2026-02-24T19:24:28.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.549+0000 7fd6f43fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:28.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.549+0000 7fd6f43fa640 1 -- 10.20.193.26:0/664092499 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd6ec13a9e0 con 0x7fd6ec157780 2026-02-24T19:24:28.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.549+0000 7fd6f43fa640 1 librados: init done 2026-02-24T19:24:28.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.550+0000 7fd6f43fa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:28.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.550+0000 7fd6f43fa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:28.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.550+0000 7fd6f43fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:28.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.550+0000 7fd6f43fa640 1 -- 10.20.193.26:0/664092499 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6ec165740 con 0x7fd6ec157780 2026-02-24T19:24:28.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.558+0000 7fd6d2ffd640 1 -- 10.20.193.26:0/664092499 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd6dc0029a0 con 0x7fd6ec157780 2026-02-24T19:24:28.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.558+0000 7fd6d2ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:28.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.558+0000 7fd6d2ffd640 1 -- 10.20.193.26:0/664092499 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fd6dc004b80 con 0x7fd6ec157780 2026-02-24T19:24:28.567 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.558+0000 7fd6d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:28.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.558+0000 7fd6d2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:28.568 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.558+0000 7fd6d2ffd640 10 monclient: dump: 2026-02-24T19:24:28.568 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.568 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.568 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.568 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.568 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.568 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.568 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.568 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.568 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.568 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.558+0000 7fd6f096c640 4 set_mon_vals no callback set 2026-02-24T19:24:28.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.558+0000 7fd6d2ffd640 1 -- 10.20.193.26:0/664092499 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fd6dc004d60 con 0x7fd6ec157780 2026-02-24T19:24:28.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.559+0000 7fd6f196e640 10 monclient: get_auth_request con 0x7fd6bc077e50 auth_method 0 2026-02-24T19:24:28.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.559+0000 7fd6d2ffd640 1 -- 10.20.193.26:0/664092499 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7fd6dc093160 con 0x7fd6ec157780 2026-02-24T19:24:28.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.559+0000 7fd6d2ffd640 10 client.30681.objecter ms_dispatch2 0x7fd6ec000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:28.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.559+0000 7fd6d2ffd640 3 client.30681.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:28.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.559+0000 7fd6d2ffd640 3 client.30681.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:28.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.559+0000 7fd6d2ffd640 20 client.30681.objecter dump_active .. 0 homeless 2026-02-24T19:24:28.569 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.559+0000 7fd6d2ffd640 10 client.30681.objecter ms_handle_connect 0x7fd6bc077e50 2026-02-24T19:24:28.646 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.644+0000 7fd6d2ffd640 1 -- 10.20.193.26:0/664092499 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fd6ec165740 con 0x7fd6ec157780 2026-02-24T19:24:28.646 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.644+0000 7fd6d2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:28.646 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.644+0000 7fd6d2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:28.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.752+0000 7fd6f43fa640 1 -- 10.20.193.26:0/664092499 --> v1:10.20.193.162:6800/3889602630 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fd6ec13ac70 con 0x7fd6bc077e50 2026-02-24T19:24:28.754 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.752+0000 7fd6d2ffd640 1 -- 10.20.193.26:0/664092499 <== mgr.4107 v1:10.20.193.162:6800/3889602630 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (unknown 489605429 0 0) 0x7fd6ec13ac70 con 0x7fd6bc077e50 2026-02-24T19:24:28.754 INFO:teuthology.orchestra.run.trial026.stderr:instructed osd(s) 1 to deep-scrub 2026-02-24T19:24:28.756 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.754+0000 7fd6f43fa640 10 librados: watch_flush enter 2026-02-24T19:24:28.756 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.754+0000 7fd6f43fa640 10 librados: watch_flush exit 2026-02-24T19:24:28.757 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.754+0000 7fd6f43fa640 20 client.30681.objecter shutdown clearing up homeless session... 2026-02-24T19:24:28.757 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.754+0000 7fd6f43fa640 10 client.30681.objecter successfully canceled tick 2026-02-24T19:24:28.757 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.754+0000 7fd6f43fa640 1 -- 10.20.193.26:0/664092499 >> v1:10.20.193.162:6800/3889602630 conn(0x7fd6bc077e50 legacy=0x7fd6bc098300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.757 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.754+0000 7fd6f43fa640 10 monclient: shutdown 2026-02-24T19:24:28.757 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.754+0000 7fd6f43fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:28.757 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.754+0000 7fd6f43fa640 1 -- 10.20.193.26:0/664092499 >> v1:10.20.193.26:6789/0 conn(0x7fd6ec157780 legacy=0x7fd6ec13a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.757 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.754+0000 7fd6f43fa640 1 -- 10.20.193.26:0/664092499 shutdown_connections 2026-02-24T19:24:28.757 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.754+0000 7fd6f43fa640 1 -- 10.20.193.26:0/664092499 >> 10.20.193.26:0/664092499 conn(0x7fd6ec0b2ef0 msgr2=0x7fd6ec13b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:28.757 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.754+0000 7fd6f43fa640 1 -- 10.20.193.26:0/664092499 shutdown_connections 2026-02-24T19:24:28.757 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.754+0000 7fd6f43fa640 1 -- 10.20.193.26:0/664092499 wait complete. 2026-02-24T19:24:28.757 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.754+0000 7fd6f43fa640 1 librados: shutdown 2026-02-24T19:24:28.765 INFO:tasks.ceph:Scrubbing osd.5 2026-02-24T19:24:28.765 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:28.836 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.835+0000 7f762d946640 10 monclient: get_monmap_and_config 2026-02-24T19:24:28.837 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.835+0000 7f762d946640 10 monclient: build_initial_monmap 2026-02-24T19:24:28.837 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.835+0000 7f762d946640 10 monclient: monmap: 2026-02-24T19:24:28.837 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:28.837 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.837 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:28.836227+0000 2026-02-24T19:24:28.837 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:28.836227+0000 2026-02-24T19:24:28.837 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:28.837 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.837 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:28.837 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:28.838 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:28.838 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.840 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.835+0000 7f762d946640 1 Processor -- start 2026-02-24T19:24:28.840 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.835+0000 7f762d946640 1 -- start start 2026-02-24T19:24:28.840 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.836+0000 7f762d946640 10 monclient: init 2026-02-24T19:24:28.841 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.836+0000 7f762d946640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:28.841 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.836+0000 7f762d946640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:24:28.841 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.836+0000 7f762d946640 10 monclient(hunting): picked mon.noname-b con 0x7f7628164660 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:28.841 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.836+0000 7f762d946640 10 monclient(hunting): picked mon.noname-a con 0x7f7628164a30 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:28.841 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.836+0000 7f762d946640 10 monclient(hunting): picked mon.noname-c con 0x7f76280598b0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:28.841 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.836+0000 7f762d946640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76280b1720 con 0x7f7628164a30 2026-02-24T19:24:28.841 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.836+0000 7f762d946640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76280b1a00 con 0x7f7628164660 2026-02-24T19:24:28.841 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.836+0000 7f762d946640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76280b1ce0 con 0x7f76280598b0 2026-02-24T19:24:28.841 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.836+0000 7f762d946640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:28.841 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.836+0000 7f762d946640 10 monclient(hunting): authenticate will time out at 4051.518602s 2026-02-24T19:24:28.841 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.836+0000 7f762d145640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f76280598b0 0x7f7628157260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58400/0 (socket says 10.20.193.26:58400) 2026-02-24T19:24:28.841 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.836+0000 7f762d145640 1 -- 10.20.193.26:0/412129532 learned_addr learned my addr 10.20.193.26:0/412129532 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:28.842 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.838+0000 7f761f7fe640 1 -- 10.20.193.26:0/412129532 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1699830819 0 0) 0x7f76280b1ce0 con 0x7f76280598b0 2026-02-24T19:24:28.842 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.838+0000 7f761f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.842 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.838+0000 7f761f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.842 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.838+0000 7f761f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.842 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.838+0000 7f761f7fe640 10 monclient(hunting): my global_id is 30023 2026-02-24T19:24:28.842 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.838+0000 7f761f7fe640 1 -- 10.20.193.26:0/412129532 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7614003610 con 0x7f76280598b0 2026-02-24T19:24:28.842 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.838+0000 7f761f7fe640 1 -- 10.20.193.26:0/412129532 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1194781279 0 0) 0x7f76280b1720 con 0x7f7628164a30 2026-02-24T19:24:28.842 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.838+0000 7f761f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.842 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.838+0000 7f761f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.842 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.838+0000 7f761f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.842 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.838+0000 7f761f7fe640 10 monclient(hunting): my global_id is 30684 2026-02-24T19:24:28.842 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.838+0000 7f761f7fe640 1 -- 10.20.193.26:0/412129532 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76280b1ce0 con 0x7f7628164a30 2026-02-24T19:24:28.843 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.838+0000 7f761f7fe640 1 -- 10.20.193.26:0/412129532 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 561749637 0 0) 0x7f76280b1a00 con 0x7f7628164660 2026-02-24T19:24:28.843 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.838+0000 7f761f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.843 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.838+0000 7f761f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.843 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.838+0000 7f761f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.843 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.838+0000 7f761f7fe640 10 monclient(hunting): my global_id is 28099 2026-02-24T19:24:28.843 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.838+0000 7f761f7fe640 1 -- 10.20.193.26:0/412129532 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76280b1720 con 0x7f7628164660 2026-02-24T19:24:28.848 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.839+0000 7f761f7fe640 1 -- 10.20.193.26:0/412129532 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3385563564 0 0) 0x7f7614003610 con 0x7f76280598b0 2026-02-24T19:24:28.849 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.840+0000 7f761f7fe640 1 -- 10.20.193.26:0/412129532 >> v1:10.20.193.70:6789/0 conn(0x7f7628164660 legacy=0x7f76281622f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.849 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.840+0000 7f761f7fe640 1 -- 10.20.193.26:0/412129532 >> v1:10.20.193.26:6789/0 conn(0x7f7628164a30 legacy=0x7f76280b0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.849 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.840+0000 7f761f7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:24:28.849 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.840+0000 7f761f7fe640 1 monclient: found mon.noname-c 2026-02-24T19:24:28.849 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.840+0000 7f761f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:28.849 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.840+0000 7f761f7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:24:28.849 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.840+0000 7f761f7fe640 1 -- 10.20.193.26:0/412129532 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76280b1fc0 con 0x7f76280598b0 2026-02-24T19:24:28.849 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.840+0000 7f761f7fe640 10 monclient: _finish_auth 0 2026-02-24T19:24:28.849 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.840+0000 7f761f7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:24:28.849 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.840+0000 7f761f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:28.849 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.840+0000 7f761f7fe640 1 -- 10.20.193.26:0/412129532 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7624003170 con 0x7f76280598b0 2026-02-24T19:24:28.850 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.840+0000 7f761f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:28.850 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.840+0000 7f761f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:28.850 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.840+0000 7f761f7fe640 10 monclient: dump: 2026-02-24T19:24:28.850 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.850 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.850 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.850 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.850 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.850 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.850 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.850 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.850 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.851 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.851 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.840+0000 7f762d946640 5 monclient: authenticate success, global_id 30023 2026-02-24T19:24:28.851 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.840+0000 7f762d946640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:28.851 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.840+0000 7f761f7fe640 1 -- 10.20.193.26:0/412129532 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7624003340 con 0x7f76280598b0 2026-02-24T19:24:28.851 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.840+0000 7f761f7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:28.851 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.840+0000 7f761f7fe640 1 -- 10.20.193.26:0/412129532 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7624003780 con 0x7f76280598b0 2026-02-24T19:24:28.851 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.840+0000 7f762d946640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:28.851 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.840+0000 7f761f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:28.851 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.840+0000 7f762d946640 4 set_mon_vals no callback set 2026-02-24T19:24:28.851 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.840+0000 7f761f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:28.851 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.840+0000 7f761f7fe640 10 monclient: dump: 2026-02-24T19:24:28.851 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.851 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.852 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.852 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.852 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.852 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.852 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.852 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.852 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.852 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.852 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.841+0000 7f762d946640 10 monclient: shutdown 2026-02-24T19:24:28.852 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.841+0000 7f762d946640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:28.852 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.841+0000 7f762d946640 1 -- 10.20.193.26:0/412129532 >> v1:10.20.193.103:6789/0 conn(0x7f76280598b0 legacy=0x7f7628157260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.852 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.841+0000 7f762d946640 1 -- 10.20.193.26:0/412129532 shutdown_connections 2026-02-24T19:24:28.852 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.841+0000 7f762d946640 1 -- 10.20.193.26:0/412129532 >> 10.20.193.26:0/412129532 conn(0x7f76280b6460 msgr2=0x7f76280b6830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:28.853 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.841+0000 7f762d946640 1 -- 10.20.193.26:0/412129532 shutdown_connections 2026-02-24T19:24:28.853 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.841+0000 7f762d946640 1 -- 10.20.193.26:0/412129532 wait complete. 2026-02-24T19:24:28.853 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.841+0000 7f762d946640 10 monclient: build_initial_monmap 2026-02-24T19:24:28.853 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.841+0000 7f762d946640 10 monclient: monmap: 2026-02-24T19:24:28.853 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:28.853 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:28.853 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:28.853 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:28.853 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:28.853 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:28.853 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:28.853 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:28.853 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:28.854 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.854 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.841+0000 7f762d946640 1 librados: starting msgr at 2026-02-24T19:24:28.854 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.841+0000 7f762d946640 1 librados: starting objecter 2026-02-24T19:24:28.854 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.841+0000 7f762d946640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:28.854 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.841+0000 7f762d946640 1 Processor -- start 2026-02-24T19:24:28.854 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.842+0000 7f762d946640 1 -- start start 2026-02-24T19:24:28.854 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.842+0000 7f762d946640 1 librados: setting wanted keys 2026-02-24T19:24:28.854 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.842+0000 7f762d946640 1 librados: calling monclient init 2026-02-24T19:24:28.854 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.842+0000 7f762d946640 10 monclient: init 2026-02-24T19:24:28.854 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.842+0000 7f762d946640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:28.854 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.842+0000 7f762d946640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:24:28.854 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.842+0000 7f762d946640 10 monclient(hunting): picked mon.noname-b con 0x7f76280598b0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:28.854 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.842+0000 7f762d946640 10 monclient(hunting): picked mon.noname-a con 0x7f7628164660 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:28.855 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.842+0000 7f762d946640 10 monclient(hunting): picked mon.noname-c con 0x7f7628164a30 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:28.855 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.842+0000 7f762d946640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76281638a0 con 0x7f7628164660 2026-02-24T19:24:28.855 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.842+0000 7f762d946640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7628120f20 con 0x7f76280598b0 2026-02-24T19:24:28.855 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.842+0000 7f762d946640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7628121200 con 0x7f7628164a30 2026-02-24T19:24:28.855 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.842+0000 7f762d946640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:28.855 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.842+0000 7f762d946640 10 monclient(hunting): authenticate will time out at 4051.524374s 2026-02-24T19:24:28.855 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.842+0000 7f761ffff640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f7628164660 0x7f7628163190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59480/0 (socket says 10.20.193.26:59480) 2026-02-24T19:24:28.855 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.842+0000 7f761ffff640 1 -- 10.20.193.26:0/630578741 learned_addr learned my addr 10.20.193.26:0/630578741 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:28.855 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.842+0000 7f761d7fa640 10 client.?.objecter ms_handle_connect 0x7f7628164a30 2026-02-24T19:24:28.855 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.842+0000 7f761d7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:28.855 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.842+0000 7f761d7fa640 10 client.?.objecter ms_handle_connect 0x7f7628164660 2026-02-24T19:24:28.855 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.842+0000 7f761d7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:28.855 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.843+0000 7f761d7fa640 10 client.?.objecter ms_handle_connect 0x7f76280598b0 2026-02-24T19:24:28.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.843+0000 7f761d7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:28.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.843+0000 7f761d7fa640 1 -- 10.20.193.26:0/630578741 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2544410450 0 0) 0x7f7628121200 con 0x7f7628164a30 2026-02-24T19:24:28.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.843+0000 7f761d7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.843+0000 7f761d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.843+0000 7f761d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.843+0000 7f761d7fa640 10 monclient(hunting): my global_id is 30026 2026-02-24T19:24:28.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.843+0000 7f761d7fa640 1 -- 10.20.193.26:0/630578741 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75f8003610 con 0x7f7628164a30 2026-02-24T19:24:28.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.843+0000 7f761d7fa640 1 -- 10.20.193.26:0/630578741 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3493647234 0 0) 0x7f76281638a0 con 0x7f7628164660 2026-02-24T19:24:28.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.843+0000 7f761d7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.843+0000 7f761d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.843+0000 7f761d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.856 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.843+0000 7f761d7fa640 10 monclient(hunting): my global_id is 30687 2026-02-24T19:24:28.857 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.843+0000 7f761d7fa640 1 -- 10.20.193.26:0/630578741 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7628121200 con 0x7f7628164660 2026-02-24T19:24:28.857 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.844+0000 7f761d7fa640 1 -- 10.20.193.26:0/630578741 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3771699469 0 0) 0x7f7628120f20 con 0x7f76280598b0 2026-02-24T19:24:28.857 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.844+0000 7f761d7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.857 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.844+0000 7f761d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.857 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.844+0000 7f761d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.857 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.844+0000 7f761d7fa640 10 monclient(hunting): my global_id is 28102 2026-02-24T19:24:28.857 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.844+0000 7f761d7fa640 1 -- 10.20.193.26:0/630578741 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76281638a0 con 0x7f76280598b0 2026-02-24T19:24:28.857 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.846+0000 7f761d7fa640 1 -- 10.20.193.26:0/630578741 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 919886025 0 0) 0x7f75f8003610 con 0x7f7628164a30 2026-02-24T19:24:28.857 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.846+0000 7f761d7fa640 1 -- 10.20.193.26:0/630578741 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7628120f20 con 0x7f7628164a30 2026-02-24T19:24:28.857 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.846+0000 7f761d7fa640 1 -- 10.20.193.26:0/630578741 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f76240034f0 con 0x7f7628164a30 2026-02-24T19:24:28.857 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.846+0000 7f761d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:28.857 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.846+0000 7f761d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:28.857 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.846+0000 7f761d7fa640 10 monclient(hunting): dump: 2026-02-24T19:24:28.857 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.858 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.858 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.858 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.858 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.858 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.858 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.858 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.858 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.858 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.858 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.846+0000 7f761d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:28.858 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.846+0000 7f761d7fa640 1 -- 10.20.193.26:0/630578741 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 975544363 0 0) 0x7f7628121200 con 0x7f7628164660 2026-02-24T19:24:28.858 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.846+0000 7f761d7fa640 1 -- 10.20.193.26:0/630578741 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f75f8003610 con 0x7f7628164660 2026-02-24T19:24:28.859 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.846+0000 7f761d7fa640 1 -- 10.20.193.26:0/630578741 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f76100030f0 con 0x7f7628164660 2026-02-24T19:24:28.859 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.846+0000 7f761d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:28.859 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.846+0000 7f761d7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:28.859 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.846+0000 7f761d7fa640 10 monclient(hunting): dump: 2026-02-24T19:24:28.859 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.859 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.859 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.859 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.859 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.859 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.859 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.859 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.859 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.859 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.860 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.846+0000 7f761d7fa640 1 -- 10.20.193.26:0/630578741 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3991939075 0 0) 0x7f76281638a0 con 0x7f76280598b0 2026-02-24T19:24:28.860 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.846+0000 7f761d7fa640 1 -- 10.20.193.26:0/630578741 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7628121200 con 0x7f76280598b0 2026-02-24T19:24:28.860 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.846+0000 7f761d7fa640 1 -- 10.20.193.26:0/630578741 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7618003060 con 0x7f76280598b0 2026-02-24T19:24:28.860 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.846+0000 7f761d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:28.860 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.846+0000 7f761d7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:28.860 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.846+0000 7f761d7fa640 10 monclient(hunting): dump: 2026-02-24T19:24:28.860 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.860 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.860 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.860 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.860 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.860 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.860 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.861 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.861 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.861 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.863 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.847+0000 7f761d7fa640 1 -- 10.20.193.26:0/630578741 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1866564997 0 0) 0x7f7628120f20 con 0x7f7628164a30 2026-02-24T19:24:28.864 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.847+0000 7f761d7fa640 1 -- 10.20.193.26:0/630578741 >> v1:10.20.193.70:6789/0 conn(0x7f76280598b0 legacy=0x7f762815e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.864 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.847+0000 7f761d7fa640 1 -- 10.20.193.26:0/630578741 >> v1:10.20.193.26:6789/0 conn(0x7f7628164660 legacy=0x7f7628163190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.864 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.847+0000 7f761d7fa640 10 monclient: _finish_hunting 0 2026-02-24T19:24:28.864 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.847+0000 7f761d7fa640 1 monclient: found mon.c 2026-02-24T19:24:28.864 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.847+0000 7f761d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:28.864 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.847+0000 7f761d7fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:28.864 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.847+0000 7f761d7fa640 1 -- 10.20.193.26:0/630578741 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76281214e0 con 0x7f7628164a30 2026-02-24T19:24:28.864 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.847+0000 7f761d7fa640 10 monclient: _finish_auth 0 2026-02-24T19:24:28.864 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.847+0000 7f761d7fa640 10 monclient: _check_auth_tickets 2026-02-24T19:24:28.864 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.847+0000 7f761d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:28.864 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.847+0000 7f762d946640 5 monclient: authenticate success, global_id 30026 2026-02-24T19:24:28.865 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.847+0000 7f762d946640 10 monclient: _renew_subs 2026-02-24T19:24:28.865 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.847+0000 7f762d946640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:28.865 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.847+0000 7f762d946640 1 -- 10.20.193.26:0/630578741 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f76281217c0 con 0x7f7628164a30 2026-02-24T19:24:28.865 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.847+0000 7f762d946640 10 client.30026.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:28.865 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.847+0000 7f762d946640 10 monclient: _renew_subs 2026-02-24T19:24:28.865 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.847+0000 7f762d946640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:28.865 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.847+0000 7f762d946640 1 -- 10.20.193.26:0/630578741 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f762811e320 con 0x7f7628164a30 2026-02-24T19:24:28.865 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.847+0000 7f762d946640 1 librados: init done 2026-02-24T19:24:28.865 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.848+0000 7f762d946640 10 client.30026.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:28.865 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.848+0000 7f762d946640 15 client.30026.objecter _session_command_op_assign -1 1 2026-02-24T19:24:28.865 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.848+0000 7f762d946640 20 client.30026.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:28.865 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.848+0000 7f762d946640 10 client.30026.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:28.865 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.848+0000 7f762d946640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:28.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.848+0000 7f762d946640 1 -- 10.20.193.26:0/630578741 --> v1:10.20.193.103:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f762811e5b0 con 0x7f7628164a30 2026-02-24T19:24:28.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.856+0000 7f761d7fa640 1 -- 10.20.193.26:0/630578741 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f762811e5b0 con 0x7f7628164a30 2026-02-24T19:24:28.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.856+0000 7f761d7fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:28.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.856+0000 7f761d7fa640 1 -- 10.20.193.26:0/630578741 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7624003690 con 0x7f7628164a30 2026-02-24T19:24:28.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.856+0000 7f761d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:28.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.856+0000 7f761d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:28.866 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.856+0000 7f761d7fa640 10 monclient: dump: 2026-02-24T19:24:28.866 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.866 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.866 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.866 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.866 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.866 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.867 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.867 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.867 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.867 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.867 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.856+0000 7f761effd640 4 set_mon_vals no callback set 2026-02-24T19:24:28.867 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.857+0000 7f761d7fa640 1 -- 10.20.193.26:0/630578741 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f762401dbd0 con 0x7f7628164a30 2026-02-24T19:24:28.867 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.857+0000 7f762c944640 10 monclient: get_auth_request con 0x7f75f8077dd0 auth_method 0 2026-02-24T19:24:28.867 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.857+0000 7f761d7fa640 1 -- 10.20.193.26:0/630578741 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7f7624093390 con 0x7f7628164a30 2026-02-24T19:24:28.867 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.857+0000 7f761d7fa640 10 client.30026.objecter ms_dispatch2 0x7f7628000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:28.867 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.857+0000 7f761d7fa640 3 client.30026.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:28.867 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.857+0000 7f761d7fa640 3 client.30026.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:28.867 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.857+0000 7f761d7fa640 10 client.30026.objecter checking command 1 2026-02-24T19:24:28.868 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.857+0000 7f761d7fa640 20 client.30026.objecter _get_session s=0x7f75f80a2130 osd=5 3 2026-02-24T19:24:28.868 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.857+0000 7f761d7fa640 20 client.30026.objecter put_session s=0x7f75f80a2130 osd=5 3 2026-02-24T19:24:28.868 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.857+0000 7f761d7fa640 15 client.30026.objecter _session_command_op_remove -1 1 2026-02-24T19:24:28.868 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.857+0000 7f761d7fa640 20 client.30026.objecter _get_session s=0x7f75f80a2130 osd=5 3 2026-02-24T19:24:28.868 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.857+0000 7f761d7fa640 20 client.30026.objecter get_session s=0x7f75f80a2130 osd=5 3 2026-02-24T19:24:28.868 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.857+0000 7f761d7fa640 15 client.30026.objecter _session_command_op_assign 5 1 2026-02-24T19:24:28.868 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.857+0000 7f761d7fa640 20 client.30026.objecter put_session s=0x7f75f80a2130 osd=5 4 2026-02-24T19:24:28.868 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.857+0000 7f761d7fa640 10 client.30026.objecter _send_command 1 2026-02-24T19:24:28.868 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.857+0000 7f761d7fa640 1 -- 10.20.193.26:0/630578741 --> v1:10.20.193.70:6812/1419227842 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7624003340 con 0x7f75f80a27e0 2026-02-24T19:24:28.868 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.857+0000 7f761d7fa640 20 client.30026.objecter dump_active .. 0 homeless 2026-02-24T19:24:28.868 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.857+0000 7f761d7fa640 10 client.30026.objecter ms_handle_connect 0x7f75f8077dd0 2026-02-24T19:24:28.868 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.858+0000 7f761d7fa640 1 -- 10.20.193.26:0/630578741 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_get_version_reply(handle=1 version=346) ==== 24+0+0 (unknown 2991753921 0 0) 0x7f7624059a30 con 0x7f7628164a30 2026-02-24T19:24:28.868 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.858+0000 7f761d7fa640 10 monclient: handle_get_version_reply finishing 1 version 346 2026-02-24T19:24:28.868 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.858+0000 7f761ffff640 10 monclient: get_auth_request con 0x7f75f80a27e0 auth_method 0 2026-02-24T19:24:28.869 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.859+0000 7f761d7fa640 10 client.30026.objecter ms_handle_connect 0x7f75f80a27e0 2026-02-24T19:24:28.870 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.869+0000 7f761d7fa640 1 -- 10.20.193.26:0/630578741 <== osd.5 v1:10.20.193.70:6812/1419227842 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f7624003340 con 0x7f75f80a27e0 2026-02-24T19:24:28.870 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.869+0000 7f761d7fa640 10 client.30026.objecter ms_dispatch2 0x7f7628000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:28.870 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.869+0000 7f761d7fa640 10 client.30026.objecter _finish_command 1 = system:0 2026-02-24T19:24:28.871 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.869+0000 7f761d7fa640 20 client.30026.objecter put_session s=0x7f75f80a2130 osd=5 4 2026-02-24T19:24:28.871 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.869+0000 7f761d7fa640 15 client.30026.objecter _session_command_op_remove 5 1 2026-02-24T19:24:28.878 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.876+0000 7f762d946640 10 client.30026.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:28.878 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.876+0000 7f762d946640 15 client.30026.objecter _session_command_op_assign -1 2 2026-02-24T19:24:28.878 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.876+0000 7f762d946640 20 client.30026.objecter _get_session s=0x7f75f80a2130 osd=5 3 2026-02-24T19:24:28.878 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.876+0000 7f762d946640 20 client.30026.objecter put_session s=0x7f75f80a2130 osd=5 3 2026-02-24T19:24:28.878 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.876+0000 7f762d946640 20 client.30026.objecter _get_session s=0x7f75f80a2130 osd=5 3 2026-02-24T19:24:28.878 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.876+0000 7f762d946640 15 client.30026.objecter _session_command_op_remove -1 2 2026-02-24T19:24:28.878 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.876+0000 7f762d946640 20 client.30026.objecter get_session s=0x7f75f80a2130 osd=5 3 2026-02-24T19:24:28.878 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.876+0000 7f762d946640 15 client.30026.objecter _session_command_op_assign 5 2 2026-02-24T19:24:28.878 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.876+0000 7f762d946640 20 client.30026.objecter put_session s=0x7f75f80a2130 osd=5 4 2026-02-24T19:24:28.878 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.876+0000 7f762d946640 10 client.30026.objecter _send_command 2 2026-02-24T19:24:28.878 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.876+0000 7f762d946640 1 -- 10.20.193.26:0/630578741 --> v1:10.20.193.70:6812/1419227842 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f762815dcc0 con 0x7f75f80a27e0 2026-02-24T19:24:28.885 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.883+0000 7f761d7fa640 1 -- 10.20.193.26:0/630578741 <== osd.5 v1:10.20.193.70:6812/1419227842 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f762815dcc0 con 0x7f75f80a27e0 2026-02-24T19:24:28.885 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.883+0000 7f761d7fa640 10 client.30026.objecter ms_dispatch2 0x7f7628000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:28.885 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.883+0000 7f761d7fa640 10 client.30026.objecter _finish_command 2 = system:0 2026-02-24T19:24:28.885 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.883+0000 7f761d7fa640 20 client.30026.objecter put_session s=0x7f75f80a2130 osd=5 4 2026-02-24T19:24:28.885 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.883+0000 7f761d7fa640 15 client.30026.objecter _session_command_op_remove 5 2 2026-02-24T19:24:28.886 INFO:teuthology.orchestra.run.trial026.stdout:{ 2026-02-24T19:24:28.886 INFO:teuthology.orchestra.run.trial026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:28.886 INFO:teuthology.orchestra.run.trial026.stdout:} 2026-02-24T19:24:28.887 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.883+0000 7f762d946640 10 librados: watch_flush enter 2026-02-24T19:24:28.887 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.883+0000 7f762d946640 10 librados: watch_flush exit 2026-02-24T19:24:28.887 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.883+0000 7f762d946640 10 client.30026.objecter close_session for osd.5 2026-02-24T19:24:28.887 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.883+0000 7f762d946640 1 -- 10.20.193.26:0/630578741 >> v1:10.20.193.70:6812/1419227842 conn(0x7f75f80a27e0 legacy=0x7f75f80c2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.887 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.883+0000 7f762d946640 20 client.30026.objecter put_session s=0x7f75f80a2130 osd=5 1 2026-02-24T19:24:28.888 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.883+0000 7f762d946640 20 client.30026.objecter shutdown clearing up homeless session... 2026-02-24T19:24:28.888 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.883+0000 7f762d946640 10 client.30026.objecter successfully canceled tick 2026-02-24T19:24:28.888 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.883+0000 7f762d946640 1 -- 10.20.193.26:0/630578741 >> v1:10.20.193.162:6800/3889602630 conn(0x7f75f8077dd0 legacy=0x7f75f8098280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.888 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.884+0000 7f762d946640 10 monclient: shutdown 2026-02-24T19:24:28.888 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.884+0000 7f762d946640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:28.888 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.884+0000 7f762d946640 1 -- 10.20.193.26:0/630578741 >> v1:10.20.193.103:6789/0 conn(0x7f7628164a30 legacy=0x7f762811dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.888 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.884+0000 7f762d145640 1 -- 10.20.193.26:0/630578741 reap_dead start 2026-02-24T19:24:28.888 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.884+0000 7f762d946640 1 -- 10.20.193.26:0/630578741 shutdown_connections 2026-02-24T19:24:28.888 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.884+0000 7f762d946640 1 -- 10.20.193.26:0/630578741 >> 10.20.193.26:0/630578741 conn(0x7f76280b6460 msgr2=0x7f76280b6830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:28.888 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.884+0000 7f762d946640 1 -- 10.20.193.26:0/630578741 shutdown_connections 2026-02-24T19:24:28.888 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.884+0000 7f762d946640 1 -- 10.20.193.26:0/630578741 wait complete. 2026-02-24T19:24:28.888 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.884+0000 7f762d946640 1 librados: shutdown 2026-02-24T19:24:28.893 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-24T19:24:28.961 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.960+0000 7fde4847b640 10 monclient: get_monmap_and_config 2026-02-24T19:24:28.962 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.960+0000 7fde4847b640 10 monclient: build_initial_monmap 2026-02-24T19:24:28.962 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.960+0000 7fde4847b640 10 monclient: monmap: 2026-02-24T19:24:28.962 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:28.962 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.962 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:28.960881+0000 2026-02-24T19:24:28.962 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:28.960881+0000 2026-02-24T19:24:28.962 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:28.962 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.962 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:28.962 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:28.962 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:28.962 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.965 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.960+0000 7fde4847b640 1 Processor -- start 2026-02-24T19:24:28.965 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.960+0000 7fde4847b640 1 -- start start 2026-02-24T19:24:28.965 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.960+0000 7fde4847b640 10 monclient: init 2026-02-24T19:24:28.965 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.961+0000 7fde4847b640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:28.965 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.961+0000 7fde4847b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:24:28.965 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.961+0000 7fde4847b640 10 monclient(hunting): picked mon.noname-c con 0x7fde401566e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:28.965 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.961+0000 7fde4847b640 10 monclient(hunting): picked mon.noname-a con 0x7fde40160c00 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:28.965 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.961+0000 7fde4847b640 10 monclient(hunting): picked mon.noname-b con 0x7fde40156ab0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:28.965 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.961+0000 7fde4847b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde40058480 con 0x7fde40160c00 2026-02-24T19:24:28.965 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.961+0000 7fde4847b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde40058760 con 0x7fde40156ab0 2026-02-24T19:24:28.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.961+0000 7fde4847b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde400b0f90 con 0x7fde401566e0 2026-02-24T19:24:28.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.961+0000 7fde4847b640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:28.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.961+0000 7fde4847b640 10 monclient(hunting): authenticate will time out at 4051.643448s 2026-02-24T19:24:28.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.961+0000 7fde461f0640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fde401566e0 0x7fde400b4370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58426/0 (socket says 10.20.193.26:58426) 2026-02-24T19:24:28.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.961+0000 7fde461f0640 1 -- 10.20.193.26:0/2030790685 learned_addr learned my addr 10.20.193.26:0/2030790685 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:28.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.961+0000 7fde459ef640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fde40160c00 0x7fde40057920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59494/0 (socket says 10.20.193.26:59494) 2026-02-24T19:24:28.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.963+0000 7fde451ee640 1 -- 10.20.193.26:0/2030790685 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4070392106 0 0) 0x7fde40058760 con 0x7fde40156ab0 2026-02-24T19:24:28.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.963+0000 7fde451ee640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.963+0000 7fde451ee640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.963+0000 7fde451ee640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.963+0000 7fde451ee640 10 monclient(hunting): my global_id is 28105 2026-02-24T19:24:28.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.963+0000 7fde451ee640 1 -- 10.20.193.26:0/2030790685 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde28003610 con 0x7fde40156ab0 2026-02-24T19:24:28.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.963+0000 7fde451ee640 1 -- 10.20.193.26:0/2030790685 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2293543899 0 0) 0x7fde400b0f90 con 0x7fde401566e0 2026-02-24T19:24:28.967 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.963+0000 7fde451ee640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.967 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.963+0000 7fde451ee640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.967 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.963+0000 7fde451ee640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.967 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.963+0000 7fde451ee640 10 monclient(hunting): my global_id is 30029 2026-02-24T19:24:28.967 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.963+0000 7fde451ee640 1 -- 10.20.193.26:0/2030790685 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde40058760 con 0x7fde401566e0 2026-02-24T19:24:28.967 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.963+0000 7fde451ee640 1 -- 10.20.193.26:0/2030790685 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 513420030 0 0) 0x7fde40058480 con 0x7fde40160c00 2026-02-24T19:24:28.967 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.963+0000 7fde451ee640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.967 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.963+0000 7fde451ee640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.967 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.963+0000 7fde451ee640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.967 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.963+0000 7fde451ee640 10 monclient(hunting): my global_id is 30690 2026-02-24T19:24:28.967 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.963+0000 7fde451ee640 1 -- 10.20.193.26:0/2030790685 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde400b0f90 con 0x7fde40160c00 2026-02-24T19:24:28.974 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.964+0000 7fde451ee640 1 -- 10.20.193.26:0/2030790685 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3535499129 0 0) 0x7fde40058760 con 0x7fde401566e0 2026-02-24T19:24:28.974 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.964+0000 7fde451ee640 1 -- 10.20.193.26:0/2030790685 >> v1:10.20.193.70:6789/0 conn(0x7fde40156ab0 legacy=0x7fde40055980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.974 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.964+0000 7fde451ee640 1 -- 10.20.193.26:0/2030790685 >> v1:10.20.193.26:6789/0 conn(0x7fde40160c00 legacy=0x7fde40057920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.974 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.964+0000 7fde451ee640 10 monclient: _finish_hunting 0 2026-02-24T19:24:28.974 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.964+0000 7fde451ee640 1 monclient: found mon.noname-c 2026-02-24T19:24:28.975 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.964+0000 7fde451ee640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:28.975 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.964+0000 7fde451ee640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:24:28.975 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.964+0000 7fde451ee640 1 -- 10.20.193.26:0/2030790685 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde400b1270 con 0x7fde401566e0 2026-02-24T19:24:28.975 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.964+0000 7fde451ee640 10 monclient: _finish_auth 0 2026-02-24T19:24:28.975 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.964+0000 7fde451ee640 10 monclient: _check_auth_tickets 2026-02-24T19:24:28.975 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.964+0000 7fde451ee640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:28.975 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.964+0000 7fde451ee640 1 -- 10.20.193.26:0/2030790685 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fde30002df0 con 0x7fde401566e0 2026-02-24T19:24:28.975 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.964+0000 7fde4847b640 5 monclient: authenticate success, global_id 30029 2026-02-24T19:24:28.975 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.964+0000 7fde4847b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:28.975 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.964+0000 7fde451ee640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:28.975 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.964+0000 7fde451ee640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:28.975 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.964+0000 7fde451ee640 10 monclient: dump: 2026-02-24T19:24:28.975 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.976 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.976 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.976 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.976 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.976 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.976 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.976 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.976 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.976 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.976 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.964+0000 7fde4847b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:28.976 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.965+0000 7fde451ee640 1 -- 10.20.193.26:0/2030790685 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fde30002fc0 con 0x7fde401566e0 2026-02-24T19:24:28.976 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.965+0000 7fde451ee640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:28.977 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.965+0000 7fde451ee640 1 -- 10.20.193.26:0/2030790685 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fde30003400 con 0x7fde401566e0 2026-02-24T19:24:28.977 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.965+0000 7fde451ee640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:28.977 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.965+0000 7fde451ee640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:28.977 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.965+0000 7fde451ee640 10 monclient: dump: 2026-02-24T19:24:28.977 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.977 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.977 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.977 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.977 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.977 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.977 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.977 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.977 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.978 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.965+0000 7fde4847b640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:28.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.965+0000 7fde4847b640 4 set_mon_vals no callback set 2026-02-24T19:24:28.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.965+0000 7fde4847b640 10 monclient: shutdown 2026-02-24T19:24:28.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.965+0000 7fde4847b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:28.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.965+0000 7fde4847b640 1 -- 10.20.193.26:0/2030790685 >> v1:10.20.193.103:6789/0 conn(0x7fde401566e0 legacy=0x7fde400b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.965+0000 7fde4847b640 1 -- 10.20.193.26:0/2030790685 shutdown_connections 2026-02-24T19:24:28.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.965+0000 7fde4847b640 1 -- 10.20.193.26:0/2030790685 >> 10.20.193.26:0/2030790685 conn(0x7fde400b2ef0 msgr2=0x7fde400b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:28.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.965+0000 7fde4847b640 1 -- 10.20.193.26:0/2030790685 shutdown_connections 2026-02-24T19:24:28.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.965+0000 7fde4847b640 1 -- 10.20.193.26:0/2030790685 wait complete. 2026-02-24T19:24:28.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.966+0000 7fde4847b640 10 monclient: build_initial_monmap 2026-02-24T19:24:28.978 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.966+0000 7fde4847b640 10 monclient: monmap: 2026-02-24T19:24:28.978 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:28.979 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:28.979 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:28.979 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:28.979 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:28.979 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:28.979 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:28.979 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:28.979 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:28.979 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.979 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.966+0000 7fde4847b640 1 librados: starting msgr at 2026-02-24T19:24:28.979 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.966+0000 7fde4847b640 1 librados: starting objecter 2026-02-24T19:24:28.979 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.966+0000 7fde4847b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:28.979 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.966+0000 7fde4847b640 1 Processor -- start 2026-02-24T19:24:28.980 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.966+0000 7fde4847b640 1 -- start start 2026-02-24T19:24:28.980 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.966+0000 7fde4847b640 1 librados: setting wanted keys 2026-02-24T19:24:28.980 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.966+0000 7fde4847b640 1 librados: calling monclient init 2026-02-24T19:24:28.980 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.966+0000 7fde4847b640 10 monclient: init 2026-02-24T19:24:28.980 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.966+0000 7fde4847b640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:28.980 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.966+0000 7fde4847b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:24:28.980 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.966+0000 7fde4847b640 10 monclient(hunting): picked mon.noname-c con 0x7fde401566e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:28.980 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.966+0000 7fde4847b640 10 monclient(hunting): picked mon.noname-a con 0x7fde40156ab0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:28.980 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.966+0000 7fde4847b640 10 monclient(hunting): picked mon.noname-b con 0x7fde40160c00 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:28.980 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.966+0000 7fde4847b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde4012dbe0 con 0x7fde40156ab0 2026-02-24T19:24:28.980 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.966+0000 7fde4847b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde400a4cd0 con 0x7fde40160c00 2026-02-24T19:24:28.980 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.966+0000 7fde4847b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde400a7d40 con 0x7fde401566e0 2026-02-24T19:24:28.980 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.966+0000 7fde4847b640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:28.980 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.966+0000 7fde4847b640 10 monclient(hunting): authenticate will time out at 4051.648933s 2026-02-24T19:24:28.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.967+0000 7fde461f0640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fde401566e0 0x7fde400a90c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58432/0 (socket says 10.20.193.26:58432) 2026-02-24T19:24:28.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.967+0000 7fde461f0640 1 -- 10.20.193.26:0/3400070635 learned_addr learned my addr 10.20.193.26:0/3400070635 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:28.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.967+0000 7fde26ffd640 10 client.?.objecter ms_handle_connect 0x7fde401566e0 2026-02-24T19:24:28.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.967+0000 7fde26ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:28.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.967+0000 7fde26ffd640 10 client.?.objecter ms_handle_connect 0x7fde40156ab0 2026-02-24T19:24:28.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.967+0000 7fde26ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:28.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.967+0000 7fde26ffd640 10 client.?.objecter ms_handle_connect 0x7fde40160c00 2026-02-24T19:24:28.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.967+0000 7fde26ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:28.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.968+0000 7fde26ffd640 1 -- 10.20.193.26:0/3400070635 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 739487911 0 0) 0x7fde400a7d40 con 0x7fde401566e0 2026-02-24T19:24:28.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.968+0000 7fde26ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.968+0000 7fde26ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.968+0000 7fde26ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.968+0000 7fde26ffd640 10 monclient(hunting): my global_id is 30032 2026-02-24T19:24:28.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.968+0000 7fde26ffd640 1 -- 10.20.193.26:0/3400070635 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde10003610 con 0x7fde401566e0 2026-02-24T19:24:28.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.968+0000 7fde26ffd640 1 -- 10.20.193.26:0/3400070635 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2745380071 0 0) 0x7fde4012dbe0 con 0x7fde40156ab0 2026-02-24T19:24:28.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.968+0000 7fde26ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.968+0000 7fde26ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.968+0000 7fde26ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.968+0000 7fde26ffd640 10 monclient(hunting): my global_id is 30693 2026-02-24T19:24:28.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.968+0000 7fde26ffd640 1 -- 10.20.193.26:0/3400070635 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde400a7d40 con 0x7fde40156ab0 2026-02-24T19:24:28.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.968+0000 7fde26ffd640 1 -- 10.20.193.26:0/3400070635 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2552728995 0 0) 0x7fde400a4cd0 con 0x7fde40160c00 2026-02-24T19:24:28.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.968+0000 7fde26ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:28.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.968+0000 7fde26ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:28.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.968+0000 7fde26ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:28.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.968+0000 7fde26ffd640 10 monclient(hunting): my global_id is 28108 2026-02-24T19:24:28.983 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.968+0000 7fde26ffd640 1 -- 10.20.193.26:0/3400070635 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde4012dbe0 con 0x7fde40160c00 2026-02-24T19:24:28.983 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.970+0000 7fde26ffd640 1 -- 10.20.193.26:0/3400070635 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4183083028 0 0) 0x7fde10003610 con 0x7fde401566e0 2026-02-24T19:24:28.983 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.970+0000 7fde26ffd640 1 -- 10.20.193.26:0/3400070635 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fde400a4cd0 con 0x7fde401566e0 2026-02-24T19:24:28.983 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.970+0000 7fde26ffd640 1 -- 10.20.193.26:0/3400070635 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fde30003310 con 0x7fde401566e0 2026-02-24T19:24:28.983 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.970+0000 7fde26ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:28.983 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.970+0000 7fde26ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:28.983 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.970+0000 7fde26ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:28.983 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.983 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.983 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.983 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.983 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.983 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.983 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.984 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.984 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.984 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.984 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.970+0000 7fde26ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:28.984 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.970+0000 7fde26ffd640 1 -- 10.20.193.26:0/3400070635 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3858900175 0 0) 0x7fde4012dbe0 con 0x7fde40160c00 2026-02-24T19:24:28.984 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.970+0000 7fde26ffd640 1 -- 10.20.193.26:0/3400070635 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fde10003610 con 0x7fde40160c00 2026-02-24T19:24:28.984 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.970+0000 7fde26ffd640 1 -- 10.20.193.26:0/3400070635 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fde3c003430 con 0x7fde40160c00 2026-02-24T19:24:28.984 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.970+0000 7fde26ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:28.984 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.970+0000 7fde26ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:28.984 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.970+0000 7fde26ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:28.984 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.984 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.984 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.985 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.985 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.985 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.985 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.985 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.985 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.985 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.985 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.970+0000 7fde26ffd640 1 -- 10.20.193.26:0/3400070635 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1417357058 0 0) 0x7fde400a7d40 con 0x7fde40156ab0 2026-02-24T19:24:28.985 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.970+0000 7fde26ffd640 1 -- 10.20.193.26:0/3400070635 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fde4012dbe0 con 0x7fde40156ab0 2026-02-24T19:24:28.985 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.970+0000 7fde26ffd640 1 -- 10.20.193.26:0/3400070635 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fde34002fb0 con 0x7fde40156ab0 2026-02-24T19:24:28.985 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.970+0000 7fde26ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:28.985 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.970+0000 7fde26ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:28.986 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.970+0000 7fde26ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:28.986 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.986 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.986 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.986 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.986 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.986 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.986 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.986 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.986 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.986 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.986 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.972+0000 7fde26ffd640 1 -- 10.20.193.26:0/3400070635 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1127990630 0 0) 0x7fde400a4cd0 con 0x7fde401566e0 2026-02-24T19:24:28.986 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.972+0000 7fde26ffd640 1 -- 10.20.193.26:0/3400070635 >> v1:10.20.193.70:6789/0 conn(0x7fde40160c00 legacy=0x7fde400a40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.987 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.972+0000 7fde26ffd640 1 -- 10.20.193.26:0/3400070635 >> v1:10.20.193.26:6789/0 conn(0x7fde40156ab0 legacy=0x7fde4012d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:28.987 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.972+0000 7fde26ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:28.987 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.972+0000 7fde26ffd640 1 monclient: found mon.c 2026-02-24T19:24:28.987 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.972+0000 7fde26ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:28.987 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.972+0000 7fde26ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:28.987 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.972+0000 7fde26ffd640 1 -- 10.20.193.26:0/3400070635 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde400a8020 con 0x7fde401566e0 2026-02-24T19:24:28.987 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.972+0000 7fde26ffd640 10 monclient: _finish_auth 0 2026-02-24T19:24:28.987 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.972+0000 7fde26ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:28.987 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.972+0000 7fde26ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:28.987 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.972+0000 7fde4847b640 5 monclient: authenticate success, global_id 30032 2026-02-24T19:24:28.987 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.972+0000 7fde4847b640 10 monclient: _renew_subs 2026-02-24T19:24:28.987 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.972+0000 7fde4847b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:28.987 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.972+0000 7fde4847b640 1 -- 10.20.193.26:0/3400070635 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fde400a8300 con 0x7fde401566e0 2026-02-24T19:24:28.987 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.972+0000 7fde4847b640 10 client.30032.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:28.988 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.972+0000 7fde4847b640 10 monclient: _renew_subs 2026-02-24T19:24:28.988 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.972+0000 7fde4847b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:28.988 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.972+0000 7fde4847b640 1 -- 10.20.193.26:0/3400070635 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fde400a88c0 con 0x7fde401566e0 2026-02-24T19:24:28.988 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.972+0000 7fde4847b640 1 librados: init done 2026-02-24T19:24:28.988 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.972+0000 7fde4847b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:28.988 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.972+0000 7fde4847b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:28.988 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.972+0000 7fde4847b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:28.988 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.972+0000 7fde4847b640 1 -- 10.20.193.26:0/3400070635 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde4015a520 con 0x7fde401566e0 2026-02-24T19:24:28.989 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.979+0000 7fde26ffd640 1 -- 10.20.193.26:0/3400070635 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fde30002f70 con 0x7fde401566e0 2026-02-24T19:24:28.989 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.979+0000 7fde26ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:28.990 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.979+0000 7fde26ffd640 1 -- 10.20.193.26:0/3400070635 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fde30004d20 con 0x7fde401566e0 2026-02-24T19:24:28.990 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.979+0000 7fde26ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:28.990 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.979+0000 7fde26ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:28.990 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.979+0000 7fde26ffd640 10 monclient: dump: 2026-02-24T19:24:28.990 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:28.990 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:28.990 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.990 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:28.990 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:28.990 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:28.990 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:28.990 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:28.990 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:28.990 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:28.991 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.979+0000 7fde449ed640 4 set_mon_vals no callback set 2026-02-24T19:24:28.991 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.980+0000 7fde26ffd640 1 -- 10.20.193.26:0/3400070635 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fde30004f00 con 0x7fde401566e0 2026-02-24T19:24:28.991 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.981+0000 7fde459ef640 10 monclient: get_auth_request con 0x7fde10077ec0 auth_method 0 2026-02-24T19:24:28.991 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.981+0000 7fde26ffd640 1 -- 10.20.193.26:0/3400070635 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7fde30093170 con 0x7fde401566e0 2026-02-24T19:24:28.991 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.981+0000 7fde26ffd640 10 client.30032.objecter ms_dispatch2 0x7fde40000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:28.991 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.981+0000 7fde26ffd640 3 client.30032.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:28.991 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.981+0000 7fde26ffd640 3 client.30032.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:28.991 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.981+0000 7fde26ffd640 20 client.30032.objecter dump_active .. 0 homeless 2026-02-24T19:24:28.991 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:28.981+0000 7fde26ffd640 10 client.30032.objecter ms_handle_connect 0x7fde10077ec0 2026-02-24T19:24:29.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.067+0000 7fde26ffd640 1 -- 10.20.193.26:0/3400070635 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fde30004d20 con 0x7fde401566e0 2026-02-24T19:24:29.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.067+0000 7fde26ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:29.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.067+0000 7fde26ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:29.175 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.174+0000 7fde4847b640 1 -- 10.20.193.26:0/3400070635 --> v1:10.20.193.162:6800/3889602630 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fde4005e280 con 0x7fde10077ec0 2026-02-24T19:24:29.176 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.174+0000 7fde26ffd640 1 -- 10.20.193.26:0/3400070635 <== mgr.4107 v1:10.20.193.162:6800/3889602630 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (unknown 2264484800 0 0) 0x7fde4005e280 con 0x7fde10077ec0 2026-02-24T19:24:29.176 INFO:teuthology.orchestra.run.trial026.stderr:instructed osd(s) 5 to deep-scrub 2026-02-24T19:24:29.178 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.176+0000 7fde4847b640 10 librados: watch_flush enter 2026-02-24T19:24:29.178 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.176+0000 7fde4847b640 10 librados: watch_flush exit 2026-02-24T19:24:29.178 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.176+0000 7fde4847b640 20 client.30032.objecter shutdown clearing up homeless session... 2026-02-24T19:24:29.178 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.176+0000 7fde4847b640 10 client.30032.objecter successfully canceled tick 2026-02-24T19:24:29.178 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.176+0000 7fde4847b640 1 -- 10.20.193.26:0/3400070635 >> v1:10.20.193.162:6800/3889602630 conn(0x7fde10077ec0 legacy=0x7fde10098370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.178 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.176+0000 7fde4847b640 10 monclient: shutdown 2026-02-24T19:24:29.178 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.176+0000 7fde4847b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:29.179 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.176+0000 7fde4847b640 1 -- 10.20.193.26:0/3400070635 >> v1:10.20.193.103:6789/0 conn(0x7fde401566e0 legacy=0x7fde400a90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.179 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.176+0000 7fde4847b640 1 -- 10.20.193.26:0/3400070635 shutdown_connections 2026-02-24T19:24:29.179 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.176+0000 7fde4847b640 1 -- 10.20.193.26:0/3400070635 >> 10.20.193.26:0/3400070635 conn(0x7fde400b2ef0 msgr2=0x7fde400ad7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:29.179 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.176+0000 7fde4847b640 1 -- 10.20.193.26:0/3400070635 shutdown_connections 2026-02-24T19:24:29.179 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.176+0000 7fde4847b640 1 -- 10.20.193.26:0/3400070635 wait complete. 2026-02-24T19:24:29.179 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.176+0000 7fde4847b640 1 librados: shutdown 2026-02-24T19:24:29.186 INFO:tasks.ceph:Scrubbing osd.9 2026-02-24T19:24:29.187 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:29.255 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.253+0000 7f062a074640 10 monclient: get_monmap_and_config 2026-02-24T19:24:29.255 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.253+0000 7f062a074640 10 monclient: build_initial_monmap 2026-02-24T19:24:29.255 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.253+0000 7f062a074640 10 monclient: monmap: 2026-02-24T19:24:29.255 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:29.255 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:29.255 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:29.254388+0000 2026-02-24T19:24:29.255 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:29.254388+0000 2026-02-24T19:24:29.255 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:29.256 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:29.256 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:29.256 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:29.256 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:29.256 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.254+0000 7f062a074640 1 Processor -- start 2026-02-24T19:24:29.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.254+0000 7f062a074640 1 -- start start 2026-02-24T19:24:29.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.254+0000 7f062a074640 10 monclient: init 2026-02-24T19:24:29.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.254+0000 7f062a074640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:29.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.254+0000 7f062a074640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:24:29.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.254+0000 7f062a074640 10 monclient(hunting): picked mon.noname-b con 0x7f0624159e10 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:29.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.254+0000 7f062a074640 10 monclient(hunting): picked mon.noname-a con 0x7f062415a1e0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:29.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.254+0000 7f062a074640 10 monclient(hunting): picked mon.noname-c con 0x7f0624161ac0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:29.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.254+0000 7f062a074640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0624055ab0 con 0x7f062415a1e0 2026-02-24T19:24:29.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.254+0000 7f062a074640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0624055d50 con 0x7f0624159e10 2026-02-24T19:24:29.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.254+0000 7f062a074640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0624056030 con 0x7f0624161ac0 2026-02-24T19:24:29.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.254+0000 7f062a074640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:29.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.254+0000 7f062a074640 10 monclient(hunting): authenticate will time out at 4051.936988s 2026-02-24T19:24:29.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.255+0000 7f0622ffd640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f062415a1e0 0x7f06241613b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59516/0 (socket says 10.20.193.26:59516) 2026-02-24T19:24:29.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.255+0000 7f0622ffd640 1 -- 10.20.193.26:0/1585976675 learned_addr learned my addr 10.20.193.26:0/1585976675 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:29.260 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.255+0000 7f0623fff640 1 --1- 10.20.193.26:0/1585976675 >> v1:10.20.193.103:6789/0 conn(0x7f0624161ac0 0x7f062415fd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58444/0 (socket says 10.20.193.26:58444) 2026-02-24T19:24:29.260 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.256+0000 7f06227fc640 1 -- 10.20.193.26:0/1585976675 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4206322681 0 0) 0x7f0624056030 con 0x7f0624161ac0 2026-02-24T19:24:29.260 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.256+0000 7f06227fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:29.260 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.256+0000 7f06227fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:29.260 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.256+0000 7f06227fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:29.260 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.256+0000 7f06227fc640 10 monclient(hunting): my global_id is 30035 2026-02-24T19:24:29.260 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.256+0000 7f06227fc640 1 -- 10.20.193.26:0/1585976675 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0608003610 con 0x7f0624161ac0 2026-02-24T19:24:29.260 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.256+0000 7f06227fc640 1 -- 10.20.193.26:0/1585976675 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1570855352 0 0) 0x7f0624055ab0 con 0x7f062415a1e0 2026-02-24T19:24:29.260 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.256+0000 7f06227fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:29.260 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.256+0000 7f06227fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:29.260 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.256+0000 7f06227fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:29.260 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.256+0000 7f06227fc640 10 monclient(hunting): my global_id is 30696 2026-02-24T19:24:29.261 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.256+0000 7f06227fc640 1 -- 10.20.193.26:0/1585976675 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0624056030 con 0x7f062415a1e0 2026-02-24T19:24:29.261 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.257+0000 7f06227fc640 1 -- 10.20.193.26:0/1585976675 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 748255564 0 0) 0x7f0624055d50 con 0x7f0624159e10 2026-02-24T19:24:29.261 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.257+0000 7f06227fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:29.261 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.257+0000 7f06227fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:29.261 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.257+0000 7f06227fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:29.261 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.257+0000 7f06227fc640 10 monclient(hunting): my global_id is 28111 2026-02-24T19:24:29.261 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.257+0000 7f06227fc640 1 -- 10.20.193.26:0/1585976675 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0624055ab0 con 0x7f0624159e10 2026-02-24T19:24:29.265 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.258+0000 7f06227fc640 1 -- 10.20.193.26:0/1585976675 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3618827695 0 0) 0x7f0608003610 con 0x7f0624161ac0 2026-02-24T19:24:29.266 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.258+0000 7f06227fc640 1 -- 10.20.193.26:0/1585976675 >> v1:10.20.193.70:6789/0 conn(0x7f0624159e10 legacy=0x7f0624059c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.266 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.258+0000 7f06227fc640 1 -- 10.20.193.26:0/1585976675 >> v1:10.20.193.26:6789/0 conn(0x7f062415a1e0 legacy=0x7f06241613b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.266 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.258+0000 7f06227fc640 10 monclient: _finish_hunting 0 2026-02-24T19:24:29.266 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.258+0000 7f06227fc640 1 monclient: found mon.noname-c 2026-02-24T19:24:29.266 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.258+0000 7f06227fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:29.266 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.258+0000 7f06227fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:24:29.266 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.258+0000 7f06227fc640 1 -- 10.20.193.26:0/1585976675 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0624056310 con 0x7f0624161ac0 2026-02-24T19:24:29.266 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.258+0000 7f06227fc640 10 monclient: _finish_auth 0 2026-02-24T19:24:29.266 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.258+0000 7f06227fc640 10 monclient: _check_auth_tickets 2026-02-24T19:24:29.266 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.258+0000 7f06227fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:29.267 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.258+0000 7f06227fc640 1 -- 10.20.193.26:0/1585976675 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f0618003160 con 0x7f0624161ac0 2026-02-24T19:24:29.267 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.258+0000 7f06227fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:29.267 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.258+0000 7f06227fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:29.267 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.258+0000 7f06227fc640 10 monclient: dump: 2026-02-24T19:24:29.267 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:29.267 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:29.267 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.267 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.267 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:29.267 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:29.267 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:29.267 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:29.267 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:29.268 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.268 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.258+0000 7f062a074640 5 monclient: authenticate success, global_id 30035 2026-02-24T19:24:29.268 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.258+0000 7f062a074640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:29.268 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.259+0000 7f06227fc640 1 -- 10.20.193.26:0/1585976675 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0618003330 con 0x7f0624161ac0 2026-02-24T19:24:29.268 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.259+0000 7f06227fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:29.268 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.259+0000 7f06227fc640 1 -- 10.20.193.26:0/1585976675 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f0618003770 con 0x7f0624161ac0 2026-02-24T19:24:29.268 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.259+0000 7f06227fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:29.268 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.259+0000 7f06227fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:29.268 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.259+0000 7f06227fc640 10 monclient: dump: 2026-02-24T19:24:29.268 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:29.268 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:29.268 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.268 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.269 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:29.269 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:29.269 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:29.269 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:29.269 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:29.269 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.269 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.259+0000 7f062a074640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:29.269 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.259+0000 7f062a074640 4 set_mon_vals no callback set 2026-02-24T19:24:29.269 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.259+0000 7f062a074640 10 monclient: shutdown 2026-02-24T19:24:29.269 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.259+0000 7f062a074640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:29.269 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.259+0000 7f062a074640 1 -- 10.20.193.26:0/1585976675 >> v1:10.20.193.103:6789/0 conn(0x7f0624161ac0 legacy=0x7f062415fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.269 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.259+0000 7f062a074640 1 -- 10.20.193.26:0/1585976675 shutdown_connections 2026-02-24T19:24:29.270 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.259+0000 7f062a074640 1 -- 10.20.193.26:0/1585976675 >> 10.20.193.26:0/1585976675 conn(0x7f06240b2f60 msgr2=0x7f06240b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:29.270 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.259+0000 7f062a074640 1 -- 10.20.193.26:0/1585976675 shutdown_connections 2026-02-24T19:24:29.270 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.259+0000 7f062a074640 1 -- 10.20.193.26:0/1585976675 wait complete. 2026-02-24T19:24:29.270 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.260+0000 7f062a074640 10 monclient: build_initial_monmap 2026-02-24T19:24:29.270 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.260+0000 7f062a074640 10 monclient: monmap: 2026-02-24T19:24:29.270 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:29.270 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:29.270 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:29.270 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:29.270 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:29.270 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:29.270 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:29.270 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:29.271 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:29.271 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.271 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.260+0000 7f062a074640 1 librados: starting msgr at 2026-02-24T19:24:29.271 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.260+0000 7f062a074640 1 librados: starting objecter 2026-02-24T19:24:29.271 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.260+0000 7f062a074640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:29.271 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.260+0000 7f062a074640 1 Processor -- start 2026-02-24T19:24:29.271 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.260+0000 7f062a074640 1 -- start start 2026-02-24T19:24:29.271 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.260+0000 7f062a074640 1 librados: setting wanted keys 2026-02-24T19:24:29.271 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.260+0000 7f062a074640 1 librados: calling monclient init 2026-02-24T19:24:29.271 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.260+0000 7f062a074640 10 monclient: init 2026-02-24T19:24:29.271 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.261+0000 7f062a074640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:29.271 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.261+0000 7f062a074640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:24:29.271 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.261+0000 7f062a074640 10 monclient(hunting): picked mon.noname-c con 0x7f0624159e10 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:29.272 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.261+0000 7f062a074640 10 monclient(hunting): picked mon.noname-a con 0x7f062415a1e0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:29.272 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.261+0000 7f062a074640 10 monclient(hunting): picked mon.noname-b con 0x7f0624161ac0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:29.272 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.261+0000 7f062a074640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06241f7210 con 0x7f062415a1e0 2026-02-24T19:24:29.272 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.261+0000 7f062a074640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06241f74f0 con 0x7f0624161ac0 2026-02-24T19:24:29.272 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.261+0000 7f062a074640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06241f77d0 con 0x7f0624159e10 2026-02-24T19:24:29.272 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.261+0000 7f062a074640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:29.272 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.261+0000 7f062a074640 10 monclient(hunting): authenticate will time out at 4051.943118s 2026-02-24T19:24:29.272 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.261+0000 7f06237fe640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f0624159e10 0x7f062415e5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58446/0 (socket says 10.20.193.26:58446) 2026-02-24T19:24:29.272 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.261+0000 7f06237fe640 1 -- 10.20.193.26:0/516183212 learned_addr learned my addr 10.20.193.26:0/516183212 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:29.272 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.261+0000 7f05fffff640 10 client.?.objecter ms_handle_connect 0x7f062415a1e0 2026-02-24T19:24:29.272 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.261+0000 7f05fffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:29.272 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.261+0000 7f05fffff640 10 client.?.objecter ms_handle_connect 0x7f0624159e10 2026-02-24T19:24:29.272 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.261+0000 7f05fffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:29.273 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.261+0000 7f05fffff640 10 client.?.objecter ms_handle_connect 0x7f0624161ac0 2026-02-24T19:24:29.273 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.261+0000 7f05fffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:29.273 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.262+0000 7f05fffff640 1 -- 10.20.193.26:0/516183212 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2078976779 0 0) 0x7f06241f7210 con 0x7f062415a1e0 2026-02-24T19:24:29.273 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.262+0000 7f05fffff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:29.273 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.262+0000 7f05fffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:29.273 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.262+0000 7f05fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:29.273 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.262+0000 7f05fffff640 10 monclient(hunting): my global_id is 30699 2026-02-24T19:24:29.273 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.262+0000 7f05fffff640 1 -- 10.20.193.26:0/516183212 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05f4003610 con 0x7f062415a1e0 2026-02-24T19:24:29.273 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.262+0000 7f05fffff640 1 -- 10.20.193.26:0/516183212 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4053515529 0 0) 0x7f06241f77d0 con 0x7f0624159e10 2026-02-24T19:24:29.273 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.262+0000 7f05fffff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:29.273 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.262+0000 7f05fffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:29.273 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.262+0000 7f05fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:29.273 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.262+0000 7f05fffff640 10 monclient(hunting): my global_id is 30038 2026-02-24T19:24:29.274 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.262+0000 7f05fffff640 1 -- 10.20.193.26:0/516183212 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06241f7210 con 0x7f0624159e10 2026-02-24T19:24:29.274 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.263+0000 7f05fffff640 1 -- 10.20.193.26:0/516183212 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3696608125 0 0) 0x7f06241f74f0 con 0x7f0624161ac0 2026-02-24T19:24:29.274 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.263+0000 7f05fffff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:29.274 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.263+0000 7f05fffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:29.274 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.263+0000 7f05fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:29.274 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.263+0000 7f05fffff640 10 monclient(hunting): my global_id is 28114 2026-02-24T19:24:29.274 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.263+0000 7f05fffff640 1 -- 10.20.193.26:0/516183212 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06241f77d0 con 0x7f0624161ac0 2026-02-24T19:24:29.276 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.265+0000 7f05fffff640 1 -- 10.20.193.26:0/516183212 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 122559128 0 0) 0x7f05f4003610 con 0x7f062415a1e0 2026-02-24T19:24:29.277 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.265+0000 7f05fffff640 1 -- 10.20.193.26:0/516183212 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f06241f74f0 con 0x7f062415a1e0 2026-02-24T19:24:29.277 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.265+0000 7f05fffff640 1 -- 10.20.193.26:0/516183212 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f0614003040 con 0x7f062415a1e0 2026-02-24T19:24:29.277 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.265+0000 7f05fffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:29.277 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.265+0000 7f05fffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:29.277 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.265+0000 7f05fffff640 10 monclient(hunting): dump: 2026-02-24T19:24:29.277 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:29.277 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:29.277 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.277 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.277 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:29.278 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:29.278 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:29.278 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:29.278 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:29.278 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.278 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.265+0000 7f05fffff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:29.278 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.265+0000 7f05fffff640 1 -- 10.20.193.26:0/516183212 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3817193167 0 0) 0x7f06241f7210 con 0x7f0624159e10 2026-02-24T19:24:29.278 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.265+0000 7f05fffff640 1 -- 10.20.193.26:0/516183212 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f05f4003610 con 0x7f0624159e10 2026-02-24T19:24:29.278 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.265+0000 7f05fffff640 1 -- 10.20.193.26:0/516183212 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f0610003170 con 0x7f0624159e10 2026-02-24T19:24:29.278 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.265+0000 7f05fffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:29.278 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.265+0000 7f05fffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:29.278 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.265+0000 7f05fffff640 10 monclient(hunting): dump: 2026-02-24T19:24:29.278 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:29.279 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:29.279 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.279 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.279 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:29.279 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:29.279 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:29.279 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:29.279 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:29.279 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.279 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.265+0000 7f05fffff640 1 -- 10.20.193.26:0/516183212 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3724096468 0 0) 0x7f06241f77d0 con 0x7f0624161ac0 2026-02-24T19:24:29.279 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.265+0000 7f05fffff640 1 -- 10.20.193.26:0/516183212 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f06241f7210 con 0x7f0624161ac0 2026-02-24T19:24:29.279 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.265+0000 7f05fffff640 1 -- 10.20.193.26:0/516183212 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f06180034e0 con 0x7f0624161ac0 2026-02-24T19:24:29.280 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.265+0000 7f05fffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:29.280 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.265+0000 7f05fffff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:29.280 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.265+0000 7f05fffff640 10 monclient(hunting): dump: 2026-02-24T19:24:29.280 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:29.280 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:29.280 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.280 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.280 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:29.280 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:29.280 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:29.280 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:29.280 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:29.280 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.266+0000 7f05fffff640 1 -- 10.20.193.26:0/516183212 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1657087014 0 0) 0x7f06241f74f0 con 0x7f062415a1e0 2026-02-24T19:24:29.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.266+0000 7f05fffff640 1 -- 10.20.193.26:0/516183212 >> v1:10.20.193.103:6789/0 conn(0x7f0624159e10 legacy=0x7f062415e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.266+0000 7f05fffff640 1 -- 10.20.193.26:0/516183212 >> v1:10.20.193.70:6789/0 conn(0x7f0624161ac0 legacy=0x7f0624059450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.266+0000 7f05fffff640 10 monclient: _finish_hunting 0 2026-02-24T19:24:29.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.266+0000 7f05fffff640 1 monclient: found mon.a 2026-02-24T19:24:29.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.266+0000 7f05fffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:29.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.266+0000 7f05fffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:29.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.266+0000 7f05fffff640 1 -- 10.20.193.26:0/516183212 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f062415dae0 con 0x7f062415a1e0 2026-02-24T19:24:29.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.266+0000 7f05fffff640 10 monclient: _finish_auth 0 2026-02-24T19:24:29.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.266+0000 7f05fffff640 10 monclient: _check_auth_tickets 2026-02-24T19:24:29.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.266+0000 7f05fffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:29.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.266+0000 7f062a074640 5 monclient: authenticate success, global_id 30699 2026-02-24T19:24:29.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.266+0000 7f062a074640 10 monclient: _renew_subs 2026-02-24T19:24:29.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.266+0000 7f062a074640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:29.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.266+0000 7f062a074640 1 -- 10.20.193.26:0/516183212 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f062415ddc0 con 0x7f062415a1e0 2026-02-24T19:24:29.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.267+0000 7f062a074640 10 client.30699.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:29.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.267+0000 7f062a074640 10 monclient: _renew_subs 2026-02-24T19:24:29.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.267+0000 7f062a074640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:29.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.267+0000 7f062a074640 1 -- 10.20.193.26:0/516183212 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f06241faca0 con 0x7f062415a1e0 2026-02-24T19:24:29.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.267+0000 7f062a074640 1 librados: init done 2026-02-24T19:24:29.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.267+0000 7f062a074640 10 client.30699.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:29.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.267+0000 7f062a074640 15 client.30699.objecter _session_command_op_assign -1 1 2026-02-24T19:24:29.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.267+0000 7f062a074640 20 client.30699.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:29.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.267+0000 7f062a074640 10 client.30699.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:29.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.267+0000 7f062a074640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:29.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.267+0000 7f062a074640 1 -- 10.20.193.26:0/516183212 --> v1:10.20.193.26:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f062415d8e0 con 0x7f062415a1e0 2026-02-24T19:24:29.284 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.275+0000 7f05fffff640 1 -- 10.20.193.26:0/516183212 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f062415d8e0 con 0x7f062415a1e0 2026-02-24T19:24:29.284 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.275+0000 7f05fffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:29.284 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.275+0000 7f05fffff640 1 -- 10.20.193.26:0/516183212 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f06140048d0 con 0x7f062415a1e0 2026-02-24T19:24:29.285 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.275+0000 7f05fffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:29.285 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.275+0000 7f05fffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:29.285 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.275+0000 7f05fffff640 10 monclient: dump: 2026-02-24T19:24:29.285 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:29.285 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:29.285 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.285 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.285 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:29.285 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:29.285 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:29.285 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:29.285 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:29.286 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.286 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.275+0000 7f0621ffb640 4 set_mon_vals no callback set 2026-02-24T19:24:29.286 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.276+0000 7f05fffff640 1 -- 10.20.193.26:0/516183212 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f061401d780 con 0x7f062415a1e0 2026-02-24T19:24:29.286 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.277+0000 7f05fffff640 1 -- 10.20.193.26:0/516183212 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7f06140930d0 con 0x7f062415a1e0 2026-02-24T19:24:29.286 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.277+0000 7f05fffff640 10 client.30699.objecter ms_dispatch2 0x7f0624000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:29.286 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.277+0000 7f05fffff640 3 client.30699.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:29.286 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.277+0000 7f05fffff640 3 client.30699.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:29.286 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.277+0000 7f06237fe640 10 monclient: get_auth_request con 0x7f05f4077e70 auth_method 0 2026-02-24T19:24:29.286 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.277+0000 7f05fffff640 10 client.30699.objecter checking command 1 2026-02-24T19:24:29.286 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.277+0000 7f05fffff640 20 client.30699.objecter _get_session s=0x7f05f40a2230 osd=9 3 2026-02-24T19:24:29.286 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.277+0000 7f05fffff640 20 client.30699.objecter put_session s=0x7f05f40a2230 osd=9 3 2026-02-24T19:24:29.286 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.277+0000 7f05fffff640 15 client.30699.objecter _session_command_op_remove -1 1 2026-02-24T19:24:29.286 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.277+0000 7f05fffff640 20 client.30699.objecter _get_session s=0x7f05f40a2230 osd=9 3 2026-02-24T19:24:29.287 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.277+0000 7f05fffff640 20 client.30699.objecter get_session s=0x7f05f40a2230 osd=9 3 2026-02-24T19:24:29.287 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.277+0000 7f05fffff640 15 client.30699.objecter _session_command_op_assign 9 1 2026-02-24T19:24:29.287 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.277+0000 7f05fffff640 20 client.30699.objecter put_session s=0x7f05f40a2230 osd=9 4 2026-02-24T19:24:29.287 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.277+0000 7f05fffff640 10 client.30699.objecter _send_command 1 2026-02-24T19:24:29.287 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.277+0000 7f05fffff640 1 -- 10.20.193.26:0/516183212 --> v1:10.20.193.70:6804/3709696191 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0614003220 con 0x7f05f40a28e0 2026-02-24T19:24:29.287 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.277+0000 7f05fffff640 20 client.30699.objecter dump_active .. 0 homeless 2026-02-24T19:24:29.287 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.277+0000 7f05fffff640 1 -- 10.20.193.26:0/516183212 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_get_version_reply(handle=1 version=346) ==== 24+0+0 (unknown 2991753921 0 0) 0x7f061405d1d0 con 0x7f062415a1e0 2026-02-24T19:24:29.287 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.277+0000 7f05fffff640 10 monclient: handle_get_version_reply finishing 1 version 346 2026-02-24T19:24:29.287 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.277+0000 7f05fffff640 10 client.30699.objecter ms_handle_connect 0x7f05f4077e70 2026-02-24T19:24:29.287 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.278+0000 7f0623fff640 10 monclient: get_auth_request con 0x7f05f40a28e0 auth_method 0 2026-02-24T19:24:29.287 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.279+0000 7f05fffff640 10 client.30699.objecter ms_handle_connect 0x7f05f40a28e0 2026-02-24T19:24:29.292 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.290+0000 7f05fffff640 1 -- 10.20.193.26:0/516183212 <== osd.9 v1:10.20.193.70:6804/3709696191 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f0614003220 con 0x7f05f40a28e0 2026-02-24T19:24:29.292 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.290+0000 7f05fffff640 10 client.30699.objecter ms_dispatch2 0x7f0624000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:29.292 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.290+0000 7f05fffff640 10 client.30699.objecter _finish_command 1 = system:0 2026-02-24T19:24:29.292 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.290+0000 7f05fffff640 20 client.30699.objecter put_session s=0x7f05f40a2230 osd=9 4 2026-02-24T19:24:29.292 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.290+0000 7f05fffff640 15 client.30699.objecter _session_command_op_remove 9 1 2026-02-24T19:24:29.299 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.298+0000 7f062a074640 10 client.30699.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:29.300 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.298+0000 7f062a074640 15 client.30699.objecter _session_command_op_assign -1 2 2026-02-24T19:24:29.300 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.298+0000 7f062a074640 20 client.30699.objecter _get_session s=0x7f05f40a2230 osd=9 3 2026-02-24T19:24:29.300 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.298+0000 7f062a074640 20 client.30699.objecter put_session s=0x7f05f40a2230 osd=9 3 2026-02-24T19:24:29.300 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.298+0000 7f062a074640 20 client.30699.objecter _get_session s=0x7f05f40a2230 osd=9 3 2026-02-24T19:24:29.300 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.298+0000 7f062a074640 15 client.30699.objecter _session_command_op_remove -1 2 2026-02-24T19:24:29.300 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.298+0000 7f062a074640 20 client.30699.objecter get_session s=0x7f05f40a2230 osd=9 3 2026-02-24T19:24:29.300 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.298+0000 7f062a074640 15 client.30699.objecter _session_command_op_assign 9 2 2026-02-24T19:24:29.300 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.298+0000 7f062a074640 20 client.30699.objecter put_session s=0x7f05f40a2230 osd=9 4 2026-02-24T19:24:29.300 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.298+0000 7f062a074640 10 client.30699.objecter _send_command 2 2026-02-24T19:24:29.300 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.298+0000 7f062a074640 1 -- 10.20.193.26:0/516183212 --> v1:10.20.193.70:6804/3709696191 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0624056c80 con 0x7f05f40a28e0 2026-02-24T19:24:29.307 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.305+0000 7f05fffff640 1 -- 10.20.193.26:0/516183212 <== osd.9 v1:10.20.193.70:6804/3709696191 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f0624056c80 con 0x7f05f40a28e0 2026-02-24T19:24:29.307 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.305+0000 7f05fffff640 10 client.30699.objecter ms_dispatch2 0x7f0624000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:29.307 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.305+0000 7f05fffff640 10 client.30699.objecter _finish_command 2 = system:0 2026-02-24T19:24:29.307 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.305+0000 7f05fffff640 20 client.30699.objecter put_session s=0x7f05f40a2230 osd=9 4 2026-02-24T19:24:29.307 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.305+0000 7f05fffff640 15 client.30699.objecter _session_command_op_remove 9 2 2026-02-24T19:24:29.308 INFO:teuthology.orchestra.run.trial026.stdout:{ 2026-02-24T19:24:29.308 INFO:teuthology.orchestra.run.trial026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:29.308 INFO:teuthology.orchestra.run.trial026.stdout:} 2026-02-24T19:24:29.309 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.305+0000 7f062a074640 10 librados: watch_flush enter 2026-02-24T19:24:29.309 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.305+0000 7f062a074640 10 librados: watch_flush exit 2026-02-24T19:24:29.309 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.305+0000 7f062a074640 10 client.30699.objecter close_session for osd.9 2026-02-24T19:24:29.310 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.305+0000 7f062a074640 1 -- 10.20.193.26:0/516183212 >> v1:10.20.193.70:6804/3709696191 conn(0x7f05f40a28e0 legacy=0x7f05f40c2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.310 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.305+0000 7f062a074640 20 client.30699.objecter put_session s=0x7f05f40a2230 osd=9 1 2026-02-24T19:24:29.310 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.305+0000 7f062a074640 20 client.30699.objecter shutdown clearing up homeless session... 2026-02-24T19:24:29.310 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.305+0000 7f062a074640 10 client.30699.objecter successfully canceled tick 2026-02-24T19:24:29.310 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.305+0000 7f062a074640 1 -- 10.20.193.26:0/516183212 >> v1:10.20.193.162:6800/3889602630 conn(0x7f05f4077e70 legacy=0x7f05f4098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.310 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.305+0000 7f062a074640 10 monclient: shutdown 2026-02-24T19:24:29.310 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.305+0000 7f062a074640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:29.310 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.305+0000 7f062a074640 1 -- 10.20.193.26:0/516183212 >> v1:10.20.193.26:6789/0 conn(0x7f062415a1e0 legacy=0x7f06241fa590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.310 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.305+0000 7f0623fff640 1 -- 10.20.193.26:0/516183212 reap_dead start 2026-02-24T19:24:29.310 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.306+0000 7f062a074640 1 -- 10.20.193.26:0/516183212 shutdown_connections 2026-02-24T19:24:29.310 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.306+0000 7f062a074640 1 -- 10.20.193.26:0/516183212 >> 10.20.193.26:0/516183212 conn(0x7f06240b2f60 msgr2=0x7f062405f690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:29.310 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.306+0000 7f062a074640 1 -- 10.20.193.26:0/516183212 shutdown_connections 2026-02-24T19:24:29.311 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.306+0000 7f062a074640 1 -- 10.20.193.26:0/516183212 wait complete. 2026-02-24T19:24:29.311 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.306+0000 7f062a074640 1 librados: shutdown 2026-02-24T19:24:29.315 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2026-02-24T19:24:29.384 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.383+0000 7f7caa001640 10 monclient: get_monmap_and_config 2026-02-24T19:24:29.385 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.383+0000 7f7caa001640 10 monclient: build_initial_monmap 2026-02-24T19:24:29.385 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.383+0000 7f7caa001640 10 monclient: monmap: 2026-02-24T19:24:29.385 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:29.385 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:29.385 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:29.384067+0000 2026-02-24T19:24:29.385 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:29.384067+0000 2026-02-24T19:24:29.385 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:29.385 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:29.385 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:29.385 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:29.385 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:29.385 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.388 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.383+0000 7f7caa001640 1 Processor -- start 2026-02-24T19:24:29.388 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.383+0000 7f7caa001640 1 -- start start 2026-02-24T19:24:29.388 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.383+0000 7f7caa001640 10 monclient: init 2026-02-24T19:24:29.388 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.384+0000 7f7caa001640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:29.388 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.384+0000 7f7caa001640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:29.388 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.384+0000 7f7caa001640 10 monclient(hunting): picked mon.noname-a con 0x7f7ca4157780 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:29.388 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.384+0000 7f7caa001640 10 monclient(hunting): picked mon.noname-c con 0x7f7ca4157b50 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:29.388 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.384+0000 7f7caa001640 10 monclient(hunting): picked mon.noname-b con 0x7f7ca4164d00 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:29.388 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.384+0000 7f7caa001640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ca405de70 con 0x7f7ca4157780 2026-02-24T19:24:29.388 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.384+0000 7f7caa001640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ca4055b20 con 0x7f7ca4164d00 2026-02-24T19:24:29.389 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.384+0000 7f7caa001640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ca4055e00 con 0x7f7ca4157b50 2026-02-24T19:24:29.389 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.384+0000 7f7caa001640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:29.389 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.384+0000 7f7caa001640 10 monclient(hunting): authenticate will time out at 4052.066284s 2026-02-24T19:24:29.389 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.384+0000 7f7ca37fe640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f7ca4157780 0x7f7ca4056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59524/0 (socket says 10.20.193.26:59524) 2026-02-24T19:24:29.389 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.384+0000 7f7ca37fe640 1 -- 10.20.193.26:0/2155116557 learned_addr learned my addr 10.20.193.26:0/2155116557 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:29.389 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.386+0000 7f7ca27fc640 1 -- 10.20.193.26:0/2155116557 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2590820017 0 0) 0x7f7ca4055e00 con 0x7f7ca4157b50 2026-02-24T19:24:29.389 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.386+0000 7f7ca27fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:29.389 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.386+0000 7f7ca27fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:29.389 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.386+0000 7f7ca27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:29.389 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.386+0000 7f7ca27fc640 10 monclient(hunting): my global_id is 30041 2026-02-24T19:24:29.389 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.386+0000 7f7ca27fc640 1 -- 10.20.193.26:0/2155116557 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c88003610 con 0x7f7ca4157b50 2026-02-24T19:24:29.389 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.386+0000 7f7ca27fc640 1 -- 10.20.193.26:0/2155116557 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1580781747 0 0) 0x7f7ca405de70 con 0x7f7ca4157780 2026-02-24T19:24:29.390 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.386+0000 7f7ca27fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:29.390 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.386+0000 7f7ca27fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:29.390 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.386+0000 7f7ca27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:29.390 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.386+0000 7f7ca27fc640 10 monclient(hunting): my global_id is 30702 2026-02-24T19:24:29.390 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.386+0000 7f7ca27fc640 1 -- 10.20.193.26:0/2155116557 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ca4055e00 con 0x7f7ca4157780 2026-02-24T19:24:29.390 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.386+0000 7f7ca27fc640 1 -- 10.20.193.26:0/2155116557 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2181152967 0 0) 0x7f7ca4055b20 con 0x7f7ca4164d00 2026-02-24T19:24:29.390 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.386+0000 7f7ca27fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:29.390 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.386+0000 7f7ca27fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:29.390 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.386+0000 7f7ca27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:29.390 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.386+0000 7f7ca27fc640 10 monclient(hunting): my global_id is 28117 2026-02-24T19:24:29.390 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.386+0000 7f7ca27fc640 1 -- 10.20.193.26:0/2155116557 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ca405de70 con 0x7f7ca4164d00 2026-02-24T19:24:29.395 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.387+0000 7f7ca27fc640 1 -- 10.20.193.26:0/2155116557 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1284290677 0 0) 0x7f7c88003610 con 0x7f7ca4157b50 2026-02-24T19:24:29.395 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.387+0000 7f7ca27fc640 1 -- 10.20.193.26:0/2155116557 >> v1:10.20.193.70:6789/0 conn(0x7f7ca4164d00 legacy=0x7f7ca41c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.395 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.387+0000 7f7ca27fc640 1 -- 10.20.193.26:0/2155116557 >> v1:10.20.193.26:6789/0 conn(0x7f7ca4157780 legacy=0x7f7ca4056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.395 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.387+0000 7f7ca27fc640 10 monclient: _finish_hunting 0 2026-02-24T19:24:29.395 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.387+0000 7f7ca27fc640 1 monclient: found mon.noname-c 2026-02-24T19:24:29.395 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.387+0000 7f7ca27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:29.395 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.387+0000 7f7ca27fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:24:29.395 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.387+0000 7f7ca27fc640 1 -- 10.20.193.26:0/2155116557 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca40560e0 con 0x7f7ca4157b50 2026-02-24T19:24:29.395 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.387+0000 7f7ca27fc640 10 monclient: _finish_auth 0 2026-02-24T19:24:29.395 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.387+0000 7f7ca27fc640 10 monclient: _check_auth_tickets 2026-02-24T19:24:29.395 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.387+0000 7f7ca27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:29.396 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.387+0000 7f7ca27fc640 1 -- 10.20.193.26:0/2155116557 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7c94002df0 con 0x7f7ca4157b50 2026-02-24T19:24:29.396 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.387+0000 7f7ca27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:29.396 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.387+0000 7f7ca27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:29.396 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.387+0000 7f7ca27fc640 10 monclient: dump: 2026-02-24T19:24:29.396 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:29.396 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:29.396 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.396 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.396 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:29.396 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:29.396 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:29.396 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:29.397 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:29.397 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.387+0000 7f7caa001640 5 monclient: authenticate success, global_id 30041 2026-02-24T19:24:29.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.387+0000 7f7caa001640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:29.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.388+0000 7f7ca27fc640 1 -- 10.20.193.26:0/2155116557 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7c94002fc0 con 0x7f7ca4157b50 2026-02-24T19:24:29.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.388+0000 7f7ca27fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:29.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.388+0000 7f7ca27fc640 1 -- 10.20.193.26:0/2155116557 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7c94003400 con 0x7f7ca4157b50 2026-02-24T19:24:29.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.388+0000 7f7ca27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:29.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.388+0000 7f7ca27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:29.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.388+0000 7f7ca27fc640 10 monclient: dump: 2026-02-24T19:24:29.397 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:29.397 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:29.398 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.398 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.398 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:29.398 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:29.398 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:29.398 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:29.398 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:29.398 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.398 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.388+0000 7f7caa001640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:29.398 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.388+0000 7f7caa001640 4 set_mon_vals no callback set 2026-02-24T19:24:29.398 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.389+0000 7f7caa001640 10 monclient: shutdown 2026-02-24T19:24:29.398 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.389+0000 7f7caa001640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:29.398 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.389+0000 7f7caa001640 1 -- 10.20.193.26:0/2155116557 >> v1:10.20.193.103:6789/0 conn(0x7f7ca4157b50 legacy=0x7f7ca41645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.399 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.389+0000 7f7caa001640 1 -- 10.20.193.26:0/2155116557 shutdown_connections 2026-02-24T19:24:29.399 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.389+0000 7f7caa001640 1 -- 10.20.193.26:0/2155116557 >> 10.20.193.26:0/2155116557 conn(0x7f7ca40b2ef0 msgr2=0x7f7ca40b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:29.399 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.389+0000 7f7caa001640 1 -- 10.20.193.26:0/2155116557 shutdown_connections 2026-02-24T19:24:29.399 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.389+0000 7f7caa001640 1 -- 10.20.193.26:0/2155116557 wait complete. 2026-02-24T19:24:29.399 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.389+0000 7f7caa001640 10 monclient: build_initial_monmap 2026-02-24T19:24:29.399 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.389+0000 7f7caa001640 10 monclient: monmap: 2026-02-24T19:24:29.399 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:29.399 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:29.399 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:29.399 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:29.399 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:29.399 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:29.399 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:29.400 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:29.400 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:29.400 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.389+0000 7f7caa001640 1 librados: starting msgr at 2026-02-24T19:24:29.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.389+0000 7f7caa001640 1 librados: starting objecter 2026-02-24T19:24:29.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.389+0000 7f7caa001640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:29.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.389+0000 7f7caa001640 1 Processor -- start 2026-02-24T19:24:29.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.389+0000 7f7caa001640 1 -- start start 2026-02-24T19:24:29.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.389+0000 7f7caa001640 1 librados: setting wanted keys 2026-02-24T19:24:29.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.389+0000 7f7caa001640 1 librados: calling monclient init 2026-02-24T19:24:29.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.389+0000 7f7caa001640 10 monclient: init 2026-02-24T19:24:29.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.390+0000 7f7caa001640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:29.401 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.390+0000 7f7caa001640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:29.401 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.390+0000 7f7caa001640 10 monclient(hunting): picked mon.noname-c con 0x7f7ca4157780 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:29.401 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.390+0000 7f7caa001640 10 monclient(hunting): picked mon.noname-b con 0x7f7ca4157b50 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:29.401 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.390+0000 7f7caa001640 10 monclient(hunting): picked mon.noname-a con 0x7f7ca4164d00 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:29.401 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.390+0000 7f7caa001640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ca4145870 con 0x7f7ca4164d00 2026-02-24T19:24:29.401 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.390+0000 7f7caa001640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ca40ae9a0 con 0x7f7ca4157b50 2026-02-24T19:24:29.401 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.390+0000 7f7caa001640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ca40aec80 con 0x7f7ca4157780 2026-02-24T19:24:29.401 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.390+0000 7f7caa001640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:29.401 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.390+0000 7f7caa001640 10 monclient(hunting): authenticate will time out at 4052.072495s 2026-02-24T19:24:29.401 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.390+0000 7f7ca37fe640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f7ca4157780 0x7f7ca41465f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58462/0 (socket says 10.20.193.26:58462) 2026-02-24T19:24:29.401 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.390+0000 7f7ca37fe640 1 -- 10.20.193.26:0/1903108081 learned_addr learned my addr 10.20.193.26:0/1903108081 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:29.401 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.390+0000 7f7c7ffff640 10 client.?.objecter ms_handle_connect 0x7f7ca4164d00 2026-02-24T19:24:29.401 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.391+0000 7f7c7ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:29.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.391+0000 7f7c7ffff640 10 client.?.objecter ms_handle_connect 0x7f7ca4157780 2026-02-24T19:24:29.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.391+0000 7f7c7ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:29.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.391+0000 7f7c7ffff640 10 client.?.objecter ms_handle_connect 0x7f7ca4157b50 2026-02-24T19:24:29.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.391+0000 7f7c7ffff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:29.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.391+0000 7f7c7ffff640 1 -- 10.20.193.26:0/1903108081 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3325603063 0 0) 0x7f7ca4145870 con 0x7f7ca4164d00 2026-02-24T19:24:29.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.391+0000 7f7c7ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:29.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.391+0000 7f7c7ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:29.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.391+0000 7f7c7ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:29.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.391+0000 7f7c7ffff640 10 monclient(hunting): my global_id is 30705 2026-02-24T19:24:29.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.391+0000 7f7c7ffff640 1 -- 10.20.193.26:0/1903108081 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c74003610 con 0x7f7ca4164d00 2026-02-24T19:24:29.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.392+0000 7f7c7ffff640 1 -- 10.20.193.26:0/1903108081 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3615944846 0 0) 0x7f7ca40aec80 con 0x7f7ca4157780 2026-02-24T19:24:29.402 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.392+0000 7f7c7ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:29.403 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.392+0000 7f7c7ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:29.403 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.392+0000 7f7c7ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:29.403 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.392+0000 7f7c7ffff640 10 monclient(hunting): my global_id is 30044 2026-02-24T19:24:29.403 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.392+0000 7f7c7ffff640 1 -- 10.20.193.26:0/1903108081 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ca4145870 con 0x7f7ca4157780 2026-02-24T19:24:29.403 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.392+0000 7f7c7ffff640 1 -- 10.20.193.26:0/1903108081 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 40896515 0 0) 0x7f7ca40ae9a0 con 0x7f7ca4157b50 2026-02-24T19:24:29.403 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.392+0000 7f7c7ffff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:29.403 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.392+0000 7f7c7ffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:29.403 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.392+0000 7f7c7ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:29.403 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.392+0000 7f7c7ffff640 10 monclient(hunting): my global_id is 28120 2026-02-24T19:24:29.403 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.392+0000 7f7c7ffff640 1 -- 10.20.193.26:0/1903108081 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ca40aec80 con 0x7f7ca4157b50 2026-02-24T19:24:29.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.394+0000 7f7c7ffff640 1 -- 10.20.193.26:0/1903108081 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1317233657 0 0) 0x7f7ca4145870 con 0x7f7ca4157780 2026-02-24T19:24:29.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.394+0000 7f7c7ffff640 1 -- 10.20.193.26:0/1903108081 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7ca40ae9a0 con 0x7f7ca4157780 2026-02-24T19:24:29.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.394+0000 7f7c7ffff640 1 -- 10.20.193.26:0/1903108081 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7c90003130 con 0x7f7ca4157780 2026-02-24T19:24:29.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.394+0000 7f7c7ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:29.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.394+0000 7f7c7ffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:29.406 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.394+0000 7f7c7ffff640 10 monclient(hunting): dump: 2026-02-24T19:24:29.406 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:29.407 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:29.407 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.407 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.407 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:29.407 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:29.407 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:29.407 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:29.407 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:29.407 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.407 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.394+0000 7f7c7ffff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:29.407 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.394+0000 7f7c7ffff640 1 -- 10.20.193.26:0/1903108081 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4213417711 0 0) 0x7f7c74003610 con 0x7f7ca4164d00 2026-02-24T19:24:29.407 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.394+0000 7f7c7ffff640 1 -- 10.20.193.26:0/1903108081 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7ca4145870 con 0x7f7ca4164d00 2026-02-24T19:24:29.407 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.394+0000 7f7c7ffff640 1 -- 10.20.193.26:0/1903108081 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7c980032b0 con 0x7f7ca4164d00 2026-02-24T19:24:29.408 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.394+0000 7f7c7ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:29.408 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.394+0000 7f7c7ffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:29.408 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.394+0000 7f7c7ffff640 10 monclient(hunting): dump: 2026-02-24T19:24:29.408 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:29.408 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:29.408 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.408 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.408 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:29.408 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:29.408 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:29.408 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:29.408 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:29.408 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.409 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.394+0000 7f7c7ffff640 1 -- 10.20.193.26:0/1903108081 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2866201888 0 0) 0x7f7ca40aec80 con 0x7f7ca4157b50 2026-02-24T19:24:29.409 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.394+0000 7f7c7ffff640 1 -- 10.20.193.26:0/1903108081 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7c74003610 con 0x7f7ca4157b50 2026-02-24T19:24:29.409 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.394+0000 7f7c7ffff640 1 -- 10.20.193.26:0/1903108081 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7c94003310 con 0x7f7ca4157b50 2026-02-24T19:24:29.409 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.394+0000 7f7c7ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:29.409 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.394+0000 7f7c7ffff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:29.409 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.394+0000 7f7c7ffff640 10 monclient(hunting): dump: 2026-02-24T19:24:29.409 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:29.409 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:29.409 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.409 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.409 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:29.409 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:29.409 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:29.410 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:29.410 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:29.410 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.410 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.395+0000 7f7c7ffff640 1 -- 10.20.193.26:0/1903108081 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2112219785 0 0) 0x7f7ca40ae9a0 con 0x7f7ca4157780 2026-02-24T19:24:29.410 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.395+0000 7f7c7ffff640 1 -- 10.20.193.26:0/1903108081 >> v1:10.20.193.70:6789/0 conn(0x7f7ca4157b50 legacy=0x7f7ca413a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.410 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.395+0000 7f7c7ffff640 1 -- 10.20.193.26:0/1903108081 >> v1:10.20.193.26:6789/0 conn(0x7f7ca4164d00 legacy=0x7f7ca4147ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.410 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.395+0000 7f7c7ffff640 10 monclient: _finish_hunting 0 2026-02-24T19:24:29.410 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.395+0000 7f7c7ffff640 1 monclient: found mon.c 2026-02-24T19:24:29.410 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.395+0000 7f7c7ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:29.410 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.395+0000 7f7c7ffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:29.410 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.395+0000 7f7c7ffff640 1 -- 10.20.193.26:0/1903108081 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca4145b10 con 0x7f7ca4157780 2026-02-24T19:24:29.410 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.395+0000 7f7c7ffff640 10 monclient: _finish_auth 0 2026-02-24T19:24:29.410 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.395+0000 7f7c7ffff640 10 monclient: _check_auth_tickets 2026-02-24T19:24:29.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.395+0000 7f7c7ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:29.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.395+0000 7f7caa001640 5 monclient: authenticate success, global_id 30044 2026-02-24T19:24:29.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.395+0000 7f7caa001640 10 monclient: _renew_subs 2026-02-24T19:24:29.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.395+0000 7f7caa001640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:29.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.395+0000 7f7caa001640 1 -- 10.20.193.26:0/1903108081 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7ca4145df0 con 0x7f7ca4157780 2026-02-24T19:24:29.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.395+0000 7f7caa001640 10 client.30044.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:29.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.395+0000 7f7caa001640 10 monclient: _renew_subs 2026-02-24T19:24:29.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.395+0000 7f7caa001640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:29.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.395+0000 7f7caa001640 1 -- 10.20.193.26:0/1903108081 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7ca4146d00 con 0x7f7ca4157780 2026-02-24T19:24:29.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.395+0000 7f7caa001640 1 librados: init done 2026-02-24T19:24:29.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.396+0000 7f7caa001640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:29.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.396+0000 7f7caa001640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:29.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.396+0000 7f7caa001640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:29.412 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.396+0000 7f7caa001640 1 -- 10.20.193.26:0/1903108081 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ca4055b20 con 0x7f7ca4157780 2026-02-24T19:24:29.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.489+0000 7f7c7ffff640 1 -- 10.20.193.26:0/1903108081 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7c900032d0 con 0x7f7ca4157780 2026-02-24T19:24:29.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.489+0000 7f7c7ffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:29.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.489+0000 7f7c7ffff640 1 -- 10.20.193.26:0/1903108081 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f7c90004d20 con 0x7f7ca4157780 2026-02-24T19:24:29.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.489+0000 7f7c7ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:29.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.489+0000 7f7c7ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:29.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.489+0000 7f7ca1ffb640 4 set_mon_vals no callback set 2026-02-24T19:24:29.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.489+0000 7f7c7ffff640 10 monclient: dump: 2026-02-24T19:24:29.491 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:29.491 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:29.491 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.491 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.491 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:29.492 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:29.492 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:29.492 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:29.492 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:29.492 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.490+0000 7f7c7ffff640 1 -- 10.20.193.26:0/1903108081 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f7c9001db90 con 0x7f7ca4157780 2026-02-24T19:24:29.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.490+0000 7f7ca2ffd640 10 monclient: get_auth_request con 0x7f7c74077e20 auth_method 0 2026-02-24T19:24:29.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.491+0000 7f7c7ffff640 10 client.30044.objecter ms_handle_connect 0x7f7c74077e20 2026-02-24T19:24:29.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.491+0000 7f7c7ffff640 1 -- 10.20.193.26:0/1903108081 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7f7c90093280 con 0x7f7ca4157780 2026-02-24T19:24:29.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.491+0000 7f7c7ffff640 10 client.30044.objecter ms_dispatch2 0x7f7ca4000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:29.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.491+0000 7f7c7ffff640 3 client.30044.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:29.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.491+0000 7f7c7ffff640 3 client.30044.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:29.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.491+0000 7f7c7ffff640 20 client.30044.objecter dump_active .. 0 homeless 2026-02-24T19:24:29.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.492+0000 7f7c7ffff640 1 -- 10.20.193.26:0/1903108081 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f7ca4055b20 con 0x7f7ca4157780 2026-02-24T19:24:29.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.492+0000 7f7c7ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:29.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.492+0000 7f7c7ffff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:29.603 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.602+0000 7f7caa001640 1 -- 10.20.193.26:0/1903108081 --> v1:10.20.193.162:6800/3889602630 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "9", "target": ["mon-mgr", ""]}) -- 0x7f7ca4146fe0 con 0x7f7c74077e20 2026-02-24T19:24:29.604 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.602+0000 7f7c7ffff640 1 -- 10.20.193.26:0/1903108081 <== mgr.4107 v1:10.20.193.162:6800/3889602630 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 9 to deep-scrub) ==== 41+0+0 (unknown 795720238 0 0) 0x7f7ca4146fe0 con 0x7f7c74077e20 2026-02-24T19:24:29.604 INFO:teuthology.orchestra.run.trial026.stderr:instructed osd(s) 9 to deep-scrub 2026-02-24T19:24:29.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.603+0000 7f7caa001640 10 librados: watch_flush enter 2026-02-24T19:24:29.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.603+0000 7f7caa001640 10 librados: watch_flush exit 2026-02-24T19:24:29.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.603+0000 7f7caa001640 20 client.30044.objecter shutdown clearing up homeless session... 2026-02-24T19:24:29.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.603+0000 7f7caa001640 10 client.30044.objecter successfully canceled tick 2026-02-24T19:24:29.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.603+0000 7f7caa001640 1 -- 10.20.193.26:0/1903108081 >> v1:10.20.193.162:6800/3889602630 conn(0x7f7c74077e20 legacy=0x7f7c740982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.603+0000 7f7caa001640 10 monclient: shutdown 2026-02-24T19:24:29.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.603+0000 7f7caa001640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:29.606 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.603+0000 7f7caa001640 1 -- 10.20.193.26:0/1903108081 >> v1:10.20.193.103:6789/0 conn(0x7f7ca4157780 legacy=0x7f7ca41465f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.603+0000 7f7caa001640 1 -- 10.20.193.26:0/1903108081 shutdown_connections 2026-02-24T19:24:29.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.603+0000 7f7caa001640 1 -- 10.20.193.26:0/1903108081 >> 10.20.193.26:0/1903108081 conn(0x7f7ca40b2ef0 msgr2=0x7f7ca413bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:29.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.604+0000 7f7caa001640 1 -- 10.20.193.26:0/1903108081 shutdown_connections 2026-02-24T19:24:29.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.604+0000 7f7caa001640 1 -- 10.20.193.26:0/1903108081 wait complete. 2026-02-24T19:24:29.607 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.604+0000 7f7caa001640 1 librados: shutdown 2026-02-24T19:24:29.614 INFO:tasks.ceph:Scrubbing osd.13 2026-02-24T19:24:29.614 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:29.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.683+0000 7f6d001c3640 10 monclient: get_monmap_and_config 2026-02-24T19:24:29.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.683+0000 7f6d001c3640 10 monclient: build_initial_monmap 2026-02-24T19:24:29.685 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.683+0000 7f6d001c3640 10 monclient: monmap: 2026-02-24T19:24:29.685 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:29.685 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:29.685 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:29.684512+0000 2026-02-24T19:24:29.685 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:29.684512+0000 2026-02-24T19:24:29.685 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:29.686 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:29.686 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:29.686 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:29.686 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:29.686 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.688 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.684+0000 7f6d001c3640 1 Processor -- start 2026-02-24T19:24:29.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.684+0000 7f6d001c3640 1 -- start start 2026-02-24T19:24:29.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.684+0000 7f6d001c3640 10 monclient: init 2026-02-24T19:24:29.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.684+0000 7f6d001c3640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:29.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.684+0000 7f6d001c3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:24:29.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.684+0000 7f6d001c3640 10 monclient(hunting): picked mon.noname-c con 0x7f6cf815e2a0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:29.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.684+0000 7f6d001c3640 10 monclient(hunting): picked mon.noname-a con 0x7f6cf8059e10 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:29.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.684+0000 7f6d001c3640 10 monclient(hunting): picked mon.noname-b con 0x7f6cf81a5660 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:29.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.684+0000 7f6d001c3640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cf8162df0 con 0x7f6cf8059e10 2026-02-24T19:24:29.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.684+0000 7f6d001c3640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cf81630d0 con 0x7f6cf81a5660 2026-02-24T19:24:29.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.684+0000 7f6d001c3640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cf81633b0 con 0x7f6cf815e2a0 2026-02-24T19:24:29.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.684+0000 7f6d001c3640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:29.689 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.684+0000 7f6d001c3640 10 monclient(hunting): authenticate will time out at 4052.366851s 2026-02-24T19:24:29.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.685+0000 7f6cfdf38640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f6cf815e2a0 0x7f6cf805da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58474/0 (socket says 10.20.193.26:58474) 2026-02-24T19:24:29.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.685+0000 7f6cfdf38640 1 -- 10.20.193.26:0/46071488 learned_addr learned my addr 10.20.193.26:0/46071488 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:29.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.686+0000 7f6cfcf36640 1 -- 10.20.193.26:0/46071488 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1646807411 0 0) 0x7f6cf81633b0 con 0x7f6cf815e2a0 2026-02-24T19:24:29.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.686+0000 7f6cfcf36640 10 monclient(hunting): _negotiate 2026-02-24T19:24:29.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.686+0000 7f6cfcf36640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:29.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.686+0000 7f6cfcf36640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:29.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.686+0000 7f6cfcf36640 10 monclient(hunting): my global_id is 30047 2026-02-24T19:24:29.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.686+0000 7f6cfcf36640 1 -- 10.20.193.26:0/46071488 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ce0003610 con 0x7f6cf815e2a0 2026-02-24T19:24:29.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.686+0000 7f6cfcf36640 1 -- 10.20.193.26:0/46071488 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3698932759 0 0) 0x7f6cf8162df0 con 0x7f6cf8059e10 2026-02-24T19:24:29.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.686+0000 7f6cfcf36640 10 monclient(hunting): _negotiate 2026-02-24T19:24:29.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.686+0000 7f6cfcf36640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:29.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.686+0000 7f6cfcf36640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:29.690 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.686+0000 7f6cfcf36640 10 monclient(hunting): my global_id is 30708 2026-02-24T19:24:29.691 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.686+0000 7f6cfcf36640 1 -- 10.20.193.26:0/46071488 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cf81633b0 con 0x7f6cf8059e10 2026-02-24T19:24:29.691 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.686+0000 7f6cfcf36640 1 -- 10.20.193.26:0/46071488 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1857048447 0 0) 0x7f6cf81630d0 con 0x7f6cf81a5660 2026-02-24T19:24:29.691 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.686+0000 7f6cfcf36640 10 monclient(hunting): _negotiate 2026-02-24T19:24:29.691 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.686+0000 7f6cfcf36640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:29.691 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.686+0000 7f6cfcf36640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:29.691 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.686+0000 7f6cfcf36640 10 monclient(hunting): my global_id is 28123 2026-02-24T19:24:29.691 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.686+0000 7f6cfcf36640 1 -- 10.20.193.26:0/46071488 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cf8162df0 con 0x7f6cf81a5660 2026-02-24T19:24:29.696 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.688+0000 7f6cfcf36640 1 -- 10.20.193.26:0/46071488 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 876851377 0 0) 0x7f6ce0003610 con 0x7f6cf815e2a0 2026-02-24T19:24:29.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.688+0000 7f6cfcf36640 1 -- 10.20.193.26:0/46071488 >> v1:10.20.193.70:6789/0 conn(0x7f6cf81a5660 legacy=0x7f6cf81c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.688+0000 7f6cfcf36640 1 -- 10.20.193.26:0/46071488 >> v1:10.20.193.26:6789/0 conn(0x7f6cf8059e10 legacy=0x7f6cf815ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.688+0000 7f6cfcf36640 10 monclient: _finish_hunting 0 2026-02-24T19:24:29.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.688+0000 7f6cfcf36640 1 monclient: found mon.noname-c 2026-02-24T19:24:29.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.688+0000 7f6cfcf36640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:29.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.688+0000 7f6cfcf36640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:24:29.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.688+0000 7f6cfcf36640 1 -- 10.20.193.26:0/46071488 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf8163690 con 0x7f6cf815e2a0 2026-02-24T19:24:29.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.688+0000 7f6cfcf36640 10 monclient: _finish_auth 0 2026-02-24T19:24:29.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.688+0000 7f6cfcf36640 10 monclient: _check_auth_tickets 2026-02-24T19:24:29.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.688+0000 7f6cfcf36640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:29.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.688+0000 7f6cfcf36640 1 -- 10.20.193.26:0/46071488 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6ce8002df0 con 0x7f6cf815e2a0 2026-02-24T19:24:29.697 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.688+0000 7f6cfcf36640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:29.698 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.688+0000 7f6cfcf36640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:29.698 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.688+0000 7f6cfcf36640 10 monclient: dump: 2026-02-24T19:24:29.698 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:29.698 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:29.698 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.698 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.698 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:29.698 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:29.698 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:29.698 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:29.698 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:29.698 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.688+0000 7f6d001c3640 5 monclient: authenticate success, global_id 30047 2026-02-24T19:24:29.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.688+0000 7f6d001c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:29.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.689+0000 7f6cfcf36640 1 -- 10.20.193.26:0/46071488 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6ce8002fc0 con 0x7f6cf815e2a0 2026-02-24T19:24:29.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.689+0000 7f6cfcf36640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:29.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.689+0000 7f6cfcf36640 1 -- 10.20.193.26:0/46071488 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6ce8003400 con 0x7f6cf815e2a0 2026-02-24T19:24:29.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.689+0000 7f6cfcf36640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:29.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.689+0000 7f6cfcf36640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:29.699 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.689+0000 7f6cfcf36640 10 monclient: dump: 2026-02-24T19:24:29.699 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:29.699 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:29.699 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.699 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.699 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:29.700 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:29.700 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:29.700 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:29.700 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:29.700 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.689+0000 7f6d001c3640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:29.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.689+0000 7f6d001c3640 4 set_mon_vals no callback set 2026-02-24T19:24:29.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.689+0000 7f6d001c3640 10 monclient: shutdown 2026-02-24T19:24:29.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.689+0000 7f6d001c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:29.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.689+0000 7f6d001c3640 1 -- 10.20.193.26:0/46071488 >> v1:10.20.193.103:6789/0 conn(0x7f6cf815e2a0 legacy=0x7f6cf805da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.689+0000 7f6d001c3640 1 -- 10.20.193.26:0/46071488 shutdown_connections 2026-02-24T19:24:29.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.689+0000 7f6d001c3640 1 -- 10.20.193.26:0/46071488 >> 10.20.193.26:0/46071488 conn(0x7f6cf80b2f60 msgr2=0x7f6cf80b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:29.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.689+0000 7f6d001c3640 1 -- 10.20.193.26:0/46071488 shutdown_connections 2026-02-24T19:24:29.701 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.689+0000 7f6d001c3640 1 -- 10.20.193.26:0/46071488 wait complete. 2026-02-24T19:24:29.701 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.689+0000 7f6d001c3640 10 monclient: build_initial_monmap 2026-02-24T19:24:29.701 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.689+0000 7f6d001c3640 10 monclient: monmap: 2026-02-24T19:24:29.701 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:29.701 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:29.701 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:29.701 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:29.701 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:29.701 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:29.701 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:29.701 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:29.701 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:29.701 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.702 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.690+0000 7f6d001c3640 1 librados: starting msgr at 2026-02-24T19:24:29.702 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.690+0000 7f6d001c3640 1 librados: starting objecter 2026-02-24T19:24:29.702 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.690+0000 7f6d001c3640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:29.702 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.690+0000 7f6d001c3640 1 Processor -- start 2026-02-24T19:24:29.702 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.690+0000 7f6d001c3640 1 -- start start 2026-02-24T19:24:29.702 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.690+0000 7f6d001c3640 1 librados: setting wanted keys 2026-02-24T19:24:29.702 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.690+0000 7f6d001c3640 1 librados: calling monclient init 2026-02-24T19:24:29.702 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.690+0000 7f6d001c3640 10 monclient: init 2026-02-24T19:24:29.702 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.690+0000 7f6d001c3640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:29.702 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.690+0000 7f6d001c3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:29.702 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.690+0000 7f6d001c3640 10 monclient(hunting): picked mon.noname-a con 0x7f6cf8059e10 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:29.702 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.690+0000 7f6d001c3640 10 monclient(hunting): picked mon.noname-c con 0x7f6cf815e2a0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:29.702 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.690+0000 7f6d001c3640 10 monclient(hunting): picked mon.noname-b con 0x7f6cf81a5660 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:29.703 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.690+0000 7f6d001c3640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cf80b3cb0 con 0x7f6cf8059e10 2026-02-24T19:24:29.703 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.690+0000 7f6d001c3640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cf812e060 con 0x7f6cf81a5660 2026-02-24T19:24:29.703 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.690+0000 7f6d001c3640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cf8129f50 con 0x7f6cf815e2a0 2026-02-24T19:24:29.703 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.690+0000 7f6d001c3640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:29.703 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.690+0000 7f6d001c3640 10 monclient(hunting): authenticate will time out at 4052.372609s 2026-02-24T19:24:29.703 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.690+0000 7f6cfdf38640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f6cf8059e10 0x7f6cf80b35a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59556/0 (socket says 10.20.193.26:59556) 2026-02-24T19:24:29.703 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.690+0000 7f6cfdf38640 1 -- 10.20.193.26:0/2148799368 learned_addr learned my addr 10.20.193.26:0/2148799368 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:29.703 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.691+0000 7f6ce67fc640 10 client.?.objecter ms_handle_connect 0x7f6cf8059e10 2026-02-24T19:24:29.703 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.691+0000 7f6ce67fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:29.703 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.691+0000 7f6ce67fc640 10 client.?.objecter ms_handle_connect 0x7f6cf81a5660 2026-02-24T19:24:29.703 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.691+0000 7f6ce67fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:29.703 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.691+0000 7f6ce67fc640 10 client.?.objecter ms_handle_connect 0x7f6cf815e2a0 2026-02-24T19:24:29.703 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.691+0000 7f6ce67fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:29.704 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.691+0000 7f6ce67fc640 1 -- 10.20.193.26:0/2148799368 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2467994541 0 0) 0x7f6cf80b3cb0 con 0x7f6cf8059e10 2026-02-24T19:24:29.704 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.691+0000 7f6ce67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:29.704 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.691+0000 7f6ce67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:29.704 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.691+0000 7f6ce67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:29.704 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.691+0000 7f6ce67fc640 10 monclient(hunting): my global_id is 30711 2026-02-24T19:24:29.704 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.691+0000 7f6ce67fc640 1 -- 10.20.193.26:0/2148799368 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cc8003610 con 0x7f6cf8059e10 2026-02-24T19:24:29.704 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.692+0000 7f6ce67fc640 1 -- 10.20.193.26:0/2148799368 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1534126479 0 0) 0x7f6cf812e060 con 0x7f6cf81a5660 2026-02-24T19:24:29.704 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.692+0000 7f6ce67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:29.704 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.692+0000 7f6ce67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:29.704 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.692+0000 7f6ce67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:29.704 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.692+0000 7f6ce67fc640 10 monclient(hunting): my global_id is 28126 2026-02-24T19:24:29.704 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.692+0000 7f6ce67fc640 1 -- 10.20.193.26:0/2148799368 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cf80b3cb0 con 0x7f6cf81a5660 2026-02-24T19:24:29.704 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.692+0000 7f6ce67fc640 1 -- 10.20.193.26:0/2148799368 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2244276309 0 0) 0x7f6cf8129f50 con 0x7f6cf815e2a0 2026-02-24T19:24:29.705 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.692+0000 7f6ce67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:29.705 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.692+0000 7f6ce67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:29.705 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.692+0000 7f6ce67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:29.705 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.692+0000 7f6ce67fc640 10 monclient(hunting): my global_id is 30050 2026-02-24T19:24:29.705 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.692+0000 7f6ce67fc640 1 -- 10.20.193.26:0/2148799368 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cf812e060 con 0x7f6cf815e2a0 2026-02-24T19:24:29.705 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.694+0000 7f6ce67fc640 1 -- 10.20.193.26:0/2148799368 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3526931661 0 0) 0x7f6cc8003610 con 0x7f6cf8059e10 2026-02-24T19:24:29.705 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.694+0000 7f6ce67fc640 1 -- 10.20.193.26:0/2148799368 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6cf8129f50 con 0x7f6cf8059e10 2026-02-24T19:24:29.705 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.694+0000 7f6ce67fc640 1 -- 10.20.193.26:0/2148799368 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6ce80033f0 con 0x7f6cf8059e10 2026-02-24T19:24:29.705 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.694+0000 7f6ce67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:29.705 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.694+0000 7f6ce67fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:29.705 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.694+0000 7f6ce67fc640 10 monclient(hunting): dump: 2026-02-24T19:24:29.705 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:29.705 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:29.706 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.706 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.706 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:29.706 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:29.706 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:29.706 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:29.706 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:29.706 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.706 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.694+0000 7f6ce67fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:29.706 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.694+0000 7f6ce67fc640 1 -- 10.20.193.26:0/2148799368 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2564047364 0 0) 0x7f6cf812e060 con 0x7f6cf815e2a0 2026-02-24T19:24:29.706 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.694+0000 7f6ce67fc640 1 -- 10.20.193.26:0/2148799368 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6cc8003610 con 0x7f6cf815e2a0 2026-02-24T19:24:29.706 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.694+0000 7f6ce67fc640 1 -- 10.20.193.26:0/2148799368 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6cec002ff0 con 0x7f6cf815e2a0 2026-02-24T19:24:29.706 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.694+0000 7f6ce67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:29.707 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.694+0000 7f6ce67fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:29.707 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.694+0000 7f6ce67fc640 10 monclient(hunting): dump: 2026-02-24T19:24:29.707 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:29.707 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:29.707 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.707 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.707 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:29.707 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:29.707 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:29.707 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:29.707 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:29.707 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.707 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.694+0000 7f6ce67fc640 1 -- 10.20.193.26:0/2148799368 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3691735410 0 0) 0x7f6cf80b3cb0 con 0x7f6cf81a5660 2026-02-24T19:24:29.708 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.694+0000 7f6ce67fc640 1 -- 10.20.193.26:0/2148799368 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6cf812e060 con 0x7f6cf81a5660 2026-02-24T19:24:29.708 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.694+0000 7f6ce67fc640 1 -- 10.20.193.26:0/2148799368 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6cf4003410 con 0x7f6cf81a5660 2026-02-24T19:24:29.708 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.694+0000 7f6ce67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:29.708 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.694+0000 7f6ce67fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:29.708 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.694+0000 7f6ce67fc640 10 monclient(hunting): dump: 2026-02-24T19:24:29.708 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:29.708 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:29.708 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.708 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.708 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:29.708 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:29.708 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:29.708 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:29.709 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:29.709 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.712 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.696+0000 7f6ce67fc640 1 -- 10.20.193.26:0/2148799368 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3823776897 0 0) 0x7f6cf8129f50 con 0x7f6cf8059e10 2026-02-24T19:24:29.712 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.696+0000 7f6ce67fc640 1 -- 10.20.193.26:0/2148799368 >> v1:10.20.193.103:6789/0 conn(0x7f6cf815e2a0 legacy=0x7f6cf80a8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.712 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.696+0000 7f6ce67fc640 1 -- 10.20.193.26:0/2148799368 >> v1:10.20.193.70:6789/0 conn(0x7f6cf81a5660 legacy=0x7f6cf805cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.712 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.696+0000 7f6ce67fc640 10 monclient: _finish_hunting 0 2026-02-24T19:24:29.712 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.696+0000 7f6ce67fc640 1 monclient: found mon.a 2026-02-24T19:24:29.712 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.696+0000 7f6ce67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:29.712 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.696+0000 7f6ce67fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:29.712 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.696+0000 7f6ce67fc640 1 -- 10.20.193.26:0/2148799368 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf812a230 con 0x7f6cf8059e10 2026-02-24T19:24:29.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.696+0000 7f6ce67fc640 10 monclient: _finish_auth 0 2026-02-24T19:24:29.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.696+0000 7f6ce67fc640 10 monclient: _check_auth_tickets 2026-02-24T19:24:29.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.696+0000 7f6ce67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:29.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.696+0000 7f6d001c3640 5 monclient: authenticate success, global_id 30711 2026-02-24T19:24:29.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.696+0000 7f6d001c3640 10 monclient: _renew_subs 2026-02-24T19:24:29.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.696+0000 7f6d001c3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:29.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.696+0000 7f6d001c3640 1 -- 10.20.193.26:0/2148799368 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf812a510 con 0x7f6cf8059e10 2026-02-24T19:24:29.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.696+0000 7f6d001c3640 10 client.30711.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:29.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.696+0000 7f6d001c3640 10 monclient: _renew_subs 2026-02-24T19:24:29.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.696+0000 7f6d001c3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:29.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.696+0000 7f6d001c3640 1 -- 10.20.193.26:0/2148799368 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6cf805d4d0 con 0x7f6cf8059e10 2026-02-24T19:24:29.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.696+0000 7f6d001c3640 1 librados: init done 2026-02-24T19:24:29.713 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.696+0000 7f6d001c3640 10 client.30711.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:29.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.696+0000 7f6d001c3640 15 client.30711.objecter _session_command_op_assign -1 1 2026-02-24T19:24:29.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.696+0000 7f6d001c3640 20 client.30711.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:29.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.696+0000 7f6d001c3640 10 client.30711.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:29.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.696+0000 7f6d001c3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:29.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.696+0000 7f6d001c3640 1 -- 10.20.193.26:0/2148799368 --> v1:10.20.193.26:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f6cf80b05f0 con 0x7f6cf8059e10 2026-02-24T19:24:29.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.704+0000 7f6ce67fc640 1 -- 10.20.193.26:0/2148799368 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6ce8002f30 con 0x7f6cf8059e10 2026-02-24T19:24:29.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.704+0000 7f6ce67fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:29.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.704+0000 7f6ce67fc640 1 -- 10.20.193.26:0/2148799368 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6ce8004d20 con 0x7f6cf8059e10 2026-02-24T19:24:29.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.704+0000 7f6ce67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:29.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.704+0000 7f6ce67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:29.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.704+0000 7f6ce7fff640 4 set_mon_vals no callback set 2026-02-24T19:24:29.714 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.704+0000 7f6ce67fc640 10 monclient: dump: 2026-02-24T19:24:29.714 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:29.715 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:29.715 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.715 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.715 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:29.715 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:29.715 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:29.715 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:29.715 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:29.715 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.715 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.705+0000 7f6ce67fc640 1 -- 10.20.193.26:0/2148799368 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f6ce801db90 con 0x7f6cf8059e10 2026-02-24T19:24:29.715 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.706+0000 7f6cfd737640 10 monclient: get_auth_request con 0x7f6cc8077e00 auth_method 0 2026-02-24T19:24:29.715 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.706+0000 7f6ce67fc640 10 client.30711.objecter ms_handle_connect 0x7f6cc8077e00 2026-02-24T19:24:29.715 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.706+0000 7f6ce67fc640 1 -- 10.20.193.26:0/2148799368 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7f6ce8093170 con 0x7f6cf8059e10 2026-02-24T19:24:29.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.706+0000 7f6ce67fc640 10 client.30711.objecter ms_dispatch2 0x7f6cf8000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:29.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.706+0000 7f6ce67fc640 3 client.30711.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:29.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.706+0000 7f6ce67fc640 3 client.30711.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:29.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.706+0000 7f6ce67fc640 10 client.30711.objecter checking command 1 2026-02-24T19:24:29.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.706+0000 7f6ce67fc640 20 client.30711.objecter _get_session s=0x7f6cc80a2160 osd=13 3 2026-02-24T19:24:29.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.706+0000 7f6ce67fc640 20 client.30711.objecter put_session s=0x7f6cc80a2160 osd=13 3 2026-02-24T19:24:29.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.706+0000 7f6ce67fc640 15 client.30711.objecter _session_command_op_remove -1 1 2026-02-24T19:24:29.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.706+0000 7f6ce67fc640 20 client.30711.objecter _get_session s=0x7f6cc80a2160 osd=13 3 2026-02-24T19:24:29.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.706+0000 7f6ce67fc640 20 client.30711.objecter get_session s=0x7f6cc80a2160 osd=13 3 2026-02-24T19:24:29.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.706+0000 7f6ce67fc640 15 client.30711.objecter _session_command_op_assign 13 1 2026-02-24T19:24:29.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.706+0000 7f6ce67fc640 20 client.30711.objecter put_session s=0x7f6cc80a2160 osd=13 4 2026-02-24T19:24:29.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.706+0000 7f6ce67fc640 10 client.30711.objecter _send_command 1 2026-02-24T19:24:29.716 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.706+0000 7f6ce67fc640 1 -- 10.20.193.26:0/2148799368 --> v1:10.20.193.70:6808/2949423039 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6cc80c4510 con 0x7f6cc80a2810 2026-02-24T19:24:29.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.706+0000 7f6ce67fc640 20 client.30711.objecter dump_active .. 0 homeless 2026-02-24T19:24:29.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.706+0000 7f6ce67fc640 1 -- 10.20.193.26:0/2148799368 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_get_version_reply(handle=1 version=346) ==== 24+0+0 (unknown 2991753921 0 0) 0x7f6ce8059810 con 0x7f6cf8059e10 2026-02-24T19:24:29.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.706+0000 7f6ce67fc640 10 monclient: handle_get_version_reply finishing 1 version 346 2026-02-24T19:24:29.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.707+0000 7f6cfe739640 10 monclient: get_auth_request con 0x7f6cc80a2810 auth_method 0 2026-02-24T19:24:29.717 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.708+0000 7f6ce67fc640 10 client.30711.objecter ms_handle_connect 0x7f6cc80a2810 2026-02-24T19:24:29.720 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.718+0000 7f6ce67fc640 1 -- 10.20.193.26:0/2148799368 <== osd.13 v1:10.20.193.70:6808/2949423039 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f6cc80c4510 con 0x7f6cc80a2810 2026-02-24T19:24:29.720 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.718+0000 7f6ce67fc640 10 client.30711.objecter ms_dispatch2 0x7f6cf8000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:29.720 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.718+0000 7f6ce67fc640 10 client.30711.objecter _finish_command 1 = system:0 2026-02-24T19:24:29.720 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.718+0000 7f6ce67fc640 20 client.30711.objecter put_session s=0x7f6cc80a2160 osd=13 4 2026-02-24T19:24:29.720 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.718+0000 7f6ce67fc640 15 client.30711.objecter _session_command_op_remove 13 1 2026-02-24T19:24:29.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.725+0000 7f6d001c3640 10 client.30711.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:29.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.725+0000 7f6d001c3640 15 client.30711.objecter _session_command_op_assign -1 2 2026-02-24T19:24:29.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.725+0000 7f6d001c3640 20 client.30711.objecter _get_session s=0x7f6cc80a2160 osd=13 3 2026-02-24T19:24:29.727 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.725+0000 7f6d001c3640 20 client.30711.objecter put_session s=0x7f6cc80a2160 osd=13 3 2026-02-24T19:24:29.728 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.725+0000 7f6d001c3640 20 client.30711.objecter _get_session s=0x7f6cc80a2160 osd=13 3 2026-02-24T19:24:29.728 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.725+0000 7f6d001c3640 15 client.30711.objecter _session_command_op_remove -1 2 2026-02-24T19:24:29.728 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.725+0000 7f6d001c3640 20 client.30711.objecter get_session s=0x7f6cc80a2160 osd=13 3 2026-02-24T19:24:29.728 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.725+0000 7f6d001c3640 15 client.30711.objecter _session_command_op_assign 13 2 2026-02-24T19:24:29.728 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.725+0000 7f6d001c3640 20 client.30711.objecter put_session s=0x7f6cc80a2160 osd=13 4 2026-02-24T19:24:29.728 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.725+0000 7f6d001c3640 10 client.30711.objecter _send_command 2 2026-02-24T19:24:29.728 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.725+0000 7f6d001c3640 1 -- 10.20.193.26:0/2148799368 --> v1:10.20.193.70:6808/2949423039 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6cf81608a0 con 0x7f6cc80a2810 2026-02-24T19:24:29.735 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.733+0000 7f6ce67fc640 1 -- 10.20.193.26:0/2148799368 <== osd.13 v1:10.20.193.70:6808/2949423039 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f6cf81608a0 con 0x7f6cc80a2810 2026-02-24T19:24:29.735 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.733+0000 7f6ce67fc640 10 client.30711.objecter ms_dispatch2 0x7f6cf8000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:29.735 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.733+0000 7f6ce67fc640 10 client.30711.objecter _finish_command 2 = system:0 2026-02-24T19:24:29.735 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.733+0000 7f6ce67fc640 20 client.30711.objecter put_session s=0x7f6cc80a2160 osd=13 4 2026-02-24T19:24:29.735 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.733+0000 7f6ce67fc640 15 client.30711.objecter _session_command_op_remove 13 2 2026-02-24T19:24:29.736 INFO:teuthology.orchestra.run.trial026.stdout:{ 2026-02-24T19:24:29.736 INFO:teuthology.orchestra.run.trial026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:29.736 INFO:teuthology.orchestra.run.trial026.stdout:} 2026-02-24T19:24:29.737 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.734+0000 7f6d001c3640 10 librados: watch_flush enter 2026-02-24T19:24:29.737 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.734+0000 7f6d001c3640 10 librados: watch_flush exit 2026-02-24T19:24:29.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.734+0000 7f6d001c3640 10 client.30711.objecter close_session for osd.13 2026-02-24T19:24:29.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.734+0000 7f6d001c3640 1 -- 10.20.193.26:0/2148799368 >> v1:10.20.193.70:6808/2949423039 conn(0x7f6cc80a2810 legacy=0x7f6cc80c2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.734+0000 7f6d001c3640 20 client.30711.objecter put_session s=0x7f6cc80a2160 osd=13 1 2026-02-24T19:24:29.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.734+0000 7f6d001c3640 20 client.30711.objecter shutdown clearing up homeless session... 2026-02-24T19:24:29.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.734+0000 7f6d001c3640 10 client.30711.objecter successfully canceled tick 2026-02-24T19:24:29.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.734+0000 7f6d001c3640 1 -- 10.20.193.26:0/2148799368 >> v1:10.20.193.162:6800/3889602630 conn(0x7f6cc8077e00 legacy=0x7f6cc80982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.734+0000 7f6d001c3640 10 monclient: shutdown 2026-02-24T19:24:29.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.734+0000 7f6d001c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:29.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.734+0000 7f6d001c3640 1 -- 10.20.193.26:0/2148799368 >> v1:10.20.193.26:6789/0 conn(0x7f6cf8059e10 legacy=0x7f6cf80b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.734+0000 7f6cfe739640 1 -- 10.20.193.26:0/2148799368 reap_dead start 2026-02-24T19:24:29.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.734+0000 7f6d001c3640 1 -- 10.20.193.26:0/2148799368 shutdown_connections 2026-02-24T19:24:29.738 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.734+0000 7f6d001c3640 1 -- 10.20.193.26:0/2148799368 >> 10.20.193.26:0/2148799368 conn(0x7f6cf80b2f60 msgr2=0x7f6cf815c460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:29.739 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.734+0000 7f6d001c3640 1 -- 10.20.193.26:0/2148799368 shutdown_connections 2026-02-24T19:24:29.739 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.734+0000 7f6d001c3640 1 -- 10.20.193.26:0/2148799368 wait complete. 2026-02-24T19:24:29.739 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.734+0000 7f6d001c3640 1 librados: shutdown 2026-02-24T19:24:29.743 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 13 2026-02-24T19:24:29.812 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.811+0000 7fa684533640 10 monclient: get_monmap_and_config 2026-02-24T19:24:29.813 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.811+0000 7fa684533640 10 monclient: build_initial_monmap 2026-02-24T19:24:29.813 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.811+0000 7fa684533640 10 monclient: monmap: 2026-02-24T19:24:29.813 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:29.813 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:29.813 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:29.812205+0000 2026-02-24T19:24:29.813 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:29.812205+0000 2026-02-24T19:24:29.813 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:29.813 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:29.813 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:29.814 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:29.814 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:29.814 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.816 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.811+0000 7fa684533640 1 Processor -- start 2026-02-24T19:24:29.816 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.811+0000 7fa684533640 1 -- start start 2026-02-24T19:24:29.816 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.811+0000 7fa684533640 10 monclient: init 2026-02-24T19:24:29.816 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.812+0000 7fa684533640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:29.816 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.812+0000 7fa684533640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:29.816 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.812+0000 7fa684533640 10 monclient(hunting): picked mon.noname-c con 0x7fa67c157780 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:29.816 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.812+0000 7fa684533640 10 monclient(hunting): picked mon.noname-b con 0x7fa67c157b50 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:29.816 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.812+0000 7fa684533640 10 monclient(hunting): picked mon.noname-a con 0x7fa67c164d00 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:29.816 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.812+0000 7fa684533640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67c05de70 con 0x7fa67c164d00 2026-02-24T19:24:29.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.812+0000 7fa684533640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67c055b20 con 0x7fa67c157b50 2026-02-24T19:24:29.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.812+0000 7fa684533640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67c055e00 con 0x7fa67c157780 2026-02-24T19:24:29.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.812+0000 7fa684533640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:29.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.812+0000 7fa684533640 10 monclient(hunting): authenticate will time out at 4052.494408s 2026-02-24T19:24:29.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.812+0000 7fa6822a8640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fa67c157780 0x7fa67c056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58488/0 (socket says 10.20.193.26:58488) 2026-02-24T19:24:29.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.812+0000 7fa6822a8640 1 -- 10.20.193.26:0/170170361 learned_addr learned my addr 10.20.193.26:0/170170361 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:29.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.814+0000 7fa6812a6640 1 -- 10.20.193.26:0/170170361 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2195327485 0 0) 0x7fa67c055e00 con 0x7fa67c157780 2026-02-24T19:24:29.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.814+0000 7fa6812a6640 10 monclient(hunting): _negotiate 2026-02-24T19:24:29.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.814+0000 7fa6812a6640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:29.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.814+0000 7fa6812a6640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:29.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.814+0000 7fa6812a6640 10 monclient(hunting): my global_id is 30053 2026-02-24T19:24:29.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.814+0000 7fa6812a6640 1 -- 10.20.193.26:0/170170361 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa664003610 con 0x7fa67c157780 2026-02-24T19:24:29.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.814+0000 7fa6812a6640 1 -- 10.20.193.26:0/170170361 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1858897919 0 0) 0x7fa67c05de70 con 0x7fa67c164d00 2026-02-24T19:24:29.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.814+0000 7fa6812a6640 10 monclient(hunting): _negotiate 2026-02-24T19:24:29.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.814+0000 7fa6812a6640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:29.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.814+0000 7fa6812a6640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:29.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.814+0000 7fa6812a6640 10 monclient(hunting): my global_id is 30714 2026-02-24T19:24:29.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.814+0000 7fa6812a6640 1 -- 10.20.193.26:0/170170361 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa67c055e00 con 0x7fa67c164d00 2026-02-24T19:24:29.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.814+0000 7fa6812a6640 1 -- 10.20.193.26:0/170170361 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 474081475 0 0) 0x7fa67c055b20 con 0x7fa67c157b50 2026-02-24T19:24:29.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.814+0000 7fa6812a6640 10 monclient(hunting): _negotiate 2026-02-24T19:24:29.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.814+0000 7fa6812a6640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:29.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.814+0000 7fa6812a6640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:29.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.814+0000 7fa6812a6640 10 monclient(hunting): my global_id is 28129 2026-02-24T19:24:29.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.814+0000 7fa6812a6640 1 -- 10.20.193.26:0/170170361 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa67c05de70 con 0x7fa67c157b50 2026-02-24T19:24:29.823 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.815+0000 7fa6812a6640 1 -- 10.20.193.26:0/170170361 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1205926076 0 0) 0x7fa664003610 con 0x7fa67c157780 2026-02-24T19:24:29.823 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.815+0000 7fa6812a6640 1 -- 10.20.193.26:0/170170361 >> v1:10.20.193.70:6789/0 conn(0x7fa67c157b50 legacy=0x7fa67c1645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.823 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.815+0000 7fa6812a6640 1 -- 10.20.193.26:0/170170361 >> v1:10.20.193.26:6789/0 conn(0x7fa67c164d00 legacy=0x7fa67c1c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.823 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.815+0000 7fa6812a6640 10 monclient: _finish_hunting 0 2026-02-24T19:24:29.823 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.815+0000 7fa6812a6640 1 monclient: found mon.noname-c 2026-02-24T19:24:29.823 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.815+0000 7fa6812a6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:29.823 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.815+0000 7fa6812a6640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:24:29.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.815+0000 7fa6812a6640 1 -- 10.20.193.26:0/170170361 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67c0560e0 con 0x7fa67c157780 2026-02-24T19:24:29.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.815+0000 7fa6812a6640 10 monclient: _finish_auth 0 2026-02-24T19:24:29.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.815+0000 7fa6812a6640 10 monclient: _check_auth_tickets 2026-02-24T19:24:29.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.815+0000 7fa6812a6640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:29.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.815+0000 7fa6812a6640 1 -- 10.20.193.26:0/170170361 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa66c002df0 con 0x7fa67c157780 2026-02-24T19:24:29.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.815+0000 7fa6812a6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:29.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.815+0000 7fa6812a6640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:29.824 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.815+0000 7fa6812a6640 10 monclient: dump: 2026-02-24T19:24:29.824 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:29.824 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:29.824 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.824 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.824 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:29.825 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:29.825 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:29.825 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:29.825 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:29.825 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.815+0000 7fa684533640 5 monclient: authenticate success, global_id 30053 2026-02-24T19:24:29.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.815+0000 7fa684533640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:29.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.816+0000 7fa6812a6640 1 -- 10.20.193.26:0/170170361 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa66c002fc0 con 0x7fa67c157780 2026-02-24T19:24:29.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.816+0000 7fa6812a6640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:29.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.816+0000 7fa6812a6640 1 -- 10.20.193.26:0/170170361 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa66c003400 con 0x7fa67c157780 2026-02-24T19:24:29.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.816+0000 7fa684533640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:29.825 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.816+0000 7fa684533640 4 set_mon_vals no callback set 2026-02-24T19:24:29.826 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.816+0000 7fa6812a6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:29.826 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.816+0000 7fa6812a6640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:29.826 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.816+0000 7fa6812a6640 10 monclient: dump: 2026-02-24T19:24:29.826 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:29.826 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:29.826 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.826 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.826 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:29.826 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:29.826 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:29.826 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:29.826 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:29.826 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.816+0000 7fa684533640 10 monclient: shutdown 2026-02-24T19:24:29.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.816+0000 7fa684533640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:29.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.816+0000 7fa684533640 1 -- 10.20.193.26:0/170170361 >> v1:10.20.193.103:6789/0 conn(0x7fa67c157780 legacy=0x7fa67c056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.816+0000 7fa684533640 1 -- 10.20.193.26:0/170170361 shutdown_connections 2026-02-24T19:24:29.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.816+0000 7fa684533640 1 -- 10.20.193.26:0/170170361 >> 10.20.193.26:0/170170361 conn(0x7fa67c0b2ef0 msgr2=0x7fa67c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:29.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.816+0000 7fa684533640 1 -- 10.20.193.26:0/170170361 shutdown_connections 2026-02-24T19:24:29.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.816+0000 7fa684533640 1 -- 10.20.193.26:0/170170361 wait complete. 2026-02-24T19:24:29.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.817+0000 7fa684533640 10 monclient: build_initial_monmap 2026-02-24T19:24:29.827 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.817+0000 7fa684533640 10 monclient: monmap: 2026-02-24T19:24:29.827 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:29.827 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:29.827 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:29.827 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:29.828 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:29.828 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:29.828 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:29.828 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:29.828 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:29.828 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.828 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.817+0000 7fa684533640 1 librados: starting msgr at 2026-02-24T19:24:29.828 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.817+0000 7fa684533640 1 librados: starting objecter 2026-02-24T19:24:29.828 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.817+0000 7fa684533640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:29.828 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.817+0000 7fa684533640 1 Processor -- start 2026-02-24T19:24:29.828 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.817+0000 7fa684533640 1 -- start start 2026-02-24T19:24:29.828 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.817+0000 7fa684533640 1 librados: setting wanted keys 2026-02-24T19:24:29.828 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.817+0000 7fa684533640 1 librados: calling monclient init 2026-02-24T19:24:29.828 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.817+0000 7fa684533640 10 monclient: init 2026-02-24T19:24:29.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.818+0000 7fa684533640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:29.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.818+0000 7fa684533640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:24:29.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.818+0000 7fa684533640 10 monclient(hunting): picked mon.noname-b con 0x7fa67c157780 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:29.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.818+0000 7fa684533640 10 monclient(hunting): picked mon.noname-c con 0x7fa67c157b50 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:29.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.818+0000 7fa684533640 10 monclient(hunting): picked mon.noname-a con 0x7fa67c164d00 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:29.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.818+0000 7fa684533640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67c057ae0 con 0x7fa67c164d00 2026-02-24T19:24:29.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.818+0000 7fa684533640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67c1617a0 con 0x7fa67c157780 2026-02-24T19:24:29.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.818+0000 7fa684533640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67c0aef80 con 0x7fa67c157b50 2026-02-24T19:24:29.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.818+0000 7fa684533640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:29.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.818+0000 7fa684533640 10 monclient(hunting): authenticate will time out at 4052.500373s 2026-02-24T19:24:29.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.818+0000 7fa681aa7640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fa67c157b50 0x7fa67c161090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:58504/0 (socket says 10.20.193.26:58504) 2026-02-24T19:24:29.829 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.818+0000 7fa681aa7640 1 -- 10.20.193.26:0/4070333843 learned_addr learned my addr 10.20.193.26:0/4070333843 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:29.830 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.818+0000 7fa662ffd640 10 client.?.objecter ms_handle_connect 0x7fa67c157b50 2026-02-24T19:24:29.830 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.818+0000 7fa662ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:29.830 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.819+0000 7fa662ffd640 10 client.?.objecter ms_handle_connect 0x7fa67c157780 2026-02-24T19:24:29.830 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.819+0000 7fa662ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:29.830 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.819+0000 7fa662ffd640 1 -- 10.20.193.26:0/4070333843 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2588093443 0 0) 0x7fa67c0aef80 con 0x7fa67c157b50 2026-02-24T19:24:29.830 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.819+0000 7fa662ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:29.830 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.819+0000 7fa662ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:29.830 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.819+0000 7fa662ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:29.830 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.819+0000 7fa662ffd640 10 monclient(hunting): my global_id is 30056 2026-02-24T19:24:29.830 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.819+0000 7fa662ffd640 1 -- 10.20.193.26:0/4070333843 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa64c003610 con 0x7fa67c157b50 2026-02-24T19:24:29.830 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.820+0000 7fa662ffd640 1 -- 10.20.193.26:0/4070333843 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 989609225 0 0) 0x7fa67c1617a0 con 0x7fa67c157780 2026-02-24T19:24:29.830 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.820+0000 7fa662ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:29.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.820+0000 7fa662ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:29.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.820+0000 7fa662ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:29.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.820+0000 7fa662ffd640 10 monclient(hunting): my global_id is 28132 2026-02-24T19:24:29.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.820+0000 7fa662ffd640 1 -- 10.20.193.26:0/4070333843 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa67c0aef80 con 0x7fa67c157780 2026-02-24T19:24:29.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.820+0000 7fa662ffd640 10 client.?.objecter ms_handle_connect 0x7fa67c164d00 2026-02-24T19:24:29.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.820+0000 7fa662ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:29.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.821+0000 7fa662ffd640 1 -- 10.20.193.26:0/4070333843 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3810015739 0 0) 0x7fa67c057ae0 con 0x7fa67c164d00 2026-02-24T19:24:29.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.821+0000 7fa662ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:29.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.821+0000 7fa662ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:29.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.821+0000 7fa662ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:29.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.821+0000 7fa662ffd640 10 monclient(hunting): my global_id is 30717 2026-02-24T19:24:29.831 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.821+0000 7fa662ffd640 1 -- 10.20.193.26:0/4070333843 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa67c1617a0 con 0x7fa67c164d00 2026-02-24T19:24:29.834 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.822+0000 7fa662ffd640 1 -- 10.20.193.26:0/4070333843 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3981479232 0 0) 0x7fa64c003610 con 0x7fa67c157b50 2026-02-24T19:24:29.834 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.822+0000 7fa662ffd640 1 -- 10.20.193.26:0/4070333843 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa67c057ae0 con 0x7fa67c157b50 2026-02-24T19:24:29.834 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.822+0000 7fa662ffd640 1 -- 10.20.193.26:0/4070333843 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa670003170 con 0x7fa67c157b50 2026-02-24T19:24:29.834 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.822+0000 7fa662ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:29.834 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.822+0000 7fa662ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:29.834 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.822+0000 7fa662ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:29.835 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:29.835 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:29.835 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.835 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.835 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:29.835 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:29.835 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:29.835 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:29.835 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:29.835 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.835 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.822+0000 7fa662ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:29.835 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.822+0000 7fa662ffd640 1 -- 10.20.193.26:0/4070333843 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1112798093 0 0) 0x7fa67c0aef80 con 0x7fa67c157780 2026-02-24T19:24:29.836 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.822+0000 7fa662ffd640 1 -- 10.20.193.26:0/4070333843 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa64c003610 con 0x7fa67c157780 2026-02-24T19:24:29.836 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.822+0000 7fa662ffd640 1 -- 10.20.193.26:0/4070333843 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa66c003310 con 0x7fa67c157780 2026-02-24T19:24:29.836 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.822+0000 7fa662ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:29.836 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.822+0000 7fa662ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:29.836 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.822+0000 7fa662ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:29.836 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:29.836 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:29.836 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.836 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.836 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:29.836 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:29.836 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:29.836 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:29.837 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:29.837 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.837 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.824+0000 7fa662ffd640 1 -- 10.20.193.26:0/4070333843 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2778533606 0 0) 0x7fa67c057ae0 con 0x7fa67c157b50 2026-02-24T19:24:29.837 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.824+0000 7fa662ffd640 1 -- 10.20.193.26:0/4070333843 >> v1:10.20.193.70:6789/0 conn(0x7fa67c157780 legacy=0x7fa67c0b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.837 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.824+0000 7fa662ffd640 1 -- 10.20.193.26:0/4070333843 >> v1:10.20.193.26:6789/0 conn(0x7fa67c164d00 legacy=0x7fa67c147a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:29.837 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.824+0000 7fa662ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:29.837 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.824+0000 7fa662ffd640 1 monclient: found mon.c 2026-02-24T19:24:29.837 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.824+0000 7fa662ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:29.837 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.824+0000 7fa662ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:29.837 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.824+0000 7fa662ffd640 1 -- 10.20.193.26:0/4070333843 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67c0af260 con 0x7fa67c157b50 2026-02-24T19:24:29.837 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.824+0000 7fa662ffd640 10 monclient: _finish_auth 0 2026-02-24T19:24:29.837 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.824+0000 7fa662ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:29.837 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.824+0000 7fa662ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:29.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.824+0000 7fa684533640 5 monclient: authenticate success, global_id 30056 2026-02-24T19:24:29.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.824+0000 7fa684533640 10 monclient: _renew_subs 2026-02-24T19:24:29.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.824+0000 7fa684533640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:29.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.824+0000 7fa684533640 1 -- 10.20.193.26:0/4070333843 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa67c0af540 con 0x7fa67c157b50 2026-02-24T19:24:29.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.824+0000 7fa684533640 10 client.30056.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:29.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.824+0000 7fa684533640 10 monclient: _renew_subs 2026-02-24T19:24:29.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.824+0000 7fa684533640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:29.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.824+0000 7fa684533640 1 -- 10.20.193.26:0/4070333843 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa67c0afb00 con 0x7fa67c157b50 2026-02-24T19:24:29.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.824+0000 7fa684533640 1 librados: init done 2026-02-24T19:24:29.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.824+0000 7fa684533640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:29.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.824+0000 7fa684533640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:29.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.824+0000 7fa684533640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:29.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.824+0000 7fa684533640 1 -- 10.20.193.26:0/4070333843 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa67c05db90 con 0x7fa67c157b50 2026-02-24T19:24:29.838 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.831+0000 7fa662ffd640 1 -- 10.20.193.26:0/4070333843 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa670003520 con 0x7fa67c157b50 2026-02-24T19:24:29.839 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.831+0000 7fa662ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:29.839 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.831+0000 7fa662ffd640 1 -- 10.20.193.26:0/4070333843 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa670003b50 con 0x7fa67c157b50 2026-02-24T19:24:29.839 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.831+0000 7fa662ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:29.839 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.831+0000 7fa662ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:29.839 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.831+0000 7fa680aa5640 4 set_mon_vals no callback set 2026-02-24T19:24:29.839 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.831+0000 7fa662ffd640 10 monclient: dump: 2026-02-24T19:24:29.839 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:29.839 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:29.839 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.839 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:29.839 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:29.839 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:29.839 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:29.840 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:29.840 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:29.840 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:29.840 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.832+0000 7fa662ffd640 1 -- 10.20.193.26:0/4070333843 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fa670003d30 con 0x7fa67c157b50 2026-02-24T19:24:29.840 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.832+0000 7fa6822a8640 10 monclient: get_auth_request con 0x7fa64c077ad0 auth_method 0 2026-02-24T19:24:29.840 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.833+0000 7fa662ffd640 1 -- 10.20.193.26:0/4070333843 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7fa670059470 con 0x7fa67c157b50 2026-02-24T19:24:29.840 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.833+0000 7fa662ffd640 10 client.30056.objecter ms_dispatch2 0x7fa67c000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:29.840 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.833+0000 7fa662ffd640 3 client.30056.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:29.840 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.833+0000 7fa662ffd640 3 client.30056.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:29.840 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.833+0000 7fa662ffd640 20 client.30056.objecter dump_active .. 0 homeless 2026-02-24T19:24:29.840 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.833+0000 7fa662ffd640 10 client.30056.objecter ms_handle_connect 0x7fa64c077ad0 2026-02-24T19:24:29.918 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.917+0000 7fa662ffd640 1 -- 10.20.193.26:0/4070333843 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fa6700cc8b0 con 0x7fa67c157b50 2026-02-24T19:24:29.918 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.917+0000 7fa662ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:29.918 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:29.917+0000 7fa662ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:30.024 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.022+0000 7fa684533640 1 -- 10.20.193.26:0/4070333843 --> v1:10.20.193.162:6800/3889602630 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "13", "target": ["mon-mgr", ""]}) -- 0x7fa67c165740 con 0x7fa64c077ad0 2026-02-24T19:24:30.024 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.023+0000 7fa662ffd640 1 -- 10.20.193.26:0/4070333843 <== mgr.4107 v1:10.20.193.162:6800/3889602630 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 13 to deep-scrub) ==== 42+0+0 (unknown 1087616222 0 0) 0x7fa67c165740 con 0x7fa64c077ad0 2026-02-24T19:24:30.025 INFO:teuthology.orchestra.run.trial026.stderr:instructed osd(s) 13 to deep-scrub 2026-02-24T19:24:30.026 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.024+0000 7fa684533640 10 librados: watch_flush enter 2026-02-24T19:24:30.026 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.024+0000 7fa684533640 10 librados: watch_flush exit 2026-02-24T19:24:30.026 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.024+0000 7fa684533640 20 client.30056.objecter shutdown clearing up homeless session... 2026-02-24T19:24:30.026 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.024+0000 7fa684533640 10 client.30056.objecter successfully canceled tick 2026-02-24T19:24:30.026 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.024+0000 7fa684533640 1 -- 10.20.193.26:0/4070333843 >> v1:10.20.193.162:6800/3889602630 conn(0x7fa64c077ad0 legacy=0x7fa64c097f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.026 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.024+0000 7fa684533640 10 monclient: shutdown 2026-02-24T19:24:30.026 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.024+0000 7fa684533640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:30.027 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.024+0000 7fa684533640 1 -- 10.20.193.26:0/4070333843 >> v1:10.20.193.103:6789/0 conn(0x7fa67c157b50 legacy=0x7fa67c161090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.027 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.024+0000 7fa684533640 1 -- 10.20.193.26:0/4070333843 shutdown_connections 2026-02-24T19:24:30.027 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.024+0000 7fa684533640 1 -- 10.20.193.26:0/4070333843 >> 10.20.193.26:0/4070333843 conn(0x7fa67c0b2ef0 msgr2=0x7fa67c13bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:30.027 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.024+0000 7fa684533640 1 -- 10.20.193.26:0/4070333843 shutdown_connections 2026-02-24T19:24:30.027 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.024+0000 7fa684533640 1 -- 10.20.193.26:0/4070333843 wait complete. 2026-02-24T19:24:30.027 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.024+0000 7fa684533640 1 librados: shutdown 2026-02-24T19:24:30.034 INFO:tasks.ceph:Scrubbing osd.2 2026-02-24T19:24:30.034 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:30.102 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.101+0000 7f8a5564d640 10 monclient: get_monmap_and_config 2026-02-24T19:24:30.103 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.101+0000 7f8a5564d640 10 monclient: build_initial_monmap 2026-02-24T19:24:30.103 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.101+0000 7f8a5564d640 10 monclient: monmap: 2026-02-24T19:24:30.103 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:30.103 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.103 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:30.102107+0000 2026-02-24T19:24:30.103 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:30.102107+0000 2026-02-24T19:24:30.103 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:30.103 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.103 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:30.103 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:30.103 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:30.104 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.106 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.101+0000 7f8a5564d640 1 Processor -- start 2026-02-24T19:24:30.106 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.101+0000 7f8a5564d640 1 -- start start 2026-02-24T19:24:30.106 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.101+0000 7f8a5564d640 10 monclient: init 2026-02-24T19:24:30.106 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.102+0000 7f8a5564d640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:30.106 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.102+0000 7f8a5564d640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:24:30.106 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.102+0000 7f8a5564d640 10 monclient(hunting): picked mon.noname-b con 0x7f8a5015e2a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:30.106 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.102+0000 7f8a5564d640 10 monclient(hunting): picked mon.noname-a con 0x7f8a50059e10 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:30.106 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.102+0000 7f8a5564d640 10 monclient(hunting): picked mon.noname-c con 0x7f8a501a5660 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:30.107 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.102+0000 7f8a5564d640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a50162df0 con 0x7f8a50059e10 2026-02-24T19:24:30.107 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.102+0000 7f8a5564d640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a501630d0 con 0x7f8a5015e2a0 2026-02-24T19:24:30.107 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.102+0000 7f8a5564d640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a501633b0 con 0x7f8a501a5660 2026-02-24T19:24:30.107 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.102+0000 7f8a5564d640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:30.107 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.102+0000 7f8a5564d640 10 monclient(hunting): authenticate will time out at 4052.784346s 2026-02-24T19:24:30.107 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.102+0000 7f8a4e7fc640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f8a50059e10 0x7f8a5015ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:58888/0 (socket says 10.20.193.26:58888) 2026-02-24T19:24:30.107 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.102+0000 7f8a4e7fc640 1 -- 10.20.193.26:0/956237543 learned_addr learned my addr 10.20.193.26:0/956237543 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:30.107 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.103+0000 7f8a4dffb640 1 -- 10.20.193.26:0/956237543 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2285933879 0 0) 0x7f8a50162df0 con 0x7f8a50059e10 2026-02-24T19:24:30.107 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.103+0000 7f8a4dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.107 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.103+0000 7f8a4dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.107 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.103+0000 7f8a4dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.107 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.103+0000 7f8a4dffb640 10 monclient(hunting): my global_id is 30720 2026-02-24T19:24:30.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.103+0000 7f8a4dffb640 1 -- 10.20.193.26:0/956237543 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a3c003610 con 0x7f8a50059e10 2026-02-24T19:24:30.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.104+0000 7f8a4dffb640 1 -- 10.20.193.26:0/956237543 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1215744550 0 0) 0x7f8a501633b0 con 0x7f8a501a5660 2026-02-24T19:24:30.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.104+0000 7f8a4dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.104+0000 7f8a4dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.104+0000 7f8a4dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.104+0000 7f8a4dffb640 10 monclient(hunting): my global_id is 30059 2026-02-24T19:24:30.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.104+0000 7f8a4dffb640 1 -- 10.20.193.26:0/956237543 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a50162df0 con 0x7f8a501a5660 2026-02-24T19:24:30.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.104+0000 7f8a4dffb640 1 -- 10.20.193.26:0/956237543 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1001021991 0 0) 0x7f8a501630d0 con 0x7f8a5015e2a0 2026-02-24T19:24:30.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.104+0000 7f8a4dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.104+0000 7f8a4dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.104+0000 7f8a4dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.104+0000 7f8a4dffb640 10 monclient(hunting): my global_id is 28135 2026-02-24T19:24:30.108 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.104+0000 7f8a4dffb640 1 -- 10.20.193.26:0/956237543 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a501633b0 con 0x7f8a5015e2a0 2026-02-24T19:24:30.113 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.105+0000 7f8a4dffb640 1 -- 10.20.193.26:0/956237543 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1043867614 0 0) 0x7f8a3c003610 con 0x7f8a50059e10 2026-02-24T19:24:30.114 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.105+0000 7f8a4dffb640 1 -- 10.20.193.26:0/956237543 >> v1:10.20.193.103:6789/0 conn(0x7f8a501a5660 legacy=0x7f8a501c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.114 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.105+0000 7f8a4dffb640 1 -- 10.20.193.26:0/956237543 >> v1:10.20.193.70:6789/0 conn(0x7f8a5015e2a0 legacy=0x7f8a5005da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.114 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.105+0000 7f8a4dffb640 10 monclient: _finish_hunting 0 2026-02-24T19:24:30.114 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.105+0000 7f8a4dffb640 1 monclient: found mon.noname-a 2026-02-24T19:24:30.114 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.105+0000 7f8a4dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:30.114 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.105+0000 7f8a4dffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:24:30.114 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.105+0000 7f8a4dffb640 1 -- 10.20.193.26:0/956237543 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a50163690 con 0x7f8a50059e10 2026-02-24T19:24:30.114 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.105+0000 7f8a4dffb640 10 monclient: _finish_auth 0 2026-02-24T19:24:30.114 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.105+0000 7f8a4dffb640 10 monclient: _check_auth_tickets 2026-02-24T19:24:30.114 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.105+0000 7f8a4dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:30.114 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.105+0000 7f8a4dffb640 1 -- 10.20.193.26:0/956237543 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f8a38002df0 con 0x7f8a50059e10 2026-02-24T19:24:30.114 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.105+0000 7f8a4dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:30.115 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.105+0000 7f8a4dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:30.115 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.105+0000 7f8a4dffb640 10 monclient: dump: 2026-02-24T19:24:30.115 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.115 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.115 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.115 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.115 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.115 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.115 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.115 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.115 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.115 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.116 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.105+0000 7f8a5564d640 5 monclient: authenticate success, global_id 30720 2026-02-24T19:24:30.116 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.105+0000 7f8a5564d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:30.116 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.106+0000 7f8a4dffb640 1 -- 10.20.193.26:0/956237543 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8a38002fc0 con 0x7f8a50059e10 2026-02-24T19:24:30.116 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.106+0000 7f8a4dffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:30.116 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.106+0000 7f8a4dffb640 1 -- 10.20.193.26:0/956237543 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f8a38003400 con 0x7f8a50059e10 2026-02-24T19:24:30.116 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.106+0000 7f8a4dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:30.116 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.106+0000 7f8a4dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:30.116 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.106+0000 7f8a4dffb640 10 monclient: dump: 2026-02-24T19:24:30.116 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.116 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.116 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.116 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.116 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.117 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.117 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.117 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.117 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.117 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.106+0000 7f8a5564d640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:30.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.106+0000 7f8a5564d640 4 set_mon_vals no callback set 2026-02-24T19:24:30.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.106+0000 7f8a5564d640 10 monclient: shutdown 2026-02-24T19:24:30.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.106+0000 7f8a5564d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:30.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.106+0000 7f8a5564d640 1 -- 10.20.193.26:0/956237543 >> v1:10.20.193.26:6789/0 conn(0x7f8a50059e10 legacy=0x7f8a5015ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.106+0000 7f8a5564d640 1 -- 10.20.193.26:0/956237543 shutdown_connections 2026-02-24T19:24:30.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.106+0000 7f8a5564d640 1 -- 10.20.193.26:0/956237543 >> 10.20.193.26:0/956237543 conn(0x7f8a500b2f60 msgr2=0x7f8a500b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:30.117 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.106+0000 7f8a5564d640 1 -- 10.20.193.26:0/956237543 shutdown_connections 2026-02-24T19:24:30.118 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.106+0000 7f8a5564d640 1 -- 10.20.193.26:0/956237543 wait complete. 2026-02-24T19:24:30.118 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.107+0000 7f8a5564d640 10 monclient: build_initial_monmap 2026-02-24T19:24:30.118 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.107+0000 7f8a5564d640 10 monclient: monmap: 2026-02-24T19:24:30.118 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:30.118 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:30.118 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:30.118 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:30.118 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:30.118 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:30.118 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:30.118 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:30.118 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:30.118 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.119 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.107+0000 7f8a5564d640 1 librados: starting msgr at 2026-02-24T19:24:30.119 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.107+0000 7f8a5564d640 1 librados: starting objecter 2026-02-24T19:24:30.119 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.107+0000 7f8a5564d640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:30.119 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.107+0000 7f8a5564d640 1 Processor -- start 2026-02-24T19:24:30.119 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.107+0000 7f8a5564d640 1 -- start start 2026-02-24T19:24:30.119 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.107+0000 7f8a5564d640 1 librados: setting wanted keys 2026-02-24T19:24:30.119 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.107+0000 7f8a5564d640 1 librados: calling monclient init 2026-02-24T19:24:30.119 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.107+0000 7f8a5564d640 10 monclient: init 2026-02-24T19:24:30.119 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.108+0000 7f8a5564d640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:30.119 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.108+0000 7f8a5564d640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:30.119 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.108+0000 7f8a5564d640 10 monclient(hunting): picked mon.noname-c con 0x7f8a50059e10 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:30.119 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.108+0000 7f8a5564d640 10 monclient(hunting): picked mon.noname-b con 0x7f8a5015e2a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:30.119 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.108+0000 7f8a5564d640 10 monclient(hunting): picked mon.noname-a con 0x7f8a501a5660 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:30.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.108+0000 7f8a5564d640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a5012dd10 con 0x7f8a501a5660 2026-02-24T19:24:30.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.108+0000 7f8a5564d640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a5012dff0 con 0x7f8a5015e2a0 2026-02-24T19:24:30.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.108+0000 7f8a5564d640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a5012e2d0 con 0x7f8a50059e10 2026-02-24T19:24:30.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.108+0000 7f8a5564d640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:30.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.108+0000 7f8a5564d640 10 monclient(hunting): authenticate will time out at 4052.790247s 2026-02-24T19:24:30.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.108+0000 7f8a4effd640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f8a50059e10 0x7f8a50124480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:57074/0 (socket says 10.20.193.26:57074) 2026-02-24T19:24:30.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.108+0000 7f8a4effd640 1 -- 10.20.193.26:0/2662600567 learned_addr learned my addr 10.20.193.26:0/2662600567 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:30.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.108+0000 7f8a2f7fe640 10 client.?.objecter ms_handle_connect 0x7f8a50059e10 2026-02-24T19:24:30.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.108+0000 7f8a2f7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:30.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.108+0000 7f8a2f7fe640 10 client.?.objecter ms_handle_connect 0x7f8a501a5660 2026-02-24T19:24:30.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.108+0000 7f8a2f7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:30.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.108+0000 7f8a2f7fe640 10 client.?.objecter ms_handle_connect 0x7f8a5015e2a0 2026-02-24T19:24:30.120 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.108+0000 7f8a2f7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:30.121 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.109+0000 7f8a2f7fe640 1 -- 10.20.193.26:0/2662600567 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 673302787 0 0) 0x7f8a5012dd10 con 0x7f8a501a5660 2026-02-24T19:24:30.121 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.109+0000 7f8a2f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.121 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.109+0000 7f8a2f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.121 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.109+0000 7f8a2f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.121 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.109+0000 7f8a2f7fe640 10 monclient(hunting): my global_id is 30723 2026-02-24T19:24:30.121 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.109+0000 7f8a2f7fe640 1 -- 10.20.193.26:0/2662600567 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a1c003610 con 0x7f8a501a5660 2026-02-24T19:24:30.121 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.109+0000 7f8a2f7fe640 1 -- 10.20.193.26:0/2662600567 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1230643673 0 0) 0x7f8a5012dff0 con 0x7f8a5015e2a0 2026-02-24T19:24:30.121 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.109+0000 7f8a2f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.121 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.109+0000 7f8a2f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.121 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.109+0000 7f8a2f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.121 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.109+0000 7f8a2f7fe640 10 monclient(hunting): my global_id is 28138 2026-02-24T19:24:30.121 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.109+0000 7f8a2f7fe640 1 -- 10.20.193.26:0/2662600567 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a5012dd10 con 0x7f8a5015e2a0 2026-02-24T19:24:30.122 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.110+0000 7f8a2f7fe640 1 -- 10.20.193.26:0/2662600567 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3117830478 0 0) 0x7f8a5012e2d0 con 0x7f8a50059e10 2026-02-24T19:24:30.122 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.110+0000 7f8a2f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.122 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.110+0000 7f8a2f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.122 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.110+0000 7f8a2f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.122 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.110+0000 7f8a2f7fe640 10 monclient(hunting): my global_id is 30062 2026-02-24T19:24:30.122 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.110+0000 7f8a2f7fe640 1 -- 10.20.193.26:0/2662600567 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a5012dff0 con 0x7f8a50059e10 2026-02-24T19:24:30.122 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.112+0000 7f8a2f7fe640 1 -- 10.20.193.26:0/2662600567 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 898137171 0 0) 0x7f8a5012dd10 con 0x7f8a5015e2a0 2026-02-24T19:24:30.122 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.112+0000 7f8a2f7fe640 1 -- 10.20.193.26:0/2662600567 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8a5012e2d0 con 0x7f8a5015e2a0 2026-02-24T19:24:30.122 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.112+0000 7f8a2f7fe640 1 -- 10.20.193.26:0/2662600567 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f8a38003170 con 0x7f8a5015e2a0 2026-02-24T19:24:30.122 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.112+0000 7f8a2f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:30.122 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.112+0000 7f8a2f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:30.122 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.112+0000 7f8a2f7fe640 10 monclient(hunting): dump: 2026-02-24T19:24:30.122 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.123 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.123 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.123 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.123 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.123 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.123 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.123 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.123 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.123 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.123 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.112+0000 7f8a2f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:30.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.113+0000 7f8a2f7fe640 1 -- 10.20.193.26:0/2662600567 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2198626119 0 0) 0x7f8a1c003610 con 0x7f8a501a5660 2026-02-24T19:24:30.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.113+0000 7f8a2f7fe640 1 -- 10.20.193.26:0/2662600567 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8a5012dd10 con 0x7f8a501a5660 2026-02-24T19:24:30.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.113+0000 7f8a2f7fe640 1 -- 10.20.193.26:0/2662600567 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f8a40003430 con 0x7f8a501a5660 2026-02-24T19:24:30.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.113+0000 7f8a2f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:30.128 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.113+0000 7f8a2f7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:30.128 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.113+0000 7f8a2f7fe640 10 monclient(hunting): dump: 2026-02-24T19:24:30.128 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.128 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.128 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.128 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.128 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.129 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.129 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.129 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.129 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.129 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.113+0000 7f8a2f7fe640 1 -- 10.20.193.26:0/2662600567 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3339530779 0 0) 0x7f8a5012dff0 con 0x7f8a50059e10 2026-02-24T19:24:30.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.113+0000 7f8a2f7fe640 1 -- 10.20.193.26:0/2662600567 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8a1c003610 con 0x7f8a50059e10 2026-02-24T19:24:30.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.113+0000 7f8a2f7fe640 1 -- 10.20.193.26:0/2662600567 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f8a44003170 con 0x7f8a50059e10 2026-02-24T19:24:30.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.113+0000 7f8a2f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:30.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.113+0000 7f8a2f7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:30.129 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.113+0000 7f8a2f7fe640 10 monclient(hunting): dump: 2026-02-24T19:24:30.130 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.130 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.130 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.130 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.130 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.130 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.130 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.130 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.130 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.130 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.130 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.113+0000 7f8a2f7fe640 1 -- 10.20.193.26:0/2662600567 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 860343181 0 0) 0x7f8a5012e2d0 con 0x7f8a5015e2a0 2026-02-24T19:24:30.130 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.113+0000 7f8a2f7fe640 1 -- 10.20.193.26:0/2662600567 >> v1:10.20.193.103:6789/0 conn(0x7f8a50059e10 legacy=0x7f8a50124480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.131 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.113+0000 7f8a2f7fe640 1 -- 10.20.193.26:0/2662600567 >> v1:10.20.193.26:6789/0 conn(0x7f8a501a5660 legacy=0x7f8a501a4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.131 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.113+0000 7f8a2f7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:24:30.131 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.113+0000 7f8a2f7fe640 1 monclient: found mon.b 2026-02-24T19:24:30.131 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.113+0000 7f8a2f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:30.131 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.113+0000 7f8a2f7fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:30.131 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.113+0000 7f8a2f7fe640 1 -- 10.20.193.26:0/2662600567 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5012e5b0 con 0x7f8a5015e2a0 2026-02-24T19:24:30.131 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.113+0000 7f8a2f7fe640 10 monclient: _finish_auth 0 2026-02-24T19:24:30.131 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.113+0000 7f8a2f7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:24:30.131 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.113+0000 7f8a2f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:30.131 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.113+0000 7f8a5564d640 5 monclient: authenticate success, global_id 28138 2026-02-24T19:24:30.131 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.113+0000 7f8a5564d640 10 monclient: _renew_subs 2026-02-24T19:24:30.131 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.113+0000 7f8a5564d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:30.131 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.113+0000 7f8a5564d640 1 -- 10.20.193.26:0/2662600567 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8a5012e890 con 0x7f8a5015e2a0 2026-02-24T19:24:30.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.114+0000 7f8a5564d640 10 client.28138.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:30.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.114+0000 7f8a5564d640 10 monclient: _renew_subs 2026-02-24T19:24:30.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.114+0000 7f8a5564d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:30.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.114+0000 7f8a5564d640 1 -- 10.20.193.26:0/2662600567 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8a5012b320 con 0x7f8a5015e2a0 2026-02-24T19:24:30.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.114+0000 7f8a5564d640 1 librados: init done 2026-02-24T19:24:30.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.114+0000 7f8a5564d640 10 client.28138.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:30.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.114+0000 7f8a5564d640 15 client.28138.objecter _session_command_op_assign -1 1 2026-02-24T19:24:30.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.114+0000 7f8a5564d640 20 client.28138.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:30.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.114+0000 7f8a5564d640 10 client.28138.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:30.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.114+0000 7f8a5564d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:30.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.114+0000 7f8a5564d640 1 -- 10.20.193.26:0/2662600567 --> v1:10.20.193.70:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f8a50195e60 con 0x7f8a5015e2a0 2026-02-24T19:24:30.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.122+0000 7f8a2f7fe640 1 -- 10.20.193.26:0/2662600567 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8a50195e60 con 0x7f8a5015e2a0 2026-02-24T19:24:30.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.122+0000 7f8a2f7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:30.132 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.122+0000 7f8a2f7fe640 1 -- 10.20.193.26:0/2662600567 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f8a38002fc0 con 0x7f8a5015e2a0 2026-02-24T19:24:30.133 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.122+0000 7f8a2f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:30.133 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.122+0000 7f8a2f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:30.133 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.122+0000 7f8a2f7fe640 10 monclient: dump: 2026-02-24T19:24:30.133 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.133 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.133 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.133 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.133 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.133 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.133 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.133 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.133 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.133 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.122+0000 7f8a4d7fa640 4 set_mon_vals no callback set 2026-02-24T19:24:30.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.123+0000 7f8a2f7fe640 1 -- 10.20.193.26:0/2662600567 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f8a3801d850 con 0x7f8a5015e2a0 2026-02-24T19:24:30.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.123+0000 7f8a4effd640 10 monclient: get_auth_request con 0x7f8a1c0780c0 auth_method 0 2026-02-24T19:24:30.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.124+0000 7f8a2f7fe640 10 client.28138.objecter ms_handle_connect 0x7f8a1c0780c0 2026-02-24T19:24:30.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.124+0000 7f8a2f7fe640 1 -- 10.20.193.26:0/2662600567 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7f8a38092fb0 con 0x7f8a5015e2a0 2026-02-24T19:24:30.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.124+0000 7f8a2f7fe640 10 client.28138.objecter ms_dispatch2 0x7f8a50000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:30.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.124+0000 7f8a2f7fe640 3 client.28138.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:30.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.124+0000 7f8a2f7fe640 3 client.28138.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:30.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.124+0000 7f8a2f7fe640 10 client.28138.objecter checking command 1 2026-02-24T19:24:30.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.124+0000 7f8a2f7fe640 20 client.28138.objecter _get_session s=0x7f8a1c0a2420 osd=2 3 2026-02-24T19:24:30.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.124+0000 7f8a2f7fe640 20 client.28138.objecter put_session s=0x7f8a1c0a2420 osd=2 3 2026-02-24T19:24:30.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.124+0000 7f8a2f7fe640 15 client.28138.objecter _session_command_op_remove -1 1 2026-02-24T19:24:30.134 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.124+0000 7f8a2f7fe640 20 client.28138.objecter _get_session s=0x7f8a1c0a2420 osd=2 3 2026-02-24T19:24:30.135 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.124+0000 7f8a2f7fe640 20 client.28138.objecter get_session s=0x7f8a1c0a2420 osd=2 3 2026-02-24T19:24:30.135 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.124+0000 7f8a2f7fe640 15 client.28138.objecter _session_command_op_assign 2 1 2026-02-24T19:24:30.135 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.124+0000 7f8a2f7fe640 20 client.28138.objecter put_session s=0x7f8a1c0a2420 osd=2 4 2026-02-24T19:24:30.135 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.124+0000 7f8a2f7fe640 10 client.28138.objecter _send_command 1 2026-02-24T19:24:30.135 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.124+0000 7f8a2f7fe640 1 -- 10.20.193.26:0/2662600567 --> v1:10.20.193.103:6800/3800806982 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a38002fc0 con 0x7f8a1c0a2ad0 2026-02-24T19:24:30.135 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.124+0000 7f8a2f7fe640 20 client.28138.objecter dump_active .. 0 homeless 2026-02-24T19:24:30.135 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.124+0000 7f8a4f7fe640 10 monclient: get_auth_request con 0x7f8a1c0a2ad0 auth_method 0 2026-02-24T19:24:30.135 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.125+0000 7f8a2f7fe640 1 -- 10.20.193.26:0/2662600567 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_get_version_reply(handle=1 version=346) ==== 24+0+0 (unknown 2991753921 0 0) 0x7f8a38059650 con 0x7f8a5015e2a0 2026-02-24T19:24:30.135 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.125+0000 7f8a2f7fe640 10 monclient: handle_get_version_reply finishing 1 version 346 2026-02-24T19:24:30.135 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.125+0000 7f8a2f7fe640 10 client.28138.objecter ms_handle_connect 0x7f8a1c0a2ad0 2026-02-24T19:24:30.137 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.135+0000 7f8a2f7fe640 1 -- 10.20.193.26:0/2662600567 <== osd.2 v1:10.20.193.103:6800/3800806982 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f8a38002fc0 con 0x7f8a1c0a2ad0 2026-02-24T19:24:30.137 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.135+0000 7f8a2f7fe640 10 client.28138.objecter ms_dispatch2 0x7f8a50000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:30.137 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.135+0000 7f8a2f7fe640 10 client.28138.objecter _finish_command 1 = system:0 2026-02-24T19:24:30.137 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.135+0000 7f8a2f7fe640 20 client.28138.objecter put_session s=0x7f8a1c0a2420 osd=2 4 2026-02-24T19:24:30.137 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.135+0000 7f8a2f7fe640 15 client.28138.objecter _session_command_op_remove 2 1 2026-02-24T19:24:30.144 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.143+0000 7f8a5564d640 10 client.28138.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:30.145 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.143+0000 7f8a5564d640 15 client.28138.objecter _session_command_op_assign -1 2 2026-02-24T19:24:30.145 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.143+0000 7f8a5564d640 20 client.28138.objecter _get_session s=0x7f8a1c0a2420 osd=2 3 2026-02-24T19:24:30.145 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.143+0000 7f8a5564d640 20 client.28138.objecter put_session s=0x7f8a1c0a2420 osd=2 3 2026-02-24T19:24:30.145 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.143+0000 7f8a5564d640 20 client.28138.objecter _get_session s=0x7f8a1c0a2420 osd=2 3 2026-02-24T19:24:30.145 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.143+0000 7f8a5564d640 15 client.28138.objecter _session_command_op_remove -1 2 2026-02-24T19:24:30.145 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.143+0000 7f8a5564d640 20 client.28138.objecter get_session s=0x7f8a1c0a2420 osd=2 3 2026-02-24T19:24:30.145 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.143+0000 7f8a5564d640 15 client.28138.objecter _session_command_op_assign 2 2 2026-02-24T19:24:30.145 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.143+0000 7f8a5564d640 20 client.28138.objecter put_session s=0x7f8a1c0a2420 osd=2 4 2026-02-24T19:24:30.145 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.143+0000 7f8a5564d640 10 client.28138.objecter _send_command 2 2026-02-24T19:24:30.145 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.143+0000 7f8a5564d640 1 -- 10.20.193.26:0/2662600567 --> v1:10.20.193.103:6800/3800806982 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8a50195b80 con 0x7f8a1c0a2ad0 2026-02-24T19:24:30.152 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.151+0000 7f8a2f7fe640 1 -- 10.20.193.26:0/2662600567 <== osd.2 v1:10.20.193.103:6800/3800806982 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f8a50195b80 con 0x7f8a1c0a2ad0 2026-02-24T19:24:30.152 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.151+0000 7f8a2f7fe640 10 client.28138.objecter ms_dispatch2 0x7f8a50000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:30.152 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.151+0000 7f8a2f7fe640 10 client.28138.objecter _finish_command 2 = system:0 2026-02-24T19:24:30.152 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.151+0000 7f8a2f7fe640 20 client.28138.objecter put_session s=0x7f8a1c0a2420 osd=2 4 2026-02-24T19:24:30.153 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.151+0000 7f8a2f7fe640 15 client.28138.objecter _session_command_op_remove 2 2 2026-02-24T19:24:30.153 INFO:teuthology.orchestra.run.trial026.stdout:{ 2026-02-24T19:24:30.153 INFO:teuthology.orchestra.run.trial026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:30.153 INFO:teuthology.orchestra.run.trial026.stdout:} 2026-02-24T19:24:30.154 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.151+0000 7f8a5564d640 10 librados: watch_flush enter 2026-02-24T19:24:30.154 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.151+0000 7f8a5564d640 10 librados: watch_flush exit 2026-02-24T19:24:30.155 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.151+0000 7f8a5564d640 10 client.28138.objecter close_session for osd.2 2026-02-24T19:24:30.155 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.151+0000 7f8a5564d640 1 -- 10.20.193.26:0/2662600567 >> v1:10.20.193.103:6800/3800806982 conn(0x7f8a1c0a2ad0 legacy=0x7f8a1c0c2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.155 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.151+0000 7f8a5564d640 20 client.28138.objecter put_session s=0x7f8a1c0a2420 osd=2 1 2026-02-24T19:24:30.155 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.151+0000 7f8a5564d640 20 client.28138.objecter shutdown clearing up homeless session... 2026-02-24T19:24:30.155 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.151+0000 7f8a5564d640 10 client.28138.objecter successfully canceled tick 2026-02-24T19:24:30.155 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.151+0000 7f8a5564d640 1 -- 10.20.193.26:0/2662600567 >> v1:10.20.193.162:6800/3889602630 conn(0x7f8a1c0780c0 legacy=0x7f8a1c098570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.155 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.151+0000 7f8a5564d640 10 monclient: shutdown 2026-02-24T19:24:30.155 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.151+0000 7f8a5564d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:30.155 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.151+0000 7f8a5564d640 1 -- 10.20.193.26:0/2662600567 >> v1:10.20.193.70:6789/0 conn(0x7f8a5015e2a0 legacy=0x7f8a5012aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.155 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.151+0000 7f8a4f7fe640 1 -- 10.20.193.26:0/2662600567 reap_dead start 2026-02-24T19:24:30.155 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.151+0000 7f8a5564d640 1 -- 10.20.193.26:0/2662600567 shutdown_connections 2026-02-24T19:24:30.155 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.151+0000 7f8a5564d640 1 -- 10.20.193.26:0/2662600567 >> 10.20.193.26:0/2662600567 conn(0x7f8a500b2f60 msgr2=0x7f8a500b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:30.156 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.151+0000 7f8a5564d640 1 -- 10.20.193.26:0/2662600567 shutdown_connections 2026-02-24T19:24:30.156 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.151+0000 7f8a5564d640 1 -- 10.20.193.26:0/2662600567 wait complete. 2026-02-24T19:24:30.156 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.151+0000 7f8a5564d640 1 librados: shutdown 2026-02-24T19:24:30.161 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-24T19:24:30.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.229+0000 7fbb2b0e1640 10 monclient: get_monmap_and_config 2026-02-24T19:24:30.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.229+0000 7fbb2b0e1640 10 monclient: build_initial_monmap 2026-02-24T19:24:30.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.229+0000 7fbb2b0e1640 10 monclient: monmap: 2026-02-24T19:24:30.231 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:30.231 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.231 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:30.230275+0000 2026-02-24T19:24:30.231 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:30.230275+0000 2026-02-24T19:24:30.231 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:30.231 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.231 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:30.232 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:30.232 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:30.232 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.230+0000 7fbb2b0e1640 1 Processor -- start 2026-02-24T19:24:30.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.230+0000 7fbb2b0e1640 1 -- start start 2026-02-24T19:24:30.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.230+0000 7fbb2b0e1640 10 monclient: init 2026-02-24T19:24:30.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.230+0000 7fbb2b0e1640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:30.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.230+0000 7fbb2b0e1640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:24:30.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.230+0000 7fbb2b0e1640 10 monclient(hunting): picked mon.noname-b con 0x7fbb2415d610 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:30.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.230+0000 7fbb2b0e1640 10 monclient(hunting): picked mon.noname-c con 0x7fbb241667e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:30.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.230+0000 7fbb2b0e1640 10 monclient(hunting): picked mon.noname-a con 0x7fbb24056ea0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:30.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.230+0000 7fbb2b0e1640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb2415d9e0 con 0x7fbb24056ea0 2026-02-24T19:24:30.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.230+0000 7fbb2b0e1640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb24055b20 con 0x7fbb2415d610 2026-02-24T19:24:30.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.230+0000 7fbb2b0e1640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb24055e00 con 0x7fbb241667e0 2026-02-24T19:24:30.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.230+0000 7fbb2b0e1640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:30.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.230+0000 7fbb2b0e1640 10 monclient(hunting): authenticate will time out at 4052.912621s 2026-02-24T19:24:30.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.230+0000 7fbb29657640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fbb24056ea0 0x7fbb241c8b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:58894/0 (socket says 10.20.193.26:58894) 2026-02-24T19:24:30.234 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.230+0000 7fbb29657640 1 -- 10.20.193.26:0/4035993102 learned_addr learned my addr 10.20.193.26:0/4035993102 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:30.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.232+0000 7fbb1b7fe640 1 -- 10.20.193.26:0/4035993102 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3238821163 0 0) 0x7fbb24055b20 con 0x7fbb2415d610 2026-02-24T19:24:30.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.232+0000 7fbb1b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.232+0000 7fbb1b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.232+0000 7fbb1b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.232+0000 7fbb1b7fe640 10 monclient(hunting): my global_id is 28141 2026-02-24T19:24:30.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.232+0000 7fbb1b7fe640 1 -- 10.20.193.26:0/4035993102 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb10003610 con 0x7fbb2415d610 2026-02-24T19:24:30.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.232+0000 7fbb1b7fe640 1 -- 10.20.193.26:0/4035993102 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4274837016 0 0) 0x7fbb24055e00 con 0x7fbb241667e0 2026-02-24T19:24:30.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.232+0000 7fbb1b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.232+0000 7fbb1b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.241 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.232+0000 7fbb1b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.241 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.232+0000 7fbb1b7fe640 10 monclient(hunting): my global_id is 30065 2026-02-24T19:24:30.241 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.232+0000 7fbb1b7fe640 1 -- 10.20.193.26:0/4035993102 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb24055b20 con 0x7fbb241667e0 2026-02-24T19:24:30.241 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.233+0000 7fbb1b7fe640 1 -- 10.20.193.26:0/4035993102 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3212004571 0 0) 0x7fbb2415d9e0 con 0x7fbb24056ea0 2026-02-24T19:24:30.241 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.233+0000 7fbb1b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.241 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.233+0000 7fbb1b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.241 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.233+0000 7fbb1b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.241 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.233+0000 7fbb1b7fe640 10 monclient(hunting): my global_id is 30726 2026-02-24T19:24:30.241 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.233+0000 7fbb1b7fe640 1 -- 10.20.193.26:0/4035993102 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb24055e00 con 0x7fbb24056ea0 2026-02-24T19:24:30.241 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.234+0000 7fbb1b7fe640 1 -- 10.20.193.26:0/4035993102 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3869730313 0 0) 0x7fbb24055b20 con 0x7fbb241667e0 2026-02-24T19:24:30.241 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.234+0000 7fbb1b7fe640 1 -- 10.20.193.26:0/4035993102 >> v1:10.20.193.70:6789/0 conn(0x7fbb2415d610 legacy=0x7fbb240b9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.241 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.234+0000 7fbb1b7fe640 1 -- 10.20.193.26:0/4035993102 >> v1:10.20.193.26:6789/0 conn(0x7fbb24056ea0 legacy=0x7fbb241c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.234+0000 7fbb1b7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:24:30.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.234+0000 7fbb1b7fe640 1 monclient: found mon.noname-c 2026-02-24T19:24:30.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.234+0000 7fbb1b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:30.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.234+0000 7fbb1b7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:24:30.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.234+0000 7fbb1b7fe640 1 -- 10.20.193.26:0/4035993102 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb240560e0 con 0x7fbb241667e0 2026-02-24T19:24:30.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.234+0000 7fbb1b7fe640 10 monclient: _finish_auth 0 2026-02-24T19:24:30.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.234+0000 7fbb1b7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:24:30.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.234+0000 7fbb1b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:30.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.234+0000 7fbb1b7fe640 1 -- 10.20.193.26:0/4035993102 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fbb0c002df0 con 0x7fbb241667e0 2026-02-24T19:24:30.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.234+0000 7fbb1b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:30.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.234+0000 7fbb1b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:30.242 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.234+0000 7fbb1b7fe640 10 monclient: dump: 2026-02-24T19:24:30.242 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.243 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.243 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.243 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.243 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.243 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.243 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.243 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.243 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.243 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.243 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.234+0000 7fbb2b0e1640 5 monclient: authenticate success, global_id 30065 2026-02-24T19:24:30.243 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.234+0000 7fbb2b0e1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:30.243 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.235+0000 7fbb1b7fe640 1 -- 10.20.193.26:0/4035993102 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbb0c002fc0 con 0x7fbb241667e0 2026-02-24T19:24:30.243 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.235+0000 7fbb1b7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:30.244 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.235+0000 7fbb1b7fe640 1 -- 10.20.193.26:0/4035993102 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fbb0c003400 con 0x7fbb241667e0 2026-02-24T19:24:30.244 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.235+0000 7fbb1b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:30.244 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.235+0000 7fbb1b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:30.244 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.235+0000 7fbb1b7fe640 10 monclient: dump: 2026-02-24T19:24:30.244 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.244 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.244 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.244 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.244 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.244 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.244 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.244 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.244 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.245 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.245 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.235+0000 7fbb2b0e1640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:30.245 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.235+0000 7fbb2b0e1640 4 set_mon_vals no callback set 2026-02-24T19:24:30.245 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.235+0000 7fbb2b0e1640 10 monclient: shutdown 2026-02-24T19:24:30.245 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.235+0000 7fbb2b0e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:30.245 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.235+0000 7fbb2b0e1640 1 -- 10.20.193.26:0/4035993102 >> v1:10.20.193.103:6789/0 conn(0x7fbb241667e0 legacy=0x7fbb240ba010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.245 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.235+0000 7fbb2b0e1640 1 -- 10.20.193.26:0/4035993102 shutdown_connections 2026-02-24T19:24:30.245 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.235+0000 7fbb2b0e1640 1 -- 10.20.193.26:0/4035993102 >> 10.20.193.26:0/4035993102 conn(0x7fbb240b7470 msgr2=0x7fbb240b7840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:30.245 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.235+0000 7fbb2b0e1640 1 -- 10.20.193.26:0/4035993102 shutdown_connections 2026-02-24T19:24:30.245 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.235+0000 7fbb2b0e1640 1 -- 10.20.193.26:0/4035993102 wait complete. 2026-02-24T19:24:30.245 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.235+0000 7fbb2b0e1640 10 monclient: build_initial_monmap 2026-02-24T19:24:30.245 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.235+0000 7fbb2b0e1640 10 monclient: monmap: 2026-02-24T19:24:30.246 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:30.246 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:30.246 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:30.246 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:30.246 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:30.246 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:30.246 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:30.246 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:30.246 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:30.246 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.246 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.236+0000 7fbb2b0e1640 1 librados: starting msgr at 2026-02-24T19:24:30.246 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.236+0000 7fbb2b0e1640 1 librados: starting objecter 2026-02-24T19:24:30.246 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.236+0000 7fbb2b0e1640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:30.246 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.236+0000 7fbb2b0e1640 1 Processor -- start 2026-02-24T19:24:30.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.236+0000 7fbb2b0e1640 1 -- start start 2026-02-24T19:24:30.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.236+0000 7fbb2b0e1640 1 librados: setting wanted keys 2026-02-24T19:24:30.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.236+0000 7fbb2b0e1640 1 librados: calling monclient init 2026-02-24T19:24:30.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.236+0000 7fbb2b0e1640 10 monclient: init 2026-02-24T19:24:30.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.236+0000 7fbb2b0e1640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:30.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.236+0000 7fbb2b0e1640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:24:30.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.236+0000 7fbb2b0e1640 10 monclient(hunting): picked mon.noname-a con 0x7fbb24056ea0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:30.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.236+0000 7fbb2b0e1640 10 monclient(hunting): picked mon.noname-b con 0x7fbb2415d610 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:30.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.236+0000 7fbb2b0e1640 10 monclient(hunting): picked mon.noname-c con 0x7fbb241667e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:30.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.236+0000 7fbb2b0e1640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb24139500 con 0x7fbb24056ea0 2026-02-24T19:24:30.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.236+0000 7fbb2b0e1640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb240b3410 con 0x7fbb2415d610 2026-02-24T19:24:30.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.236+0000 7fbb2b0e1640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb24145050 con 0x7fbb241667e0 2026-02-24T19:24:30.247 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.236+0000 7fbb2b0e1640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:30.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.236+0000 7fbb2b0e1640 10 monclient(hunting): authenticate will time out at 4052.918546s 2026-02-24T19:24:30.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.236+0000 7fbb28e56640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fbb24056ea0 0x7fbb24144940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:58908/0 (socket says 10.20.193.26:58908) 2026-02-24T19:24:30.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.236+0000 7fbb28e56640 1 -- 10.20.193.26:0/266194460 learned_addr learned my addr 10.20.193.26:0/266194460 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:30.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.236+0000 7fbb197fa640 10 client.?.objecter ms_handle_connect 0x7fbb241667e0 2026-02-24T19:24:30.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.236+0000 7fbb197fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:30.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.236+0000 7fbb197fa640 10 client.?.objecter ms_handle_connect 0x7fbb24056ea0 2026-02-24T19:24:30.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.236+0000 7fbb197fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:30.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.237+0000 7fbb197fa640 10 client.?.objecter ms_handle_connect 0x7fbb2415d610 2026-02-24T19:24:30.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.237+0000 7fbb197fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:30.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.237+0000 7fbb197fa640 1 -- 10.20.193.26:0/266194460 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1037399145 0 0) 0x7fbb24145050 con 0x7fbb241667e0 2026-02-24T19:24:30.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.237+0000 7fbb197fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.237+0000 7fbb197fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.237+0000 7fbb197fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.249 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.237+0000 7fbb197fa640 10 monclient(hunting): my global_id is 30068 2026-02-24T19:24:30.249 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.237+0000 7fbb197fa640 1 -- 10.20.193.26:0/266194460 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbaf4003610 con 0x7fbb241667e0 2026-02-24T19:24:30.249 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.237+0000 7fbb197fa640 1 -- 10.20.193.26:0/266194460 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2481325454 0 0) 0x7fbb24139500 con 0x7fbb24056ea0 2026-02-24T19:24:30.249 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.237+0000 7fbb197fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.249 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.237+0000 7fbb197fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.249 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.237+0000 7fbb197fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.249 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.237+0000 7fbb197fa640 10 monclient(hunting): my global_id is 30729 2026-02-24T19:24:30.249 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.237+0000 7fbb197fa640 1 -- 10.20.193.26:0/266194460 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb24145050 con 0x7fbb24056ea0 2026-02-24T19:24:30.249 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.238+0000 7fbb197fa640 1 -- 10.20.193.26:0/266194460 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1849108631 0 0) 0x7fbb240b3410 con 0x7fbb2415d610 2026-02-24T19:24:30.249 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.238+0000 7fbb197fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.249 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.238+0000 7fbb197fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.249 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.238+0000 7fbb197fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.249 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.238+0000 7fbb197fa640 10 monclient(hunting): my global_id is 28144 2026-02-24T19:24:30.250 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.238+0000 7fbb197fa640 1 -- 10.20.193.26:0/266194460 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb24139500 con 0x7fbb2415d610 2026-02-24T19:24:30.253 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.240+0000 7fbb197fa640 1 -- 10.20.193.26:0/266194460 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3672359184 0 0) 0x7fbaf4003610 con 0x7fbb241667e0 2026-02-24T19:24:30.253 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.240+0000 7fbb197fa640 1 -- 10.20.193.26:0/266194460 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb240b3410 con 0x7fbb241667e0 2026-02-24T19:24:30.253 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.240+0000 7fbb197fa640 1 -- 10.20.193.26:0/266194460 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fbb20003330 con 0x7fbb241667e0 2026-02-24T19:24:30.254 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.240+0000 7fbb197fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:30.254 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.240+0000 7fbb197fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:30.254 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.240+0000 7fbb197fa640 10 monclient(hunting): dump: 2026-02-24T19:24:30.254 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.254 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.254 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.254 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.254 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.254 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.254 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.254 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.254 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.255 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.255 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.240+0000 7fbb197fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:30.255 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.240+0000 7fbb197fa640 1 -- 10.20.193.26:0/266194460 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2070192906 0 0) 0x7fbb24145050 con 0x7fbb24056ea0 2026-02-24T19:24:30.255 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.240+0000 7fbb197fa640 1 -- 10.20.193.26:0/266194460 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbaf4003610 con 0x7fbb24056ea0 2026-02-24T19:24:30.255 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.240+0000 7fbb197fa640 1 -- 10.20.193.26:0/266194460 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fbb14003010 con 0x7fbb24056ea0 2026-02-24T19:24:30.255 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.240+0000 7fbb197fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:30.255 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.240+0000 7fbb197fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:30.255 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.240+0000 7fbb197fa640 10 monclient(hunting): dump: 2026-02-24T19:24:30.255 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.255 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.255 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.255 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.255 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.256 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.256 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.256 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.256 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.256 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.256 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.240+0000 7fbb197fa640 1 -- 10.20.193.26:0/266194460 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1512307249 0 0) 0x7fbb24139500 con 0x7fbb2415d610 2026-02-24T19:24:30.256 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.240+0000 7fbb197fa640 1 -- 10.20.193.26:0/266194460 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb24145050 con 0x7fbb2415d610 2026-02-24T19:24:30.256 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.240+0000 7fbb197fa640 1 -- 10.20.193.26:0/266194460 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fbb0c003310 con 0x7fbb2415d610 2026-02-24T19:24:30.256 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.240+0000 7fbb197fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:30.256 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.240+0000 7fbb197fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:30.256 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.240+0000 7fbb197fa640 10 monclient(hunting): dump: 2026-02-24T19:24:30.256 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.256 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.257 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.257 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.257 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.257 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.257 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.257 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.257 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.257 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.257 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.241+0000 7fbb197fa640 1 -- 10.20.193.26:0/266194460 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2054894681 0 0) 0x7fbb240b3410 con 0x7fbb241667e0 2026-02-24T19:24:30.257 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.241+0000 7fbb197fa640 1 -- 10.20.193.26:0/266194460 >> v1:10.20.193.70:6789/0 conn(0x7fbb2415d610 legacy=0x7fbb24137d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.257 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.241+0000 7fbb197fa640 1 -- 10.20.193.26:0/266194460 >> v1:10.20.193.26:6789/0 conn(0x7fbb24056ea0 legacy=0x7fbb24144940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.257 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.241+0000 7fbb197fa640 10 monclient: _finish_hunting 0 2026-02-24T19:24:30.257 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.241+0000 7fbb197fa640 1 monclient: found mon.c 2026-02-24T19:24:30.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.241+0000 7fbb197fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:30.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.241+0000 7fbb197fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:30.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.241+0000 7fbb197fa640 1 -- 10.20.193.26:0/266194460 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb24138980 con 0x7fbb241667e0 2026-02-24T19:24:30.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.241+0000 7fbb197fa640 10 monclient: _finish_auth 0 2026-02-24T19:24:30.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.241+0000 7fbb197fa640 10 monclient: _check_auth_tickets 2026-02-24T19:24:30.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.241+0000 7fbb197fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:30.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.241+0000 7fbb2b0e1640 5 monclient: authenticate success, global_id 30068 2026-02-24T19:24:30.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.241+0000 7fbb2b0e1640 10 monclient: _renew_subs 2026-02-24T19:24:30.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.241+0000 7fbb2b0e1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:30.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.241+0000 7fbb2b0e1640 1 -- 10.20.193.26:0/266194460 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbb24138c60 con 0x7fbb241667e0 2026-02-24T19:24:30.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.241+0000 7fbb2b0e1640 10 client.30068.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:30.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.241+0000 7fbb2b0e1640 10 monclient: _renew_subs 2026-02-24T19:24:30.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.241+0000 7fbb2b0e1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:30.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.241+0000 7fbb2b0e1640 1 -- 10.20.193.26:0/266194460 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbb24139220 con 0x7fbb241667e0 2026-02-24T19:24:30.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.241+0000 7fbb2b0e1640 1 librados: init done 2026-02-24T19:24:30.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.242+0000 7fbb2b0e1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:30.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.242+0000 7fbb2b0e1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:30.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.242+0000 7fbb2b0e1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:30.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.242+0000 7fbb2b0e1640 1 -- 10.20.193.26:0/266194460 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb2415a9e0 con 0x7fbb241667e0 2026-02-24T19:24:30.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.249+0000 7fbb197fa640 1 -- 10.20.193.26:0/266194460 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbb20003830 con 0x7fbb241667e0 2026-02-24T19:24:30.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.249+0000 7fbb197fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:30.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.249+0000 7fbb197fa640 1 -- 10.20.193.26:0/266194460 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fbb20004df0 con 0x7fbb241667e0 2026-02-24T19:24:30.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.249+0000 7fbb197fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:30.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.249+0000 7fbb197fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:30.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.249+0000 7fbb197fa640 10 monclient: dump: 2026-02-24T19:24:30.259 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.259 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.259 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.260 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.260 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.260 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.260 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.260 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.260 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.260 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.260 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.249+0000 7fbb1affd640 4 set_mon_vals no callback set 2026-02-24T19:24:30.260 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.250+0000 7fbb197fa640 1 -- 10.20.193.26:0/266194460 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fbb2001dc60 con 0x7fbb241667e0 2026-02-24T19:24:30.260 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.251+0000 7fbb28e56640 10 monclient: get_auth_request con 0x7fbaf4077ed0 auth_method 0 2026-02-24T19:24:30.260 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.251+0000 7fbb197fa640 1 -- 10.20.193.26:0/266194460 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7fbb200933f0 con 0x7fbb241667e0 2026-02-24T19:24:30.260 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.251+0000 7fbb197fa640 10 client.30068.objecter ms_dispatch2 0x7fbb24000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:30.260 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.251+0000 7fbb197fa640 3 client.30068.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:30.260 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.251+0000 7fbb197fa640 3 client.30068.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:30.261 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.251+0000 7fbb197fa640 20 client.30068.objecter dump_active .. 0 homeless 2026-02-24T19:24:30.261 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.251+0000 7fbb197fa640 10 client.30068.objecter ms_handle_connect 0x7fbaf4077ed0 2026-02-24T19:24:30.336 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.335+0000 7fbb197fa640 1 -- 10.20.193.26:0/266194460 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fbb2005de20 con 0x7fbb241667e0 2026-02-24T19:24:30.337 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.335+0000 7fbb197fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:30.337 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.335+0000 7fbb197fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:30.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.439+0000 7fbb2b0e1640 1 -- 10.20.193.26:0/266194460 --> v1:10.20.193.162:6800/3889602630 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fbb24159550 con 0x7fbaf4077ed0 2026-02-24T19:24:30.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.440+0000 7fbb197fa640 1 -- 10.20.193.26:0/266194460 <== mgr.4107 v1:10.20.193.162:6800/3889602630 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (unknown 3049115190 0 0) 0x7fbb24159550 con 0x7fbaf4077ed0 2026-02-24T19:24:30.442 INFO:teuthology.orchestra.run.trial026.stderr:instructed osd(s) 2 to deep-scrub 2026-02-24T19:24:30.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.441+0000 7fbb2b0e1640 10 librados: watch_flush enter 2026-02-24T19:24:30.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.441+0000 7fbb2b0e1640 10 librados: watch_flush exit 2026-02-24T19:24:30.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.441+0000 7fbb2b0e1640 20 client.30068.objecter shutdown clearing up homeless session... 2026-02-24T19:24:30.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.441+0000 7fbb2b0e1640 10 client.30068.objecter successfully canceled tick 2026-02-24T19:24:30.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.441+0000 7fbb2b0e1640 1 -- 10.20.193.26:0/266194460 >> v1:10.20.193.162:6800/3889602630 conn(0x7fbaf4077ed0 legacy=0x7fbaf4098380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.441+0000 7fbb2b0e1640 10 monclient: shutdown 2026-02-24T19:24:30.443 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.441+0000 7fbb2b0e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:30.444 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.441+0000 7fbb2b0e1640 1 -- 10.20.193.26:0/266194460 >> v1:10.20.193.103:6789/0 conn(0x7fbb241667e0 legacy=0x7fbb2412aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.444 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.441+0000 7fbb2b0e1640 1 -- 10.20.193.26:0/266194460 shutdown_connections 2026-02-24T19:24:30.444 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.441+0000 7fbb2b0e1640 1 -- 10.20.193.26:0/266194460 >> 10.20.193.26:0/266194460 conn(0x7fbb240b7470 msgr2=0x7fbb2415c070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:30.444 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.441+0000 7fbb2b0e1640 1 -- 10.20.193.26:0/266194460 shutdown_connections 2026-02-24T19:24:30.444 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.441+0000 7fbb2b0e1640 1 -- 10.20.193.26:0/266194460 wait complete. 2026-02-24T19:24:30.444 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.441+0000 7fbb2b0e1640 1 librados: shutdown 2026-02-24T19:24:30.451 INFO:tasks.ceph:Scrubbing osd.6 2026-02-24T19:24:30.451 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:30.522 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.520+0000 7fc76bac6640 10 monclient: get_monmap_and_config 2026-02-24T19:24:30.522 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.520+0000 7fc76bac6640 10 monclient: build_initial_monmap 2026-02-24T19:24:30.522 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.520+0000 7fc76bac6640 10 monclient: monmap: 2026-02-24T19:24:30.523 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:30.523 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.523 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:30.521773+0000 2026-02-24T19:24:30.523 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:30.521773+0000 2026-02-24T19:24:30.523 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:30.523 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.523 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:30.523 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:30.523 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:30.523 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.521+0000 7fc76bac6640 1 Processor -- start 2026-02-24T19:24:30.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.521+0000 7fc76bac6640 1 -- start start 2026-02-24T19:24:30.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.521+0000 7fc76bac6640 10 monclient: init 2026-02-24T19:24:30.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.522+0000 7fc76bac6640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:30.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.522+0000 7fc76bac6640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:24:30.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.522+0000 7fc76bac6640 10 monclient(hunting): picked mon.noname-a con 0x7fc7640b9f80 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:30.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.522+0000 7fc76bac6640 10 monclient(hunting): picked mon.noname-b con 0x7fc7640ba350 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:30.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.522+0000 7fc76bac6640 10 monclient(hunting): picked mon.noname-c con 0x7fc7640585e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:30.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.522+0000 7fc76bac6640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc764163930 con 0x7fc7640b9f80 2026-02-24T19:24:30.525 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.522+0000 7fc76bac6640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc764163bb0 con 0x7fc7640ba350 2026-02-24T19:24:30.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.522+0000 7fc76bac6640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc764163e90 con 0x7fc7640585e0 2026-02-24T19:24:30.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.522+0000 7fc76bac6640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:30.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.522+0000 7fc76bac6640 10 monclient(hunting): authenticate will time out at 4053.204423s 2026-02-24T19:24:30.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.522+0000 7fc76a03c640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fc7640585e0 0x7fc764166cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:57112/0 (socket says 10.20.193.26:57112) 2026-02-24T19:24:30.526 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.522+0000 7fc76a03c640 1 -- 10.20.193.26:0/1915829936 learned_addr learned my addr 10.20.193.26:0/1915829936 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:30.530 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.524+0000 7fc768839640 1 -- 10.20.193.26:0/1915829936 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1136480356 0 0) 0x7fc764163bb0 con 0x7fc7640ba350 2026-02-24T19:24:30.530 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.524+0000 7fc768839640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.530 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.524+0000 7fc768839640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.530 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.524+0000 7fc768839640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.531 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.524+0000 7fc768839640 10 monclient(hunting): my global_id is 28147 2026-02-24T19:24:30.531 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.524+0000 7fc768839640 1 -- 10.20.193.26:0/1915829936 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc74c003610 con 0x7fc7640ba350 2026-02-24T19:24:30.531 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.524+0000 7fc768839640 1 -- 10.20.193.26:0/1915829936 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 560102927 0 0) 0x7fc764163e90 con 0x7fc7640585e0 2026-02-24T19:24:30.531 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.524+0000 7fc768839640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.531 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.524+0000 7fc768839640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.531 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.524+0000 7fc768839640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.531 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.524+0000 7fc768839640 10 monclient(hunting): my global_id is 30071 2026-02-24T19:24:30.531 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.524+0000 7fc768839640 1 -- 10.20.193.26:0/1915829936 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc764163bb0 con 0x7fc7640585e0 2026-02-24T19:24:30.531 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.526+0000 7fc768839640 1 -- 10.20.193.26:0/1915829936 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1868036092 0 0) 0x7fc74c003610 con 0x7fc7640ba350 2026-02-24T19:24:30.531 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.526+0000 7fc768839640 1 -- 10.20.193.26:0/1915829936 >> v1:10.20.193.103:6789/0 conn(0x7fc7640585e0 legacy=0x7fc764166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.531 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.526+0000 7fc768839640 1 -- 10.20.193.26:0/1915829936 >> v1:10.20.193.26:6789/0 conn(0x7fc7640b9f80 legacy=0x7fc764163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.531 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.526+0000 7fc768839640 10 monclient: _finish_hunting 0 2026-02-24T19:24:30.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.526+0000 7fc768839640 1 monclient: found mon.noname-b 2026-02-24T19:24:30.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.526+0000 7fc768839640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:30.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.526+0000 7fc768839640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:24:30.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.526+0000 7fc768839640 1 -- 10.20.193.26:0/1915829936 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7640573f0 con 0x7fc7640ba350 2026-02-24T19:24:30.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.526+0000 7fc768839640 10 monclient: _finish_auth 0 2026-02-24T19:24:30.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.526+0000 7fc768839640 10 monclient: _check_auth_tickets 2026-02-24T19:24:30.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.526+0000 7fc768839640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:30.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.526+0000 7fc768839640 1 -- 10.20.193.26:0/1915829936 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc758002df0 con 0x7fc7640ba350 2026-02-24T19:24:30.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.526+0000 7fc768839640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:30.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.526+0000 7fc768839640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:30.532 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.526+0000 7fc768839640 10 monclient: dump: 2026-02-24T19:24:30.532 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.532 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.533 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.533 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.533 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.533 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.533 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.533 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.533 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.533 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.533 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.526+0000 7fc76bac6640 5 monclient: authenticate success, global_id 28147 2026-02-24T19:24:30.533 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.526+0000 7fc76bac6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:30.533 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.526+0000 7fc768839640 1 -- 10.20.193.26:0/1915829936 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc758003000 con 0x7fc7640ba350 2026-02-24T19:24:30.533 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.526+0000 7fc768839640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:30.533 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.526+0000 7fc768839640 1 -- 10.20.193.26:0/1915829936 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc758003440 con 0x7fc7640ba350 2026-02-24T19:24:30.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.526+0000 7fc768839640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:30.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.526+0000 7fc768839640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:30.534 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.526+0000 7fc768839640 10 monclient: dump: 2026-02-24T19:24:30.534 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.534 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.534 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.534 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.534 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.534 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.534 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.534 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.534 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.534 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.527+0000 7fc76bac6640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:30.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.527+0000 7fc76bac6640 4 set_mon_vals no callback set 2026-02-24T19:24:30.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.527+0000 7fc76bac6640 10 monclient: shutdown 2026-02-24T19:24:30.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.527+0000 7fc76bac6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:30.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.527+0000 7fc76bac6640 1 -- 10.20.193.26:0/1915829936 >> v1:10.20.193.70:6789/0 conn(0x7fc7640ba350 legacy=0x7fc764057ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.527+0000 7fc76bac6640 1 -- 10.20.193.26:0/1915829936 shutdown_connections 2026-02-24T19:24:30.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.527+0000 7fc76bac6640 1 -- 10.20.193.26:0/1915829936 >> 10.20.193.26:0/1915829936 conn(0x7fc7640b7990 msgr2=0x7fc7640b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:30.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.527+0000 7fc76bac6640 1 -- 10.20.193.26:0/1915829936 shutdown_connections 2026-02-24T19:24:30.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.527+0000 7fc76bac6640 1 -- 10.20.193.26:0/1915829936 wait complete. 2026-02-24T19:24:30.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.527+0000 7fc76bac6640 10 monclient: build_initial_monmap 2026-02-24T19:24:30.535 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.527+0000 7fc76bac6640 10 monclient: monmap: 2026-02-24T19:24:30.535 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:30.535 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:30.536 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:30.536 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:30.536 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:30.536 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:30.536 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:30.536 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:30.536 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:30.536 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.527+0000 7fc76bac6640 1 librados: starting msgr at 2026-02-24T19:24:30.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.527+0000 7fc76bac6640 1 librados: starting objecter 2026-02-24T19:24:30.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.528+0000 7fc76bac6640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:30.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.528+0000 7fc76bac6640 1 Processor -- start 2026-02-24T19:24:30.536 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.528+0000 7fc76bac6640 1 -- start start 2026-02-24T19:24:30.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.528+0000 7fc76bac6640 1 librados: setting wanted keys 2026-02-24T19:24:30.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.528+0000 7fc76bac6640 1 librados: calling monclient init 2026-02-24T19:24:30.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.528+0000 7fc76bac6640 10 monclient: init 2026-02-24T19:24:30.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.528+0000 7fc76bac6640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:30.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.528+0000 7fc76bac6640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:30.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.528+0000 7fc76bac6640 10 monclient(hunting): picked mon.noname-c con 0x7fc7640585e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:30.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.528+0000 7fc76bac6640 10 monclient(hunting): picked mon.noname-b con 0x7fc7640b9f80 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:30.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.528+0000 7fc76bac6640 10 monclient(hunting): picked mon.noname-a con 0x7fc7640ba350 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:30.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.528+0000 7fc76bac6640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc764162b20 con 0x7fc7640ba350 2026-02-24T19:24:30.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.528+0000 7fc76bac6640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7641fbbf0 con 0x7fc7640b9f80 2026-02-24T19:24:30.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.528+0000 7fc76bac6640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7641fbed0 con 0x7fc7640585e0 2026-02-24T19:24:30.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.528+0000 7fc76bac6640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:30.537 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.528+0000 7fc76bac6640 10 monclient(hunting): authenticate will time out at 4053.210512s 2026-02-24T19:24:30.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.528+0000 7fc76983b640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fc7640585e0 0x7fc764162410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:57118/0 (socket says 10.20.193.26:57118) 2026-02-24T19:24:30.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.528+0000 7fc76983b640 1 -- 10.20.193.26:0/1038727913 learned_addr learned my addr 10.20.193.26:0/1038727913 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:30.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.529+0000 7fc7527fc640 10 client.?.objecter ms_handle_connect 0x7fc7640585e0 2026-02-24T19:24:30.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.529+0000 7fc7527fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:30.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.529+0000 7fc7527fc640 10 client.?.objecter ms_handle_connect 0x7fc7640b9f80 2026-02-24T19:24:30.538 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.529+0000 7fc7527fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:30.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.530+0000 7fc7527fc640 1 -- 10.20.193.26:0/1038727913 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1137110386 0 0) 0x7fc7641fbbf0 con 0x7fc7640b9f80 2026-02-24T19:24:30.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.530+0000 7fc7527fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.541 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.530+0000 7fc7527fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.530+0000 7fc7527fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.530+0000 7fc7527fc640 10 monclient(hunting): my global_id is 28150 2026-02-24T19:24:30.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.530+0000 7fc7527fc640 1 -- 10.20.193.26:0/1038727913 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc734003610 con 0x7fc7640b9f80 2026-02-24T19:24:30.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.530+0000 7fc7527fc640 1 -- 10.20.193.26:0/1038727913 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3255316345 0 0) 0x7fc7641fbed0 con 0x7fc7640585e0 2026-02-24T19:24:30.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.530+0000 7fc7527fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.530+0000 7fc7527fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.530+0000 7fc7527fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.530+0000 7fc7527fc640 10 monclient(hunting): my global_id is 30074 2026-02-24T19:24:30.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.530+0000 7fc7527fc640 1 -- 10.20.193.26:0/1038727913 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7641fbbf0 con 0x7fc7640585e0 2026-02-24T19:24:30.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.530+0000 7fc7527fc640 10 client.?.objecter ms_handle_connect 0x7fc7640ba350 2026-02-24T19:24:30.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.530+0000 7fc7527fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:30.542 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.531+0000 7fc7527fc640 1 -- 10.20.193.26:0/1038727913 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3873419177 0 0) 0x7fc764162b20 con 0x7fc7640ba350 2026-02-24T19:24:30.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.531+0000 7fc7527fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.531+0000 7fc7527fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.531+0000 7fc7527fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.531+0000 7fc7527fc640 10 monclient(hunting): my global_id is 30735 2026-02-24T19:24:30.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.531+0000 7fc7527fc640 1 -- 10.20.193.26:0/1038727913 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7641fbed0 con 0x7fc7640ba350 2026-02-24T19:24:30.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.532+0000 7fc7527fc640 1 -- 10.20.193.26:0/1038727913 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3757370661 0 0) 0x7fc734003610 con 0x7fc7640b9f80 2026-02-24T19:24:30.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.532+0000 7fc7527fc640 1 -- 10.20.193.26:0/1038727913 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc764162b20 con 0x7fc7640b9f80 2026-02-24T19:24:30.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.532+0000 7fc7527fc640 1 -- 10.20.193.26:0/1038727913 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc758003350 con 0x7fc7640b9f80 2026-02-24T19:24:30.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.532+0000 7fc7527fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:30.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.532+0000 7fc7527fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:30.543 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.532+0000 7fc7527fc640 10 monclient(hunting): dump: 2026-02-24T19:24:30.543 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.543 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.544 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.544 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.544 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.544 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.544 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.544 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.544 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.544 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.532+0000 7fc7527fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:30.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.532+0000 7fc7527fc640 1 -- 10.20.193.26:0/1038727913 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2753929767 0 0) 0x7fc7641fbbf0 con 0x7fc7640585e0 2026-02-24T19:24:30.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.532+0000 7fc7527fc640 1 -- 10.20.193.26:0/1038727913 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc734003610 con 0x7fc7640585e0 2026-02-24T19:24:30.544 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.532+0000 7fc7527fc640 1 -- 10.20.193.26:0/1038727913 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc754003100 con 0x7fc7640585e0 2026-02-24T19:24:30.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.532+0000 7fc7527fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:30.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.532+0000 7fc7527fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:30.545 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.532+0000 7fc7527fc640 10 monclient(hunting): dump: 2026-02-24T19:24:30.545 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.545 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.545 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.545 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.545 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.545 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.545 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.545 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.545 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.545 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.534+0000 7fc7527fc640 1 -- 10.20.193.26:0/1038727913 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 941896523 0 0) 0x7fc764162b20 con 0x7fc7640b9f80 2026-02-24T19:24:30.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.534+0000 7fc7527fc640 1 -- 10.20.193.26:0/1038727913 >> v1:10.20.193.103:6789/0 conn(0x7fc7640585e0 legacy=0x7fc764162410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.534+0000 7fc7527fc640 1 -- 10.20.193.26:0/1038727913 >> v1:10.20.193.26:6789/0 conn(0x7fc7640ba350 legacy=0x7fc7640b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.534+0000 7fc7527fc640 10 monclient: _finish_hunting 0 2026-02-24T19:24:30.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.534+0000 7fc7527fc640 1 monclient: found mon.b 2026-02-24T19:24:30.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.534+0000 7fc7527fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:30.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.534+0000 7fc7527fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:30.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.534+0000 7fc7527fc640 1 -- 10.20.193.26:0/1038727913 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7640b1f90 con 0x7fc7640b9f80 2026-02-24T19:24:30.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.534+0000 7fc7527fc640 10 monclient: _finish_auth 0 2026-02-24T19:24:30.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.534+0000 7fc7527fc640 10 monclient: _check_auth_tickets 2026-02-24T19:24:30.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.534+0000 7fc7527fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:30.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.534+0000 7fc76bac6640 5 monclient: authenticate success, global_id 28150 2026-02-24T19:24:30.546 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.534+0000 7fc76bac6640 10 monclient: _renew_subs 2026-02-24T19:24:30.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.534+0000 7fc76bac6640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:30.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.534+0000 7fc76bac6640 1 -- 10.20.193.26:0/1038727913 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc7640b2270 con 0x7fc7640b9f80 2026-02-24T19:24:30.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.534+0000 7fc76bac6640 10 client.28150.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:30.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.534+0000 7fc76bac6640 10 monclient: _renew_subs 2026-02-24T19:24:30.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.534+0000 7fc76bac6640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:30.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.534+0000 7fc76bac6640 1 -- 10.20.193.26:0/1038727913 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc7640b3180 con 0x7fc7640b9f80 2026-02-24T19:24:30.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.534+0000 7fc76bac6640 1 librados: init done 2026-02-24T19:24:30.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.534+0000 7fc76bac6640 10 client.28150.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:30.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.534+0000 7fc76bac6640 15 client.28150.objecter _session_command_op_assign -1 1 2026-02-24T19:24:30.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.534+0000 7fc76bac6640 20 client.28150.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:30.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.534+0000 7fc76bac6640 10 client.28150.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:30.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.534+0000 7fc76bac6640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:30.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.534+0000 7fc76bac6640 1 -- 10.20.193.26:0/1038727913 --> v1:10.20.193.70:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fc7641631b0 con 0x7fc7640b9f80 2026-02-24T19:24:30.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.542+0000 7fc7527fc640 1 -- 10.20.193.26:0/1038727913 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc7641631b0 con 0x7fc7640b9f80 2026-02-24T19:24:30.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.542+0000 7fc7527fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:30.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.542+0000 7fc7527fc640 1 -- 10.20.193.26:0/1038727913 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc7580037a0 con 0x7fc7640b9f80 2026-02-24T19:24:30.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.542+0000 7fc7527fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:30.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.542+0000 7fc7527fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:30.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.542+0000 7fc7527fc640 10 monclient: dump: 2026-02-24T19:24:30.550 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.550 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.550 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.550 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.550 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.550 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.550 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.550 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.551 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.551 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.542+0000 7fc753fff640 4 set_mon_vals no callback set 2026-02-24T19:24:30.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.543+0000 7fc7527fc640 1 -- 10.20.193.26:0/1038727913 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fc758003980 con 0x7fc7640b9f80 2026-02-24T19:24:30.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.544+0000 7fc76983b640 10 monclient: get_auth_request con 0x7fc734077d30 auth_method 0 2026-02-24T19:24:30.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.544+0000 7fc7527fc640 10 client.28150.objecter ms_handle_connect 0x7fc734077d30 2026-02-24T19:24:30.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.544+0000 7fc7527fc640 1 -- 10.20.193.26:0/1038727913 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7fc758091e80 con 0x7fc7640b9f80 2026-02-24T19:24:30.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.544+0000 7fc7527fc640 10 client.28150.objecter ms_dispatch2 0x7fc764000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:30.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.544+0000 7fc7527fc640 3 client.28150.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:30.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.544+0000 7fc7527fc640 3 client.28150.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:30.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.544+0000 7fc7527fc640 10 client.28150.objecter checking command 1 2026-02-24T19:24:30.551 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.544+0000 7fc7527fc640 20 client.28150.objecter _get_session s=0x7fc7340a2090 osd=6 3 2026-02-24T19:24:30.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.544+0000 7fc7527fc640 20 client.28150.objecter put_session s=0x7fc7340a2090 osd=6 3 2026-02-24T19:24:30.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.544+0000 7fc7527fc640 15 client.28150.objecter _session_command_op_remove -1 1 2026-02-24T19:24:30.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.544+0000 7fc7527fc640 20 client.28150.objecter _get_session s=0x7fc7340a2090 osd=6 3 2026-02-24T19:24:30.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.544+0000 7fc7527fc640 20 client.28150.objecter get_session s=0x7fc7340a2090 osd=6 3 2026-02-24T19:24:30.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.544+0000 7fc7527fc640 15 client.28150.objecter _session_command_op_assign 6 1 2026-02-24T19:24:30.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.544+0000 7fc7527fc640 20 client.28150.objecter put_session s=0x7fc7340a2090 osd=6 4 2026-02-24T19:24:30.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.544+0000 7fc7527fc640 10 client.28150.objecter _send_command 1 2026-02-24T19:24:30.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.544+0000 7fc7527fc640 1 -- 10.20.193.26:0/1038727913 --> v1:10.20.193.103:6808/3149418268 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc7340c43a0 con 0x7fc7340a2740 2026-02-24T19:24:30.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.544+0000 7fc7527fc640 20 client.28150.objecter dump_active .. 0 homeless 2026-02-24T19:24:30.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.544+0000 7fc7527fc640 1 -- 10.20.193.26:0/1038727913 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_get_version_reply(handle=1 version=346) ==== 24+0+0 (unknown 2991753921 0 0) 0x7fc758058520 con 0x7fc7640b9f80 2026-02-24T19:24:30.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.544+0000 7fc7527fc640 10 monclient: handle_get_version_reply finishing 1 version 346 2026-02-24T19:24:30.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.545+0000 7fc76a03c640 10 monclient: get_auth_request con 0x7fc7340a2740 auth_method 0 2026-02-24T19:24:30.552 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.546+0000 7fc7527fc640 10 client.28150.objecter ms_handle_connect 0x7fc7340a2740 2026-02-24T19:24:30.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.555+0000 7fc7527fc640 1 -- 10.20.193.26:0/1038727913 <== osd.6 v1:10.20.193.103:6808/3149418268 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fc7340c43a0 con 0x7fc7340a2740 2026-02-24T19:24:30.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.555+0000 7fc7527fc640 10 client.28150.objecter ms_dispatch2 0x7fc764000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:30.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.555+0000 7fc7527fc640 10 client.28150.objecter _finish_command 1 = system:0 2026-02-24T19:24:30.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.555+0000 7fc7527fc640 20 client.28150.objecter put_session s=0x7fc7340a2090 osd=6 4 2026-02-24T19:24:30.557 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.555+0000 7fc7527fc640 15 client.28150.objecter _session_command_op_remove 6 1 2026-02-24T19:24:30.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.563+0000 7fc76bac6640 10 client.28150.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:30.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.563+0000 7fc76bac6640 15 client.28150.objecter _session_command_op_assign -1 2 2026-02-24T19:24:30.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.563+0000 7fc76bac6640 20 client.28150.objecter _get_session s=0x7fc7340a2090 osd=6 3 2026-02-24T19:24:30.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.563+0000 7fc76bac6640 20 client.28150.objecter put_session s=0x7fc7340a2090 osd=6 3 2026-02-24T19:24:30.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.563+0000 7fc76bac6640 20 client.28150.objecter _get_session s=0x7fc7340a2090 osd=6 3 2026-02-24T19:24:30.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.563+0000 7fc76bac6640 15 client.28150.objecter _session_command_op_remove -1 2 2026-02-24T19:24:30.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.563+0000 7fc76bac6640 20 client.28150.objecter get_session s=0x7fc7340a2090 osd=6 3 2026-02-24T19:24:30.565 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.563+0000 7fc76bac6640 15 client.28150.objecter _session_command_op_assign 6 2 2026-02-24T19:24:30.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.563+0000 7fc76bac6640 20 client.28150.objecter put_session s=0x7fc7340a2090 osd=6 4 2026-02-24T19:24:30.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.563+0000 7fc76bac6640 10 client.28150.objecter _send_command 2 2026-02-24T19:24:30.566 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.563+0000 7fc76bac6640 1 -- 10.20.193.26:0/1038727913 --> v1:10.20.193.103:6808/3149418268 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc7640b64c0 con 0x7fc7340a2740 2026-02-24T19:24:30.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.571+0000 7fc7527fc640 1 -- 10.20.193.26:0/1038727913 <== osd.6 v1:10.20.193.103:6808/3149418268 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fc7640b64c0 con 0x7fc7340a2740 2026-02-24T19:24:30.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.571+0000 7fc7527fc640 10 client.28150.objecter ms_dispatch2 0x7fc764000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:30.572 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.571+0000 7fc7527fc640 10 client.28150.objecter _finish_command 2 = system:0 2026-02-24T19:24:30.573 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.571+0000 7fc7527fc640 20 client.28150.objecter put_session s=0x7fc7340a2090 osd=6 4 2026-02-24T19:24:30.573 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.571+0000 7fc7527fc640 15 client.28150.objecter _session_command_op_remove 6 2 2026-02-24T19:24:30.573 INFO:teuthology.orchestra.run.trial026.stdout:{ 2026-02-24T19:24:30.573 INFO:teuthology.orchestra.run.trial026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:30.573 INFO:teuthology.orchestra.run.trial026.stdout:} 2026-02-24T19:24:30.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.571+0000 7fc76bac6640 10 librados: watch_flush enter 2026-02-24T19:24:30.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.571+0000 7fc76bac6640 10 librados: watch_flush exit 2026-02-24T19:24:30.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.571+0000 7fc76bac6640 10 client.28150.objecter close_session for osd.6 2026-02-24T19:24:30.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.571+0000 7fc76bac6640 1 -- 10.20.193.26:0/1038727913 >> v1:10.20.193.103:6808/3149418268 conn(0x7fc7340a2740 legacy=0x7fc7340c2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.571+0000 7fc76bac6640 20 client.28150.objecter put_session s=0x7fc7340a2090 osd=6 1 2026-02-24T19:24:30.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.571+0000 7fc76bac6640 20 client.28150.objecter shutdown clearing up homeless session... 2026-02-24T19:24:30.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.571+0000 7fc76bac6640 10 client.28150.objecter successfully canceled tick 2026-02-24T19:24:30.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.571+0000 7fc76bac6640 1 -- 10.20.193.26:0/1038727913 >> v1:10.20.193.162:6800/3889602630 conn(0x7fc734077d30 legacy=0x7fc7340981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.571+0000 7fc76bac6640 10 monclient: shutdown 2026-02-24T19:24:30.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.571+0000 7fc76bac6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:30.575 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.571+0000 7fc76bac6640 1 -- 10.20.193.26:0/1038727913 >> v1:10.20.193.70:6789/0 conn(0x7fc7640b9f80 legacy=0x7fc7641fb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.571+0000 7fc76a03c640 1 -- 10.20.193.26:0/1038727913 reap_dead start 2026-02-24T19:24:30.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.571+0000 7fc76bac6640 1 -- 10.20.193.26:0/1038727913 shutdown_connections 2026-02-24T19:24:30.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.571+0000 7fc76bac6640 1 -- 10.20.193.26:0/1038727913 >> 10.20.193.26:0/1038727913 conn(0x7fc7640b7990 msgr2=0x7fc76415bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:30.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.571+0000 7fc76bac6640 1 -- 10.20.193.26:0/1038727913 shutdown_connections 2026-02-24T19:24:30.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.571+0000 7fc76bac6640 1 -- 10.20.193.26:0/1038727913 wait complete. 2026-02-24T19:24:30.576 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.571+0000 7fc76bac6640 1 librados: shutdown 2026-02-24T19:24:30.580 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2026-02-24T19:24:30.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.647+0000 7fcff6f87640 10 monclient: get_monmap_and_config 2026-02-24T19:24:30.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.647+0000 7fcff6f87640 10 monclient: build_initial_monmap 2026-02-24T19:24:30.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.647+0000 7fcff6f87640 10 monclient: monmap: 2026-02-24T19:24:30.649 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:30.649 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.650 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:30.648647+0000 2026-02-24T19:24:30.650 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:30.648647+0000 2026-02-24T19:24:30.650 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:30.650 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.650 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:30.650 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:30.650 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:30.650 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.652 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.648+0000 7fcff6f87640 1 Processor -- start 2026-02-24T19:24:30.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.648+0000 7fcff6f87640 1 -- start start 2026-02-24T19:24:30.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.648+0000 7fcff6f87640 10 monclient: init 2026-02-24T19:24:30.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.648+0000 7fcff6f87640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:30.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.648+0000 7fcff6f87640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:24:30.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.648+0000 7fcff6f87640 10 monclient(hunting): picked mon.noname-c con 0x7fcff0157780 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:30.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.648+0000 7fcff6f87640 10 monclient(hunting): picked mon.noname-a con 0x7fcff0157b50 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:30.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.648+0000 7fcff6f87640 10 monclient(hunting): picked mon.noname-b con 0x7fcff0164d00 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:30.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.648+0000 7fcff6f87640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcff005de70 con 0x7fcff0157b50 2026-02-24T19:24:30.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.648+0000 7fcff6f87640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcff0055b20 con 0x7fcff0164d00 2026-02-24T19:24:30.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.648+0000 7fcff6f87640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcff0055e00 con 0x7fcff0157780 2026-02-24T19:24:30.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.648+0000 7fcff6f87640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:30.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.648+0000 7fcff6f87640 10 monclient(hunting): authenticate will time out at 4053.330928s 2026-02-24T19:24:30.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.649+0000 7fcff4cfc640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fcff0157780 0x7fcff0056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:57128/0 (socket says 10.20.193.26:57128) 2026-02-24T19:24:30.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.649+0000 7fcff4cfc640 1 -- 10.20.193.26:0/2003468993 learned_addr learned my addr 10.20.193.26:0/2003468993 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:30.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.650+0000 7fcfe77fe640 1 -- 10.20.193.26:0/2003468993 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1794037594 0 0) 0x7fcff0055e00 con 0x7fcff0157780 2026-02-24T19:24:30.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.650+0000 7fcfe77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.650+0000 7fcfe77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.650+0000 7fcfe77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.650+0000 7fcfe77fe640 10 monclient(hunting): my global_id is 30077 2026-02-24T19:24:30.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.650+0000 7fcfe77fe640 1 -- 10.20.193.26:0/2003468993 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfdc003610 con 0x7fcff0157780 2026-02-24T19:24:30.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.650+0000 7fcfe77fe640 1 -- 10.20.193.26:0/2003468993 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3452802941 0 0) 0x7fcff005de70 con 0x7fcff0157b50 2026-02-24T19:24:30.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.650+0000 7fcfe77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.650+0000 7fcfe77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.650+0000 7fcfe77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.650+0000 7fcfe77fe640 10 monclient(hunting): my global_id is 30738 2026-02-24T19:24:30.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.650+0000 7fcfe77fe640 1 -- 10.20.193.26:0/2003468993 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcff0055e00 con 0x7fcff0157b50 2026-02-24T19:24:30.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.650+0000 7fcfe77fe640 1 -- 10.20.193.26:0/2003468993 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3034241495 0 0) 0x7fcff0055b20 con 0x7fcff0164d00 2026-02-24T19:24:30.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.650+0000 7fcfe77fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.650+0000 7fcfe77fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.650+0000 7fcfe77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.650+0000 7fcfe77fe640 10 monclient(hunting): my global_id is 28153 2026-02-24T19:24:30.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.650+0000 7fcfe77fe640 1 -- 10.20.193.26:0/2003468993 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcff005de70 con 0x7fcff0164d00 2026-02-24T19:24:30.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.652+0000 7fcfe77fe640 1 -- 10.20.193.26:0/2003468993 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3703841705 0 0) 0x7fcfdc003610 con 0x7fcff0157780 2026-02-24T19:24:30.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.652+0000 7fcfe77fe640 1 -- 10.20.193.26:0/2003468993 >> v1:10.20.193.70:6789/0 conn(0x7fcff0164d00 legacy=0x7fcff01c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.652+0000 7fcfe77fe640 1 -- 10.20.193.26:0/2003468993 >> v1:10.20.193.26:6789/0 conn(0x7fcff0157b50 legacy=0x7fcff01645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.652+0000 7fcfe77fe640 10 monclient: _finish_hunting 0 2026-02-24T19:24:30.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.652+0000 7fcfe77fe640 1 monclient: found mon.noname-c 2026-02-24T19:24:30.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.652+0000 7fcfe77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:30.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.652+0000 7fcfe77fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:24:30.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.652+0000 7fcfe77fe640 1 -- 10.20.193.26:0/2003468993 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff00560e0 con 0x7fcff0157780 2026-02-24T19:24:30.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.652+0000 7fcfe77fe640 10 monclient: _finish_auth 0 2026-02-24T19:24:30.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.652+0000 7fcfe77fe640 10 monclient: _check_auth_tickets 2026-02-24T19:24:30.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.652+0000 7fcfe77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:30.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.652+0000 7fcfe77fe640 1 -- 10.20.193.26:0/2003468993 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fcfe0002d20 con 0x7fcff0157780 2026-02-24T19:24:30.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.652+0000 7fcfe77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:30.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.652+0000 7fcfe77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:30.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.652+0000 7fcfe77fe640 10 monclient: dump: 2026-02-24T19:24:30.661 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.661 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.661 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.662 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.662 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.662 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.662 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.662 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.662 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.662 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.662 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.652+0000 7fcff6f87640 5 monclient: authenticate success, global_id 30077 2026-02-24T19:24:30.662 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.652+0000 7fcff6f87640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:30.662 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.653+0000 7fcfe77fe640 1 -- 10.20.193.26:0/2003468993 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcfe0002ef0 con 0x7fcff0157780 2026-02-24T19:24:30.662 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.653+0000 7fcfe77fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:30.662 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.653+0000 7fcfe77fe640 1 -- 10.20.193.26:0/2003468993 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fcfe0003330 con 0x7fcff0157780 2026-02-24T19:24:30.663 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.653+0000 7fcfe77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:30.663 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.653+0000 7fcfe77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:30.663 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.653+0000 7fcfe77fe640 10 monclient: dump: 2026-02-24T19:24:30.663 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.663 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.663 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.663 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.663 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.663 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.663 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.663 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.663 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.663 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.663 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.653+0000 7fcff6f87640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:30.664 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.653+0000 7fcff6f87640 4 set_mon_vals no callback set 2026-02-24T19:24:30.664 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.653+0000 7fcff6f87640 10 monclient: shutdown 2026-02-24T19:24:30.664 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.653+0000 7fcff6f87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:30.664 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.653+0000 7fcff6f87640 1 -- 10.20.193.26:0/2003468993 >> v1:10.20.193.103:6789/0 conn(0x7fcff0157780 legacy=0x7fcff0056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.664 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.653+0000 7fcff6f87640 1 -- 10.20.193.26:0/2003468993 shutdown_connections 2026-02-24T19:24:30.664 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.653+0000 7fcff6f87640 1 -- 10.20.193.26:0/2003468993 >> 10.20.193.26:0/2003468993 conn(0x7fcff00b2ef0 msgr2=0x7fcff00b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:30.664 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.653+0000 7fcff6f87640 1 -- 10.20.193.26:0/2003468993 shutdown_connections 2026-02-24T19:24:30.664 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.653+0000 7fcff6f87640 1 -- 10.20.193.26:0/2003468993 wait complete. 2026-02-24T19:24:30.664 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.653+0000 7fcff6f87640 10 monclient: build_initial_monmap 2026-02-24T19:24:30.664 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.653+0000 7fcff6f87640 10 monclient: monmap: 2026-02-24T19:24:30.664 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:30.664 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:30.664 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:30.665 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:30.665 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:30.665 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:30.665 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:30.665 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:30.665 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:30.665 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.665 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.653+0000 7fcff6f87640 1 librados: starting msgr at 2026-02-24T19:24:30.665 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.653+0000 7fcff6f87640 1 librados: starting objecter 2026-02-24T19:24:30.665 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.654+0000 7fcff6f87640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:30.665 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.654+0000 7fcff6f87640 1 Processor -- start 2026-02-24T19:24:30.665 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.654+0000 7fcff6f87640 1 -- start start 2026-02-24T19:24:30.665 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.654+0000 7fcff6f87640 1 librados: setting wanted keys 2026-02-24T19:24:30.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.654+0000 7fcff6f87640 1 librados: calling monclient init 2026-02-24T19:24:30.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.654+0000 7fcff6f87640 10 monclient: init 2026-02-24T19:24:30.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.654+0000 7fcff6f87640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:30.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.654+0000 7fcff6f87640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:24:30.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.654+0000 7fcff6f87640 10 monclient(hunting): picked mon.noname-a con 0x7fcff0157780 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:30.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.654+0000 7fcff6f87640 10 monclient(hunting): picked mon.noname-b con 0x7fcff0157b50 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:30.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.654+0000 7fcff6f87640 10 monclient(hunting): picked mon.noname-c con 0x7fcff0164d00 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:30.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.654+0000 7fcff6f87640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcff01496a0 con 0x7fcff0157780 2026-02-24T19:24:30.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.654+0000 7fcff6f87640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcff0148860 con 0x7fcff0157b50 2026-02-24T19:24:30.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.654+0000 7fcff6f87640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcff0058400 con 0x7fcff0164d00 2026-02-24T19:24:30.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.654+0000 7fcff6f87640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:30.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.654+0000 7fcff6f87640 10 monclient(hunting): authenticate will time out at 4053.336485s 2026-02-24T19:24:30.666 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.654+0000 7fcff4cfc640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fcff0157780 0x7fcff0057cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:58940/0 (socket says 10.20.193.26:58940) 2026-02-24T19:24:30.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.654+0000 7fcff4cfc640 1 -- 10.20.193.26:0/398352128 learned_addr learned my addr 10.20.193.26:0/398352128 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:30.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.654+0000 7fcfe57fa640 10 client.?.objecter ms_handle_connect 0x7fcff0157780 2026-02-24T19:24:30.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.654+0000 7fcfe57fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:30.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.655+0000 7fcfe57fa640 10 client.?.objecter ms_handle_connect 0x7fcff0157b50 2026-02-24T19:24:30.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.655+0000 7fcfe57fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:30.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.655+0000 7fcfe57fa640 10 client.?.objecter ms_handle_connect 0x7fcff0164d00 2026-02-24T19:24:30.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.655+0000 7fcfe57fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:30.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.655+0000 7fcfe57fa640 1 -- 10.20.193.26:0/398352128 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2518818496 0 0) 0x7fcff01496a0 con 0x7fcff0157780 2026-02-24T19:24:30.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.655+0000 7fcfe57fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.655+0000 7fcfe57fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.655+0000 7fcfe57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.667 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.655+0000 7fcfe57fa640 10 monclient(hunting): my global_id is 30741 2026-02-24T19:24:30.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.655+0000 7fcfe57fa640 1 -- 10.20.193.26:0/398352128 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfc0003610 con 0x7fcff0157780 2026-02-24T19:24:30.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.656+0000 7fcfe57fa640 1 -- 10.20.193.26:0/398352128 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1303187511 0 0) 0x7fcff0148860 con 0x7fcff0157b50 2026-02-24T19:24:30.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.656+0000 7fcfe57fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.656+0000 7fcfe57fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.656+0000 7fcfe57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.656+0000 7fcfe57fa640 10 monclient(hunting): my global_id is 28156 2026-02-24T19:24:30.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.656+0000 7fcfe57fa640 1 -- 10.20.193.26:0/398352128 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcff01496a0 con 0x7fcff0157b50 2026-02-24T19:24:30.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.656+0000 7fcfe57fa640 1 -- 10.20.193.26:0/398352128 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2293541651 0 0) 0x7fcff0058400 con 0x7fcff0164d00 2026-02-24T19:24:30.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.656+0000 7fcfe57fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.656+0000 7fcfe57fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.656+0000 7fcfe57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.656+0000 7fcfe57fa640 10 monclient(hunting): my global_id is 30080 2026-02-24T19:24:30.668 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.656+0000 7fcfe57fa640 1 -- 10.20.193.26:0/398352128 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcff0148860 con 0x7fcff0164d00 2026-02-24T19:24:30.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.658+0000 7fcfe57fa640 1 -- 10.20.193.26:0/398352128 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1634928851 0 0) 0x7fcfc0003610 con 0x7fcff0157780 2026-02-24T19:24:30.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.658+0000 7fcfe57fa640 1 -- 10.20.193.26:0/398352128 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcff0058400 con 0x7fcff0157780 2026-02-24T19:24:30.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.658+0000 7fcfe57fa640 1 -- 10.20.193.26:0/398352128 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fcfe0003240 con 0x7fcff0157780 2026-02-24T19:24:30.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.658+0000 7fcfe57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:30.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.658+0000 7fcfe57fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:30.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.658+0000 7fcfe57fa640 10 monclient(hunting): dump: 2026-02-24T19:24:30.669 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.669 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.669 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.669 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.669 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.669 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.670 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.670 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.670 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.670 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.658+0000 7fcfe57fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:30.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.658+0000 7fcfe57fa640 1 -- 10.20.193.26:0/398352128 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1259338630 0 0) 0x7fcff01496a0 con 0x7fcff0157b50 2026-02-24T19:24:30.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.658+0000 7fcfe57fa640 1 -- 10.20.193.26:0/398352128 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcfc0003610 con 0x7fcff0157b50 2026-02-24T19:24:30.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.658+0000 7fcfe57fa640 1 -- 10.20.193.26:0/398352128 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fcfd80030b0 con 0x7fcff0157b50 2026-02-24T19:24:30.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.658+0000 7fcfe57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:30.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.658+0000 7fcfe57fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:30.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.658+0000 7fcfe57fa640 10 monclient(hunting): dump: 2026-02-24T19:24:30.670 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.670 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.670 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.671 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.671 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.671 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.671 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.671 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.671 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.671 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.659+0000 7fcfe57fa640 1 -- 10.20.193.26:0/398352128 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 844058242 0 0) 0x7fcff0148860 con 0x7fcff0164d00 2026-02-24T19:24:30.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.659+0000 7fcfe57fa640 1 -- 10.20.193.26:0/398352128 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcff01496a0 con 0x7fcff0164d00 2026-02-24T19:24:30.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.659+0000 7fcfe57fa640 1 -- 10.20.193.26:0/398352128 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fcfec003330 con 0x7fcff0164d00 2026-02-24T19:24:30.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.659+0000 7fcfe57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:30.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.659+0000 7fcfe57fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:30.673 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.659+0000 7fcfe57fa640 10 monclient(hunting): dump: 2026-02-24T19:24:30.673 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.674 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.674 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.674 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.674 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.674 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.674 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.674 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.674 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.674 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.659+0000 7fcfe57fa640 1 -- 10.20.193.26:0/398352128 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 783165815 0 0) 0x7fcff0058400 con 0x7fcff0157780 2026-02-24T19:24:30.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.660+0000 7fcfe57fa640 1 -- 10.20.193.26:0/398352128 >> v1:10.20.193.103:6789/0 conn(0x7fcff0164d00 legacy=0x7fcff0139c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.660+0000 7fcfe57fa640 1 -- 10.20.193.26:0/398352128 >> v1:10.20.193.70:6789/0 conn(0x7fcff0157b50 legacy=0x7fcff0138ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.674 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.660+0000 7fcfe57fa640 10 monclient: _finish_hunting 0 2026-02-24T19:24:30.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.660+0000 7fcfe57fa640 1 monclient: found mon.a 2026-02-24T19:24:30.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.660+0000 7fcfe57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:30.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.660+0000 7fcfe57fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:30.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.660+0000 7fcfe57fa640 1 -- 10.20.193.26:0/398352128 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff0148b20 con 0x7fcff0157780 2026-02-24T19:24:30.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.660+0000 7fcfe57fa640 10 monclient: _finish_auth 0 2026-02-24T19:24:30.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.660+0000 7fcfe57fa640 10 monclient: _check_auth_tickets 2026-02-24T19:24:30.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.660+0000 7fcfe57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:30.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.660+0000 7fcff6f87640 5 monclient: authenticate success, global_id 30741 2026-02-24T19:24:30.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.660+0000 7fcff6f87640 10 monclient: _renew_subs 2026-02-24T19:24:30.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.660+0000 7fcff6f87640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:30.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.660+0000 7fcff6f87640 1 -- 10.20.193.26:0/398352128 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcff0148e00 con 0x7fcff0157780 2026-02-24T19:24:30.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.660+0000 7fcff6f87640 10 client.30741.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:30.675 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.660+0000 7fcff6f87640 10 monclient: _renew_subs 2026-02-24T19:24:30.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.660+0000 7fcff6f87640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:30.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.660+0000 7fcff6f87640 1 -- 10.20.193.26:0/398352128 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fcff01493c0 con 0x7fcff0157780 2026-02-24T19:24:30.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.660+0000 7fcff6f87640 1 librados: init done 2026-02-24T19:24:30.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.660+0000 7fcff6f87640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:30.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.660+0000 7fcff6f87640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:30.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.660+0000 7fcff6f87640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:30.676 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.660+0000 7fcff6f87640 1 -- 10.20.193.26:0/398352128 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcff00b3780 con 0x7fcff0157780 2026-02-24T19:24:30.751 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.749+0000 7fcfe57fa640 1 -- 10.20.193.26:0/398352128 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcfe0002ea0 con 0x7fcff0157780 2026-02-24T19:24:30.751 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.749+0000 7fcfe57fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:30.751 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.749+0000 7fcfe57fa640 1 -- 10.20.193.26:0/398352128 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fcfe0004d20 con 0x7fcff0157780 2026-02-24T19:24:30.751 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.749+0000 7fcfe57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:30.752 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.749+0000 7fcfe57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:30.752 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.749+0000 7fcfe57fa640 10 monclient: dump: 2026-02-24T19:24:30.752 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.752 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.752 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.752 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.752 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.752 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.752 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.752 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.752 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.752 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.749+0000 7fcfe6ffd640 4 set_mon_vals no callback set 2026-02-24T19:24:30.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.750+0000 7fcfe57fa640 1 -- 10.20.193.26:0/398352128 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fcfe001db90 con 0x7fcff0157780 2026-02-24T19:24:30.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.751+0000 7fcfe7fff640 10 monclient: get_auth_request con 0x7fcfc0077e70 auth_method 0 2026-02-24T19:24:30.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.751+0000 7fcfe57fa640 10 client.30741.objecter ms_handle_connect 0x7fcfc0077e70 2026-02-24T19:24:30.755 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.753+0000 7fcfe57fa640 1 -- 10.20.193.26:0/398352128 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7fcfe0002890 con 0x7fcff0157780 2026-02-24T19:24:30.755 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.753+0000 7fcfe57fa640 10 client.30741.objecter ms_dispatch2 0x7fcff0000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:30.755 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.753+0000 7fcfe57fa640 3 client.30741.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:30.755 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.753+0000 7fcfe57fa640 3 client.30741.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:30.755 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.753+0000 7fcfe57fa640 20 client.30741.objecter dump_active .. 0 homeless 2026-02-24T19:24:30.755 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.753+0000 7fcfe57fa640 1 -- 10.20.193.26:0/398352128 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fcfe005db30 con 0x7fcff0157780 2026-02-24T19:24:30.755 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.753+0000 7fcfe57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:30.755 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.753+0000 7fcfe57fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:30.859 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.858+0000 7fcff6f87640 1 -- 10.20.193.26:0/398352128 --> v1:10.20.193.162:6800/3889602630 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fcff0137790 con 0x7fcfc0077e70 2026-02-24T19:24:30.860 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.858+0000 7fcfe57fa640 1 -- 10.20.193.26:0/398352128 <== mgr.4107 v1:10.20.193.162:6800/3889602630 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (unknown 778718403 0 0) 0x7fcff0137790 con 0x7fcfc0077e70 2026-02-24T19:24:30.860 INFO:teuthology.orchestra.run.trial026.stderr:instructed osd(s) 6 to deep-scrub 2026-02-24T19:24:30.861 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.859+0000 7fcff6f87640 10 librados: watch_flush enter 2026-02-24T19:24:30.861 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.859+0000 7fcff6f87640 10 librados: watch_flush exit 2026-02-24T19:24:30.861 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.859+0000 7fcff6f87640 20 client.30741.objecter shutdown clearing up homeless session... 2026-02-24T19:24:30.861 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.859+0000 7fcff6f87640 10 client.30741.objecter successfully canceled tick 2026-02-24T19:24:30.862 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.859+0000 7fcff6f87640 1 -- 10.20.193.26:0/398352128 >> v1:10.20.193.162:6800/3889602630 conn(0x7fcfc0077e70 legacy=0x7fcfc0098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.862 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.859+0000 7fcff6f87640 10 monclient: shutdown 2026-02-24T19:24:30.862 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.859+0000 7fcff6f87640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:30.862 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.859+0000 7fcff6f87640 1 -- 10.20.193.26:0/398352128 >> v1:10.20.193.26:6789/0 conn(0x7fcff0157780 legacy=0x7fcff0057cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.862 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.859+0000 7fcff6f87640 1 -- 10.20.193.26:0/398352128 shutdown_connections 2026-02-24T19:24:30.862 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.859+0000 7fcff6f87640 1 -- 10.20.193.26:0/398352128 >> 10.20.193.26:0/398352128 conn(0x7fcff00b2ef0 msgr2=0x7fcff00b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:30.862 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.859+0000 7fcff6f87640 1 -- 10.20.193.26:0/398352128 shutdown_connections 2026-02-24T19:24:30.862 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.859+0000 7fcff6f87640 1 -- 10.20.193.26:0/398352128 wait complete. 2026-02-24T19:24:30.862 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.859+0000 7fcff6f87640 1 librados: shutdown 2026-02-24T19:24:30.869 INFO:tasks.ceph:Scrubbing osd.10 2026-02-24T19:24:30.869 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:30.940 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.938+0000 7fdbd7526640 10 monclient: get_monmap_and_config 2026-02-24T19:24:30.940 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.938+0000 7fdbd7526640 10 monclient: build_initial_monmap 2026-02-24T19:24:30.940 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.938+0000 7fdbd7526640 10 monclient: monmap: 2026-02-24T19:24:30.940 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:30.940 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.940 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:30.939492+0000 2026-02-24T19:24:30.940 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:30.939492+0000 2026-02-24T19:24:30.941 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:30.941 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.941 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:30.941 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:30.941 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:30.941 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.944 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.939+0000 7fdbd7526640 1 Processor -- start 2026-02-24T19:24:30.944 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.939+0000 7fdbd7526640 1 -- start start 2026-02-24T19:24:30.944 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.939+0000 7fdbd7526640 10 monclient: init 2026-02-24T19:24:30.944 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.939+0000 7fdbd7526640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:30.944 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.939+0000 7fdbd7526640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:24:30.944 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.939+0000 7fdbd7526640 10 monclient(hunting): picked mon.noname-b con 0x7fdbd015e2a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:30.944 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.939+0000 7fdbd7526640 10 monclient(hunting): picked mon.noname-a con 0x7fdbd0059e10 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:30.944 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.939+0000 7fdbd7526640 10 monclient(hunting): picked mon.noname-c con 0x7fdbd01a5660 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:30.944 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.939+0000 7fdbd7526640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbd0162df0 con 0x7fdbd0059e10 2026-02-24T19:24:30.944 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.939+0000 7fdbd7526640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbd01630d0 con 0x7fdbd015e2a0 2026-02-24T19:24:30.945 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.939+0000 7fdbd7526640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbd01633b0 con 0x7fdbd01a5660 2026-02-24T19:24:30.945 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.939+0000 7fdbd7526640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:30.945 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.939+0000 7fdbd7526640 10 monclient(hunting): authenticate will time out at 4053.621872s 2026-02-24T19:24:30.945 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.940+0000 7fdbd5a9c640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fdbd01a5660 0x7fdbd01c5a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:57160/0 (socket says 10.20.193.26:57160) 2026-02-24T19:24:30.945 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.940+0000 7fdbd5a9c640 1 -- 10.20.193.26:0/2448162372 learned_addr learned my addr 10.20.193.26:0/2448162372 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:30.945 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.941+0000 7fdbbffff640 1 -- 10.20.193.26:0/2448162372 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1198442311 0 0) 0x7fdbd01630d0 con 0x7fdbd015e2a0 2026-02-24T19:24:30.945 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.941+0000 7fdbbffff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.945 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.941+0000 7fdbbffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.945 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.941+0000 7fdbbffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.945 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.941+0000 7fdbbffff640 10 monclient(hunting): my global_id is 28159 2026-02-24T19:24:30.945 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.941+0000 7fdbbffff640 1 -- 10.20.193.26:0/2448162372 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbb8003610 con 0x7fdbd015e2a0 2026-02-24T19:24:30.945 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.941+0000 7fdbbffff640 1 -- 10.20.193.26:0/2448162372 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2290835438 0 0) 0x7fdbd0162df0 con 0x7fdbd0059e10 2026-02-24T19:24:30.945 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.941+0000 7fdbbffff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.946 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.941+0000 7fdbbffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.946 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.941+0000 7fdbbffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.946 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.941+0000 7fdbbffff640 10 monclient(hunting): my global_id is 30744 2026-02-24T19:24:30.946 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.941+0000 7fdbbffff640 1 -- 10.20.193.26:0/2448162372 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbd01630d0 con 0x7fdbd0059e10 2026-02-24T19:24:30.946 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.941+0000 7fdbbffff640 1 -- 10.20.193.26:0/2448162372 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 260291828 0 0) 0x7fdbd01633b0 con 0x7fdbd01a5660 2026-02-24T19:24:30.946 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.941+0000 7fdbbffff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.946 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.941+0000 7fdbbffff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.946 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.941+0000 7fdbbffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.946 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.941+0000 7fdbbffff640 10 monclient(hunting): my global_id is 30083 2026-02-24T19:24:30.946 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.941+0000 7fdbbffff640 1 -- 10.20.193.26:0/2448162372 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbd0162df0 con 0x7fdbd01a5660 2026-02-24T19:24:30.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.943+0000 7fdbbffff640 1 -- 10.20.193.26:0/2448162372 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3913303639 0 0) 0x7fdbd01630d0 con 0x7fdbd0059e10 2026-02-24T19:24:30.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.943+0000 7fdbbffff640 1 -- 10.20.193.26:0/2448162372 >> v1:10.20.193.103:6789/0 conn(0x7fdbd01a5660 legacy=0x7fdbd01c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.943+0000 7fdbbffff640 1 -- 10.20.193.26:0/2448162372 >> v1:10.20.193.70:6789/0 conn(0x7fdbd015e2a0 legacy=0x7fdbd005da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.943+0000 7fdbbffff640 10 monclient: _finish_hunting 0 2026-02-24T19:24:30.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.943+0000 7fdbbffff640 1 monclient: found mon.noname-a 2026-02-24T19:24:30.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.943+0000 7fdbbffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:30.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.943+0000 7fdbbffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:24:30.953 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.943+0000 7fdbbffff640 1 -- 10.20.193.26:0/2448162372 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd0163690 con 0x7fdbd0059e10 2026-02-24T19:24:30.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.943+0000 7fdbbffff640 10 monclient: _finish_auth 0 2026-02-24T19:24:30.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.943+0000 7fdbbffff640 10 monclient: _check_auth_tickets 2026-02-24T19:24:30.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.943+0000 7fdbbffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:30.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.943+0000 7fdbbffff640 1 -- 10.20.193.26:0/2448162372 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fdbc4002df0 con 0x7fdbd0059e10 2026-02-24T19:24:30.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.943+0000 7fdbd7526640 5 monclient: authenticate success, global_id 30744 2026-02-24T19:24:30.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.943+0000 7fdbbffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:30.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.943+0000 7fdbbffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:30.954 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.943+0000 7fdbbffff640 10 monclient: dump: 2026-02-24T19:24:30.954 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.954 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.954 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.954 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.955 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.955 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.955 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.955 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.955 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.955 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.955 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.943+0000 7fdbd7526640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:30.955 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.944+0000 7fdbbffff640 1 -- 10.20.193.26:0/2448162372 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdbc4002fc0 con 0x7fdbd0059e10 2026-02-24T19:24:30.955 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.944+0000 7fdbbffff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:30.955 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.944+0000 7fdbbffff640 1 -- 10.20.193.26:0/2448162372 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fdbc4003400 con 0x7fdbd0059e10 2026-02-24T19:24:30.955 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.944+0000 7fdbd7526640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:30.955 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.944+0000 7fdbd7526640 4 set_mon_vals no callback set 2026-02-24T19:24:30.955 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.944+0000 7fdbbffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:30.956 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.944+0000 7fdbbffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:30.956 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.944+0000 7fdbbffff640 10 monclient: dump: 2026-02-24T19:24:30.956 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.956 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.956 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.956 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.956 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.956 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.956 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.956 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.956 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.956 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.956 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.944+0000 7fdbd7526640 10 monclient: shutdown 2026-02-24T19:24:30.957 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.944+0000 7fdbd7526640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:30.957 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.944+0000 7fdbd7526640 1 -- 10.20.193.26:0/2448162372 >> v1:10.20.193.26:6789/0 conn(0x7fdbd0059e10 legacy=0x7fdbd015ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.957 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.944+0000 7fdbd7526640 1 -- 10.20.193.26:0/2448162372 shutdown_connections 2026-02-24T19:24:30.957 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.944+0000 7fdbd7526640 1 -- 10.20.193.26:0/2448162372 >> 10.20.193.26:0/2448162372 conn(0x7fdbd00b2f60 msgr2=0x7fdbd00b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:30.957 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.944+0000 7fdbd7526640 1 -- 10.20.193.26:0/2448162372 shutdown_connections 2026-02-24T19:24:30.957 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.944+0000 7fdbd7526640 1 -- 10.20.193.26:0/2448162372 wait complete. 2026-02-24T19:24:30.957 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.944+0000 7fdbd7526640 10 monclient: build_initial_monmap 2026-02-24T19:24:30.957 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.944+0000 7fdbd7526640 10 monclient: monmap: 2026-02-24T19:24:30.957 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:30.957 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:30.957 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:30.957 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:30.957 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:30.958 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:30.958 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:30.958 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:30.958 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:30.958 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.958 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.944+0000 7fdbd7526640 1 librados: starting msgr at 2026-02-24T19:24:30.958 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.944+0000 7fdbd7526640 1 librados: starting objecter 2026-02-24T19:24:30.958 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.945+0000 7fdbd7526640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:30.958 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.945+0000 7fdbd7526640 1 Processor -- start 2026-02-24T19:24:30.958 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.945+0000 7fdbd7526640 1 -- start start 2026-02-24T19:24:30.958 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.945+0000 7fdbd7526640 1 librados: setting wanted keys 2026-02-24T19:24:30.958 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.945+0000 7fdbd7526640 1 librados: calling monclient init 2026-02-24T19:24:30.958 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.945+0000 7fdbd7526640 10 monclient: init 2026-02-24T19:24:30.959 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.945+0000 7fdbd7526640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:30.959 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.945+0000 7fdbd7526640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:24:30.959 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.945+0000 7fdbd7526640 10 monclient(hunting): picked mon.noname-b con 0x7fdbd0059e10 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:30.959 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.945+0000 7fdbd7526640 10 monclient(hunting): picked mon.noname-c con 0x7fdbd015e2a0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:30.959 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.945+0000 7fdbd7526640 10 monclient(hunting): picked mon.noname-a con 0x7fdbd01a5660 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:30.959 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.945+0000 7fdbd7526640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbd00a8070 con 0x7fdbd01a5660 2026-02-24T19:24:30.959 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.945+0000 7fdbd7526640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbd0180270 con 0x7fdbd0059e10 2026-02-24T19:24:30.959 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.945+0000 7fdbd7526640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbd0180550 con 0x7fdbd015e2a0 2026-02-24T19:24:30.959 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.945+0000 7fdbd7526640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:30.959 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.945+0000 7fdbd7526640 10 monclient(hunting): authenticate will time out at 4053.627451s 2026-02-24T19:24:30.959 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.945+0000 7fdbd5a9c640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fdbd01a5660 0x7fdbd017d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:58960/0 (socket says 10.20.193.26:58960) 2026-02-24T19:24:30.959 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.945+0000 7fdbd5a9c640 1 -- 10.20.193.26:0/3369741687 learned_addr learned my addr 10.20.193.26:0/3369741687 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:30.959 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.945+0000 7fdbbdffb640 10 client.?.objecter ms_handle_connect 0x7fdbd01a5660 2026-02-24T19:24:30.960 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.945+0000 7fdbbdffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:30.960 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.945+0000 7fdbbdffb640 10 client.?.objecter ms_handle_connect 0x7fdbd015e2a0 2026-02-24T19:24:30.960 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.946+0000 7fdbbdffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:30.960 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.946+0000 7fdbbdffb640 10 client.?.objecter ms_handle_connect 0x7fdbd0059e10 2026-02-24T19:24:30.960 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.946+0000 7fdbbdffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:30.960 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.946+0000 7fdbbdffb640 1 -- 10.20.193.26:0/3369741687 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1450140039 0 0) 0x7fdbd00a8070 con 0x7fdbd01a5660 2026-02-24T19:24:30.960 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.946+0000 7fdbbdffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.960 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.946+0000 7fdbbdffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.960 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.946+0000 7fdbbdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.960 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.946+0000 7fdbbdffb640 10 monclient(hunting): my global_id is 30747 2026-02-24T19:24:30.960 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.946+0000 7fdbbdffb640 1 -- 10.20.193.26:0/3369741687 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdba0003610 con 0x7fdbd01a5660 2026-02-24T19:24:30.960 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.947+0000 7fdbbdffb640 1 -- 10.20.193.26:0/3369741687 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2659970928 0 0) 0x7fdbd0180270 con 0x7fdbd0059e10 2026-02-24T19:24:30.960 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.947+0000 7fdbbdffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.961 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.947+0000 7fdbbdffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.961 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.947+0000 7fdbbdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.961 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.947+0000 7fdbbdffb640 10 monclient(hunting): my global_id is 28162 2026-02-24T19:24:30.961 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.947+0000 7fdbbdffb640 1 -- 10.20.193.26:0/3369741687 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbd00a8070 con 0x7fdbd0059e10 2026-02-24T19:24:30.961 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.947+0000 7fdbbdffb640 1 -- 10.20.193.26:0/3369741687 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 267980339 0 0) 0x7fdbd0180550 con 0x7fdbd015e2a0 2026-02-24T19:24:30.961 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.947+0000 7fdbbdffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:30.961 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.947+0000 7fdbbdffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:30.961 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.947+0000 7fdbbdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:30.961 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.947+0000 7fdbbdffb640 10 monclient(hunting): my global_id is 30086 2026-02-24T19:24:30.961 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.947+0000 7fdbbdffb640 1 -- 10.20.193.26:0/3369741687 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbd0180270 con 0x7fdbd015e2a0 2026-02-24T19:24:30.961 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.949+0000 7fdbbdffb640 1 -- 10.20.193.26:0/3369741687 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1873561872 0 0) 0x7fdba0003610 con 0x7fdbd01a5660 2026-02-24T19:24:30.961 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.949+0000 7fdbbdffb640 1 -- 10.20.193.26:0/3369741687 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdbd0180550 con 0x7fdbd01a5660 2026-02-24T19:24:30.961 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.949+0000 7fdbbdffb640 1 -- 10.20.193.26:0/3369741687 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fdbcc003410 con 0x7fdbd01a5660 2026-02-24T19:24:30.962 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.949+0000 7fdbbdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:30.962 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.949+0000 7fdbbdffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:30.962 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.949+0000 7fdbbdffb640 10 monclient(hunting): dump: 2026-02-24T19:24:30.962 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.962 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.962 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.962 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.962 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.962 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.962 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.962 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.962 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.962 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.963 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.949+0000 7fdbbdffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:30.963 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.949+0000 7fdbbdffb640 1 -- 10.20.193.26:0/3369741687 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2202036010 0 0) 0x7fdbd0180270 con 0x7fdbd015e2a0 2026-02-24T19:24:30.963 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.949+0000 7fdbbdffb640 1 -- 10.20.193.26:0/3369741687 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdba0003610 con 0x7fdbd015e2a0 2026-02-24T19:24:30.963 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.949+0000 7fdbbdffb640 1 -- 10.20.193.26:0/3369741687 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fdbc4003310 con 0x7fdbd015e2a0 2026-02-24T19:24:30.963 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.949+0000 7fdbbdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:30.963 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.949+0000 7fdbbdffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:30.963 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.949+0000 7fdbbdffb640 10 monclient(hunting): dump: 2026-02-24T19:24:30.963 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.963 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.963 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.963 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.963 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.963 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.964 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.964 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.964 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.964 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.964 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.949+0000 7fdbbdffb640 1 -- 10.20.193.26:0/3369741687 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3775078922 0 0) 0x7fdbd00a8070 con 0x7fdbd0059e10 2026-02-24T19:24:30.964 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.949+0000 7fdbbdffb640 1 -- 10.20.193.26:0/3369741687 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdbd0180270 con 0x7fdbd0059e10 2026-02-24T19:24:30.964 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.949+0000 7fdbbdffb640 1 -- 10.20.193.26:0/3369741687 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fdbc00030b0 con 0x7fdbd0059e10 2026-02-24T19:24:30.964 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.949+0000 7fdbbdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:30.964 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.949+0000 7fdbbdffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:30.964 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.949+0000 7fdbbdffb640 10 monclient(hunting): dump: 2026-02-24T19:24:30.964 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.964 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.964 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.965 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.965 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.965 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.965 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.965 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.965 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.965 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.965 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.950+0000 7fdbbdffb640 1 -- 10.20.193.26:0/3369741687 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2284704773 0 0) 0x7fdbd0180550 con 0x7fdbd01a5660 2026-02-24T19:24:30.965 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.950+0000 7fdbbdffb640 1 -- 10.20.193.26:0/3369741687 >> v1:10.20.193.103:6789/0 conn(0x7fdbd015e2a0 legacy=0x7fdbd017f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.965 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.950+0000 7fdbbdffb640 1 -- 10.20.193.26:0/3369741687 >> v1:10.20.193.70:6789/0 conn(0x7fdbd0059e10 legacy=0x7fdbd0180fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.965 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.950+0000 7fdbbdffb640 10 monclient: _finish_hunting 0 2026-02-24T19:24:30.965 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.950+0000 7fdbbdffb640 1 monclient: found mon.a 2026-02-24T19:24:30.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.950+0000 7fdbbdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:30.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.950+0000 7fdbbdffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:30.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.950+0000 7fdbbdffb640 1 -- 10.20.193.26:0/3369741687 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd00a8330 con 0x7fdbd01a5660 2026-02-24T19:24:30.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.950+0000 7fdbbdffb640 10 monclient: _finish_auth 0 2026-02-24T19:24:30.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.950+0000 7fdbbdffb640 10 monclient: _check_auth_tickets 2026-02-24T19:24:30.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.950+0000 7fdbbdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:30.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.950+0000 7fdbd7526640 5 monclient: authenticate success, global_id 30747 2026-02-24T19:24:30.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.950+0000 7fdbd7526640 10 monclient: _renew_subs 2026-02-24T19:24:30.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.950+0000 7fdbd7526640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:30.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.950+0000 7fdbd7526640 1 -- 10.20.193.26:0/3369741687 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdbd00a8610 con 0x7fdbd01a5660 2026-02-24T19:24:30.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.950+0000 7fdbd7526640 10 client.30747.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:30.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.950+0000 7fdbd7526640 10 monclient: _renew_subs 2026-02-24T19:24:30.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.950+0000 7fdbd7526640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:30.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.950+0000 7fdbd7526640 1 -- 10.20.193.26:0/3369741687 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdbd00a8bd0 con 0x7fdbd01a5660 2026-02-24T19:24:30.967 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.950+0000 7fdbd7526640 1 librados: init done 2026-02-24T19:24:30.967 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.951+0000 7fdbd7526640 10 client.30747.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:30.967 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.951+0000 7fdbd7526640 15 client.30747.objecter _session_command_op_assign -1 1 2026-02-24T19:24:30.967 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.951+0000 7fdbd7526640 20 client.30747.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:30.967 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.951+0000 7fdbd7526640 10 client.30747.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:30.967 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.951+0000 7fdbd7526640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:30.967 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.951+0000 7fdbd7526640 1 -- 10.20.193.26:0/3369741687 --> v1:10.20.193.26:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fdbd01925e0 con 0x7fdbd01a5660 2026-02-24T19:24:30.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.959+0000 7fdbbdffb640 1 -- 10.20.193.26:0/3369741687 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdbd01925e0 con 0x7fdbd01a5660 2026-02-24T19:24:30.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.959+0000 7fdbbdffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:30.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.959+0000 7fdbbdffb640 1 -- 10.20.193.26:0/3369741687 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fdbcc004df0 con 0x7fdbd01a5660 2026-02-24T19:24:30.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.959+0000 7fdbbdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:30.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.959+0000 7fdbbdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:30.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.959+0000 7fdbbdffb640 10 monclient: dump: 2026-02-24T19:24:30.970 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:30.970 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:30.970 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.970 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:30.970 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:30.970 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:30.970 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:30.970 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:30.970 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:30.970 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:30.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.959+0000 7fdbbf7fe640 4 set_mon_vals no callback set 2026-02-24T19:24:30.970 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.960+0000 7fdbbdffb640 1 -- 10.20.193.26:0/3369741687 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fdbcc004fd0 con 0x7fdbd01a5660 2026-02-24T19:24:30.971 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.960+0000 7fdbd529b640 10 monclient: get_auth_request con 0x7fdba0077e60 auth_method 0 2026-02-24T19:24:30.971 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.960+0000 7fdbbdffb640 10 client.30747.objecter ms_handle_connect 0x7fdba0077e60 2026-02-24T19:24:30.971 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.961+0000 7fdbbdffb640 1 -- 10.20.193.26:0/3369741687 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7fdbcc0933c0 con 0x7fdbd01a5660 2026-02-24T19:24:30.971 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.961+0000 7fdbbdffb640 10 client.30747.objecter ms_dispatch2 0x7fdbd0000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:30.971 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.961+0000 7fdbbdffb640 3 client.30747.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:30.971 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.961+0000 7fdbbdffb640 3 client.30747.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:30.971 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.961+0000 7fdbbdffb640 10 client.30747.objecter checking command 1 2026-02-24T19:24:30.971 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.961+0000 7fdbbdffb640 20 client.30747.objecter _get_session s=0x7fdba00a21c0 osd=10 3 2026-02-24T19:24:30.971 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.961+0000 7fdbbdffb640 20 client.30747.objecter put_session s=0x7fdba00a21c0 osd=10 3 2026-02-24T19:24:30.971 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.961+0000 7fdbbdffb640 15 client.30747.objecter _session_command_op_remove -1 1 2026-02-24T19:24:30.971 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.961+0000 7fdbbdffb640 20 client.30747.objecter _get_session s=0x7fdba00a21c0 osd=10 3 2026-02-24T19:24:30.971 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.961+0000 7fdbbdffb640 20 client.30747.objecter get_session s=0x7fdba00a21c0 osd=10 3 2026-02-24T19:24:30.971 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.961+0000 7fdbbdffb640 15 client.30747.objecter _session_command_op_assign 10 1 2026-02-24T19:24:30.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.961+0000 7fdbbdffb640 20 client.30747.objecter put_session s=0x7fdba00a21c0 osd=10 4 2026-02-24T19:24:30.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.961+0000 7fdbbdffb640 10 client.30747.objecter _send_command 1 2026-02-24T19:24:30.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.961+0000 7fdbbdffb640 1 -- 10.20.193.26:0/3369741687 --> v1:10.20.193.103:6801/3185480373 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdba00c44d0 con 0x7fdba00a2870 2026-02-24T19:24:30.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.961+0000 7fdbbdffb640 20 client.30747.objecter dump_active .. 0 homeless 2026-02-24T19:24:30.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.961+0000 7fdbbdffb640 1 -- 10.20.193.26:0/3369741687 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_get_version_reply(handle=1 version=346) ==== 24+0+0 (unknown 2991753921 0 0) 0x7fdbcc059a60 con 0x7fdbd01a5660 2026-02-24T19:24:30.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.961+0000 7fdbbdffb640 10 monclient: handle_get_version_reply finishing 1 version 346 2026-02-24T19:24:30.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.961+0000 7fdbd4a9a640 10 monclient: get_auth_request con 0x7fdba00a2870 auth_method 0 2026-02-24T19:24:30.972 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.962+0000 7fdbbdffb640 10 client.30747.objecter ms_handle_connect 0x7fdba00a2870 2026-02-24T19:24:30.973 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.972+0000 7fdbbdffb640 1 -- 10.20.193.26:0/3369741687 <== osd.10 v1:10.20.193.103:6801/3185480373 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fdba00c44d0 con 0x7fdba00a2870 2026-02-24T19:24:30.973 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.972+0000 7fdbbdffb640 10 client.30747.objecter ms_dispatch2 0x7fdbd0000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:30.973 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.972+0000 7fdbbdffb640 10 client.30747.objecter _finish_command 1 = system:0 2026-02-24T19:24:30.974 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.972+0000 7fdbbdffb640 20 client.30747.objecter put_session s=0x7fdba00a21c0 osd=10 4 2026-02-24T19:24:30.974 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.972+0000 7fdbbdffb640 15 client.30747.objecter _session_command_op_remove 10 1 2026-02-24T19:24:30.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.979+0000 7fdbd7526640 10 client.30747.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:30.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.979+0000 7fdbd7526640 15 client.30747.objecter _session_command_op_assign -1 2 2026-02-24T19:24:30.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.979+0000 7fdbd7526640 20 client.30747.objecter _get_session s=0x7fdba00a21c0 osd=10 3 2026-02-24T19:24:30.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.979+0000 7fdbd7526640 20 client.30747.objecter put_session s=0x7fdba00a21c0 osd=10 3 2026-02-24T19:24:30.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.979+0000 7fdbd7526640 20 client.30747.objecter _get_session s=0x7fdba00a21c0 osd=10 3 2026-02-24T19:24:30.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.979+0000 7fdbd7526640 15 client.30747.objecter _session_command_op_remove -1 2 2026-02-24T19:24:30.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.979+0000 7fdbd7526640 20 client.30747.objecter get_session s=0x7fdba00a21c0 osd=10 3 2026-02-24T19:24:30.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.979+0000 7fdbd7526640 15 client.30747.objecter _session_command_op_assign 10 2 2026-02-24T19:24:30.981 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.979+0000 7fdbd7526640 20 client.30747.objecter put_session s=0x7fdba00a21c0 osd=10 4 2026-02-24T19:24:30.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.979+0000 7fdbd7526640 10 client.30747.objecter _send_command 2 2026-02-24T19:24:30.982 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.979+0000 7fdbd7526640 1 -- 10.20.193.26:0/3369741687 --> v1:10.20.193.103:6801/3185480373 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdbd0192300 con 0x7fdba00a2870 2026-02-24T19:24:30.988 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.986+0000 7fdbbdffb640 1 -- 10.20.193.26:0/3369741687 <== osd.10 v1:10.20.193.103:6801/3185480373 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fdbd0192300 con 0x7fdba00a2870 2026-02-24T19:24:30.988 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.986+0000 7fdbbdffb640 10 client.30747.objecter ms_dispatch2 0x7fdbd0000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:30.988 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.986+0000 7fdbbdffb640 10 client.30747.objecter _finish_command 2 = system:0 2026-02-24T19:24:30.988 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.986+0000 7fdbbdffb640 20 client.30747.objecter put_session s=0x7fdba00a21c0 osd=10 4 2026-02-24T19:24:30.988 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.986+0000 7fdbbdffb640 15 client.30747.objecter _session_command_op_remove 10 2 2026-02-24T19:24:30.989 INFO:teuthology.orchestra.run.trial026.stdout:{ 2026-02-24T19:24:30.989 INFO:teuthology.orchestra.run.trial026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:30.989 INFO:teuthology.orchestra.run.trial026.stdout:} 2026-02-24T19:24:30.990 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.987+0000 7fdbd7526640 10 librados: watch_flush enter 2026-02-24T19:24:30.991 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.987+0000 7fdbd7526640 10 librados: watch_flush exit 2026-02-24T19:24:30.991 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.987+0000 7fdbd7526640 10 client.30747.objecter close_session for osd.10 2026-02-24T19:24:30.991 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.987+0000 7fdbd7526640 1 -- 10.20.193.26:0/3369741687 >> v1:10.20.193.103:6801/3185480373 conn(0x7fdba00a2870 legacy=0x7fdba00c2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.991 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.987+0000 7fdbd7526640 20 client.30747.objecter put_session s=0x7fdba00a21c0 osd=10 1 2026-02-24T19:24:30.991 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.987+0000 7fdbd7526640 20 client.30747.objecter shutdown clearing up homeless session... 2026-02-24T19:24:30.991 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.987+0000 7fdbd7526640 10 client.30747.objecter successfully canceled tick 2026-02-24T19:24:30.991 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.987+0000 7fdbd7526640 1 -- 10.20.193.26:0/3369741687 >> v1:10.20.193.162:6800/3889602630 conn(0x7fdba0077e60 legacy=0x7fdba0098310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.991 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.987+0000 7fdbd7526640 10 monclient: shutdown 2026-02-24T19:24:30.991 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.987+0000 7fdbd7526640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:30.991 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.987+0000 7fdbd7526640 1 -- 10.20.193.26:0/3369741687 >> v1:10.20.193.26:6789/0 conn(0x7fdbd01a5660 legacy=0x7fdbd017d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:30.991 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.987+0000 7fdbd5a9c640 1 -- 10.20.193.26:0/3369741687 reap_dead start 2026-02-24T19:24:30.992 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.987+0000 7fdbd7526640 1 -- 10.20.193.26:0/3369741687 shutdown_connections 2026-02-24T19:24:30.992 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.987+0000 7fdbd7526640 1 -- 10.20.193.26:0/3369741687 >> 10.20.193.26:0/3369741687 conn(0x7fdbd00b2f60 msgr2=0x7fdbd00b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:30.992 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.987+0000 7fdbd7526640 1 -- 10.20.193.26:0/3369741687 shutdown_connections 2026-02-24T19:24:30.992 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.987+0000 7fdbd7526640 1 -- 10.20.193.26:0/3369741687 wait complete. 2026-02-24T19:24:30.992 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:30.987+0000 7fdbd7526640 1 librados: shutdown 2026-02-24T19:24:30.996 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 10 2026-02-24T19:24:31.063 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.062+0000 7fa97577f640 10 monclient: get_monmap_and_config 2026-02-24T19:24:31.064 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.062+0000 7fa97577f640 10 monclient: build_initial_monmap 2026-02-24T19:24:31.064 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.062+0000 7fa97577f640 10 monclient: monmap: 2026-02-24T19:24:31.064 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:31.064 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.064 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:31.063008+0000 2026-02-24T19:24:31.064 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:31.063008+0000 2026-02-24T19:24:31.064 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:31.064 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.064 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:31.065 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:31.065 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:31.065 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.067 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.062+0000 7fa97577f640 1 Processor -- start 2026-02-24T19:24:31.067 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.062+0000 7fa97577f640 1 -- start start 2026-02-24T19:24:31.067 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.062+0000 7fa97577f640 10 monclient: init 2026-02-24T19:24:31.067 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.063+0000 7fa97577f640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:31.067 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.063+0000 7fa97577f640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:31.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.063+0000 7fa97577f640 10 monclient(hunting): picked mon.noname-a con 0x7fa970157780 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:31.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.063+0000 7fa97577f640 10 monclient(hunting): picked mon.noname-c con 0x7fa970157b50 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:31.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.063+0000 7fa97577f640 10 monclient(hunting): picked mon.noname-b con 0x7fa970164d00 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:31.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.063+0000 7fa97577f640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa97005de70 con 0x7fa970157780 2026-02-24T19:24:31.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.063+0000 7fa97577f640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa970055b20 con 0x7fa970164d00 2026-02-24T19:24:31.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.063+0000 7fa97577f640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa970055e00 con 0x7fa970157b50 2026-02-24T19:24:31.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.063+0000 7fa97577f640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:31.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.063+0000 7fa97577f640 10 monclient(hunting): authenticate will time out at 4053.745301s 2026-02-24T19:24:31.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.063+0000 7fa96e7fc640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fa970157b50 0x7fa9701645f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:57186/0 (socket says 10.20.193.26:57186) 2026-02-24T19:24:31.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.063+0000 7fa96e7fc640 1 -- 10.20.193.26:0/3220715691 learned_addr learned my addr 10.20.193.26:0/3220715691 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:31.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.065+0000 7fa96dffb640 1 -- 10.20.193.26:0/3220715691 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2254680461 0 0) 0x7fa970055e00 con 0x7fa970157b50 2026-02-24T19:24:31.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.065+0000 7fa96dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.065+0000 7fa96dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.065+0000 7fa96dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.065+0000 7fa96dffb640 10 monclient(hunting): my global_id is 30089 2026-02-24T19:24:31.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.065+0000 7fa96dffb640 1 -- 10.20.193.26:0/3220715691 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa95c003610 con 0x7fa970157b50 2026-02-24T19:24:31.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.065+0000 7fa96dffb640 1 -- 10.20.193.26:0/3220715691 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 593024145 0 0) 0x7fa970055b20 con 0x7fa970164d00 2026-02-24T19:24:31.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.065+0000 7fa96dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.065+0000 7fa96dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.065+0000 7fa96dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.065+0000 7fa96dffb640 10 monclient(hunting): my global_id is 28165 2026-02-24T19:24:31.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.065+0000 7fa96dffb640 1 -- 10.20.193.26:0/3220715691 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa970055e00 con 0x7fa970164d00 2026-02-24T19:24:31.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.065+0000 7fa96dffb640 1 -- 10.20.193.26:0/3220715691 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2930128212 0 0) 0x7fa97005de70 con 0x7fa970157780 2026-02-24T19:24:31.070 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.065+0000 7fa96dffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.070 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.065+0000 7fa96dffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.070 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.065+0000 7fa96dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.070 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.065+0000 7fa96dffb640 10 monclient(hunting): my global_id is 30750 2026-02-24T19:24:31.070 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.065+0000 7fa96dffb640 1 -- 10.20.193.26:0/3220715691 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa970055b20 con 0x7fa970157780 2026-02-24T19:24:31.076 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.066+0000 7fa96dffb640 1 -- 10.20.193.26:0/3220715691 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3650415881 0 0) 0x7fa970055e00 con 0x7fa970164d00 2026-02-24T19:24:31.076 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.066+0000 7fa96dffb640 1 -- 10.20.193.26:0/3220715691 >> v1:10.20.193.103:6789/0 conn(0x7fa970157b50 legacy=0x7fa9701645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.066+0000 7fa96dffb640 1 -- 10.20.193.26:0/3220715691 >> v1:10.20.193.26:6789/0 conn(0x7fa970157780 legacy=0x7fa970056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.066+0000 7fa96dffb640 10 monclient: _finish_hunting 0 2026-02-24T19:24:31.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.066+0000 7fa96dffb640 1 monclient: found mon.noname-b 2026-02-24T19:24:31.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.066+0000 7fa96dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:31.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.066+0000 7fa96dffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:24:31.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.066+0000 7fa96dffb640 1 -- 10.20.193.26:0/3220715691 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9700560e0 con 0x7fa970164d00 2026-02-24T19:24:31.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.066+0000 7fa96dffb640 10 monclient: _finish_auth 0 2026-02-24T19:24:31.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.066+0000 7fa96dffb640 10 monclient: _check_auth_tickets 2026-02-24T19:24:31.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.066+0000 7fa96dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:31.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.066+0000 7fa96dffb640 1 -- 10.20.193.26:0/3220715691 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa960003170 con 0x7fa970164d00 2026-02-24T19:24:31.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.066+0000 7fa96dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:31.078 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.066+0000 7fa96dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:31.078 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.066+0000 7fa96dffb640 10 monclient: dump: 2026-02-24T19:24:31.078 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.078 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.078 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.078 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.078 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.078 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.078 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.078 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.078 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.078 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.078 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.066+0000 7fa97577f640 5 monclient: authenticate success, global_id 28165 2026-02-24T19:24:31.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.066+0000 7fa97577f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:31.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.067+0000 7fa96dffb640 1 -- 10.20.193.26:0/3220715691 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa960003340 con 0x7fa970164d00 2026-02-24T19:24:31.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.067+0000 7fa96dffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:31.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.067+0000 7fa96dffb640 1 -- 10.20.193.26:0/3220715691 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa960003780 con 0x7fa970164d00 2026-02-24T19:24:31.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.067+0000 7fa96dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:31.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.067+0000 7fa96dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:31.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.067+0000 7fa96dffb640 10 monclient: dump: 2026-02-24T19:24:31.079 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.079 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.079 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.079 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.079 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.080 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.080 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.080 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.080 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.080 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.080 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.067+0000 7fa97577f640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:31.080 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.067+0000 7fa97577f640 4 set_mon_vals no callback set 2026-02-24T19:24:31.080 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.067+0000 7fa97577f640 10 monclient: shutdown 2026-02-24T19:24:31.080 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.067+0000 7fa97577f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:31.080 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.067+0000 7fa97577f640 1 -- 10.20.193.26:0/3220715691 >> v1:10.20.193.70:6789/0 conn(0x7fa970164d00 legacy=0x7fa9701c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.080 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.067+0000 7fa97577f640 1 -- 10.20.193.26:0/3220715691 shutdown_connections 2026-02-24T19:24:31.080 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.067+0000 7fa97577f640 1 -- 10.20.193.26:0/3220715691 >> 10.20.193.26:0/3220715691 conn(0x7fa9700b2ef0 msgr2=0x7fa9700b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:31.080 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.067+0000 7fa97577f640 1 -- 10.20.193.26:0/3220715691 shutdown_connections 2026-02-24T19:24:31.081 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.067+0000 7fa97577f640 1 -- 10.20.193.26:0/3220715691 wait complete. 2026-02-24T19:24:31.081 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.068+0000 7fa97577f640 10 monclient: build_initial_monmap 2026-02-24T19:24:31.081 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.068+0000 7fa97577f640 10 monclient: monmap: 2026-02-24T19:24:31.081 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:31.081 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:31.081 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:31.081 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:31.081 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:31.081 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:31.081 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:31.081 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:31.081 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:31.081 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.082 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.068+0000 7fa97577f640 1 librados: starting msgr at 2026-02-24T19:24:31.082 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.068+0000 7fa97577f640 1 librados: starting objecter 2026-02-24T19:24:31.082 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.068+0000 7fa97577f640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:31.082 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.068+0000 7fa97577f640 1 Processor -- start 2026-02-24T19:24:31.082 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.068+0000 7fa97577f640 1 -- start start 2026-02-24T19:24:31.082 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.068+0000 7fa97577f640 1 librados: setting wanted keys 2026-02-24T19:24:31.082 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.068+0000 7fa97577f640 1 librados: calling monclient init 2026-02-24T19:24:31.082 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.068+0000 7fa97577f640 10 monclient: init 2026-02-24T19:24:31.082 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.068+0000 7fa97577f640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:31.082 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.068+0000 7fa97577f640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:31.082 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.068+0000 7fa97577f640 10 monclient(hunting): picked mon.noname-c con 0x7fa970157780 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:31.082 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.068+0000 7fa97577f640 10 monclient(hunting): picked mon.noname-b con 0x7fa970157b50 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:31.082 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.068+0000 7fa97577f640 10 monclient(hunting): picked mon.noname-a con 0x7fa970164d00 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:31.083 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.068+0000 7fa97577f640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa970131050 con 0x7fa970164d00 2026-02-24T19:24:31.083 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.068+0000 7fa97577f640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa970131330 con 0x7fa970157b50 2026-02-24T19:24:31.083 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.068+0000 7fa97577f640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa970131610 con 0x7fa970157780 2026-02-24T19:24:31.083 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.068+0000 7fa97577f640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:31.083 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.068+0000 7fa97577f640 10 monclient(hunting): authenticate will time out at 4053.750950s 2026-02-24T19:24:31.083 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.069+0000 7fa96effd640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fa970157780 0x7fa9700ae5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:57190/0 (socket says 10.20.193.26:57190) 2026-02-24T19:24:31.083 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.069+0000 7fa96effd640 1 -- 10.20.193.26:0/2951142454 learned_addr learned my addr 10.20.193.26:0/2951142454 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:31.083 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.069+0000 7fa94f7fe640 10 client.?.objecter ms_handle_connect 0x7fa970157b50 2026-02-24T19:24:31.083 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.069+0000 7fa94f7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:31.083 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.069+0000 7fa94f7fe640 10 client.?.objecter ms_handle_connect 0x7fa970157780 2026-02-24T19:24:31.083 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.069+0000 7fa94f7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:31.083 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.069+0000 7fa94f7fe640 10 client.?.objecter ms_handle_connect 0x7fa970164d00 2026-02-24T19:24:31.083 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.069+0000 7fa94f7fe640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:31.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.070+0000 7fa94f7fe640 1 -- 10.20.193.26:0/2951142454 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 330145976 0 0) 0x7fa970131050 con 0x7fa970164d00 2026-02-24T19:24:31.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.070+0000 7fa94f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.070+0000 7fa94f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.070+0000 7fa94f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.070+0000 7fa94f7fe640 10 monclient(hunting): my global_id is 30753 2026-02-24T19:24:31.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.070+0000 7fa94f7fe640 1 -- 10.20.193.26:0/2951142454 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa93c003610 con 0x7fa970164d00 2026-02-24T19:24:31.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.070+0000 7fa94f7fe640 1 -- 10.20.193.26:0/2951142454 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3851517763 0 0) 0x7fa970131330 con 0x7fa970157b50 2026-02-24T19:24:31.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.070+0000 7fa94f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.070+0000 7fa94f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.070+0000 7fa94f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.070+0000 7fa94f7fe640 10 monclient(hunting): my global_id is 28168 2026-02-24T19:24:31.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.070+0000 7fa94f7fe640 1 -- 10.20.193.26:0/2951142454 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa970131050 con 0x7fa970157b50 2026-02-24T19:24:31.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.070+0000 7fa94f7fe640 1 -- 10.20.193.26:0/2951142454 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3089002684 0 0) 0x7fa970131610 con 0x7fa970157780 2026-02-24T19:24:31.085 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.070+0000 7fa94f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.085 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.070+0000 7fa94f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.085 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.070+0000 7fa94f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.085 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.070+0000 7fa94f7fe640 10 monclient(hunting): my global_id is 30092 2026-02-24T19:24:31.085 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.070+0000 7fa94f7fe640 1 -- 10.20.193.26:0/2951142454 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa970131330 con 0x7fa970157780 2026-02-24T19:24:31.085 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.072+0000 7fa94f7fe640 1 -- 10.20.193.26:0/2951142454 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1343028359 0 0) 0x7fa970131050 con 0x7fa970157b50 2026-02-24T19:24:31.085 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.072+0000 7fa94f7fe640 1 -- 10.20.193.26:0/2951142454 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa970131610 con 0x7fa970157b50 2026-02-24T19:24:31.085 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.072+0000 7fa94f7fe640 1 -- 10.20.193.26:0/2951142454 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa9580030b0 con 0x7fa970157b50 2026-02-24T19:24:31.085 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.072+0000 7fa94f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:31.085 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.072+0000 7fa94f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:31.085 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.072+0000 7fa94f7fe640 10 monclient(hunting): dump: 2026-02-24T19:24:31.085 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.086 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.086 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.086 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.086 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.086 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.086 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.086 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.086 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.086 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.086 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.072+0000 7fa94f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:31.086 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.072+0000 7fa94f7fe640 1 -- 10.20.193.26:0/2951142454 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2313954279 0 0) 0x7fa970131330 con 0x7fa970157780 2026-02-24T19:24:31.086 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.072+0000 7fa94f7fe640 1 -- 10.20.193.26:0/2951142454 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa970131050 con 0x7fa970157780 2026-02-24T19:24:31.086 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.072+0000 7fa94f7fe640 1 -- 10.20.193.26:0/2951142454 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa964003170 con 0x7fa970157780 2026-02-24T19:24:31.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.072+0000 7fa94f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:31.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.072+0000 7fa94f7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:31.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.072+0000 7fa94f7fe640 10 monclient(hunting): dump: 2026-02-24T19:24:31.087 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.087 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.087 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.087 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.087 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.087 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.087 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.087 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.087 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.087 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.072+0000 7fa94f7fe640 1 -- 10.20.193.26:0/2951142454 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1309399573 0 0) 0x7fa93c003610 con 0x7fa970164d00 2026-02-24T19:24:31.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.072+0000 7fa94f7fe640 1 -- 10.20.193.26:0/2951142454 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa970131330 con 0x7fa970164d00 2026-02-24T19:24:31.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.072+0000 7fa94f7fe640 1 -- 10.20.193.26:0/2951142454 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa960003690 con 0x7fa970164d00 2026-02-24T19:24:31.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.072+0000 7fa94f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:31.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.072+0000 7fa94f7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:31.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.072+0000 7fa94f7fe640 10 monclient(hunting): dump: 2026-02-24T19:24:31.088 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.088 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.088 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.088 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.088 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.088 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.088 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.089 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.089 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.089 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.074+0000 7fa94f7fe640 1 -- 10.20.193.26:0/2951142454 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3162207599 0 0) 0x7fa970131610 con 0x7fa970157b50 2026-02-24T19:24:31.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.074+0000 7fa94f7fe640 1 -- 10.20.193.26:0/2951142454 >> v1:10.20.193.103:6789/0 conn(0x7fa970157780 legacy=0x7fa9700ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.074+0000 7fa94f7fe640 1 -- 10.20.193.26:0/2951142454 >> v1:10.20.193.26:6789/0 conn(0x7fa970164d00 legacy=0x7fa9700a6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.074+0000 7fa94f7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:24:31.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.074+0000 7fa94f7fe640 1 monclient: found mon.b 2026-02-24T19:24:31.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.074+0000 7fa94f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:31.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.074+0000 7fa94f7fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:31.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.074+0000 7fa94f7fe640 1 -- 10.20.193.26:0/2951142454 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9701318f0 con 0x7fa970157b50 2026-02-24T19:24:31.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.074+0000 7fa94f7fe640 10 monclient: _finish_auth 0 2026-02-24T19:24:31.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.074+0000 7fa94f7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:24:31.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.074+0000 7fa94f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:31.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.074+0000 7fa97577f640 5 monclient: authenticate success, global_id 28168 2026-02-24T19:24:31.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.074+0000 7fa97577f640 10 monclient: _renew_subs 2026-02-24T19:24:31.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.074+0000 7fa97577f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:31.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.074+0000 7fa97577f640 1 -- 10.20.193.26:0/2951142454 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa970131bd0 con 0x7fa970157b50 2026-02-24T19:24:31.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.074+0000 7fa97577f640 10 client.28168.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:31.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.074+0000 7fa97577f640 10 monclient: _renew_subs 2026-02-24T19:24:31.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.074+0000 7fa97577f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:31.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.074+0000 7fa97577f640 1 -- 10.20.193.26:0/2951142454 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa970144e10 con 0x7fa970157b50 2026-02-24T19:24:31.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.074+0000 7fa97577f640 1 librados: init done 2026-02-24T19:24:31.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.074+0000 7fa97577f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:31.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.074+0000 7fa97577f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:31.091 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.074+0000 7fa97577f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:31.091 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.074+0000 7fa97577f640 1 -- 10.20.193.26:0/2951142454 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9700ad220 con 0x7fa970157b50 2026-02-24T19:24:31.167 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.165+0000 7fa94f7fe640 1 -- 10.20.193.26:0/2951142454 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa9580048d0 con 0x7fa970157b50 2026-02-24T19:24:31.167 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.165+0000 7fa94f7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:31.167 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.165+0000 7fa94f7fe640 1 -- 10.20.193.26:0/2951142454 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa958004c20 con 0x7fa970157b50 2026-02-24T19:24:31.167 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.165+0000 7fa94f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:31.167 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.165+0000 7fa94f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:31.167 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.165+0000 7fa94f7fe640 10 monclient: dump: 2026-02-24T19:24:31.167 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.167 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.168 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.168 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.168 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.168 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.168 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.168 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.168 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.168 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.168 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.165+0000 7fa96d7fa640 4 set_mon_vals no callback set 2026-02-24T19:24:31.169 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.166+0000 7fa94f7fe640 1 -- 10.20.193.26:0/2951142454 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fa95801da90 con 0x7fa970157b50 2026-02-24T19:24:31.169 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.166+0000 7fa96effd640 10 monclient: get_auth_request con 0x7fa93c077e40 auth_method 0 2026-02-24T19:24:31.169 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.167+0000 7fa94f7fe640 10 client.28168.objecter ms_handle_connect 0x7fa93c077e40 2026-02-24T19:24:31.170 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.167+0000 7fa94f7fe640 1 -- 10.20.193.26:0/2951142454 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7fa958093160 con 0x7fa970157b50 2026-02-24T19:24:31.170 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.167+0000 7fa94f7fe640 10 client.28168.objecter ms_dispatch2 0x7fa970000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:31.170 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.167+0000 7fa94f7fe640 3 client.28168.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:31.170 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.167+0000 7fa94f7fe640 3 client.28168.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:31.170 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.167+0000 7fa94f7fe640 20 client.28168.objecter dump_active .. 0 homeless 2026-02-24T19:24:31.170 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.168+0000 7fa94f7fe640 1 -- 10.20.193.26:0/2951142454 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fa95805db90 con 0x7fa970157b50 2026-02-24T19:24:31.170 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.168+0000 7fa94f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:31.171 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.168+0000 7fa94f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:31.278 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.277+0000 7fa97577f640 1 -- 10.20.193.26:0/2951142454 --> v1:10.20.193.162:6800/3889602630 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "10", "target": ["mon-mgr", ""]}) -- 0x7fa970130e00 con 0x7fa93c077e40 2026-02-24T19:24:31.279 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.277+0000 7fa94f7fe640 1 -- 10.20.193.26:0/2951142454 <== mgr.4107 v1:10.20.193.162:6800/3889602630 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 10 to deep-scrub) ==== 42+0+0 (unknown 3896554461 0 0) 0x7fa970130e00 con 0x7fa93c077e40 2026-02-24T19:24:31.279 INFO:teuthology.orchestra.run.trial026.stderr:instructed osd(s) 10 to deep-scrub 2026-02-24T19:24:31.280 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.278+0000 7fa97577f640 10 librados: watch_flush enter 2026-02-24T19:24:31.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.278+0000 7fa97577f640 10 librados: watch_flush exit 2026-02-24T19:24:31.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.278+0000 7fa97577f640 20 client.28168.objecter shutdown clearing up homeless session... 2026-02-24T19:24:31.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.278+0000 7fa97577f640 10 client.28168.objecter successfully canceled tick 2026-02-24T19:24:31.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.278+0000 7fa97577f640 1 -- 10.20.193.26:0/2951142454 >> v1:10.20.193.162:6800/3889602630 conn(0x7fa93c077e40 legacy=0x7fa93c0982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.278+0000 7fa97577f640 10 monclient: shutdown 2026-02-24T19:24:31.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.278+0000 7fa97577f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:31.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.278+0000 7fa97577f640 1 -- 10.20.193.26:0/2951142454 >> v1:10.20.193.70:6789/0 conn(0x7fa970157b50 legacy=0x7fa9700a8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.278+0000 7fa97577f640 1 -- 10.20.193.26:0/2951142454 shutdown_connections 2026-02-24T19:24:31.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.278+0000 7fa97577f640 1 -- 10.20.193.26:0/2951142454 >> 10.20.193.26:0/2951142454 conn(0x7fa9700b2ef0 msgr2=0x7fa97013ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:31.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.278+0000 7fa97577f640 1 -- 10.20.193.26:0/2951142454 shutdown_connections 2026-02-24T19:24:31.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.278+0000 7fa97577f640 1 -- 10.20.193.26:0/2951142454 wait complete. 2026-02-24T19:24:31.282 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.278+0000 7fa97577f640 1 librados: shutdown 2026-02-24T19:24:31.289 INFO:tasks.ceph:Scrubbing osd.14 2026-02-24T19:24:31.289 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:31.357 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.355+0000 7f212b6e8640 10 monclient: get_monmap_and_config 2026-02-24T19:24:31.357 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.355+0000 7f212b6e8640 10 monclient: build_initial_monmap 2026-02-24T19:24:31.357 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.355+0000 7f212b6e8640 10 monclient: monmap: 2026-02-24T19:24:31.357 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:31.357 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.357 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:31.356408+0000 2026-02-24T19:24:31.358 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:31.356408+0000 2026-02-24T19:24:31.358 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:31.358 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.358 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:31.358 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:31.358 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:31.358 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.356+0000 7f212b6e8640 1 Processor -- start 2026-02-24T19:24:31.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.356+0000 7f212b6e8640 1 -- start start 2026-02-24T19:24:31.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.356+0000 7f212b6e8640 10 monclient: init 2026-02-24T19:24:31.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.356+0000 7f212b6e8640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:31.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.356+0000 7f212b6e8640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:24:31.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.356+0000 7f212b6e8640 10 monclient(hunting): picked mon.noname-c con 0x7f2124159e10 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:31.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.356+0000 7f212b6e8640 10 monclient(hunting): picked mon.noname-a con 0x7f212415a1e0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:31.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.357+0000 7f212b6e8640 10 monclient(hunting): picked mon.noname-b con 0x7f2124161ac0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:31.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.357+0000 7f212b6e8640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2124055ab0 con 0x7f212415a1e0 2026-02-24T19:24:31.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.357+0000 7f212b6e8640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2124055d50 con 0x7f2124161ac0 2026-02-24T19:24:31.361 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.357+0000 7f212b6e8640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2124056030 con 0x7f2124159e10 2026-02-24T19:24:31.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.357+0000 7f212b6e8640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:31.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.357+0000 7f212b6e8640 10 monclient(hunting): authenticate will time out at 4054.039035s 2026-02-24T19:24:31.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.357+0000 7f212945d640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f2124159e10 0x7f2124059c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:57204/0 (socket says 10.20.193.26:57204) 2026-02-24T19:24:31.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.357+0000 7f212945d640 1 -- 10.20.193.26:0/1137302724 learned_addr learned my addr 10.20.193.26:0/1137302724 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:31.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.358+0000 7f2113fff640 1 -- 10.20.193.26:0/1137302724 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1322595382 0 0) 0x7f2124056030 con 0x7f2124159e10 2026-02-24T19:24:31.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.358+0000 7f2113fff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.358+0000 7f2113fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.358+0000 7f2113fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.358+0000 7f2113fff640 10 monclient(hunting): my global_id is 30095 2026-02-24T19:24:31.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.358+0000 7f2113fff640 1 -- 10.20.193.26:0/1137302724 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f210c0058a0 con 0x7f2124159e10 2026-02-24T19:24:31.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.358+0000 7f2113fff640 1 -- 10.20.193.26:0/1137302724 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3916777715 0 0) 0x7f2124055ab0 con 0x7f212415a1e0 2026-02-24T19:24:31.362 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.358+0000 7f2113fff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.358+0000 7f2113fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.358+0000 7f2113fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.358+0000 7f2113fff640 10 monclient(hunting): my global_id is 30756 2026-02-24T19:24:31.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.358+0000 7f2113fff640 1 -- 10.20.193.26:0/1137302724 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2124056030 con 0x7f212415a1e0 2026-02-24T19:24:31.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.358+0000 7f2113fff640 1 -- 10.20.193.26:0/1137302724 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2814234383 0 0) 0x7f2124055d50 con 0x7f2124161ac0 2026-02-24T19:24:31.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.358+0000 7f2113fff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.358+0000 7f2113fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.358+0000 7f2113fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.358+0000 7f2113fff640 10 monclient(hunting): my global_id is 28171 2026-02-24T19:24:31.363 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.358+0000 7f2113fff640 1 -- 10.20.193.26:0/1137302724 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2124055ab0 con 0x7f2124161ac0 2026-02-24T19:24:31.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.360+0000 7f2113fff640 1 -- 10.20.193.26:0/1137302724 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1997390303 0 0) 0x7f210c0058a0 con 0x7f2124159e10 2026-02-24T19:24:31.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.360+0000 7f2113fff640 1 -- 10.20.193.26:0/1137302724 >> v1:10.20.193.70:6789/0 conn(0x7f2124161ac0 legacy=0x7f212415fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.360+0000 7f2113fff640 1 -- 10.20.193.26:0/1137302724 >> v1:10.20.193.26:6789/0 conn(0x7f212415a1e0 legacy=0x7f21241613b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.360+0000 7f2113fff640 10 monclient: _finish_hunting 0 2026-02-24T19:24:31.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.360+0000 7f2113fff640 1 monclient: found mon.noname-c 2026-02-24T19:24:31.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.360+0000 7f2113fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:31.368 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.360+0000 7f2113fff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:24:31.369 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.360+0000 7f2113fff640 1 -- 10.20.193.26:0/1137302724 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2124056310 con 0x7f2124159e10 2026-02-24T19:24:31.369 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.360+0000 7f2113fff640 10 monclient: _finish_auth 0 2026-02-24T19:24:31.369 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.360+0000 7f2113fff640 10 monclient: _check_auth_tickets 2026-02-24T19:24:31.369 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.360+0000 7f2113fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:31.369 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.360+0000 7f2113fff640 1 -- 10.20.193.26:0/1137302724 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2114002de0 con 0x7f2124159e10 2026-02-24T19:24:31.369 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.360+0000 7f2113fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:31.369 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.360+0000 7f2113fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:31.369 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.360+0000 7f2113fff640 10 monclient: dump: 2026-02-24T19:24:31.369 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.369 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.369 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.369 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.369 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.370 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.370 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.370 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.370 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.370 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.370 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.360+0000 7f212b6e8640 5 monclient: authenticate success, global_id 30095 2026-02-24T19:24:31.370 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.360+0000 7f212b6e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:31.370 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.361+0000 7f2113fff640 1 -- 10.20.193.26:0/1137302724 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2114002fb0 con 0x7f2124159e10 2026-02-24T19:24:31.370 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.361+0000 7f2113fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:31.370 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.361+0000 7f2113fff640 1 -- 10.20.193.26:0/1137302724 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f21140033f0 con 0x7f2124159e10 2026-02-24T19:24:31.370 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.361+0000 7f2113fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:31.371 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.361+0000 7f2113fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:31.371 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.361+0000 7f2113fff640 10 monclient: dump: 2026-02-24T19:24:31.371 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.371 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.371 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.371 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.371 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.371 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.371 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.371 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.371 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.371 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.371 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.361+0000 7f212b6e8640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:31.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.361+0000 7f212b6e8640 4 set_mon_vals no callback set 2026-02-24T19:24:31.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.361+0000 7f212b6e8640 10 monclient: shutdown 2026-02-24T19:24:31.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.361+0000 7f212b6e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:31.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.361+0000 7f212b6e8640 1 -- 10.20.193.26:0/1137302724 >> v1:10.20.193.103:6789/0 conn(0x7f2124159e10 legacy=0x7f2124059c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.361+0000 7f212b6e8640 1 -- 10.20.193.26:0/1137302724 shutdown_connections 2026-02-24T19:24:31.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.361+0000 7f212b6e8640 1 -- 10.20.193.26:0/1137302724 >> 10.20.193.26:0/1137302724 conn(0x7f21240b2f60 msgr2=0x7f21240b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:31.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.362+0000 7f212b6e8640 1 -- 10.20.193.26:0/1137302724 shutdown_connections 2026-02-24T19:24:31.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.362+0000 7f212b6e8640 1 -- 10.20.193.26:0/1137302724 wait complete. 2026-02-24T19:24:31.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.362+0000 7f212b6e8640 10 monclient: build_initial_monmap 2026-02-24T19:24:31.372 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.362+0000 7f212b6e8640 10 monclient: monmap: 2026-02-24T19:24:31.372 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:31.372 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:31.373 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:31.373 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:31.373 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:31.373 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:31.373 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:31.373 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:31.373 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:31.373 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.373 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.362+0000 7f212b6e8640 1 librados: starting msgr at 2026-02-24T19:24:31.373 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.362+0000 7f212b6e8640 1 librados: starting objecter 2026-02-24T19:24:31.373 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.362+0000 7f212b6e8640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:31.373 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.362+0000 7f212b6e8640 1 Processor -- start 2026-02-24T19:24:31.373 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.362+0000 7f212b6e8640 1 -- start start 2026-02-24T19:24:31.373 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.362+0000 7f212b6e8640 1 librados: setting wanted keys 2026-02-24T19:24:31.374 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.362+0000 7f212b6e8640 1 librados: calling monclient init 2026-02-24T19:24:31.374 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.362+0000 7f212b6e8640 10 monclient: init 2026-02-24T19:24:31.374 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.363+0000 7f212b6e8640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:31.374 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.363+0000 7f212b6e8640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:31.374 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.363+0000 7f212b6e8640 10 monclient(hunting): picked mon.noname-c con 0x7f2124159e10 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:31.374 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.363+0000 7f212b6e8640 10 monclient(hunting): picked mon.noname-b con 0x7f212415a1e0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:31.374 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.363+0000 7f212b6e8640 10 monclient(hunting): picked mon.noname-a con 0x7f2124161ac0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:31.374 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.363+0000 7f212b6e8640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2124162c80 con 0x7f2124161ac0 2026-02-24T19:24:31.374 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.363+0000 7f212b6e8640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2124158a90 con 0x7f212415a1e0 2026-02-24T19:24:31.374 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.363+0000 7f212b6e8640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f212413b090 con 0x7f2124159e10 2026-02-24T19:24:31.374 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.363+0000 7f212b6e8640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:31.374 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.363+0000 7f212b6e8640 10 monclient(hunting): authenticate will time out at 4054.045364s 2026-02-24T19:24:31.374 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.363+0000 7f212945d640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f2124159e10 0x7f2124162570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:57208/0 (socket says 10.20.193.26:57208) 2026-02-24T19:24:31.375 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.363+0000 7f212945d640 1 -- 10.20.193.26:0/1433825474 learned_addr learned my addr 10.20.193.26:0/1433825474 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:31.375 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.363+0000 7f2111ffb640 10 client.?.objecter ms_handle_connect 0x7f2124159e10 2026-02-24T19:24:31.375 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.363+0000 7f2111ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:31.375 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.363+0000 7f2111ffb640 10 client.?.objecter ms_handle_connect 0x7f2124161ac0 2026-02-24T19:24:31.375 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.363+0000 7f2111ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:31.375 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.364+0000 7f2111ffb640 10 client.?.objecter ms_handle_connect 0x7f212415a1e0 2026-02-24T19:24:31.375 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.364+0000 7f2111ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:31.375 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.364+0000 7f2111ffb640 1 -- 10.20.193.26:0/1433825474 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1849930474 0 0) 0x7f212413b090 con 0x7f2124159e10 2026-02-24T19:24:31.375 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.364+0000 7f2111ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.375 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.364+0000 7f2111ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.375 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.364+0000 7f2111ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.375 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.364+0000 7f2111ffb640 10 monclient(hunting): my global_id is 30098 2026-02-24T19:24:31.376 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.364+0000 7f2111ffb640 1 -- 10.20.193.26:0/1433825474 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20f4003610 con 0x7f2124159e10 2026-02-24T19:24:31.376 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.364+0000 7f2111ffb640 1 -- 10.20.193.26:0/1433825474 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 214554861 0 0) 0x7f2124162c80 con 0x7f2124161ac0 2026-02-24T19:24:31.376 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.364+0000 7f2111ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.376 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.364+0000 7f2111ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.376 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.364+0000 7f2111ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.376 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.364+0000 7f2111ffb640 10 monclient(hunting): my global_id is 30759 2026-02-24T19:24:31.376 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.364+0000 7f2111ffb640 1 -- 10.20.193.26:0/1433825474 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f212413b090 con 0x7f2124161ac0 2026-02-24T19:24:31.376 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.365+0000 7f2111ffb640 1 -- 10.20.193.26:0/1433825474 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2076977847 0 0) 0x7f2124158a90 con 0x7f212415a1e0 2026-02-24T19:24:31.376 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.365+0000 7f2111ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.376 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.365+0000 7f2111ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.376 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.365+0000 7f2111ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.376 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.365+0000 7f2111ffb640 10 monclient(hunting): my global_id is 28174 2026-02-24T19:24:31.376 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.365+0000 7f2111ffb640 1 -- 10.20.193.26:0/1433825474 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2124162c80 con 0x7f212415a1e0 2026-02-24T19:24:31.379 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.367+0000 7f2111ffb640 1 -- 10.20.193.26:0/1433825474 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2623407670 0 0) 0x7f212413b090 con 0x7f2124161ac0 2026-02-24T19:24:31.379 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.367+0000 7f2111ffb640 1 -- 10.20.193.26:0/1433825474 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2124158a90 con 0x7f2124161ac0 2026-02-24T19:24:31.380 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.367+0000 7f2111ffb640 1 -- 10.20.193.26:0/1433825474 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2120003330 con 0x7f2124161ac0 2026-02-24T19:24:31.380 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.367+0000 7f2111ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:31.380 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.367+0000 7f2111ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:31.380 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.367+0000 7f2111ffb640 10 monclient(hunting): dump: 2026-02-24T19:24:31.380 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.380 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.380 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.380 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.380 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.380 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.381 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.381 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.381 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.381 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.381 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.367+0000 7f2111ffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:31.381 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.367+0000 7f2111ffb640 1 -- 10.20.193.26:0/1433825474 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1048141285 0 0) 0x7f20f4003610 con 0x7f2124159e10 2026-02-24T19:24:31.381 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.367+0000 7f2111ffb640 1 -- 10.20.193.26:0/1433825474 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f212413b090 con 0x7f2124159e10 2026-02-24T19:24:31.381 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.367+0000 7f2111ffb640 1 -- 10.20.193.26:0/1433825474 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2114003300 con 0x7f2124159e10 2026-02-24T19:24:31.381 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.367+0000 7f2111ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:31.381 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.367+0000 7f2111ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:31.381 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.367+0000 7f2111ffb640 10 monclient(hunting): dump: 2026-02-24T19:24:31.381 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.382 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.382 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.382 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.382 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.382 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.382 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.382 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.382 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.382 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.382 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.367+0000 7f2111ffb640 1 -- 10.20.193.26:0/1433825474 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3678233039 0 0) 0x7f2124162c80 con 0x7f212415a1e0 2026-02-24T19:24:31.382 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.367+0000 7f2111ffb640 1 -- 10.20.193.26:0/1433825474 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f20f4003610 con 0x7f212415a1e0 2026-02-24T19:24:31.382 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.367+0000 7f2111ffb640 1 -- 10.20.193.26:0/1433825474 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2118003080 con 0x7f212415a1e0 2026-02-24T19:24:31.382 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.367+0000 7f2111ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:31.383 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.367+0000 7f2111ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:31.383 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.367+0000 7f2111ffb640 10 monclient(hunting): dump: 2026-02-24T19:24:31.383 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.383 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.383 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.383 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.383 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.383 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.383 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.383 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.383 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.383 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.384 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.368+0000 7f2111ffb640 1 -- 10.20.193.26:0/1433825474 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3742894210 0 0) 0x7f2124158a90 con 0x7f2124161ac0 2026-02-24T19:24:31.384 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.368+0000 7f2111ffb640 1 -- 10.20.193.26:0/1433825474 >> v1:10.20.193.103:6789/0 conn(0x7f2124159e10 legacy=0x7f2124162570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.384 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.368+0000 7f2111ffb640 1 -- 10.20.193.26:0/1433825474 >> v1:10.20.193.70:6789/0 conn(0x7f212415a1e0 legacy=0x7f2124158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.384 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.368+0000 7f2111ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:24:31.384 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.368+0000 7f2111ffb640 1 monclient: found mon.a 2026-02-24T19:24:31.384 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.368+0000 7f2111ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:31.384 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.368+0000 7f2111ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:31.384 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.368+0000 7f2111ffb640 1 -- 10.20.193.26:0/1433825474 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2124138440 con 0x7f2124161ac0 2026-02-24T19:24:31.384 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.368+0000 7f2111ffb640 10 monclient: _finish_auth 0 2026-02-24T19:24:31.384 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.368+0000 7f2111ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:24:31.384 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.368+0000 7f2111ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:31.384 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.368+0000 7f212b6e8640 5 monclient: authenticate success, global_id 30759 2026-02-24T19:24:31.384 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.368+0000 7f212b6e8640 10 monclient: _renew_subs 2026-02-24T19:24:31.385 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.368+0000 7f212b6e8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:31.385 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.368+0000 7f212b6e8640 1 -- 10.20.193.26:0/1433825474 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2124138720 con 0x7f2124161ac0 2026-02-24T19:24:31.385 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.368+0000 7f212b6e8640 10 client.30759.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:31.385 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.368+0000 7f212b6e8640 10 monclient: _renew_subs 2026-02-24T19:24:31.385 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.368+0000 7f212b6e8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:31.385 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.368+0000 7f212b6e8640 1 -- 10.20.193.26:0/1433825474 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2124138ce0 con 0x7f2124161ac0 2026-02-24T19:24:31.385 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.368+0000 7f212b6e8640 1 librados: init done 2026-02-24T19:24:31.385 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.369+0000 7f212b6e8640 10 client.30759.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:31.385 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.369+0000 7f212b6e8640 15 client.30759.objecter _session_command_op_assign -1 1 2026-02-24T19:24:31.385 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.369+0000 7f212b6e8640 20 client.30759.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:31.385 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.369+0000 7f212b6e8640 10 client.30759.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:31.385 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.369+0000 7f212b6e8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:31.385 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.369+0000 7f212b6e8640 1 -- 10.20.193.26:0/1433825474 --> v1:10.20.193.26:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f2124056c80 con 0x7f2124161ac0 2026-02-24T19:24:31.385 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.377+0000 7f2111ffb640 1 -- 10.20.193.26:0/1433825474 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2124056c80 con 0x7f2124161ac0 2026-02-24T19:24:31.386 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.377+0000 7f2111ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:31.386 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.377+0000 7f2111ffb640 1 -- 10.20.193.26:0/1433825474 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2120003c20 con 0x7f2124161ac0 2026-02-24T19:24:31.386 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.377+0000 7f2111ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:31.386 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.377+0000 7f2111ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:31.386 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.377+0000 7f2111ffb640 10 monclient: dump: 2026-02-24T19:24:31.386 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.386 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.386 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.386 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.386 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.386 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.386 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.386 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.387 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.387 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.387 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.377+0000 7f21137fe640 4 set_mon_vals no callback set 2026-02-24T19:24:31.387 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.377+0000 7f2111ffb640 1 -- 10.20.193.26:0/1433825474 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f212001ca90 con 0x7f2124161ac0 2026-02-24T19:24:31.387 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.378+0000 7f212945d640 10 monclient: get_auth_request con 0x7f20f4077e70 auth_method 0 2026-02-24T19:24:31.388 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.378+0000 7f2111ffb640 10 client.30759.objecter ms_handle_connect 0x7f20f4077e70 2026-02-24T19:24:31.388 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.379+0000 7f2111ffb640 1 -- 10.20.193.26:0/1433825474 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7f2120092010 con 0x7f2124161ac0 2026-02-24T19:24:31.388 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.379+0000 7f2111ffb640 10 client.30759.objecter ms_dispatch2 0x7f2124000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:31.389 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.379+0000 7f2111ffb640 3 client.30759.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:31.389 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.379+0000 7f2111ffb640 3 client.30759.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:31.389 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.379+0000 7f2111ffb640 10 client.30759.objecter checking command 1 2026-02-24T19:24:31.389 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.379+0000 7f2111ffb640 20 client.30759.objecter _get_session s=0x7f20f40a21d0 osd=14 3 2026-02-24T19:24:31.389 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.379+0000 7f2111ffb640 20 client.30759.objecter put_session s=0x7f20f40a21d0 osd=14 3 2026-02-24T19:24:31.389 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.379+0000 7f2111ffb640 15 client.30759.objecter _session_command_op_remove -1 1 2026-02-24T19:24:31.389 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.379+0000 7f2111ffb640 20 client.30759.objecter _get_session s=0x7f20f40a21d0 osd=14 3 2026-02-24T19:24:31.389 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.379+0000 7f2111ffb640 20 client.30759.objecter get_session s=0x7f20f40a21d0 osd=14 3 2026-02-24T19:24:31.389 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.379+0000 7f2111ffb640 15 client.30759.objecter _session_command_op_assign 14 1 2026-02-24T19:24:31.389 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.379+0000 7f2111ffb640 20 client.30759.objecter put_session s=0x7f20f40a21d0 osd=14 4 2026-02-24T19:24:31.389 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.379+0000 7f2111ffb640 10 client.30759.objecter _send_command 1 2026-02-24T19:24:31.389 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.379+0000 7f2111ffb640 1 -- 10.20.193.26:0/1433825474 --> v1:10.20.193.103:6812/1276189911 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f20f40c44e0 con 0x7f20f40a2880 2026-02-24T19:24:31.389 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.379+0000 7f2111ffb640 20 client.30759.objecter dump_active .. 0 homeless 2026-02-24T19:24:31.390 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.379+0000 7f2111ffb640 1 -- 10.20.193.26:0/1433825474 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_get_version_reply(handle=1 version=346) ==== 24+0+0 (unknown 2991753921 0 0) 0x7f21200586b0 con 0x7f2124161ac0 2026-02-24T19:24:31.390 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.379+0000 7f2111ffb640 10 monclient: handle_get_version_reply finishing 1 version 346 2026-02-24T19:24:31.390 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.379+0000 7f2128c5c640 10 monclient: get_auth_request con 0x7f20f40a2880 auth_method 0 2026-02-24T19:24:31.390 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.380+0000 7f2111ffb640 10 client.30759.objecter ms_handle_connect 0x7f20f40a2880 2026-02-24T19:24:31.392 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.390+0000 7f2111ffb640 1 -- 10.20.193.26:0/1433825474 <== osd.14 v1:10.20.193.103:6812/1276189911 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f20f40c44e0 con 0x7f20f40a2880 2026-02-24T19:24:31.392 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.390+0000 7f2111ffb640 10 client.30759.objecter ms_dispatch2 0x7f2124000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:31.392 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.390+0000 7f2111ffb640 10 client.30759.objecter _finish_command 1 = system:0 2026-02-24T19:24:31.392 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.390+0000 7f2111ffb640 20 client.30759.objecter put_session s=0x7f20f40a21d0 osd=14 4 2026-02-24T19:24:31.392 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.390+0000 7f2111ffb640 15 client.30759.objecter _session_command_op_remove 14 1 2026-02-24T19:24:31.399 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.398+0000 7f212b6e8640 10 client.30759.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:31.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.398+0000 7f212b6e8640 15 client.30759.objecter _session_command_op_assign -1 2 2026-02-24T19:24:31.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.398+0000 7f212b6e8640 20 client.30759.objecter _get_session s=0x7f20f40a21d0 osd=14 3 2026-02-24T19:24:31.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.398+0000 7f212b6e8640 20 client.30759.objecter put_session s=0x7f20f40a21d0 osd=14 3 2026-02-24T19:24:31.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.398+0000 7f212b6e8640 20 client.30759.objecter _get_session s=0x7f20f40a21d0 osd=14 3 2026-02-24T19:24:31.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.398+0000 7f212b6e8640 15 client.30759.objecter _session_command_op_remove -1 2 2026-02-24T19:24:31.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.398+0000 7f212b6e8640 20 client.30759.objecter get_session s=0x7f20f40a21d0 osd=14 3 2026-02-24T19:24:31.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.398+0000 7f212b6e8640 15 client.30759.objecter _session_command_op_assign 14 2 2026-02-24T19:24:31.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.398+0000 7f212b6e8640 20 client.30759.objecter put_session s=0x7f20f40a21d0 osd=14 4 2026-02-24T19:24:31.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.398+0000 7f212b6e8640 10 client.30759.objecter _send_command 2 2026-02-24T19:24:31.400 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.398+0000 7f212b6e8640 1 -- 10.20.193.26:0/1433825474 --> v1:10.20.193.103:6812/1276189911 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2124139e60 con 0x7f20f40a2880 2026-02-24T19:24:31.408 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.406+0000 7f2111ffb640 1 -- 10.20.193.26:0/1433825474 <== osd.14 v1:10.20.193.103:6812/1276189911 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f2124139e60 con 0x7f20f40a2880 2026-02-24T19:24:31.408 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.406+0000 7f2111ffb640 10 client.30759.objecter ms_dispatch2 0x7f2124000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:31.408 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.406+0000 7f2111ffb640 10 client.30759.objecter _finish_command 2 = system:0 2026-02-24T19:24:31.408 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.406+0000 7f2111ffb640 20 client.30759.objecter put_session s=0x7f20f40a21d0 osd=14 4 2026-02-24T19:24:31.408 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.406+0000 7f2111ffb640 15 client.30759.objecter _session_command_op_remove 14 2 2026-02-24T19:24:31.409 INFO:teuthology.orchestra.run.trial026.stdout:{ 2026-02-24T19:24:31.409 INFO:teuthology.orchestra.run.trial026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:31.409 INFO:teuthology.orchestra.run.trial026.stdout:} 2026-02-24T19:24:31.410 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.406+0000 7f212b6e8640 10 librados: watch_flush enter 2026-02-24T19:24:31.410 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.406+0000 7f212b6e8640 10 librados: watch_flush exit 2026-02-24T19:24:31.410 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.406+0000 7f212b6e8640 10 client.30759.objecter close_session for osd.14 2026-02-24T19:24:31.410 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.406+0000 7f212b6e8640 1 -- 10.20.193.26:0/1433825474 >> v1:10.20.193.103:6812/1276189911 conn(0x7f20f40a2880 legacy=0x7f20f40c2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.410 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.406+0000 7f212b6e8640 20 client.30759.objecter put_session s=0x7f20f40a21d0 osd=14 1 2026-02-24T19:24:31.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.406+0000 7f212b6e8640 20 client.30759.objecter shutdown clearing up homeless session... 2026-02-24T19:24:31.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.406+0000 7f212b6e8640 10 client.30759.objecter successfully canceled tick 2026-02-24T19:24:31.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.406+0000 7f212b6e8640 1 -- 10.20.193.26:0/1433825474 >> v1:10.20.193.162:6800/3889602630 conn(0x7f20f4077e70 legacy=0x7f20f4098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.406+0000 7f212b6e8640 10 monclient: shutdown 2026-02-24T19:24:31.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.406+0000 7f212b6e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:31.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.406+0000 7f212b6e8640 1 -- 10.20.193.26:0/1433825474 >> v1:10.20.193.26:6789/0 conn(0x7f2124161ac0 legacy=0x7f212413a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.406+0000 7f2129c5e640 1 -- 10.20.193.26:0/1433825474 reap_dead start 2026-02-24T19:24:31.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.407+0000 7f212b6e8640 1 -- 10.20.193.26:0/1433825474 shutdown_connections 2026-02-24T19:24:31.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.407+0000 7f212b6e8640 1 -- 10.20.193.26:0/1433825474 >> 10.20.193.26:0/1433825474 conn(0x7f21240b2f60 msgr2=0x7f2124059c20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:31.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.407+0000 7f212b6e8640 1 -- 10.20.193.26:0/1433825474 shutdown_connections 2026-02-24T19:24:31.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.407+0000 7f212b6e8640 1 -- 10.20.193.26:0/1433825474 wait complete. 2026-02-24T19:24:31.411 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.407+0000 7f212b6e8640 1 librados: shutdown 2026-02-24T19:24:31.416 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 14 2026-02-24T19:24:31.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.482+0000 7f44d01fa640 10 monclient: get_monmap_and_config 2026-02-24T19:24:31.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.482+0000 7f44d01fa640 10 monclient: build_initial_monmap 2026-02-24T19:24:31.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.482+0000 7f44d01fa640 10 monclient: monmap: 2026-02-24T19:24:31.484 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:31.484 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.484 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:31.483366+0000 2026-02-24T19:24:31.484 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:31.483366+0000 2026-02-24T19:24:31.485 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:31.485 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.485 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:31.485 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:31.485 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:31.485 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.483+0000 7f44d01fa640 1 Processor -- start 2026-02-24T19:24:31.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.483+0000 7f44d01fa640 1 -- start start 2026-02-24T19:24:31.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.483+0000 7f44d01fa640 10 monclient: init 2026-02-24T19:24:31.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.483+0000 7f44d01fa640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:31.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.483+0000 7f44d01fa640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:24:31.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.483+0000 7f44d01fa640 10 monclient(hunting): picked mon.noname-b con 0x7f44c8157780 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:31.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.483+0000 7f44d01fa640 10 monclient(hunting): picked mon.noname-c con 0x7f44c8157b50 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:31.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.483+0000 7f44d01fa640 10 monclient(hunting): picked mon.noname-a con 0x7f44c8164d00 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:31.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.483+0000 7f44d01fa640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c805de70 con 0x7f44c8164d00 2026-02-24T19:24:31.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.483+0000 7f44d01fa640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c8055b20 con 0x7f44c8157780 2026-02-24T19:24:31.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.483+0000 7f44d01fa640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c8055e00 con 0x7f44c8157b50 2026-02-24T19:24:31.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.483+0000 7f44d01fa640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:31.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.483+0000 7f44d01fa640 10 monclient(hunting): authenticate will time out at 4054.165596s 2026-02-24T19:24:31.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.483+0000 7f44cdf6f640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f44c8157780 0x7f44c8056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:59070/0 (socket says 10.20.193.26:59070) 2026-02-24T19:24:31.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.483+0000 7f44cdf6f640 1 -- 10.20.193.26:0/2255420666 learned_addr learned my addr 10.20.193.26:0/2255420666 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:31.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.485+0000 7f44ccf6d640 1 -- 10.20.193.26:0/2255420666 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 228717561 0 0) 0x7f44c8055b20 con 0x7f44c8157780 2026-02-24T19:24:31.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.485+0000 7f44ccf6d640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.485+0000 7f44ccf6d640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.485+0000 7f44ccf6d640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.485+0000 7f44ccf6d640 10 monclient(hunting): my global_id is 28177 2026-02-24T19:24:31.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.485+0000 7f44ccf6d640 1 -- 10.20.193.26:0/2255420666 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44b0003610 con 0x7f44c8157780 2026-02-24T19:24:31.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.485+0000 7f44ccf6d640 1 -- 10.20.193.26:0/2255420666 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 563587625 0 0) 0x7f44c805de70 con 0x7f44c8164d00 2026-02-24T19:24:31.489 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.485+0000 7f44ccf6d640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.485+0000 7f44ccf6d640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.485+0000 7f44ccf6d640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.485+0000 7f44ccf6d640 10 monclient(hunting): my global_id is 30762 2026-02-24T19:24:31.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.485+0000 7f44ccf6d640 1 -- 10.20.193.26:0/2255420666 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44c8055b20 con 0x7f44c8164d00 2026-02-24T19:24:31.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.485+0000 7f44ccf6d640 1 -- 10.20.193.26:0/2255420666 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1325244234 0 0) 0x7f44c8055e00 con 0x7f44c8157b50 2026-02-24T19:24:31.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.485+0000 7f44ccf6d640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.485+0000 7f44ccf6d640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.485+0000 7f44ccf6d640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.485+0000 7f44ccf6d640 10 monclient(hunting): my global_id is 30101 2026-02-24T19:24:31.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.485+0000 7f44ccf6d640 1 -- 10.20.193.26:0/2255420666 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44c805de70 con 0x7f44c8157b50 2026-02-24T19:24:31.497 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.486+0000 7f44ccf6d640 1 -- 10.20.193.26:0/2255420666 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 167822475 0 0) 0x7f44b0003610 con 0x7f44c8157780 2026-02-24T19:24:31.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.486+0000 7f44ccf6d640 1 -- 10.20.193.26:0/2255420666 >> v1:10.20.193.103:6789/0 conn(0x7f44c8157b50 legacy=0x7f44c81645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.486+0000 7f44ccf6d640 1 -- 10.20.193.26:0/2255420666 >> v1:10.20.193.26:6789/0 conn(0x7f44c8164d00 legacy=0x7f44c81c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.486+0000 7f44ccf6d640 10 monclient: _finish_hunting 0 2026-02-24T19:24:31.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.486+0000 7f44ccf6d640 1 monclient: found mon.noname-b 2026-02-24T19:24:31.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.486+0000 7f44ccf6d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:31.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.486+0000 7f44ccf6d640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:24:31.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.486+0000 7f44ccf6d640 1 -- 10.20.193.26:0/2255420666 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c80560e0 con 0x7f44c8157780 2026-02-24T19:24:31.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.486+0000 7f44ccf6d640 10 monclient: _finish_auth 0 2026-02-24T19:24:31.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.486+0000 7f44ccf6d640 10 monclient: _check_auth_tickets 2026-02-24T19:24:31.498 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.486+0000 7f44ccf6d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:31.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.486+0000 7f44ccf6d640 1 -- 10.20.193.26:0/2255420666 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f44b8002df0 con 0x7f44c8157780 2026-02-24T19:24:31.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.486+0000 7f44d01fa640 5 monclient: authenticate success, global_id 28177 2026-02-24T19:24:31.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.486+0000 7f44d01fa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:31.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.486+0000 7f44ccf6d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:31.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.486+0000 7f44ccf6d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:31.499 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.486+0000 7f44ccf6d640 10 monclient: dump: 2026-02-24T19:24:31.499 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.499 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.499 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.499 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.499 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.499 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.499 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.500 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.500 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.500 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.486+0000 7f44d01fa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:31.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.487+0000 7f44ccf6d640 1 -- 10.20.193.26:0/2255420666 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f44b8002fc0 con 0x7f44c8157780 2026-02-24T19:24:31.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.487+0000 7f44ccf6d640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:31.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.487+0000 7f44ccf6d640 1 -- 10.20.193.26:0/2255420666 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f44b8003400 con 0x7f44c8157780 2026-02-24T19:24:31.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.487+0000 7f44ccf6d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:31.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.487+0000 7f44ccf6d640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:31.500 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.487+0000 7f44ccf6d640 10 monclient: dump: 2026-02-24T19:24:31.500 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.500 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.501 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.501 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.501 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.501 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.501 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.501 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.501 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.501 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.501 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.487+0000 7f44d01fa640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:31.501 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.487+0000 7f44d01fa640 4 set_mon_vals no callback set 2026-02-24T19:24:31.501 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.488+0000 7f44d01fa640 10 monclient: shutdown 2026-02-24T19:24:31.501 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.488+0000 7f44d01fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:31.501 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.488+0000 7f44d01fa640 1 -- 10.20.193.26:0/2255420666 >> v1:10.20.193.70:6789/0 conn(0x7f44c8157780 legacy=0x7f44c8056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.488+0000 7f44d01fa640 1 -- 10.20.193.26:0/2255420666 shutdown_connections 2026-02-24T19:24:31.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.488+0000 7f44d01fa640 1 -- 10.20.193.26:0/2255420666 >> 10.20.193.26:0/2255420666 conn(0x7f44c80b2ef0 msgr2=0x7f44c80b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:31.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.488+0000 7f44d01fa640 1 -- 10.20.193.26:0/2255420666 shutdown_connections 2026-02-24T19:24:31.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.488+0000 7f44d01fa640 1 -- 10.20.193.26:0/2255420666 wait complete. 2026-02-24T19:24:31.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.488+0000 7f44d01fa640 10 monclient: build_initial_monmap 2026-02-24T19:24:31.502 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.488+0000 7f44d01fa640 10 monclient: monmap: 2026-02-24T19:24:31.502 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:31.502 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:31.502 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:31.502 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:31.502 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:31.502 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:31.503 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:31.503 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:31.503 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:31.503 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.488+0000 7f44d01fa640 1 librados: starting msgr at 2026-02-24T19:24:31.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.488+0000 7f44d01fa640 1 librados: starting objecter 2026-02-24T19:24:31.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.488+0000 7f44d01fa640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:31.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.488+0000 7f44d01fa640 1 Processor -- start 2026-02-24T19:24:31.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.488+0000 7f44d01fa640 1 -- start start 2026-02-24T19:24:31.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.488+0000 7f44d01fa640 1 librados: setting wanted keys 2026-02-24T19:24:31.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.488+0000 7f44d01fa640 1 librados: calling monclient init 2026-02-24T19:24:31.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.488+0000 7f44d01fa640 10 monclient: init 2026-02-24T19:24:31.503 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.489+0000 7f44d01fa640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:31.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.489+0000 7f44d01fa640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:31.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.489+0000 7f44d01fa640 10 monclient(hunting): picked mon.noname-a con 0x7f44c8157780 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:31.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.489+0000 7f44d01fa640 10 monclient(hunting): picked mon.noname-c con 0x7f44c8157b50 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:31.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.489+0000 7f44d01fa640 10 monclient(hunting): picked mon.noname-b con 0x7f44c8164d00 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:31.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.489+0000 7f44d01fa640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c8130b60 con 0x7f44c8157780 2026-02-24T19:24:31.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.489+0000 7f44d01fa640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c8130e40 con 0x7f44c8164d00 2026-02-24T19:24:31.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.489+0000 7f44d01fa640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c8131120 con 0x7f44c8157b50 2026-02-24T19:24:31.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.489+0000 7f44d01fa640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:31.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.489+0000 7f44d01fa640 10 monclient(hunting): authenticate will time out at 4054.171234s 2026-02-24T19:24:31.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.489+0000 7f44cd76e640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f44c8157b50 0x7f44c80ac7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:57220/0 (socket says 10.20.193.26:57220) 2026-02-24T19:24:31.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.489+0000 7f44cd76e640 1 -- 10.20.193.26:0/1565578222 learned_addr learned my addr 10.20.193.26:0/1565578222 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:31.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.489+0000 7f44b67fc640 10 client.?.objecter ms_handle_connect 0x7f44c8157780 2026-02-24T19:24:31.504 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.489+0000 7f44b67fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:31.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.489+0000 7f44b67fc640 10 client.?.objecter ms_handle_connect 0x7f44c8164d00 2026-02-24T19:24:31.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.489+0000 7f44b67fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:31.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.489+0000 7f44b67fc640 10 client.?.objecter ms_handle_connect 0x7f44c8157b50 2026-02-24T19:24:31.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.489+0000 7f44b67fc640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:31.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.490+0000 7f44b67fc640 1 -- 10.20.193.26:0/1565578222 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1279091196 0 0) 0x7f44c8130b60 con 0x7f44c8157780 2026-02-24T19:24:31.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.490+0000 7f44b67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.490+0000 7f44b67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.490+0000 7f44b67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.490+0000 7f44b67fc640 10 monclient(hunting): my global_id is 30765 2026-02-24T19:24:31.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.490+0000 7f44b67fc640 1 -- 10.20.193.26:0/1565578222 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4498003610 con 0x7f44c8157780 2026-02-24T19:24:31.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.490+0000 7f44b67fc640 1 -- 10.20.193.26:0/1565578222 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2833917718 0 0) 0x7f44c8130e40 con 0x7f44c8164d00 2026-02-24T19:24:31.505 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.490+0000 7f44b67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.506 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.490+0000 7f44b67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.506 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.490+0000 7f44b67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.506 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.490+0000 7f44b67fc640 10 monclient(hunting): my global_id is 28180 2026-02-24T19:24:31.506 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.490+0000 7f44b67fc640 1 -- 10.20.193.26:0/1565578222 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44c8130b60 con 0x7f44c8164d00 2026-02-24T19:24:31.506 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.490+0000 7f44b67fc640 1 -- 10.20.193.26:0/1565578222 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1712172931 0 0) 0x7f44c8131120 con 0x7f44c8157b50 2026-02-24T19:24:31.506 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.490+0000 7f44b67fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.506 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.490+0000 7f44b67fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.506 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.490+0000 7f44b67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.506 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.490+0000 7f44b67fc640 10 monclient(hunting): my global_id is 30104 2026-02-24T19:24:31.506 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.490+0000 7f44b67fc640 1 -- 10.20.193.26:0/1565578222 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44c8130e40 con 0x7f44c8157b50 2026-02-24T19:24:31.506 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.492+0000 7f44b67fc640 1 -- 10.20.193.26:0/1565578222 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2497021888 0 0) 0x7f4498003610 con 0x7f44c8157780 2026-02-24T19:24:31.506 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.492+0000 7f44b67fc640 1 -- 10.20.193.26:0/1565578222 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44c8131120 con 0x7f44c8157780 2026-02-24T19:24:31.506 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.492+0000 7f44b67fc640 1 -- 10.20.193.26:0/1565578222 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f44b8003310 con 0x7f44c8157780 2026-02-24T19:24:31.507 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.492+0000 7f44b67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:31.507 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.492+0000 7f44b67fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:31.507 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.492+0000 7f44b67fc640 10 monclient(hunting): dump: 2026-02-24T19:24:31.507 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.507 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.507 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.507 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.507 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.507 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.507 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.507 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.507 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.508 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.508 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.492+0000 7f44b67fc640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:31.508 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.492+0000 7f44b67fc640 1 -- 10.20.193.26:0/1565578222 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 950964478 0 0) 0x7f44c8130b60 con 0x7f44c8164d00 2026-02-24T19:24:31.508 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.492+0000 7f44b67fc640 1 -- 10.20.193.26:0/1565578222 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4498003610 con 0x7f44c8164d00 2026-02-24T19:24:31.508 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.492+0000 7f44b67fc640 1 -- 10.20.193.26:0/1565578222 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f44c40032f0 con 0x7f44c8164d00 2026-02-24T19:24:31.508 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.492+0000 7f44b67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:31.508 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.492+0000 7f44b67fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:31.508 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.492+0000 7f44b67fc640 10 monclient(hunting): dump: 2026-02-24T19:24:31.508 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.508 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.508 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.508 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.508 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.509 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.509 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.509 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.509 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.509 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.509 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.493+0000 7f44b67fc640 1 -- 10.20.193.26:0/1565578222 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 403031662 0 0) 0x7f44c8130e40 con 0x7f44c8157b50 2026-02-24T19:24:31.509 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.493+0000 7f44b67fc640 1 -- 10.20.193.26:0/1565578222 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44c8130b60 con 0x7f44c8157b50 2026-02-24T19:24:31.509 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.493+0000 7f44b67fc640 1 -- 10.20.193.26:0/1565578222 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f44bc003170 con 0x7f44c8157b50 2026-02-24T19:24:31.509 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.493+0000 7f44b67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:31.509 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.493+0000 7f44b67fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:31.509 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.493+0000 7f44b67fc640 10 monclient(hunting): dump: 2026-02-24T19:24:31.509 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.509 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.510 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.510 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.510 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.510 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.510 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.510 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.510 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.510 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.510 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.494+0000 7f44b67fc640 1 -- 10.20.193.26:0/1565578222 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3922557426 0 0) 0x7f4498003610 con 0x7f44c8164d00 2026-02-24T19:24:31.510 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.494+0000 7f44b67fc640 1 -- 10.20.193.26:0/1565578222 >> v1:10.20.193.103:6789/0 conn(0x7f44c8157b50 legacy=0x7f44c80ac7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.510 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.494+0000 7f44b67fc640 1 -- 10.20.193.26:0/1565578222 >> v1:10.20.193.26:6789/0 conn(0x7f44c8157780 legacy=0x7f44c80ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.510 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.494+0000 7f44b67fc640 10 monclient: _finish_hunting 0 2026-02-24T19:24:31.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.494+0000 7f44b67fc640 1 monclient: found mon.b 2026-02-24T19:24:31.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.494+0000 7f44b67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:31.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.494+0000 7f44b67fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:31.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.494+0000 7f44b67fc640 1 -- 10.20.193.26:0/1565578222 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c8131400 con 0x7f44c8164d00 2026-02-24T19:24:31.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.494+0000 7f44b67fc640 10 monclient: _finish_auth 0 2026-02-24T19:24:31.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.494+0000 7f44b67fc640 10 monclient: _check_auth_tickets 2026-02-24T19:24:31.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.494+0000 7f44b67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:31.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.494+0000 7f44d01fa640 5 monclient: authenticate success, global_id 28180 2026-02-24T19:24:31.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.494+0000 7f44d01fa640 10 monclient: _renew_subs 2026-02-24T19:24:31.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.494+0000 7f44d01fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:31.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.494+0000 7f44d01fa640 1 -- 10.20.193.26:0/1565578222 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f44c81316e0 con 0x7f44c8164d00 2026-02-24T19:24:31.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.494+0000 7f44d01fa640 10 client.28180.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:31.511 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.494+0000 7f44d01fa640 10 monclient: _renew_subs 2026-02-24T19:24:31.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.494+0000 7f44d01fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:31.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.494+0000 7f44d01fa640 1 -- 10.20.193.26:0/1565578222 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f44c8156fd0 con 0x7f44c8164d00 2026-02-24T19:24:31.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.494+0000 7f44d01fa640 1 librados: init done 2026-02-24T19:24:31.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.495+0000 7f44d01fa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:31.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.495+0000 7f44d01fa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:31.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.495+0000 7f44d01fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:31.512 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.495+0000 7f44d01fa640 1 -- 10.20.193.26:0/1565578222 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44c805e250 con 0x7f44c8164d00 2026-02-24T19:24:31.587 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.586+0000 7f44b67fc640 1 -- 10.20.193.26:0/1565578222 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f44c4003880 con 0x7f44c8164d00 2026-02-24T19:24:31.587 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.586+0000 7f44b67fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:31.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.586+0000 7f44b67fc640 1 -- 10.20.193.26:0/1565578222 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f44c4003bd0 con 0x7f44c8164d00 2026-02-24T19:24:31.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.586+0000 7f44b67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:31.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.586+0000 7f44b67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:31.588 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.586+0000 7f44b67fc640 10 monclient: dump: 2026-02-24T19:24:31.588 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.588 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.588 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.588 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.588 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.588 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.588 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.588 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.589 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.589 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.589 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.586+0000 7f44b7fff640 4 set_mon_vals no callback set 2026-02-24T19:24:31.590 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.586+0000 7f44b67fc640 1 -- 10.20.193.26:0/1565578222 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f44c401ca40 con 0x7f44c8164d00 2026-02-24T19:24:31.590 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.587+0000 7f44cdf6f640 10 monclient: get_auth_request con 0x7f4498077e80 auth_method 0 2026-02-24T19:24:31.590 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.587+0000 7f44b67fc640 10 client.28180.objecter ms_handle_connect 0x7f4498077e80 2026-02-24T19:24:31.590 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.587+0000 7f44b67fc640 1 -- 10.20.193.26:0/1565578222 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7f44c4092150 con 0x7f44c8164d00 2026-02-24T19:24:31.590 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.587+0000 7f44b67fc640 10 client.28180.objecter ms_dispatch2 0x7f44c8000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:31.590 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.587+0000 7f44b67fc640 3 client.28180.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:31.590 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.587+0000 7f44b67fc640 3 client.28180.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:31.590 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.587+0000 7f44b67fc640 20 client.28180.objecter dump_active .. 0 homeless 2026-02-24T19:24:31.591 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.589+0000 7f44b67fc640 1 -- 10.20.193.26:0/1565578222 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f44c805e250 con 0x7f44c8164d00 2026-02-24T19:24:31.591 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.589+0000 7f44b67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:31.591 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.589+0000 7f44b67fc640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:31.698 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.696+0000 7f44d01fa640 1 -- 10.20.193.26:0/1565578222 --> v1:10.20.193.162:6800/3889602630 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "14", "target": ["mon-mgr", ""]}) -- 0x7f44c80b5660 con 0x7f4498077e80 2026-02-24T19:24:31.698 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.696+0000 7f44b67fc640 1 -- 10.20.193.26:0/1565578222 <== mgr.4107 v1:10.20.193.162:6800/3889602630 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 14 to deep-scrub) ==== 42+0+0 (unknown 1939288360 0 0) 0x7f44c80b5660 con 0x7f4498077e80 2026-02-24T19:24:31.698 INFO:teuthology.orchestra.run.trial026.stderr:instructed osd(s) 14 to deep-scrub 2026-02-24T19:24:31.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.697+0000 7f44d01fa640 10 librados: watch_flush enter 2026-02-24T19:24:31.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.697+0000 7f44d01fa640 10 librados: watch_flush exit 2026-02-24T19:24:31.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.697+0000 7f44d01fa640 20 client.28180.objecter shutdown clearing up homeless session... 2026-02-24T19:24:31.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.697+0000 7f44d01fa640 10 client.28180.objecter successfully canceled tick 2026-02-24T19:24:31.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.697+0000 7f44d01fa640 1 -- 10.20.193.26:0/1565578222 >> v1:10.20.193.162:6800/3889602630 conn(0x7f4498077e80 legacy=0x7f4498098330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.697+0000 7f44d01fa640 10 monclient: shutdown 2026-02-24T19:24:31.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.697+0000 7f44d01fa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:31.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.697+0000 7f44d01fa640 1 -- 10.20.193.26:0/1565578222 >> v1:10.20.193.70:6789/0 conn(0x7f44c8164d00 legacy=0x7f44c81210e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.700 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.697+0000 7f44d01fa640 1 -- 10.20.193.26:0/1565578222 shutdown_connections 2026-02-24T19:24:31.701 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.697+0000 7f44d01fa640 1 -- 10.20.193.26:0/1565578222 >> 10.20.193.26:0/1565578222 conn(0x7f44c80b2ef0 msgr2=0x7f44c8058bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:31.701 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.697+0000 7f44d01fa640 1 -- 10.20.193.26:0/1565578222 shutdown_connections 2026-02-24T19:24:31.701 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.697+0000 7f44d01fa640 1 -- 10.20.193.26:0/1565578222 wait complete. 2026-02-24T19:24:31.701 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.697+0000 7f44d01fa640 1 librados: shutdown 2026-02-24T19:24:31.707 INFO:tasks.ceph:Scrubbing osd.3 2026-02-24T19:24:31.708 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:31.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.776+0000 7fc4c0dfa640 10 monclient: get_monmap_and_config 2026-02-24T19:24:31.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.776+0000 7fc4c0dfa640 10 monclient: build_initial_monmap 2026-02-24T19:24:31.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.776+0000 7fc4c0dfa640 10 monclient: monmap: 2026-02-24T19:24:31.778 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:31.778 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.778 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:31.776849+0000 2026-02-24T19:24:31.778 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:31.776849+0000 2026-02-24T19:24:31.778 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:31.778 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.778 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:31.778 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:31.778 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:31.778 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.776+0000 7fc4c0dfa640 1 Processor -- start 2026-02-24T19:24:31.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.776+0000 7fc4c0dfa640 1 -- start start 2026-02-24T19:24:31.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.776+0000 7fc4c0dfa640 10 monclient: init 2026-02-24T19:24:31.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.777+0000 7fc4c0dfa640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:31.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.777+0000 7fc4c0dfa640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:24:31.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.777+0000 7fc4c0dfa640 10 monclient(hunting): picked mon.noname-a con 0x7fc4bc15e2a0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:31.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.777+0000 7fc4c0dfa640 10 monclient(hunting): picked mon.noname-b con 0x7fc4bc059e10 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:31.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.777+0000 7fc4c0dfa640 10 monclient(hunting): picked mon.noname-c con 0x7fc4bc1a5660 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:31.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.777+0000 7fc4c0dfa640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4bc162df0 con 0x7fc4bc15e2a0 2026-02-24T19:24:31.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.777+0000 7fc4c0dfa640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4bc1630d0 con 0x7fc4bc059e10 2026-02-24T19:24:31.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.777+0000 7fc4c0dfa640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4bc1633b0 con 0x7fc4bc1a5660 2026-02-24T19:24:31.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.777+0000 7fc4c0dfa640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:31.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.777+0000 7fc4c0dfa640 10 monclient(hunting): authenticate will time out at 4054.459085s 2026-02-24T19:24:31.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.777+0000 7fc4bad76640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fc4bc1a5660 0x7fc4bc1c5a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:57232/0 (socket says 10.20.193.26:57232) 2026-02-24T19:24:31.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.777+0000 7fc4bad76640 1 -- 10.20.193.26:0/958658614 learned_addr learned my addr 10.20.193.26:0/958658614 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:31.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.778+0000 7fc4b9573640 1 -- 10.20.193.26:0/958658614 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 917823491 0 0) 0x7fc4bc1630d0 con 0x7fc4bc059e10 2026-02-24T19:24:31.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.778+0000 7fc4b9573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.778+0000 7fc4b9573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.778+0000 7fc4b9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.778+0000 7fc4b9573640 10 monclient(hunting): my global_id is 28183 2026-02-24T19:24:31.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.778+0000 7fc4b9573640 1 -- 10.20.193.26:0/958658614 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4a8003610 con 0x7fc4bc059e10 2026-02-24T19:24:31.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.779+0000 7fc4b9573640 1 -- 10.20.193.26:0/958658614 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3984575847 0 0) 0x7fc4bc1633b0 con 0x7fc4bc1a5660 2026-02-24T19:24:31.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.779+0000 7fc4b9573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.779+0000 7fc4b9573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.779+0000 7fc4b9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.779+0000 7fc4b9573640 10 monclient(hunting): my global_id is 30107 2026-02-24T19:24:31.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.779+0000 7fc4b9573640 1 -- 10.20.193.26:0/958658614 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4bc1630d0 con 0x7fc4bc1a5660 2026-02-24T19:24:31.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.779+0000 7fc4b9573640 1 -- 10.20.193.26:0/958658614 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 103478127 0 0) 0x7fc4bc162df0 con 0x7fc4bc15e2a0 2026-02-24T19:24:31.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.779+0000 7fc4b9573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.779+0000 7fc4b9573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.779+0000 7fc4b9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.779+0000 7fc4b9573640 10 monclient(hunting): my global_id is 30768 2026-02-24T19:24:31.784 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.779+0000 7fc4b9573640 1 -- 10.20.193.26:0/958658614 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4bc1633b0 con 0x7fc4bc15e2a0 2026-02-24T19:24:31.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.780+0000 7fc4b9573640 1 -- 10.20.193.26:0/958658614 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2792692876 0 0) 0x7fc4a8003610 con 0x7fc4bc059e10 2026-02-24T19:24:31.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.780+0000 7fc4b9573640 1 -- 10.20.193.26:0/958658614 >> v1:10.20.193.103:6789/0 conn(0x7fc4bc1a5660 legacy=0x7fc4bc1c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.780+0000 7fc4b9573640 1 -- 10.20.193.26:0/958658614 >> v1:10.20.193.26:6789/0 conn(0x7fc4bc15e2a0 legacy=0x7fc4bc05da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.780+0000 7fc4b9573640 10 monclient: _finish_hunting 0 2026-02-24T19:24:31.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.780+0000 7fc4b9573640 1 monclient: found mon.noname-b 2026-02-24T19:24:31.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.780+0000 7fc4b9573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:31.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.780+0000 7fc4b9573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:24:31.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.780+0000 7fc4b9573640 1 -- 10.20.193.26:0/958658614 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4bc163690 con 0x7fc4bc059e10 2026-02-24T19:24:31.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.780+0000 7fc4b9573640 10 monclient: _finish_auth 0 2026-02-24T19:24:31.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.780+0000 7fc4b9573640 10 monclient: _check_auth_tickets 2026-02-24T19:24:31.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.780+0000 7fc4b9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:31.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.780+0000 7fc4b9573640 1 -- 10.20.193.26:0/958658614 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc4a4002df0 con 0x7fc4bc059e10 2026-02-24T19:24:31.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.780+0000 7fc4c0dfa640 5 monclient: authenticate success, global_id 28183 2026-02-24T19:24:31.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.780+0000 7fc4c0dfa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:31.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.780+0000 7fc4b9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:31.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.780+0000 7fc4b9573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:31.792 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.780+0000 7fc4b9573640 10 monclient: dump: 2026-02-24T19:24:31.792 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.792 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.792 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.792 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.792 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.792 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.792 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.792 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.792 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.792 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.792 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.780+0000 7fc4c0dfa640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:31.793 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.781+0000 7fc4b9573640 1 -- 10.20.193.26:0/958658614 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc4a4002fc0 con 0x7fc4bc059e10 2026-02-24T19:24:31.793 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.781+0000 7fc4b9573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:31.793 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.781+0000 7fc4b9573640 1 -- 10.20.193.26:0/958658614 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc4a4003400 con 0x7fc4bc059e10 2026-02-24T19:24:31.793 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.781+0000 7fc4c0dfa640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:31.793 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.781+0000 7fc4b9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:31.793 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.781+0000 7fc4c0dfa640 4 set_mon_vals no callback set 2026-02-24T19:24:31.793 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.781+0000 7fc4b9573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:31.793 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.781+0000 7fc4b9573640 10 monclient: dump: 2026-02-24T19:24:31.793 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.793 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.793 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.794 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.794 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.794 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.794 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.794 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.794 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.794 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.781+0000 7fc4c0dfa640 10 monclient: shutdown 2026-02-24T19:24:31.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.781+0000 7fc4c0dfa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:31.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.781+0000 7fc4c0dfa640 1 -- 10.20.193.26:0/958658614 >> v1:10.20.193.70:6789/0 conn(0x7fc4bc059e10 legacy=0x7fc4bc15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.781+0000 7fc4c0dfa640 1 -- 10.20.193.26:0/958658614 shutdown_connections 2026-02-24T19:24:31.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.781+0000 7fc4c0dfa640 1 -- 10.20.193.26:0/958658614 >> 10.20.193.26:0/958658614 conn(0x7fc4bc0b2f60 msgr2=0x7fc4bc0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:31.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.781+0000 7fc4c0dfa640 1 -- 10.20.193.26:0/958658614 shutdown_connections 2026-02-24T19:24:31.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.781+0000 7fc4c0dfa640 1 -- 10.20.193.26:0/958658614 wait complete. 2026-02-24T19:24:31.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.782+0000 7fc4c0dfa640 10 monclient: build_initial_monmap 2026-02-24T19:24:31.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.782+0000 7fc4c0dfa640 10 monclient: monmap: 2026-02-24T19:24:31.795 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:31.795 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:31.795 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:31.795 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:31.795 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:31.795 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:31.795 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:31.795 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:31.795 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:31.796 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.782+0000 7fc4c0dfa640 1 librados: starting msgr at 2026-02-24T19:24:31.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.782+0000 7fc4c0dfa640 1 librados: starting objecter 2026-02-24T19:24:31.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.782+0000 7fc4c0dfa640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:31.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.782+0000 7fc4c0dfa640 1 Processor -- start 2026-02-24T19:24:31.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.782+0000 7fc4c0dfa640 1 -- start start 2026-02-24T19:24:31.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.782+0000 7fc4c0dfa640 1 librados: setting wanted keys 2026-02-24T19:24:31.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.782+0000 7fc4c0dfa640 1 librados: calling monclient init 2026-02-24T19:24:31.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.782+0000 7fc4c0dfa640 10 monclient: init 2026-02-24T19:24:31.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.782+0000 7fc4c0dfa640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:31.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.782+0000 7fc4c0dfa640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:24:31.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.782+0000 7fc4c0dfa640 10 monclient(hunting): picked mon.noname-c con 0x7fc4bc059e10 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:31.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.782+0000 7fc4c0dfa640 10 monclient(hunting): picked mon.noname-a con 0x7fc4bc15e2a0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:31.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.782+0000 7fc4c0dfa640 10 monclient(hunting): picked mon.noname-b con 0x7fc4bc1a5660 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:31.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.782+0000 7fc4c0dfa640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4bc12da50 con 0x7fc4bc15e2a0 2026-02-24T19:24:31.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.782+0000 7fc4c0dfa640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4bc12dd30 con 0x7fc4bc1a5660 2026-02-24T19:24:31.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.782+0000 7fc4c0dfa640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4bc12e010 con 0x7fc4bc059e10 2026-02-24T19:24:31.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.782+0000 7fc4c0dfa640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:31.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.782+0000 7fc4c0dfa640 10 monclient(hunting): authenticate will time out at 4054.464900s 2026-02-24T19:24:31.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.783+0000 7fc4ba575640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fc4bc059e10 0x7fc4bc120a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:57246/0 (socket says 10.20.193.26:57246) 2026-02-24T19:24:31.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.783+0000 7fc4ba575640 1 -- 10.20.193.26:0/4014488453 learned_addr learned my addr 10.20.193.26:0/4014488453 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:31.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.783+0000 7fc4a2ffd640 10 client.?.objecter ms_handle_connect 0x7fc4bc15e2a0 2026-02-24T19:24:31.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.783+0000 7fc4a2ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:31.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.783+0000 7fc4a2ffd640 10 client.?.objecter ms_handle_connect 0x7fc4bc059e10 2026-02-24T19:24:31.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.783+0000 7fc4a2ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:31.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.784+0000 7fc4a2ffd640 1 -- 10.20.193.26:0/4014488453 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 61379491 0 0) 0x7fc4bc12da50 con 0x7fc4bc15e2a0 2026-02-24T19:24:31.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.784+0000 7fc4a2ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.784+0000 7fc4a2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.784+0000 7fc4a2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.784+0000 7fc4a2ffd640 10 monclient(hunting): my global_id is 30771 2026-02-24T19:24:31.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.784+0000 7fc4a2ffd640 1 -- 10.20.193.26:0/4014488453 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc488003610 con 0x7fc4bc15e2a0 2026-02-24T19:24:31.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.784+0000 7fc4a2ffd640 1 -- 10.20.193.26:0/4014488453 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2276982789 0 0) 0x7fc4bc12e010 con 0x7fc4bc059e10 2026-02-24T19:24:31.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.784+0000 7fc4a2ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.784+0000 7fc4a2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.784+0000 7fc4a2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.784+0000 7fc4a2ffd640 10 monclient(hunting): my global_id is 30110 2026-02-24T19:24:31.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.784+0000 7fc4a2ffd640 1 -- 10.20.193.26:0/4014488453 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4bc12da50 con 0x7fc4bc059e10 2026-02-24T19:24:31.799 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.784+0000 7fc4a2ffd640 10 client.?.objecter ms_handle_connect 0x7fc4bc1a5660 2026-02-24T19:24:31.799 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.784+0000 7fc4a2ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:31.799 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.786+0000 7fc4a2ffd640 1 -- 10.20.193.26:0/4014488453 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4283782679 0 0) 0x7fc4bc12dd30 con 0x7fc4bc1a5660 2026-02-24T19:24:31.799 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.786+0000 7fc4a2ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.799 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.786+0000 7fc4a2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.799 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.786+0000 7fc4a2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.799 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.786+0000 7fc4a2ffd640 10 monclient(hunting): my global_id is 28186 2026-02-24T19:24:31.799 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.786+0000 7fc4a2ffd640 1 -- 10.20.193.26:0/4014488453 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4bc12e010 con 0x7fc4bc1a5660 2026-02-24T19:24:31.799 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.786+0000 7fc4a2ffd640 1 -- 10.20.193.26:0/4014488453 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1019486709 0 0) 0x7fc4bc12da50 con 0x7fc4bc059e10 2026-02-24T19:24:31.799 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.786+0000 7fc4a2ffd640 1 -- 10.20.193.26:0/4014488453 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc4bc12dd30 con 0x7fc4bc059e10 2026-02-24T19:24:31.799 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.786+0000 7fc4a2ffd640 1 -- 10.20.193.26:0/4014488453 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc4b0003170 con 0x7fc4bc059e10 2026-02-24T19:24:31.799 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.786+0000 7fc4a2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:31.800 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.786+0000 7fc4a2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:31.800 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.786+0000 7fc4a2ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:31.800 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.800 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.800 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.800 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.800 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.800 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.800 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.800 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.800 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.800 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.800 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.786+0000 7fc4a2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:31.801 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.786+0000 7fc4a2ffd640 1 -- 10.20.193.26:0/4014488453 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2492606303 0 0) 0x7fc488003610 con 0x7fc4bc15e2a0 2026-02-24T19:24:31.801 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.786+0000 7fc4a2ffd640 1 -- 10.20.193.26:0/4014488453 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc4bc12da50 con 0x7fc4bc15e2a0 2026-02-24T19:24:31.801 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.786+0000 7fc4a2ffd640 1 -- 10.20.193.26:0/4014488453 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc4a4003310 con 0x7fc4bc15e2a0 2026-02-24T19:24:31.801 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.786+0000 7fc4a2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:31.801 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.786+0000 7fc4a2ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:31.801 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.786+0000 7fc4a2ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:31.801 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.801 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.801 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.801 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.801 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.801 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.801 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.802 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.802 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.802 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.788+0000 7fc4a2ffd640 1 -- 10.20.193.26:0/4014488453 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3556260260 0 0) 0x7fc4bc12dd30 con 0x7fc4bc059e10 2026-02-24T19:24:31.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.788+0000 7fc4a2ffd640 1 -- 10.20.193.26:0/4014488453 >> v1:10.20.193.70:6789/0 conn(0x7fc4bc1a5660 legacy=0x7fc4bc190e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.788+0000 7fc4a2ffd640 1 -- 10.20.193.26:0/4014488453 >> v1:10.20.193.26:6789/0 conn(0x7fc4bc15e2a0 legacy=0x7fc4bc12a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.788+0000 7fc4a2ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:31.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.788+0000 7fc4a2ffd640 1 monclient: found mon.c 2026-02-24T19:24:31.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.788+0000 7fc4a2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:31.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.788+0000 7fc4a2ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:31.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.788+0000 7fc4a2ffd640 1 -- 10.20.193.26:0/4014488453 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4bc12e2f0 con 0x7fc4bc059e10 2026-02-24T19:24:31.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.788+0000 7fc4a2ffd640 10 monclient: _finish_auth 0 2026-02-24T19:24:31.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.788+0000 7fc4a2ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:31.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.788+0000 7fc4a2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:31.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.788+0000 7fc4c0dfa640 5 monclient: authenticate success, global_id 30110 2026-02-24T19:24:31.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.788+0000 7fc4c0dfa640 10 monclient: _renew_subs 2026-02-24T19:24:31.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.788+0000 7fc4c0dfa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:31.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.788+0000 7fc4c0dfa640 1 -- 10.20.193.26:0/4014488453 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc4bc12d6d0 con 0x7fc4bc059e10 2026-02-24T19:24:31.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.788+0000 7fc4c0dfa640 10 client.30110.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:31.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.788+0000 7fc4c0dfa640 10 monclient: _renew_subs 2026-02-24T19:24:31.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.788+0000 7fc4c0dfa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:31.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.788+0000 7fc4c0dfa640 1 -- 10.20.193.26:0/4014488453 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc4bc12aeb0 con 0x7fc4bc059e10 2026-02-24T19:24:31.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.788+0000 7fc4c0dfa640 1 librados: init done 2026-02-24T19:24:31.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.788+0000 7fc4c0dfa640 10 client.30110.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:31.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.788+0000 7fc4c0dfa640 15 client.30110.objecter _session_command_op_assign -1 1 2026-02-24T19:24:31.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.788+0000 7fc4c0dfa640 20 client.30110.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:31.804 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.788+0000 7fc4c0dfa640 10 client.30110.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:31.804 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.788+0000 7fc4c0dfa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:31.804 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.788+0000 7fc4c0dfa640 1 -- 10.20.193.26:0/4014488453 --> v1:10.20.193.103:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fc4bc1647d0 con 0x7fc4bc059e10 2026-02-24T19:24:31.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.796+0000 7fc4a2ffd640 1 -- 10.20.193.26:0/4014488453 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc4bc1647d0 con 0x7fc4bc059e10 2026-02-24T19:24:31.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.796+0000 7fc4a2ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:31.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.796+0000 7fc4a2ffd640 1 -- 10.20.193.26:0/4014488453 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc4b00039b0 con 0x7fc4bc059e10 2026-02-24T19:24:31.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.796+0000 7fc4a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:31.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.796+0000 7fc4a2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:31.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.796+0000 7fc4a2ffd640 10 monclient: dump: 2026-02-24T19:24:31.806 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.806 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.806 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.806 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.807 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.807 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.807 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.807 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.807 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.807 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.796+0000 7fc4b8d72640 4 set_mon_vals no callback set 2026-02-24T19:24:31.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.797+0000 7fc4a2ffd640 1 -- 10.20.193.26:0/4014488453 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fc4b0003bc0 con 0x7fc4bc059e10 2026-02-24T19:24:31.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.798+0000 7fc4b9d74640 10 monclient: get_auth_request con 0x7fc488077d30 auth_method 0 2026-02-24T19:24:31.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.798+0000 7fc4a2ffd640 1 -- 10.20.193.26:0/4014488453 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7fc4b0093240 con 0x7fc4bc059e10 2026-02-24T19:24:31.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.798+0000 7fc4a2ffd640 10 client.30110.objecter ms_dispatch2 0x7fc4bc000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:31.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.798+0000 7fc4a2ffd640 3 client.30110.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:31.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.798+0000 7fc4a2ffd640 3 client.30110.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:31.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.798+0000 7fc4a2ffd640 10 client.30110.objecter checking command 1 2026-02-24T19:24:31.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.798+0000 7fc4a2ffd640 20 client.30110.objecter _get_session s=0x7fc4880a2090 osd=3 3 2026-02-24T19:24:31.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.798+0000 7fc4a2ffd640 20 client.30110.objecter put_session s=0x7fc4880a2090 osd=3 3 2026-02-24T19:24:31.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.798+0000 7fc4a2ffd640 15 client.30110.objecter _session_command_op_remove -1 1 2026-02-24T19:24:31.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.798+0000 7fc4a2ffd640 20 client.30110.objecter _get_session s=0x7fc4880a2090 osd=3 3 2026-02-24T19:24:31.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.798+0000 7fc4a2ffd640 20 client.30110.objecter get_session s=0x7fc4880a2090 osd=3 3 2026-02-24T19:24:31.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.798+0000 7fc4a2ffd640 15 client.30110.objecter _session_command_op_assign 3 1 2026-02-24T19:24:31.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.798+0000 7fc4a2ffd640 20 client.30110.objecter put_session s=0x7fc4880a2090 osd=3 4 2026-02-24T19:24:31.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.798+0000 7fc4a2ffd640 10 client.30110.objecter _send_command 1 2026-02-24T19:24:31.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.798+0000 7fc4a2ffd640 1 -- 10.20.193.26:0/4014488453 --> v1:10.20.193.162:6805/920272754 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc4880c4440 con 0x7fc4880a2740 2026-02-24T19:24:31.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.798+0000 7fc4a2ffd640 20 client.30110.objecter dump_active .. 0 homeless 2026-02-24T19:24:31.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.798+0000 7fc4a2ffd640 10 client.30110.objecter ms_handle_connect 0x7fc488077d30 2026-02-24T19:24:31.808 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.798+0000 7fc4a2ffd640 1 -- 10.20.193.26:0/4014488453 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_get_version_reply(handle=1 version=346) ==== 24+0+0 (unknown 2991753921 0 0) 0x7fc4b005d340 con 0x7fc4bc059e10 2026-02-24T19:24:31.809 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.798+0000 7fc4a2ffd640 10 monclient: handle_get_version_reply finishing 1 version 346 2026-02-24T19:24:31.809 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.798+0000 7fc4bad76640 10 monclient: get_auth_request con 0x7fc4880a2740 auth_method 0 2026-02-24T19:24:31.809 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.799+0000 7fc4a2ffd640 10 client.30110.objecter ms_handle_connect 0x7fc4880a2740 2026-02-24T19:24:31.810 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.809+0000 7fc4a2ffd640 1 -- 10.20.193.26:0/4014488453 <== osd.3 v1:10.20.193.162:6805/920272754 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fc4880c4440 con 0x7fc4880a2740 2026-02-24T19:24:31.810 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.809+0000 7fc4a2ffd640 10 client.30110.objecter ms_dispatch2 0x7fc4bc000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:31.811 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.809+0000 7fc4a2ffd640 10 client.30110.objecter _finish_command 1 = system:0 2026-02-24T19:24:31.811 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.809+0000 7fc4a2ffd640 20 client.30110.objecter put_session s=0x7fc4880a2090 osd=3 4 2026-02-24T19:24:31.811 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.809+0000 7fc4a2ffd640 15 client.30110.objecter _session_command_op_remove 3 1 2026-02-24T19:24:31.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.816+0000 7fc4c0dfa640 10 client.30110.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:31.817 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.816+0000 7fc4c0dfa640 15 client.30110.objecter _session_command_op_assign -1 2 2026-02-24T19:24:31.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.816+0000 7fc4c0dfa640 20 client.30110.objecter _get_session s=0x7fc4880a2090 osd=3 3 2026-02-24T19:24:31.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.816+0000 7fc4c0dfa640 20 client.30110.objecter put_session s=0x7fc4880a2090 osd=3 3 2026-02-24T19:24:31.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.816+0000 7fc4c0dfa640 20 client.30110.objecter _get_session s=0x7fc4880a2090 osd=3 3 2026-02-24T19:24:31.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.816+0000 7fc4c0dfa640 15 client.30110.objecter _session_command_op_remove -1 2 2026-02-24T19:24:31.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.816+0000 7fc4c0dfa640 20 client.30110.objecter get_session s=0x7fc4880a2090 osd=3 3 2026-02-24T19:24:31.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.816+0000 7fc4c0dfa640 15 client.30110.objecter _session_command_op_assign 3 2 2026-02-24T19:24:31.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.816+0000 7fc4c0dfa640 20 client.30110.objecter put_session s=0x7fc4880a2090 osd=3 4 2026-02-24T19:24:31.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.816+0000 7fc4c0dfa640 10 client.30110.objecter _send_command 2 2026-02-24T19:24:31.818 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.816+0000 7fc4c0dfa640 1 -- 10.20.193.26:0/4014488453 --> v1:10.20.193.162:6805/920272754 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc4bc1644f0 con 0x7fc4880a2740 2026-02-24T19:24:31.832 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.831+0000 7fc4a2ffd640 1 -- 10.20.193.26:0/4014488453 <== osd.3 v1:10.20.193.162:6805/920272754 2 ==== command_reply(tid 2: 0 ) ==== 8+0+712 (unknown 0 0 714369635) 0x7fc4bc1644f0 con 0x7fc4880a2740 2026-02-24T19:24:31.832 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.831+0000 7fc4a2ffd640 10 client.30110.objecter ms_dispatch2 0x7fc4bc000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:31.832 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.831+0000 7fc4a2ffd640 10 client.30110.objecter _finish_command 2 = system:0 2026-02-24T19:24:31.832 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.831+0000 7fc4a2ffd640 20 client.30110.objecter put_session s=0x7fc4880a2090 osd=3 4 2026-02-24T19:24:31.832 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.831+0000 7fc4a2ffd640 15 client.30110.objecter _session_command_op_remove 3 2 2026-02-24T19:24:31.833 INFO:teuthology.orchestra.run.trial026.stdout:{ 2026-02-24T19:24:31.833 INFO:teuthology.orchestra.run.trial026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_degraded = '' osd_recovery_sleep_degraded_hdd = '' osd_recovery_sleep_degraded_hybrid = '' osd_recovery_sleep_degraded_ssd = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2026-02-24T19:24:31.833 INFO:teuthology.orchestra.run.trial026.stdout:} 2026-02-24T19:24:31.834 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.831+0000 7fc4c0dfa640 10 librados: watch_flush enter 2026-02-24T19:24:31.835 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.831+0000 7fc4c0dfa640 10 librados: watch_flush exit 2026-02-24T19:24:31.835 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.831+0000 7fc4c0dfa640 10 client.30110.objecter close_session for osd.3 2026-02-24T19:24:31.835 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.831+0000 7fc4c0dfa640 1 -- 10.20.193.26:0/4014488453 >> v1:10.20.193.162:6805/920272754 conn(0x7fc4880a2740 legacy=0x7fc4880c2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.835 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.831+0000 7fc4c0dfa640 20 client.30110.objecter put_session s=0x7fc4880a2090 osd=3 1 2026-02-24T19:24:31.835 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.831+0000 7fc4c0dfa640 20 client.30110.objecter shutdown clearing up homeless session... 2026-02-24T19:24:31.835 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.831+0000 7fc4c0dfa640 10 client.30110.objecter successfully canceled tick 2026-02-24T19:24:31.835 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.831+0000 7fc4c0dfa640 1 -- 10.20.193.26:0/4014488453 >> v1:10.20.193.162:6800/3889602630 conn(0x7fc488077d30 legacy=0x7fc4880981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.835 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.831+0000 7fc4c0dfa640 10 monclient: shutdown 2026-02-24T19:24:31.835 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.831+0000 7fc4c0dfa640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:31.835 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.831+0000 7fc4c0dfa640 1 -- 10.20.193.26:0/4014488453 >> v1:10.20.193.103:6789/0 conn(0x7fc4bc059e10 legacy=0x7fc4bc120a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.835 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.831+0000 7fc4bad76640 1 -- 10.20.193.26:0/4014488453 reap_dead start 2026-02-24T19:24:31.835 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.831+0000 7fc4c0dfa640 1 -- 10.20.193.26:0/4014488453 shutdown_connections 2026-02-24T19:24:31.836 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.831+0000 7fc4c0dfa640 1 -- 10.20.193.26:0/4014488453 >> 10.20.193.26:0/4014488453 conn(0x7fc4bc0b2f60 msgr2=0x7fc4bc195d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:31.836 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.831+0000 7fc4c0dfa640 1 -- 10.20.193.26:0/4014488453 shutdown_connections 2026-02-24T19:24:31.836 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.831+0000 7fc4c0dfa640 1 -- 10.20.193.26:0/4014488453 wait complete. 2026-02-24T19:24:31.836 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.831+0000 7fc4c0dfa640 1 librados: shutdown 2026-02-24T19:24:31.840 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-24T19:24:31.910 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.908+0000 7fa5ff8e1640 10 monclient: get_monmap_and_config 2026-02-24T19:24:31.910 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.908+0000 7fa5ff8e1640 10 monclient: build_initial_monmap 2026-02-24T19:24:31.910 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.908+0000 7fa5ff8e1640 10 monclient: monmap: 2026-02-24T19:24:31.910 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:31.910 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.910 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:31.909290+0000 2026-02-24T19:24:31.910 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:31.909290+0000 2026-02-24T19:24:31.910 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:31.911 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.911 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:31.911 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:31.911 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:31.911 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.913 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.909+0000 7fa5ff8e1640 1 Processor -- start 2026-02-24T19:24:31.913 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.909+0000 7fa5ff8e1640 1 -- start start 2026-02-24T19:24:31.913 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.909+0000 7fa5ff8e1640 10 monclient: init 2026-02-24T19:24:31.914 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.909+0000 7fa5ff8e1640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:31.914 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.909+0000 7fa5ff8e1640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:31.914 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.909+0000 7fa5ff8e1640 10 monclient(hunting): picked mon.noname-c con 0x7fa5f815d610 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:31.914 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.909+0000 7fa5ff8e1640 10 monclient(hunting): picked mon.noname-b con 0x7fa5f81667e0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:31.914 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.909+0000 7fa5ff8e1640 10 monclient(hunting): picked mon.noname-a con 0x7fa5f8056ea0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:31.914 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.909+0000 7fa5ff8e1640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5f815d9e0 con 0x7fa5f8056ea0 2026-02-24T19:24:31.914 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.909+0000 7fa5ff8e1640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5f8055b20 con 0x7fa5f81667e0 2026-02-24T19:24:31.914 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.909+0000 7fa5ff8e1640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5f8055e00 con 0x7fa5f815d610 2026-02-24T19:24:31.914 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.909+0000 7fa5ff8e1640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:31.914 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.909+0000 7fa5ff8e1640 10 monclient(hunting): authenticate will time out at 4054.591677s 2026-02-24T19:24:31.914 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.910+0000 7fa5fd656640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7fa5f815d610 0x7fa5f80b9900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:57250/0 (socket says 10.20.193.26:57250) 2026-02-24T19:24:31.914 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.910+0000 7fa5fd656640 1 -- 10.20.193.26:0/3466458325 learned_addr learned my addr 10.20.193.26:0/3466458325 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:31.915 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.911+0000 7fa5e7fff640 1 -- 10.20.193.26:0/3466458325 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2777684479 0 0) 0x7fa5f8055e00 con 0x7fa5f815d610 2026-02-24T19:24:31.915 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.911+0000 7fa5e7fff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.915 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.911+0000 7fa5e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.915 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.911+0000 7fa5e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.915 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.911+0000 7fa5e7fff640 10 monclient(hunting): my global_id is 30113 2026-02-24T19:24:31.915 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.911+0000 7fa5e7fff640 1 -- 10.20.193.26:0/3466458325 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5e0003610 con 0x7fa5f815d610 2026-02-24T19:24:31.915 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.911+0000 7fa5e7fff640 1 -- 10.20.193.26:0/3466458325 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4056008789 0 0) 0x7fa5f815d9e0 con 0x7fa5f8056ea0 2026-02-24T19:24:31.915 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.911+0000 7fa5e7fff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.915 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.911+0000 7fa5e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.915 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.911+0000 7fa5e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.915 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.911+0000 7fa5e7fff640 10 monclient(hunting): my global_id is 30774 2026-02-24T19:24:31.916 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.911+0000 7fa5e7fff640 1 -- 10.20.193.26:0/3466458325 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5f8055e00 con 0x7fa5f8056ea0 2026-02-24T19:24:31.916 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.911+0000 7fa5e7fff640 1 -- 10.20.193.26:0/3466458325 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 445798906 0 0) 0x7fa5f8055b20 con 0x7fa5f81667e0 2026-02-24T19:24:31.916 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.911+0000 7fa5e7fff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.916 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.911+0000 7fa5e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.916 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.911+0000 7fa5e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.916 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.911+0000 7fa5e7fff640 10 monclient(hunting): my global_id is 28189 2026-02-24T19:24:31.916 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.911+0000 7fa5e7fff640 1 -- 10.20.193.26:0/3466458325 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5f815d9e0 con 0x7fa5f81667e0 2026-02-24T19:24:31.923 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.913+0000 7fa5e7fff640 1 -- 10.20.193.26:0/3466458325 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1045915076 0 0) 0x7fa5e0003610 con 0x7fa5f815d610 2026-02-24T19:24:31.923 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.913+0000 7fa5e7fff640 1 -- 10.20.193.26:0/3466458325 >> v1:10.20.193.70:6789/0 conn(0x7fa5f81667e0 legacy=0x7fa5f80ba010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.923 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.913+0000 7fa5e7fff640 1 -- 10.20.193.26:0/3466458325 >> v1:10.20.193.26:6789/0 conn(0x7fa5f8056ea0 legacy=0x7fa5f81c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.923 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.913+0000 7fa5e7fff640 10 monclient: _finish_hunting 0 2026-02-24T19:24:31.923 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.913+0000 7fa5e7fff640 1 monclient: found mon.noname-c 2026-02-24T19:24:31.923 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.913+0000 7fa5e7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:31.923 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.913+0000 7fa5e7fff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:24:31.924 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.913+0000 7fa5e7fff640 1 -- 10.20.193.26:0/3466458325 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f80560e0 con 0x7fa5f815d610 2026-02-24T19:24:31.924 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.913+0000 7fa5e7fff640 10 monclient: _finish_auth 0 2026-02-24T19:24:31.924 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.913+0000 7fa5e7fff640 10 monclient: _check_auth_tickets 2026-02-24T19:24:31.924 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.913+0000 7fa5e7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:31.924 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.913+0000 7fa5e7fff640 1 -- 10.20.193.26:0/3466458325 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa5e8002df0 con 0x7fa5f815d610 2026-02-24T19:24:31.924 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.913+0000 7fa5e7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:31.924 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.913+0000 7fa5e7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:31.924 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.913+0000 7fa5e7fff640 10 monclient: dump: 2026-02-24T19:24:31.924 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.924 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.924 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.924 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.925 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.925 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.925 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.925 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.925 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.925 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.925 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.913+0000 7fa5ff8e1640 5 monclient: authenticate success, global_id 30113 2026-02-24T19:24:31.925 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.913+0000 7fa5ff8e1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:31.925 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.913+0000 7fa5e7fff640 1 -- 10.20.193.26:0/3466458325 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa5e8002fc0 con 0x7fa5f815d610 2026-02-24T19:24:31.925 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.913+0000 7fa5e7fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:31.925 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.913+0000 7fa5e7fff640 1 -- 10.20.193.26:0/3466458325 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa5e8003400 con 0x7fa5f815d610 2026-02-24T19:24:31.925 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.913+0000 7fa5e7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:31.925 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.913+0000 7fa5e7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:31.926 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.913+0000 7fa5e7fff640 10 monclient: dump: 2026-02-24T19:24:31.926 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.926 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.926 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.926 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.926 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.926 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.926 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.926 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.926 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.926 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.926 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.913+0000 7fa5ff8e1640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:31.927 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.913+0000 7fa5ff8e1640 4 set_mon_vals no callback set 2026-02-24T19:24:31.927 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.914+0000 7fa5ff8e1640 10 monclient: shutdown 2026-02-24T19:24:31.927 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.914+0000 7fa5ff8e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:31.927 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.914+0000 7fa5ff8e1640 1 -- 10.20.193.26:0/3466458325 >> v1:10.20.193.103:6789/0 conn(0x7fa5f815d610 legacy=0x7fa5f80b9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.927 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.914+0000 7fa5ff8e1640 1 -- 10.20.193.26:0/3466458325 shutdown_connections 2026-02-24T19:24:31.927 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.914+0000 7fa5ff8e1640 1 -- 10.20.193.26:0/3466458325 >> 10.20.193.26:0/3466458325 conn(0x7fa5f80b7470 msgr2=0x7fa5f80b7840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:31.927 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.914+0000 7fa5ff8e1640 1 -- 10.20.193.26:0/3466458325 shutdown_connections 2026-02-24T19:24:31.927 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.914+0000 7fa5ff8e1640 1 -- 10.20.193.26:0/3466458325 wait complete. 2026-02-24T19:24:31.927 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.914+0000 7fa5ff8e1640 10 monclient: build_initial_monmap 2026-02-24T19:24:31.927 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.914+0000 7fa5ff8e1640 10 monclient: monmap: 2026-02-24T19:24:31.927 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:31.927 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:31.927 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:31.928 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:31.928 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:31.928 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:31.928 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:31.928 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:31.928 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:31.928 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.928 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.914+0000 7fa5ff8e1640 1 librados: starting msgr at 2026-02-24T19:24:31.928 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.914+0000 7fa5ff8e1640 1 librados: starting objecter 2026-02-24T19:24:31.928 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.915+0000 7fa5ff8e1640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:31.928 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.915+0000 7fa5ff8e1640 1 Processor -- start 2026-02-24T19:24:31.928 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.915+0000 7fa5ff8e1640 1 -- start start 2026-02-24T19:24:31.929 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.915+0000 7fa5ff8e1640 1 librados: setting wanted keys 2026-02-24T19:24:31.929 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.915+0000 7fa5ff8e1640 1 librados: calling monclient init 2026-02-24T19:24:31.929 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.915+0000 7fa5ff8e1640 10 monclient: init 2026-02-24T19:24:31.929 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.915+0000 7fa5ff8e1640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:31.929 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.915+0000 7fa5ff8e1640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:24:31.929 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.915+0000 7fa5ff8e1640 10 monclient(hunting): picked mon.noname-b con 0x7fa5f8056ea0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:31.929 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.915+0000 7fa5ff8e1640 10 monclient(hunting): picked mon.noname-a con 0x7fa5f815d610 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:31.929 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.915+0000 7fa5ff8e1640 10 monclient(hunting): picked mon.noname-c con 0x7fa5f81667e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:31.929 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.915+0000 7fa5ff8e1640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5f8135210 con 0x7fa5f815d610 2026-02-24T19:24:31.929 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.915+0000 7fa5ff8e1640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5f81354f0 con 0x7fa5f8056ea0 2026-02-24T19:24:31.929 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.915+0000 7fa5ff8e1640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5f81357d0 con 0x7fa5f81667e0 2026-02-24T19:24:31.929 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.915+0000 7fa5ff8e1640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:31.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.915+0000 7fa5ff8e1640 10 monclient(hunting): authenticate will time out at 4054.597455s 2026-02-24T19:24:31.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.915+0000 7fa5fce55640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fa5f815d610 0x7fa5f8133660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59052/0 (socket says 10.20.193.26:59052) 2026-02-24T19:24:31.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.915+0000 7fa5fce55640 1 -- 10.20.193.26:0/4059580872 learned_addr learned my addr 10.20.193.26:0/4059580872 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:31.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.915+0000 7fa5e5ffb640 10 client.?.objecter ms_handle_connect 0x7fa5f815d610 2026-02-24T19:24:31.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.915+0000 7fa5e5ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:31.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.916+0000 7fa5e5ffb640 10 client.?.objecter ms_handle_connect 0x7fa5f81667e0 2026-02-24T19:24:31.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.916+0000 7fa5e5ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:31.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.916+0000 7fa5e5ffb640 10 client.?.objecter ms_handle_connect 0x7fa5f8056ea0 2026-02-24T19:24:31.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.916+0000 7fa5e5ffb640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:31.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.916+0000 7fa5e5ffb640 1 -- 10.20.193.26:0/4059580872 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1707246287 0 0) 0x7fa5f81357d0 con 0x7fa5f81667e0 2026-02-24T19:24:31.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.916+0000 7fa5e5ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.916+0000 7fa5e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.930 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.916+0000 7fa5e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.931 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.916+0000 7fa5e5ffb640 10 monclient(hunting): my global_id is 30116 2026-02-24T19:24:31.931 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.916+0000 7fa5e5ffb640 1 -- 10.20.193.26:0/4059580872 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5c8003610 con 0x7fa5f81667e0 2026-02-24T19:24:31.931 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.916+0000 7fa5e5ffb640 1 -- 10.20.193.26:0/4059580872 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1253855146 0 0) 0x7fa5f8135210 con 0x7fa5f815d610 2026-02-24T19:24:31.931 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.916+0000 7fa5e5ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.931 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.916+0000 7fa5e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.931 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.916+0000 7fa5e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.931 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.916+0000 7fa5e5ffb640 10 monclient(hunting): my global_id is 30777 2026-02-24T19:24:31.931 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.916+0000 7fa5e5ffb640 1 -- 10.20.193.26:0/4059580872 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5f81357d0 con 0x7fa5f815d610 2026-02-24T19:24:31.931 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.916+0000 7fa5e5ffb640 1 -- 10.20.193.26:0/4059580872 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 466852861 0 0) 0x7fa5f81354f0 con 0x7fa5f8056ea0 2026-02-24T19:24:31.931 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.916+0000 7fa5e5ffb640 10 monclient(hunting): _negotiate 2026-02-24T19:24:31.931 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.916+0000 7fa5e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:31.932 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.916+0000 7fa5e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:31.932 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.916+0000 7fa5e5ffb640 10 monclient(hunting): my global_id is 28192 2026-02-24T19:24:31.932 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.916+0000 7fa5e5ffb640 1 -- 10.20.193.26:0/4059580872 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5f8135210 con 0x7fa5f8056ea0 2026-02-24T19:24:31.932 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.919+0000 7fa5e5ffb640 1 -- 10.20.193.26:0/4059580872 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3868693491 0 0) 0x7fa5c8003610 con 0x7fa5f81667e0 2026-02-24T19:24:31.932 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.919+0000 7fa5e5ffb640 1 -- 10.20.193.26:0/4059580872 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa5f81354f0 con 0x7fa5f81667e0 2026-02-24T19:24:31.932 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.919+0000 7fa5e5ffb640 1 -- 10.20.193.26:0/4059580872 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa5f40032a0 con 0x7fa5f81667e0 2026-02-24T19:24:31.932 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.919+0000 7fa5e5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:31.932 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.919+0000 7fa5e5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:31.932 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.919+0000 7fa5e5ffb640 10 monclient(hunting): dump: 2026-02-24T19:24:31.932 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.932 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.932 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.933 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.933 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.933 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.933 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.933 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.933 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.933 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.933 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.919+0000 7fa5e5ffb640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:31.933 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.919+0000 7fa5e5ffb640 1 -- 10.20.193.26:0/4059580872 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2216999905 0 0) 0x7fa5f81357d0 con 0x7fa5f815d610 2026-02-24T19:24:31.933 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.919+0000 7fa5e5ffb640 1 -- 10.20.193.26:0/4059580872 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa5c8003610 con 0x7fa5f815d610 2026-02-24T19:24:31.933 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.919+0000 7fa5e5ffb640 1 -- 10.20.193.26:0/4059580872 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa5ec003170 con 0x7fa5f815d610 2026-02-24T19:24:31.933 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.919+0000 7fa5e5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:31.933 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.919+0000 7fa5e5ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:31.934 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.919+0000 7fa5e5ffb640 10 monclient(hunting): dump: 2026-02-24T19:24:31.934 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.934 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.934 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.934 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.934 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.934 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.934 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.934 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.934 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.934 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.934 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.919+0000 7fa5e5ffb640 1 -- 10.20.193.26:0/4059580872 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2028592555 0 0) 0x7fa5f8135210 con 0x7fa5f8056ea0 2026-02-24T19:24:31.935 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.919+0000 7fa5e5ffb640 1 -- 10.20.193.26:0/4059580872 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa5f81357d0 con 0x7fa5f8056ea0 2026-02-24T19:24:31.935 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.919+0000 7fa5e5ffb640 1 -- 10.20.193.26:0/4059580872 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa5e8003170 con 0x7fa5f8056ea0 2026-02-24T19:24:31.935 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.919+0000 7fa5e5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:31.935 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.919+0000 7fa5e5ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:31.935 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.919+0000 7fa5e5ffb640 10 monclient(hunting): dump: 2026-02-24T19:24:31.935 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.935 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.935 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.935 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.935 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.935 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.935 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.936 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.936 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.936 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.936 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.920+0000 7fa5e5ffb640 1 -- 10.20.193.26:0/4059580872 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1265842594 0 0) 0x7fa5f81354f0 con 0x7fa5f81667e0 2026-02-24T19:24:31.936 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.920+0000 7fa5e5ffb640 1 -- 10.20.193.26:0/4059580872 >> v1:10.20.193.70:6789/0 conn(0x7fa5f8056ea0 legacy=0x7fa5f80b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.936 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.920+0000 7fa5e5ffb640 1 -- 10.20.193.26:0/4059580872 >> v1:10.20.193.26:6789/0 conn(0x7fa5f815d610 legacy=0x7fa5f8133660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:31.936 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.920+0000 7fa5e5ffb640 10 monclient: _finish_hunting 0 2026-02-24T19:24:31.936 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.920+0000 7fa5e5ffb640 1 monclient: found mon.c 2026-02-24T19:24:31.936 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.920+0000 7fa5e5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:31.936 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.920+0000 7fa5e5ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:31.936 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.920+0000 7fa5e5ffb640 1 -- 10.20.193.26:0/4059580872 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f8135ab0 con 0x7fa5f81667e0 2026-02-24T19:24:31.936 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.920+0000 7fa5e5ffb640 10 monclient: _finish_auth 0 2026-02-24T19:24:31.937 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.920+0000 7fa5e5ffb640 10 monclient: _check_auth_tickets 2026-02-24T19:24:31.937 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.920+0000 7fa5e5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:31.937 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.920+0000 7fa5ff8e1640 5 monclient: authenticate success, global_id 30116 2026-02-24T19:24:31.937 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.920+0000 7fa5ff8e1640 10 monclient: _renew_subs 2026-02-24T19:24:31.937 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.920+0000 7fa5ff8e1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:31.937 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.920+0000 7fa5ff8e1640 1 -- 10.20.193.26:0/4059580872 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f8135d90 con 0x7fa5f81667e0 2026-02-24T19:24:31.937 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.921+0000 7fa5ff8e1640 10 client.30116.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:31.937 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.921+0000 7fa5ff8e1640 10 monclient: _renew_subs 2026-02-24T19:24:31.937 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.921+0000 7fa5ff8e1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:31.937 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.921+0000 7fa5ff8e1640 1 -- 10.20.193.26:0/4059580872 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa5f8134d20 con 0x7fa5f81667e0 2026-02-24T19:24:31.937 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.921+0000 7fa5ff8e1640 1 librados: init done 2026-02-24T19:24:31.937 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.921+0000 7fa5ff8e1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:31.937 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.921+0000 7fa5ff8e1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:31.938 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.921+0000 7fa5ff8e1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:31.938 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.921+0000 7fa5ff8e1640 1 -- 10.20.193.26:0/4059580872 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5f8057750 con 0x7fa5f81667e0 2026-02-24T19:24:31.939 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.928+0000 7fa5e5ffb640 1 -- 10.20.193.26:0/4059580872 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa5f4003440 con 0x7fa5f81667e0 2026-02-24T19:24:31.939 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.928+0000 7fa5e5ffb640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:31.939 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.928+0000 7fa5e5ffb640 1 -- 10.20.193.26:0/4059580872 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fa5f4003c20 con 0x7fa5f81667e0 2026-02-24T19:24:31.939 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.928+0000 7fa5e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:31.939 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.928+0000 7fa5e5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:31.939 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.928+0000 7fa5e77fe640 4 set_mon_vals no callback set 2026-02-24T19:24:31.940 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.928+0000 7fa5e5ffb640 10 monclient: dump: 2026-02-24T19:24:31.940 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:31.940 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:31.940 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.940 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:31.940 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:31.940 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:31.940 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:31.940 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:31.940 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:31.940 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:31.940 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.929+0000 7fa5e5ffb640 1 -- 10.20.193.26:0/4059580872 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fa5f401ca90 con 0x7fa5f81667e0 2026-02-24T19:24:31.940 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.929+0000 7fa5fd656640 10 monclient: get_auth_request con 0x7fa5c8077f20 auth_method 0 2026-02-24T19:24:31.941 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.930+0000 7fa5e5ffb640 10 client.30116.objecter ms_handle_connect 0x7fa5c8077f20 2026-02-24T19:24:31.941 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.930+0000 7fa5e5ffb640 1 -- 10.20.193.26:0/4059580872 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7fa5f4092250 con 0x7fa5f81667e0 2026-02-24T19:24:31.941 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.930+0000 7fa5e5ffb640 10 client.30116.objecter ms_dispatch2 0x7fa5f8000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:31.941 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.930+0000 7fa5e5ffb640 3 client.30116.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:31.941 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.930+0000 7fa5e5ffb640 3 client.30116.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:31.941 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:31.930+0000 7fa5e5ffb640 20 client.30116.objecter dump_active .. 0 homeless 2026-02-24T19:24:32.018 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.016+0000 7fa5e5ffb640 1 -- 10.20.193.26:0/4059580872 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7fa5f405cc80 con 0x7fa5f81667e0 2026-02-24T19:24:32.018 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.016+0000 7fa5e5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:32.018 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.016+0000 7fa5e5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:32.124 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.123+0000 7fa5ff8e1640 1 -- 10.20.193.26:0/4059580872 --> v1:10.20.193.162:6800/3889602630 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fa5f8134fb0 con 0x7fa5c8077f20 2026-02-24T19:24:32.124 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.123+0000 7fa5e5ffb640 1 -- 10.20.193.26:0/4059580872 <== mgr.4107 v1:10.20.193.162:6800/3889602630 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (unknown 3526570807 0 0) 0x7fa5e8003450 con 0x7fa5c8077f20 2026-02-24T19:24:32.125 INFO:teuthology.orchestra.run.trial026.stderr:instructed osd(s) 3 to deep-scrub 2026-02-24T19:24:32.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.124+0000 7fa5ff8e1640 10 librados: watch_flush enter 2026-02-24T19:24:32.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.124+0000 7fa5ff8e1640 10 librados: watch_flush exit 2026-02-24T19:24:32.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.124+0000 7fa5ff8e1640 20 client.30116.objecter shutdown clearing up homeless session... 2026-02-24T19:24:32.126 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.124+0000 7fa5ff8e1640 10 client.30116.objecter successfully canceled tick 2026-02-24T19:24:32.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.124+0000 7fa5ff8e1640 1 -- 10.20.193.26:0/4059580872 >> v1:10.20.193.162:6800/3889602630 conn(0x7fa5c8077f20 legacy=0x7fa5c80983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.124+0000 7fa5ff8e1640 10 monclient: shutdown 2026-02-24T19:24:32.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.124+0000 7fa5ff8e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:32.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.124+0000 7fa5ff8e1640 1 -- 10.20.193.26:0/4059580872 >> v1:10.20.193.103:6789/0 conn(0x7fa5f81667e0 legacy=0x7fa5f8122910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.124+0000 7fa5ff8e1640 1 -- 10.20.193.26:0/4059580872 shutdown_connections 2026-02-24T19:24:32.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.124+0000 7fa5ff8e1640 1 -- 10.20.193.26:0/4059580872 >> 10.20.193.26:0/4059580872 conn(0x7fa5f80b7470 msgr2=0x7fa5f8158910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:32.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.124+0000 7fa5ff8e1640 1 -- 10.20.193.26:0/4059580872 shutdown_connections 2026-02-24T19:24:32.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.124+0000 7fa5ff8e1640 1 -- 10.20.193.26:0/4059580872 wait complete. 2026-02-24T19:24:32.127 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.124+0000 7fa5ff8e1640 1 librados: shutdown 2026-02-24T19:24:32.134 INFO:tasks.ceph:Scrubbing osd.7 2026-02-24T19:24:32.135 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:32.205 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.203+0000 7f5a90ded640 10 monclient: get_monmap_and_config 2026-02-24T19:24:32.205 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.203+0000 7f5a90ded640 10 monclient: build_initial_monmap 2026-02-24T19:24:32.205 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.203+0000 7f5a90ded640 10 monclient: monmap: 2026-02-24T19:24:32.205 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:32.205 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.205 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:32.203889+0000 2026-02-24T19:24:32.205 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:32.203889+0000 2026-02-24T19:24:32.205 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:32.206 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.206 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:32.206 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:32.206 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:32.206 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.206 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.203+0000 7f5a90ded640 1 Processor -- start 2026-02-24T19:24:32.206 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.203+0000 7f5a90ded640 1 -- start start 2026-02-24T19:24:32.206 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.203+0000 7f5a90ded640 10 monclient: init 2026-02-24T19:24:32.209 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.204+0000 7f5a90ded640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:32.209 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.204+0000 7f5a90ded640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:32.209 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.204+0000 7f5a90ded640 10 monclient(hunting): picked mon.noname-c con 0x7f5a8c15e2a0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:32.210 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.204+0000 7f5a90ded640 10 monclient(hunting): picked mon.noname-b con 0x7f5a8c059e10 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:32.210 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.204+0000 7f5a90ded640 10 monclient(hunting): picked mon.noname-a con 0x7f5a8c1a5660 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:32.210 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.204+0000 7f5a90ded640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a8c162df0 con 0x7f5a8c1a5660 2026-02-24T19:24:32.210 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.204+0000 7f5a90ded640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a8c1630d0 con 0x7f5a8c059e10 2026-02-24T19:24:32.210 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.204+0000 7f5a90ded640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a8c1633b0 con 0x7f5a8c15e2a0 2026-02-24T19:24:32.210 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.204+0000 7f5a90ded640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:32.210 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.204+0000 7f5a90ded640 10 monclient(hunting): authenticate will time out at 4054.886129s 2026-02-24T19:24:32.210 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.204+0000 7f5a8ad76640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f5a8c1a5660 0x7f5a8c1c5a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59054/0 (socket says 10.20.193.26:59054) 2026-02-24T19:24:32.210 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.204+0000 7f5a8ad76640 1 -- 10.20.193.26:0/2325595940 learned_addr learned my addr 10.20.193.26:0/2325595940 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:32.210 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.205+0000 7f5a89573640 1 -- 10.20.193.26:0/2325595940 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2878138184 0 0) 0x7f5a8c162df0 con 0x7f5a8c1a5660 2026-02-24T19:24:32.211 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.205+0000 7f5a89573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:32.211 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.205+0000 7f5a89573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:32.211 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.205+0000 7f5a89573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:32.211 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.205+0000 7f5a89573640 10 monclient(hunting): my global_id is 30780 2026-02-24T19:24:32.211 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.206+0000 7f5a89573640 1 -- 10.20.193.26:0/2325595940 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a78003610 con 0x7f5a8c1a5660 2026-02-24T19:24:32.211 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.206+0000 7f5a89573640 1 -- 10.20.193.26:0/2325595940 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 141586546 0 0) 0x7f5a8c1633b0 con 0x7f5a8c15e2a0 2026-02-24T19:24:32.211 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.206+0000 7f5a89573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:32.211 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.206+0000 7f5a89573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:32.211 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.206+0000 7f5a89573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:32.211 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.206+0000 7f5a89573640 10 monclient(hunting): my global_id is 30119 2026-02-24T19:24:32.211 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.206+0000 7f5a89573640 1 -- 10.20.193.26:0/2325595940 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a8c162df0 con 0x7f5a8c15e2a0 2026-02-24T19:24:32.211 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.206+0000 7f5a89573640 1 -- 10.20.193.26:0/2325595940 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1556765900 0 0) 0x7f5a8c1630d0 con 0x7f5a8c059e10 2026-02-24T19:24:32.212 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.206+0000 7f5a89573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:32.212 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.206+0000 7f5a89573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:32.212 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.206+0000 7f5a89573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:32.212 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.206+0000 7f5a89573640 10 monclient(hunting): my global_id is 28195 2026-02-24T19:24:32.212 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.206+0000 7f5a89573640 1 -- 10.20.193.26:0/2325595940 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a8c1633b0 con 0x7f5a8c059e10 2026-02-24T19:24:32.212 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.207+0000 7f5a89573640 1 -- 10.20.193.26:0/2325595940 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1919487997 0 0) 0x7f5a8c162df0 con 0x7f5a8c15e2a0 2026-02-24T19:24:32.212 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.207+0000 7f5a89573640 1 -- 10.20.193.26:0/2325595940 >> v1:10.20.193.70:6789/0 conn(0x7f5a8c059e10 legacy=0x7f5a8c15ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.212 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.207+0000 7f5a89573640 1 -- 10.20.193.26:0/2325595940 >> v1:10.20.193.26:6789/0 conn(0x7f5a8c1a5660 legacy=0x7f5a8c1c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.212 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.207+0000 7f5a89573640 10 monclient: _finish_hunting 0 2026-02-24T19:24:32.212 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.207+0000 7f5a89573640 1 monclient: found mon.noname-c 2026-02-24T19:24:32.212 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.207+0000 7f5a89573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:32.212 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.207+0000 7f5a89573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:24:32.213 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.207+0000 7f5a89573640 1 -- 10.20.193.26:0/2325595940 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a8c163690 con 0x7f5a8c15e2a0 2026-02-24T19:24:32.213 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.207+0000 7f5a89573640 10 monclient: _finish_auth 0 2026-02-24T19:24:32.213 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.207+0000 7f5a89573640 10 monclient: _check_auth_tickets 2026-02-24T19:24:32.213 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.207+0000 7f5a89573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:32.213 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.207+0000 7f5a89573640 1 -- 10.20.193.26:0/2325595940 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f5a80002df0 con 0x7f5a8c15e2a0 2026-02-24T19:24:32.213 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.207+0000 7f5a89573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:32.213 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.207+0000 7f5a89573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:32.213 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.207+0000 7f5a89573640 10 monclient: dump: 2026-02-24T19:24:32.213 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:32.213 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.213 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.213 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.214 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:32.214 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.214 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:32.214 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:32.214 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:32.214 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.214 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.207+0000 7f5a90ded640 5 monclient: authenticate success, global_id 30119 2026-02-24T19:24:32.214 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.207+0000 7f5a90ded640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:32.220 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.208+0000 7f5a89573640 1 -- 10.20.193.26:0/2325595940 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5a80002fc0 con 0x7f5a8c15e2a0 2026-02-24T19:24:32.221 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.208+0000 7f5a89573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:32.221 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.208+0000 7f5a89573640 1 -- 10.20.193.26:0/2325595940 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f5a80003400 con 0x7f5a8c15e2a0 2026-02-24T19:24:32.221 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.208+0000 7f5a89573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:32.221 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.208+0000 7f5a89573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:32.221 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.208+0000 7f5a89573640 10 monclient: dump: 2026-02-24T19:24:32.221 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:32.221 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.221 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.221 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.221 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:32.221 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.222 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:32.222 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:32.222 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:32.222 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.222 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.208+0000 7f5a90ded640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:32.222 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.208+0000 7f5a90ded640 4 set_mon_vals no callback set 2026-02-24T19:24:32.222 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.208+0000 7f5a90ded640 10 monclient: shutdown 2026-02-24T19:24:32.222 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.208+0000 7f5a90ded640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:32.222 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.208+0000 7f5a90ded640 1 -- 10.20.193.26:0/2325595940 >> v1:10.20.193.103:6789/0 conn(0x7f5a8c15e2a0 legacy=0x7f5a8c05da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.222 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.208+0000 7f5a90ded640 1 -- 10.20.193.26:0/2325595940 shutdown_connections 2026-02-24T19:24:32.222 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.208+0000 7f5a90ded640 1 -- 10.20.193.26:0/2325595940 >> 10.20.193.26:0/2325595940 conn(0x7f5a8c0b2f60 msgr2=0x7f5a8c0b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:32.222 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.208+0000 7f5a90ded640 1 -- 10.20.193.26:0/2325595940 shutdown_connections 2026-02-24T19:24:32.223 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.208+0000 7f5a90ded640 1 -- 10.20.193.26:0/2325595940 wait complete. 2026-02-24T19:24:32.223 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.209+0000 7f5a90ded640 10 monclient: build_initial_monmap 2026-02-24T19:24:32.223 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.209+0000 7f5a90ded640 10 monclient: monmap: 2026-02-24T19:24:32.223 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:32.223 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:32.223 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:32.223 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:32.223 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:32.223 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:32.223 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:32.223 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:32.223 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:32.223 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.224 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.209+0000 7f5a90ded640 1 librados: starting msgr at 2026-02-24T19:24:32.224 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.209+0000 7f5a90ded640 1 librados: starting objecter 2026-02-24T19:24:32.224 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.209+0000 7f5a90ded640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:32.224 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.209+0000 7f5a90ded640 1 Processor -- start 2026-02-24T19:24:32.224 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.209+0000 7f5a90ded640 1 -- start start 2026-02-24T19:24:32.224 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.209+0000 7f5a90ded640 1 librados: setting wanted keys 2026-02-24T19:24:32.224 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.209+0000 7f5a90ded640 1 librados: calling monclient init 2026-02-24T19:24:32.224 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.209+0000 7f5a90ded640 10 monclient: init 2026-02-24T19:24:32.224 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.209+0000 7f5a90ded640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:32.224 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.209+0000 7f5a90ded640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:24:32.224 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.209+0000 7f5a90ded640 10 monclient(hunting): picked mon.noname-a con 0x7f5a8c059e10 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:32.224 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.209+0000 7f5a90ded640 10 monclient(hunting): picked mon.noname-b con 0x7f5a8c15e2a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:32.225 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.209+0000 7f5a90ded640 10 monclient(hunting): picked mon.noname-c con 0x7f5a8c1a5660 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:32.225 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.209+0000 7f5a90ded640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a8c160900 con 0x7f5a8c059e10 2026-02-24T19:24:32.225 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.209+0000 7f5a90ded640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a8c05b920 con 0x7f5a8c15e2a0 2026-02-24T19:24:32.225 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.209+0000 7f5a90ded640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a8c05bbe0 con 0x7f5a8c1a5660 2026-02-24T19:24:32.225 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.209+0000 7f5a90ded640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:32.225 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.209+0000 7f5a90ded640 10 monclient(hunting): authenticate will time out at 4054.891967s 2026-02-24T19:24:32.225 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.210+0000 7f5a8ad76640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f5a8c1a5660 0x7f5a8c0b0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:57272/0 (socket says 10.20.193.26:57272) 2026-02-24T19:24:32.225 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.210+0000 7f5a8ad76640 1 -- 10.20.193.26:0/4210542523 learned_addr learned my addr 10.20.193.26:0/4210542523 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:32.225 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.210+0000 7f5a72ffd640 10 client.?.objecter ms_handle_connect 0x7f5a8c15e2a0 2026-02-24T19:24:32.225 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.210+0000 7f5a72ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:32.225 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.210+0000 7f5a72ffd640 10 client.?.objecter ms_handle_connect 0x7f5a8c1a5660 2026-02-24T19:24:32.225 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.210+0000 7f5a72ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:32.225 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.211+0000 7f5a72ffd640 10 client.?.objecter ms_handle_connect 0x7f5a8c059e10 2026-02-24T19:24:32.226 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.211+0000 7f5a72ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:32.226 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.211+0000 7f5a72ffd640 1 -- 10.20.193.26:0/4210542523 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 471273470 0 0) 0x7f5a8c05b920 con 0x7f5a8c15e2a0 2026-02-24T19:24:32.226 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.211+0000 7f5a72ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:32.226 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.211+0000 7f5a72ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:32.226 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.211+0000 7f5a72ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:32.226 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.211+0000 7f5a72ffd640 10 monclient(hunting): my global_id is 28198 2026-02-24T19:24:32.226 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.211+0000 7f5a72ffd640 1 -- 10.20.193.26:0/4210542523 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a58003610 con 0x7f5a8c15e2a0 2026-02-24T19:24:32.226 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.211+0000 7f5a72ffd640 1 -- 10.20.193.26:0/4210542523 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 789010255 0 0) 0x7f5a8c05bbe0 con 0x7f5a8c1a5660 2026-02-24T19:24:32.226 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.211+0000 7f5a72ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:32.226 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.211+0000 7f5a72ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:32.226 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.211+0000 7f5a72ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:32.226 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.211+0000 7f5a72ffd640 10 monclient(hunting): my global_id is 30122 2026-02-24T19:24:32.226 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.211+0000 7f5a72ffd640 1 -- 10.20.193.26:0/4210542523 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a8c05b920 con 0x7f5a8c1a5660 2026-02-24T19:24:32.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.212+0000 7f5a72ffd640 1 -- 10.20.193.26:0/4210542523 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3087967170 0 0) 0x7f5a8c160900 con 0x7f5a8c059e10 2026-02-24T19:24:32.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.212+0000 7f5a72ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:32.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.212+0000 7f5a72ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:32.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.212+0000 7f5a72ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:32.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.212+0000 7f5a72ffd640 10 monclient(hunting): my global_id is 30783 2026-02-24T19:24:32.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.212+0000 7f5a72ffd640 1 -- 10.20.193.26:0/4210542523 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a8c05bbe0 con 0x7f5a8c059e10 2026-02-24T19:24:32.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.213+0000 7f5a72ffd640 1 -- 10.20.193.26:0/4210542523 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4254093374 0 0) 0x7f5a58003610 con 0x7f5a8c15e2a0 2026-02-24T19:24:32.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.213+0000 7f5a72ffd640 1 -- 10.20.193.26:0/4210542523 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5a8c160900 con 0x7f5a8c15e2a0 2026-02-24T19:24:32.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.213+0000 7f5a72ffd640 1 -- 10.20.193.26:0/4210542523 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f5a74002f50 con 0x7f5a8c15e2a0 2026-02-24T19:24:32.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.213+0000 7f5a72ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:32.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.213+0000 7f5a72ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:32.227 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.213+0000 7f5a72ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:32.228 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:32.228 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.228 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.228 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.228 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:32.228 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.228 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:32.228 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:32.228 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:32.228 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.228 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.213+0000 7f5a72ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:32.228 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.214+0000 7f5a72ffd640 1 -- 10.20.193.26:0/4210542523 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 987020317 0 0) 0x7f5a8c05b920 con 0x7f5a8c1a5660 2026-02-24T19:24:32.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.214+0000 7f5a72ffd640 1 -- 10.20.193.26:0/4210542523 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5a58003610 con 0x7f5a8c1a5660 2026-02-24T19:24:32.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.214+0000 7f5a72ffd640 1 -- 10.20.193.26:0/4210542523 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f5a7c003430 con 0x7f5a8c1a5660 2026-02-24T19:24:32.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.214+0000 7f5a72ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:32.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.214+0000 7f5a72ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:32.229 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.214+0000 7f5a72ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:32.229 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:32.229 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.229 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.229 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.229 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:32.229 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.229 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:32.229 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:32.230 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:32.230 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.230 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.215+0000 7f5a72ffd640 1 -- 10.20.193.26:0/4210542523 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1229465053 0 0) 0x7f5a8c05bbe0 con 0x7f5a8c059e10 2026-02-24T19:24:32.230 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.215+0000 7f5a72ffd640 1 -- 10.20.193.26:0/4210542523 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5a8c05b920 con 0x7f5a8c059e10 2026-02-24T19:24:32.230 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.215+0000 7f5a72ffd640 1 -- 10.20.193.26:0/4210542523 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f5a80003310 con 0x7f5a8c059e10 2026-02-24T19:24:32.230 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.215+0000 7f5a72ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:32.230 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.215+0000 7f5a72ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:32.230 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.215+0000 7f5a72ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:32.230 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:32.230 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.230 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.230 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.231 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:32.231 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.231 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:32.231 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:32.231 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:32.231 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.215+0000 7f5a72ffd640 1 -- 10.20.193.26:0/4210542523 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 959283157 0 0) 0x7f5a8c160900 con 0x7f5a8c15e2a0 2026-02-24T19:24:32.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.215+0000 7f5a72ffd640 1 -- 10.20.193.26:0/4210542523 >> v1:10.20.193.103:6789/0 conn(0x7f5a8c1a5660 legacy=0x7f5a8c0b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.215+0000 7f5a72ffd640 1 -- 10.20.193.26:0/4210542523 >> v1:10.20.193.26:6789/0 conn(0x7f5a8c059e10 legacy=0x7f5a8c1601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.215+0000 7f5a72ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:32.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.215+0000 7f5a72ffd640 1 monclient: found mon.b 2026-02-24T19:24:32.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.215+0000 7f5a72ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:32.231 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.215+0000 7f5a72ffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:32.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.215+0000 7f5a72ffd640 1 -- 10.20.193.26:0/4210542523 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a8c05bec0 con 0x7f5a8c15e2a0 2026-02-24T19:24:32.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.215+0000 7f5a72ffd640 10 monclient: _finish_auth 0 2026-02-24T19:24:32.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.215+0000 7f5a72ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:32.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.215+0000 7f5a72ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:32.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.215+0000 7f5a90ded640 5 monclient: authenticate success, global_id 28198 2026-02-24T19:24:32.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.215+0000 7f5a90ded640 10 monclient: _renew_subs 2026-02-24T19:24:32.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.215+0000 7f5a90ded640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:32.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.215+0000 7f5a90ded640 1 -- 10.20.193.26:0/4210542523 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5a8c05c1a0 con 0x7f5a8c15e2a0 2026-02-24T19:24:32.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.215+0000 7f5a90ded640 10 client.28198.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:32.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.215+0000 7f5a90ded640 10 monclient: _renew_subs 2026-02-24T19:24:32.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.215+0000 7f5a90ded640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:32.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.215+0000 7f5a90ded640 1 -- 10.20.193.26:0/4210542523 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5a8c05c760 con 0x7f5a8c15e2a0 2026-02-24T19:24:32.232 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.215+0000 7f5a90ded640 1 librados: init done 2026-02-24T19:24:32.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.216+0000 7f5a90ded640 10 client.28198.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:32.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.216+0000 7f5a90ded640 15 client.28198.objecter _session_command_op_assign -1 1 2026-02-24T19:24:32.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.216+0000 7f5a90ded640 20 client.28198.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:32.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.216+0000 7f5a90ded640 10 client.28198.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:32.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.216+0000 7f5a90ded640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:32.233 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.216+0000 7f5a90ded640 1 -- 10.20.193.26:0/4210542523 --> v1:10.20.193.70:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f5a8c192a30 con 0x7f5a8c15e2a0 2026-02-24T19:24:32.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.224+0000 7f5a72ffd640 1 -- 10.20.193.26:0/4210542523 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5a8c192a30 con 0x7f5a8c15e2a0 2026-02-24T19:24:32.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.224+0000 7f5a72ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:32.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.224+0000 7f5a72ffd640 1 -- 10.20.193.26:0/4210542523 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f5a74003700 con 0x7f5a8c15e2a0 2026-02-24T19:24:32.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.224+0000 7f5a72ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:32.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.224+0000 7f5a72ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:32.235 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.224+0000 7f5a88d72640 4 set_mon_vals no callback set 2026-02-24T19:24:32.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.224+0000 7f5a72ffd640 10 monclient: dump: 2026-02-24T19:24:32.236 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:32.236 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.236 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.236 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.236 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:32.236 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.236 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:32.236 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:32.236 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:32.236 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.236 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.225+0000 7f5a72ffd640 1 -- 10.20.193.26:0/4210542523 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f5a7401c570 con 0x7f5a8c15e2a0 2026-02-24T19:24:32.237 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.225+0000 7f5a8a575640 10 monclient: get_auth_request con 0x7f5a58077e70 auth_method 0 2026-02-24T19:24:32.237 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.225+0000 7f5a72ffd640 10 client.28198.objecter ms_handle_connect 0x7f5a58077e70 2026-02-24T19:24:32.237 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.226+0000 7f5a72ffd640 1 -- 10.20.193.26:0/4210542523 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7f5a74091e40 con 0x7f5a8c15e2a0 2026-02-24T19:24:32.237 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.226+0000 7f5a72ffd640 10 client.28198.objecter ms_dispatch2 0x7f5a8c000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:32.237 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.226+0000 7f5a72ffd640 3 client.28198.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:32.237 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.226+0000 7f5a72ffd640 3 client.28198.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:32.237 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.227+0000 7f5a72ffd640 10 client.28198.objecter checking command 1 2026-02-24T19:24:32.237 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.227+0000 7f5a72ffd640 20 client.28198.objecter _get_session s=0x7f5a580a2230 osd=7 3 2026-02-24T19:24:32.237 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.227+0000 7f5a72ffd640 20 client.28198.objecter put_session s=0x7f5a580a2230 osd=7 3 2026-02-24T19:24:32.237 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.227+0000 7f5a72ffd640 15 client.28198.objecter _session_command_op_remove -1 1 2026-02-24T19:24:32.237 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.227+0000 7f5a72ffd640 20 client.28198.objecter _get_session s=0x7f5a580a2230 osd=7 3 2026-02-24T19:24:32.237 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.227+0000 7f5a72ffd640 20 client.28198.objecter get_session s=0x7f5a580a2230 osd=7 3 2026-02-24T19:24:32.237 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.227+0000 7f5a72ffd640 15 client.28198.objecter _session_command_op_assign 7 1 2026-02-24T19:24:32.238 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.227+0000 7f5a72ffd640 20 client.28198.objecter put_session s=0x7f5a580a2230 osd=7 4 2026-02-24T19:24:32.238 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.227+0000 7f5a72ffd640 10 client.28198.objecter _send_command 1 2026-02-24T19:24:32.238 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.227+0000 7f5a72ffd640 1 -- 10.20.193.26:0/4210542523 --> v1:10.20.193.162:6809/2963240067 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5a740030f0 con 0x7f5a580a28e0 2026-02-24T19:24:32.238 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.227+0000 7f5a72ffd640 20 client.28198.objecter dump_active .. 0 homeless 2026-02-24T19:24:32.238 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.227+0000 7f5a72ffd640 1 -- 10.20.193.26:0/4210542523 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_get_version_reply(handle=1 version=346) ==== 24+0+0 (unknown 2991753921 0 0) 0x7f5a7405bf40 con 0x7f5a8c15e2a0 2026-02-24T19:24:32.238 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.227+0000 7f5a72ffd640 10 monclient: handle_get_version_reply finishing 1 version 346 2026-02-24T19:24:32.238 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.227+0000 7f5a8ad76640 10 monclient: get_auth_request con 0x7f5a580a28e0 auth_method 0 2026-02-24T19:24:32.238 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.228+0000 7f5a72ffd640 10 client.28198.objecter ms_handle_connect 0x7f5a580a28e0 2026-02-24T19:24:32.239 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.238+0000 7f5a72ffd640 1 -- 10.20.193.26:0/4210542523 <== osd.7 v1:10.20.193.162:6809/2963240067 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f5a740030f0 con 0x7f5a580a28e0 2026-02-24T19:24:32.239 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.238+0000 7f5a72ffd640 10 client.28198.objecter ms_dispatch2 0x7f5a8c000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:32.239 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.238+0000 7f5a72ffd640 10 client.28198.objecter _finish_command 1 = system:0 2026-02-24T19:24:32.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.238+0000 7f5a72ffd640 20 client.28198.objecter put_session s=0x7f5a580a2230 osd=7 4 2026-02-24T19:24:32.240 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.238+0000 7f5a72ffd640 15 client.28198.objecter _session_command_op_remove 7 1 2026-02-24T19:24:32.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.246+0000 7f5a90ded640 10 client.28198.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:32.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.246+0000 7f5a90ded640 15 client.28198.objecter _session_command_op_assign -1 2 2026-02-24T19:24:32.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.246+0000 7f5a90ded640 20 client.28198.objecter _get_session s=0x7f5a580a2230 osd=7 3 2026-02-24T19:24:32.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.246+0000 7f5a90ded640 20 client.28198.objecter put_session s=0x7f5a580a2230 osd=7 3 2026-02-24T19:24:32.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.246+0000 7f5a90ded640 20 client.28198.objecter _get_session s=0x7f5a580a2230 osd=7 3 2026-02-24T19:24:32.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.246+0000 7f5a90ded640 15 client.28198.objecter _session_command_op_remove -1 2 2026-02-24T19:24:32.248 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.246+0000 7f5a90ded640 20 client.28198.objecter get_session s=0x7f5a580a2230 osd=7 3 2026-02-24T19:24:32.249 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.246+0000 7f5a90ded640 15 client.28198.objecter _session_command_op_assign 7 2 2026-02-24T19:24:32.249 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.246+0000 7f5a90ded640 20 client.28198.objecter put_session s=0x7f5a580a2230 osd=7 4 2026-02-24T19:24:32.249 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.246+0000 7f5a90ded640 10 client.28198.objecter _send_command 2 2026-02-24T19:24:32.249 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.246+0000 7f5a90ded640 1 -- 10.20.193.26:0/4210542523 --> v1:10.20.193.162:6809/2963240067 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5a8c192750 con 0x7f5a580a28e0 2026-02-24T19:24:32.255 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.253+0000 7f5a72ffd640 1 -- 10.20.193.26:0/4210542523 <== osd.7 v1:10.20.193.162:6809/2963240067 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f5a8c192750 con 0x7f5a580a28e0 2026-02-24T19:24:32.255 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.253+0000 7f5a72ffd640 10 client.28198.objecter ms_dispatch2 0x7f5a8c000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:32.255 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.253+0000 7f5a72ffd640 10 client.28198.objecter _finish_command 2 = system:0 2026-02-24T19:24:32.255 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.253+0000 7f5a72ffd640 20 client.28198.objecter put_session s=0x7f5a580a2230 osd=7 4 2026-02-24T19:24:32.256 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.253+0000 7f5a72ffd640 15 client.28198.objecter _session_command_op_remove 7 2 2026-02-24T19:24:32.256 INFO:teuthology.orchestra.run.trial026.stdout:{ 2026-02-24T19:24:32.256 INFO:teuthology.orchestra.run.trial026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:32.256 INFO:teuthology.orchestra.run.trial026.stdout:} 2026-02-24T19:24:32.257 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.254+0000 7f5a90ded640 10 librados: watch_flush enter 2026-02-24T19:24:32.257 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.254+0000 7f5a90ded640 10 librados: watch_flush exit 2026-02-24T19:24:32.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.254+0000 7f5a90ded640 10 client.28198.objecter close_session for osd.7 2026-02-24T19:24:32.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.254+0000 7f5a90ded640 1 -- 10.20.193.26:0/4210542523 >> v1:10.20.193.162:6809/2963240067 conn(0x7f5a580a28e0 legacy=0x7f5a580c2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.254+0000 7f5a90ded640 20 client.28198.objecter put_session s=0x7f5a580a2230 osd=7 1 2026-02-24T19:24:32.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.254+0000 7f5a90ded640 20 client.28198.objecter shutdown clearing up homeless session... 2026-02-24T19:24:32.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.254+0000 7f5a90ded640 10 client.28198.objecter successfully canceled tick 2026-02-24T19:24:32.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.254+0000 7f5a90ded640 1 -- 10.20.193.26:0/4210542523 >> v1:10.20.193.162:6800/3889602630 conn(0x7f5a58077e70 legacy=0x7f5a58098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.254+0000 7f5a90ded640 10 monclient: shutdown 2026-02-24T19:24:32.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.254+0000 7f5a90ded640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:32.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.254+0000 7f5a90ded640 1 -- 10.20.193.26:0/4210542523 >> v1:10.20.193.70:6789/0 conn(0x7f5a8c15e2a0 legacy=0x7f5a8c12d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.254+0000 7f5a8ad76640 1 -- 10.20.193.26:0/4210542523 reap_dead start 2026-02-24T19:24:32.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.254+0000 7f5a90ded640 1 -- 10.20.193.26:0/4210542523 shutdown_connections 2026-02-24T19:24:32.258 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.254+0000 7f5a90ded640 1 -- 10.20.193.26:0/4210542523 >> 10.20.193.26:0/4210542523 conn(0x7f5a8c0b2f60 msgr2=0x7f5a8c195b70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:32.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.254+0000 7f5a90ded640 1 -- 10.20.193.26:0/4210542523 shutdown_connections 2026-02-24T19:24:32.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.254+0000 7f5a90ded640 1 -- 10.20.193.26:0/4210542523 wait complete. 2026-02-24T19:24:32.259 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.254+0000 7f5a90ded640 1 librados: shutdown 2026-02-24T19:24:32.264 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2026-02-24T19:24:32.332 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.330+0000 7f2540cfb640 10 monclient: get_monmap_and_config 2026-02-24T19:24:32.332 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.330+0000 7f2540cfb640 10 monclient: build_initial_monmap 2026-02-24T19:24:32.332 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.330+0000 7f2540cfb640 10 monclient: monmap: 2026-02-24T19:24:32.332 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:32.332 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.332 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:32.331356+0000 2026-02-24T19:24:32.332 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:32.331356+0000 2026-02-24T19:24:32.333 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:32.333 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.333 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:32.333 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:32.333 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:32.333 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.334 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.331+0000 7f2540cfb640 1 Processor -- start 2026-02-24T19:24:32.335 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.331+0000 7f2540cfb640 1 -- start start 2026-02-24T19:24:32.335 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.331+0000 7f2540cfb640 10 monclient: init 2026-02-24T19:24:32.335 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.331+0000 7f2540cfb640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:32.335 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.331+0000 7f2540cfb640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:24:32.335 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.331+0000 7f2540cfb640 10 monclient(hunting): picked mon.noname-a con 0x7f253c059b90 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:32.335 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.331+0000 7f2540cfb640 10 monclient(hunting): picked mon.noname-b con 0x7f253c0b27b0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:32.335 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.331+0000 7f2540cfb640 10 monclient(hunting): picked mon.noname-c con 0x7f253c159b60 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:32.335 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.331+0000 7f2540cfb640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f253c0b1750 con 0x7f253c059b90 2026-02-24T19:24:32.335 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.331+0000 7f2540cfb640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f253c0b19f0 con 0x7f253c0b27b0 2026-02-24T19:24:32.335 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.331+0000 7f2540cfb640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f253c0b1cd0 con 0x7f253c159b60 2026-02-24T19:24:32.335 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.331+0000 7f2540cfb640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:32.335 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.331+0000 7f2540cfb640 10 monclient(hunting): authenticate will time out at 4055.013884s 2026-02-24T19:24:32.336 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.332+0000 7f253ad76640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f253c159b60 0x7f253c1c7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:57280/0 (socket says 10.20.193.26:57280) 2026-02-24T19:24:32.336 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.332+0000 7f253ad76640 1 -- 10.20.193.26:0/418239710 learned_addr learned my addr 10.20.193.26:0/418239710 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:32.340 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.333+0000 7f2539573640 1 -- 10.20.193.26:0/418239710 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3825264105 0 0) 0x7f253c0b19f0 con 0x7f253c0b27b0 2026-02-24T19:24:32.340 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.333+0000 7f2539573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:32.340 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.333+0000 7f2539573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:32.340 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.333+0000 7f2539573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:32.341 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.333+0000 7f2539573640 10 monclient(hunting): my global_id is 28201 2026-02-24T19:24:32.341 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.333+0000 7f2539573640 1 -- 10.20.193.26:0/418239710 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2528003610 con 0x7f253c0b27b0 2026-02-24T19:24:32.341 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.333+0000 7f2539573640 1 -- 10.20.193.26:0/418239710 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1334565064 0 0) 0x7f253c0b1cd0 con 0x7f253c159b60 2026-02-24T19:24:32.341 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.333+0000 7f2539573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:32.341 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.333+0000 7f2539573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:32.341 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.333+0000 7f2539573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:32.341 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.333+0000 7f2539573640 10 monclient(hunting): my global_id is 30125 2026-02-24T19:24:32.341 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.333+0000 7f2539573640 1 -- 10.20.193.26:0/418239710 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f253c0b19f0 con 0x7f253c159b60 2026-02-24T19:24:32.341 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.333+0000 7f2539573640 1 -- 10.20.193.26:0/418239710 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4249419970 0 0) 0x7f253c0b1750 con 0x7f253c059b90 2026-02-24T19:24:32.341 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.333+0000 7f2539573640 10 monclient(hunting): _negotiate 2026-02-24T19:24:32.341 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.333+0000 7f2539573640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:32.341 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.333+0000 7f2539573640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:32.342 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.333+0000 7f2539573640 10 monclient(hunting): my global_id is 30786 2026-02-24T19:24:32.342 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.333+0000 7f2539573640 1 -- 10.20.193.26:0/418239710 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f253c0b1cd0 con 0x7f253c059b90 2026-02-24T19:24:32.342 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.335+0000 7f2539573640 1 -- 10.20.193.26:0/418239710 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2062650480 0 0) 0x7f2528003610 con 0x7f253c0b27b0 2026-02-24T19:24:32.342 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.335+0000 7f2539573640 1 -- 10.20.193.26:0/418239710 >> v1:10.20.193.103:6789/0 conn(0x7f253c159b60 legacy=0x7f253c1c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.342 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.335+0000 7f2539573640 1 -- 10.20.193.26:0/418239710 >> v1:10.20.193.26:6789/0 conn(0x7f253c059b90 legacy=0x7f253c057620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.342 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.335+0000 7f2539573640 10 monclient: _finish_hunting 0 2026-02-24T19:24:32.342 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.335+0000 7f2539573640 1 monclient: found mon.noname-b 2026-02-24T19:24:32.342 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.335+0000 7f2539573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:32.342 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.335+0000 7f2539573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:24:32.342 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.335+0000 7f2539573640 1 -- 10.20.193.26:0/418239710 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253c0b1fb0 con 0x7f253c0b27b0 2026-02-24T19:24:32.342 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.335+0000 7f2539573640 10 monclient: _finish_auth 0 2026-02-24T19:24:32.342 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.335+0000 7f2539573640 10 monclient: _check_auth_tickets 2026-02-24T19:24:32.342 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.335+0000 7f2539573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:32.343 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.335+0000 7f2539573640 1 -- 10.20.193.26:0/418239710 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2524002df0 con 0x7f253c0b27b0 2026-02-24T19:24:32.343 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.335+0000 7f2539573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:32.343 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.335+0000 7f2539573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:32.343 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.335+0000 7f2539573640 10 monclient: dump: 2026-02-24T19:24:32.343 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:32.343 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.343 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.343 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.343 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:32.343 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.343 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:32.343 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:32.344 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:32.344 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.344 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.335+0000 7f2540cfb640 5 monclient: authenticate success, global_id 28201 2026-02-24T19:24:32.344 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.335+0000 7f2540cfb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:32.344 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.336+0000 7f2539573640 1 -- 10.20.193.26:0/418239710 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2524002fc0 con 0x7f253c0b27b0 2026-02-24T19:24:32.344 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.336+0000 7f2539573640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:32.344 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.336+0000 7f2539573640 1 -- 10.20.193.26:0/418239710 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2524003400 con 0x7f253c0b27b0 2026-02-24T19:24:32.344 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.336+0000 7f2539573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:32.344 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.336+0000 7f2539573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:32.344 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.336+0000 7f2539573640 10 monclient: dump: 2026-02-24T19:24:32.344 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:32.344 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.345 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.345 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.345 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:32.345 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.345 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:32.345 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:32.345 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:32.345 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.345 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.336+0000 7f2540cfb640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:32.345 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.336+0000 7f2540cfb640 4 set_mon_vals no callback set 2026-02-24T19:24:32.346 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.336+0000 7f2540cfb640 10 monclient: shutdown 2026-02-24T19:24:32.346 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.336+0000 7f2540cfb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:32.346 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.336+0000 7f2540cfb640 1 -- 10.20.193.26:0/418239710 >> v1:10.20.193.70:6789/0 conn(0x7f253c0b27b0 legacy=0x7f253c159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.346 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.336+0000 7f2540cfb640 1 -- 10.20.193.26:0/418239710 shutdown_connections 2026-02-24T19:24:32.346 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.336+0000 7f2540cfb640 1 -- 10.20.193.26:0/418239710 >> 10.20.193.26:0/418239710 conn(0x7f253c0b7120 msgr2=0x7f253c0b7520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:32.346 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.336+0000 7f2540cfb640 1 -- 10.20.193.26:0/418239710 shutdown_connections 2026-02-24T19:24:32.346 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.336+0000 7f2540cfb640 1 -- 10.20.193.26:0/418239710 wait complete. 2026-02-24T19:24:32.346 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.337+0000 7f2540cfb640 10 monclient: build_initial_monmap 2026-02-24T19:24:32.346 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.337+0000 7f2540cfb640 10 monclient: monmap: 2026-02-24T19:24:32.346 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:32.346 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:32.346 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:32.347 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:32.347 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:32.347 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:32.347 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:32.347 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:32.347 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:32.347 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.347 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.337+0000 7f2540cfb640 1 librados: starting msgr at 2026-02-24T19:24:32.347 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.337+0000 7f2540cfb640 1 librados: starting objecter 2026-02-24T19:24:32.347 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.337+0000 7f2540cfb640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:32.347 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.337+0000 7f2540cfb640 1 Processor -- start 2026-02-24T19:24:32.347 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.337+0000 7f2540cfb640 1 -- start start 2026-02-24T19:24:32.347 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.337+0000 7f2540cfb640 1 librados: setting wanted keys 2026-02-24T19:24:32.348 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.337+0000 7f2540cfb640 1 librados: calling monclient init 2026-02-24T19:24:32.348 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.337+0000 7f2540cfb640 10 monclient: init 2026-02-24T19:24:32.348 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.337+0000 7f2540cfb640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:32.348 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.337+0000 7f2540cfb640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:32.348 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.337+0000 7f2540cfb640 10 monclient(hunting): picked mon.noname-c con 0x7f253c059b90 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:32.348 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.337+0000 7f2540cfb640 10 monclient(hunting): picked mon.noname-b con 0x7f253c0b27b0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:32.348 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.337+0000 7f2540cfb640 10 monclient(hunting): picked mon.noname-a con 0x7f253c159b60 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:32.348 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.337+0000 7f2540cfb640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f253c0b4cf0 con 0x7f253c159b60 2026-02-24T19:24:32.348 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.337+0000 7f2540cfb640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f253c0b4fd0 con 0x7f253c0b27b0 2026-02-24T19:24:32.348 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.337+0000 7f2540cfb640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f253c0b52b0 con 0x7f253c059b90 2026-02-24T19:24:32.348 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.337+0000 7f2540cfb640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:32.348 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.337+0000 7f2540cfb640 10 monclient(hunting): authenticate will time out at 4055.019943s 2026-02-24T19:24:32.348 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.338+0000 7f253ad76640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f253c159b60 0x7f253c1fe230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59072/0 (socket says 10.20.193.26:59072) 2026-02-24T19:24:32.349 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.338+0000 7f253ad76640 1 -- 10.20.193.26:0/3318065030 learned_addr learned my addr 10.20.193.26:0/3318065030 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:32.349 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.338+0000 7f2522ffd640 10 client.?.objecter ms_handle_connect 0x7f253c159b60 2026-02-24T19:24:32.349 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.338+0000 7f2522ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:32.349 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.338+0000 7f2522ffd640 10 client.?.objecter ms_handle_connect 0x7f253c059b90 2026-02-24T19:24:32.349 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.338+0000 7f2522ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:32.349 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.338+0000 7f2522ffd640 10 client.?.objecter ms_handle_connect 0x7f253c0b27b0 2026-02-24T19:24:32.349 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.338+0000 7f2522ffd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:32.352 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.339+0000 7f2522ffd640 1 -- 10.20.193.26:0/3318065030 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3606407821 0 0) 0x7f253c0b4cf0 con 0x7f253c159b60 2026-02-24T19:24:32.353 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.339+0000 7f2522ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:32.353 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.339+0000 7f2522ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:32.353 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.339+0000 7f2522ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:32.353 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.339+0000 7f2522ffd640 10 monclient(hunting): my global_id is 30789 2026-02-24T19:24:32.353 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.339+0000 7f2522ffd640 1 -- 10.20.193.26:0/3318065030 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2508003610 con 0x7f253c159b60 2026-02-24T19:24:32.353 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.339+0000 7f2522ffd640 1 -- 10.20.193.26:0/3318065030 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4132008447 0 0) 0x7f253c0b52b0 con 0x7f253c059b90 2026-02-24T19:24:32.353 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.339+0000 7f2522ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:32.353 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.339+0000 7f2522ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:32.353 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.339+0000 7f2522ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:32.353 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.339+0000 7f2522ffd640 10 monclient(hunting): my global_id is 30128 2026-02-24T19:24:32.353 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.339+0000 7f2522ffd640 1 -- 10.20.193.26:0/3318065030 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f253c0b4cf0 con 0x7f253c059b90 2026-02-24T19:24:32.353 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.339+0000 7f2522ffd640 1 -- 10.20.193.26:0/3318065030 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3652335888 0 0) 0x7f253c0b4fd0 con 0x7f253c0b27b0 2026-02-24T19:24:32.354 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.339+0000 7f2522ffd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:32.354 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.339+0000 7f2522ffd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:32.354 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.339+0000 7f2522ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:32.354 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.339+0000 7f2522ffd640 10 monclient(hunting): my global_id is 28204 2026-02-24T19:24:32.354 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.339+0000 7f2522ffd640 1 -- 10.20.193.26:0/3318065030 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f253c0b52b0 con 0x7f253c0b27b0 2026-02-24T19:24:32.354 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.342+0000 7f2522ffd640 1 -- 10.20.193.26:0/3318065030 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1787567526 0 0) 0x7f2508003610 con 0x7f253c159b60 2026-02-24T19:24:32.354 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.342+0000 7f2522ffd640 1 -- 10.20.193.26:0/3318065030 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f253c0b4fd0 con 0x7f253c159b60 2026-02-24T19:24:32.354 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.342+0000 7f2522ffd640 1 -- 10.20.193.26:0/3318065030 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f252c0032f0 con 0x7f253c159b60 2026-02-24T19:24:32.354 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.342+0000 7f2522ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:32.354 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.342+0000 7f2522ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:32.354 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.342+0000 7f2522ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:32.354 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:32.354 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.355 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.355 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.355 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:32.355 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.355 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:32.355 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:32.355 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:32.355 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.355 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.342+0000 7f2522ffd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:32.355 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.342+0000 7f2522ffd640 1 -- 10.20.193.26:0/3318065030 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 266060996 0 0) 0x7f253c0b52b0 con 0x7f253c0b27b0 2026-02-24T19:24:32.355 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.342+0000 7f2522ffd640 1 -- 10.20.193.26:0/3318065030 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2508003610 con 0x7f253c0b27b0 2026-02-24T19:24:32.355 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.342+0000 7f2522ffd640 1 -- 10.20.193.26:0/3318065030 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2524003310 con 0x7f253c0b27b0 2026-02-24T19:24:32.356 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.342+0000 7f2522ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:32.356 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.342+0000 7f2522ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:32.356 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.342+0000 7f2522ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:32.356 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:32.356 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.356 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.356 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.356 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:32.356 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.356 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:32.356 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:32.356 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:32.356 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.357 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.342+0000 7f2522ffd640 1 -- 10.20.193.26:0/3318065030 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1309844938 0 0) 0x7f253c0b4cf0 con 0x7f253c059b90 2026-02-24T19:24:32.357 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.342+0000 7f2522ffd640 1 -- 10.20.193.26:0/3318065030 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f253c0b52b0 con 0x7f253c059b90 2026-02-24T19:24:32.357 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.342+0000 7f2522ffd640 1 -- 10.20.193.26:0/3318065030 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2530002fd0 con 0x7f253c059b90 2026-02-24T19:24:32.357 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.342+0000 7f2522ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:32.357 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.342+0000 7f2522ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:32.357 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.342+0000 7f2522ffd640 10 monclient(hunting): dump: 2026-02-24T19:24:32.357 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:32.357 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.357 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.357 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.357 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:32.357 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.357 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:32.358 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:32.358 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:32.358 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.358 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.343+0000 7f2522ffd640 1 -- 10.20.193.26:0/3318065030 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2702535639 0 0) 0x7f2508003610 con 0x7f253c0b27b0 2026-02-24T19:24:32.358 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.343+0000 7f2522ffd640 1 -- 10.20.193.26:0/3318065030 >> v1:10.20.193.103:6789/0 conn(0x7f253c059b90 legacy=0x7f253c0b6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.358 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.343+0000 7f2522ffd640 1 -- 10.20.193.26:0/3318065030 >> v1:10.20.193.26:6789/0 conn(0x7f253c159b60 legacy=0x7f253c1fe230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.358 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.343+0000 7f2522ffd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:32.358 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.343+0000 7f2522ffd640 1 monclient: found mon.b 2026-02-24T19:24:32.358 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.343+0000 7f2522ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:32.358 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.343+0000 7f2522ffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:32.358 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.343+0000 7f2522ffd640 1 -- 10.20.193.26:0/3318065030 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253c0b5590 con 0x7f253c0b27b0 2026-02-24T19:24:32.358 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.343+0000 7f2522ffd640 10 monclient: _finish_auth 0 2026-02-24T19:24:32.358 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.343+0000 7f2522ffd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:32.359 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.343+0000 7f2522ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:32.359 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.343+0000 7f2540cfb640 5 monclient: authenticate success, global_id 28204 2026-02-24T19:24:32.359 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.343+0000 7f2540cfb640 10 monclient: _renew_subs 2026-02-24T19:24:32.359 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.343+0000 7f2540cfb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:32.359 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.343+0000 7f2540cfb640 1 -- 10.20.193.26:0/3318065030 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f253c0b5870 con 0x7f253c0b27b0 2026-02-24T19:24:32.359 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.343+0000 7f2540cfb640 10 client.28204.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:32.359 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.343+0000 7f2540cfb640 10 monclient: _renew_subs 2026-02-24T19:24:32.359 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.343+0000 7f2540cfb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:32.359 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.343+0000 7f2540cfb640 1 -- 10.20.193.26:0/3318065030 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f253c162a80 con 0x7f253c0b27b0 2026-02-24T19:24:32.359 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.343+0000 7f2540cfb640 1 librados: init done 2026-02-24T19:24:32.359 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.344+0000 7f2540cfb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:32.359 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.344+0000 7f2540cfb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:32.360 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.344+0000 7f2540cfb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:32.360 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.344+0000 7f2540cfb640 1 -- 10.20.193.26:0/3318065030 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f253c14f510 con 0x7f253c0b27b0 2026-02-24T19:24:32.438 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.436+0000 7f2522ffd640 1 -- 10.20.193.26:0/3318065030 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2524002f70 con 0x7f253c0b27b0 2026-02-24T19:24:32.438 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.436+0000 7f2522ffd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:32.438 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.436+0000 7f2522ffd640 1 -- 10.20.193.26:0/3318065030 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f2524003b00 con 0x7f253c0b27b0 2026-02-24T19:24:32.438 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.436+0000 7f2522ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:32.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.436+0000 7f2522ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:32.439 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.436+0000 7f2522ffd640 10 monclient: dump: 2026-02-24T19:24:32.439 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:32.439 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.439 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.439 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.439 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:32.439 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.439 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:32.439 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:32.439 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:32.439 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.440 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.436+0000 7f2538d72640 4 set_mon_vals no callback set 2026-02-24T19:24:32.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.437+0000 7f2522ffd640 1 -- 10.20.193.26:0/3318065030 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f252401c970 con 0x7f253c0b27b0 2026-02-24T19:24:32.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.438+0000 7f253a575640 10 monclient: get_auth_request con 0x7f2508077ef0 auth_method 0 2026-02-24T19:24:32.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.438+0000 7f2522ffd640 10 client.28204.objecter ms_handle_connect 0x7f2508077ef0 2026-02-24T19:24:32.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.439+0000 7f2522ffd640 1 -- 10.20.193.26:0/3318065030 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7f2524091eb0 con 0x7f253c0b27b0 2026-02-24T19:24:32.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.439+0000 7f2522ffd640 10 client.28204.objecter ms_dispatch2 0x7f253c000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:32.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.439+0000 7f2522ffd640 3 client.28204.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:32.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.439+0000 7f2522ffd640 3 client.28204.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:32.441 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.439+0000 7f2522ffd640 20 client.28204.objecter dump_active .. 0 homeless 2026-02-24T19:24:32.442 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.440+0000 7f2522ffd640 1 -- 10.20.193.26:0/3318065030 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f252405c8e0 con 0x7f253c0b27b0 2026-02-24T19:24:32.442 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.440+0000 7f2522ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:32.442 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.440+0000 7f2522ffd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:32.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.545+0000 7f2540cfb640 1 -- 10.20.193.26:0/3318065030 --> v1:10.20.193.162:6800/3889602630 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f253c0b1160 con 0x7f2508077ef0 2026-02-24T19:24:32.547 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.545+0000 7f2522ffd640 1 -- 10.20.193.26:0/3318065030 <== mgr.4107 v1:10.20.193.162:6800/3889602630 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (unknown 1239724482 0 0) 0x7f253c0b1160 con 0x7f2508077ef0 2026-02-24T19:24:32.547 INFO:teuthology.orchestra.run.trial026.stderr:instructed osd(s) 7 to deep-scrub 2026-02-24T19:24:32.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.547+0000 7f2540cfb640 10 librados: watch_flush enter 2026-02-24T19:24:32.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.547+0000 7f2540cfb640 10 librados: watch_flush exit 2026-02-24T19:24:32.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.547+0000 7f2540cfb640 20 client.28204.objecter shutdown clearing up homeless session... 2026-02-24T19:24:32.549 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.547+0000 7f2540cfb640 10 client.28204.objecter successfully canceled tick 2026-02-24T19:24:32.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.547+0000 7f2540cfb640 1 -- 10.20.193.26:0/3318065030 >> v1:10.20.193.162:6800/3889602630 conn(0x7f2508077ef0 legacy=0x7f25080983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.547+0000 7f2540cfb640 10 monclient: shutdown 2026-02-24T19:24:32.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.547+0000 7f2540cfb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:32.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.547+0000 7f2540cfb640 1 -- 10.20.193.26:0/3318065030 >> v1:10.20.193.70:6789/0 conn(0x7f253c0b27b0 legacy=0x7f253c14e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.547+0000 7f2540cfb640 1 -- 10.20.193.26:0/3318065030 shutdown_connections 2026-02-24T19:24:32.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.547+0000 7f2540cfb640 1 -- 10.20.193.26:0/3318065030 >> 10.20.193.26:0/3318065030 conn(0x7f253c0b7120 msgr2=0x7f253c0b74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:32.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.547+0000 7f2540cfb640 1 -- 10.20.193.26:0/3318065030 shutdown_connections 2026-02-24T19:24:32.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.547+0000 7f2540cfb640 1 -- 10.20.193.26:0/3318065030 wait complete. 2026-02-24T19:24:32.550 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.547+0000 7f2540cfb640 1 librados: shutdown 2026-02-24T19:24:32.557 INFO:tasks.ceph:Scrubbing osd.11 2026-02-24T19:24:32.557 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:32.628 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.626+0000 7fc815f1b640 10 monclient: get_monmap_and_config 2026-02-24T19:24:32.628 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.626+0000 7fc815f1b640 10 monclient: build_initial_monmap 2026-02-24T19:24:32.628 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.626+0000 7fc815f1b640 10 monclient: monmap: 2026-02-24T19:24:32.628 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:32.629 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.629 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:32.627627+0000 2026-02-24T19:24:32.629 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:32.627627+0000 2026-02-24T19:24:32.629 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:32.629 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.629 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:32.629 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:32.629 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:32.629 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.632 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.627+0000 7fc815f1b640 1 Processor -- start 2026-02-24T19:24:32.632 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.627+0000 7fc815f1b640 1 -- start start 2026-02-24T19:24:32.632 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.627+0000 7fc815f1b640 10 monclient: init 2026-02-24T19:24:32.632 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.627+0000 7fc815f1b640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:32.632 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.627+0000 7fc815f1b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:24:32.632 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.627+0000 7fc815f1b640 10 monclient(hunting): picked mon.noname-b con 0x7fc810159e10 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:32.632 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.627+0000 7fc815f1b640 10 monclient(hunting): picked mon.noname-c con 0x7fc81015a1e0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:32.633 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.627+0000 7fc815f1b640 10 monclient(hunting): picked mon.noname-a con 0x7fc810161ac0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:32.633 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.627+0000 7fc815f1b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc810055ab0 con 0x7fc810161ac0 2026-02-24T19:24:32.633 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.627+0000 7fc815f1b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc810055d50 con 0x7fc810159e10 2026-02-24T19:24:32.633 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.627+0000 7fc815f1b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc810056030 con 0x7fc81015a1e0 2026-02-24T19:24:32.633 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.627+0000 7fc815f1b640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:32.633 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.627+0000 7fc815f1b640 10 monclient(hunting): authenticate will time out at 4055.309934s 2026-02-24T19:24:32.633 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.628+0000 7fc80ffff640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fc810161ac0 0x7fc81015fd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59088/0 (socket says 10.20.193.26:59088) 2026-02-24T19:24:32.633 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.628+0000 7fc80ffff640 1 -- 10.20.193.26:0/1393867887 learned_addr learned my addr 10.20.193.26:0/1393867887 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:32.633 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.629+0000 7fc80e7fc640 1 -- 10.20.193.26:0/1393867887 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3288336582 0 0) 0x7fc810055ab0 con 0x7fc810161ac0 2026-02-24T19:24:32.633 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.629+0000 7fc80e7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:32.633 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.629+0000 7fc80e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:32.633 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.629+0000 7fc80e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:32.634 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.629+0000 7fc80e7fc640 10 monclient(hunting): my global_id is 30792 2026-02-24T19:24:32.634 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.629+0000 7fc80e7fc640 1 -- 10.20.193.26:0/1393867887 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7f4003610 con 0x7fc810161ac0 2026-02-24T19:24:32.634 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.629+0000 7fc80e7fc640 1 -- 10.20.193.26:0/1393867887 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1469173999 0 0) 0x7fc810056030 con 0x7fc81015a1e0 2026-02-24T19:24:32.634 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.629+0000 7fc80e7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:32.634 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.629+0000 7fc80e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:32.634 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.629+0000 7fc80e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:32.634 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.629+0000 7fc80e7fc640 10 monclient(hunting): my global_id is 30131 2026-02-24T19:24:32.634 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.629+0000 7fc80e7fc640 1 -- 10.20.193.26:0/1393867887 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc810055ab0 con 0x7fc81015a1e0 2026-02-24T19:24:32.634 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.629+0000 7fc80e7fc640 1 -- 10.20.193.26:0/1393867887 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3751604248 0 0) 0x7fc810055d50 con 0x7fc810159e10 2026-02-24T19:24:32.634 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.629+0000 7fc80e7fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:32.634 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.629+0000 7fc80e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:32.635 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.629+0000 7fc80e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:32.635 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.629+0000 7fc80e7fc640 10 monclient(hunting): my global_id is 28207 2026-02-24T19:24:32.635 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.629+0000 7fc80e7fc640 1 -- 10.20.193.26:0/1393867887 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc810056030 con 0x7fc810159e10 2026-02-24T19:24:32.642 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.631+0000 7fc80e7fc640 1 -- 10.20.193.26:0/1393867887 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 549256650 0 0) 0x7fc7f4003610 con 0x7fc810161ac0 2026-02-24T19:24:32.642 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.631+0000 7fc80e7fc640 1 -- 10.20.193.26:0/1393867887 >> v1:10.20.193.103:6789/0 conn(0x7fc81015a1e0 legacy=0x7fc8101613b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.642 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.631+0000 7fc80e7fc640 1 -- 10.20.193.26:0/1393867887 >> v1:10.20.193.70:6789/0 conn(0x7fc810159e10 legacy=0x7fc810059c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.642 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.631+0000 7fc80e7fc640 10 monclient: _finish_hunting 0 2026-02-24T19:24:32.642 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.631+0000 7fc80e7fc640 1 monclient: found mon.noname-a 2026-02-24T19:24:32.642 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.631+0000 7fc80e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:32.642 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.631+0000 7fc80e7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:24:32.642 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.631+0000 7fc80e7fc640 1 -- 10.20.193.26:0/1393867887 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc810056310 con 0x7fc810161ac0 2026-02-24T19:24:32.642 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.631+0000 7fc80e7fc640 10 monclient: _finish_auth 0 2026-02-24T19:24:32.643 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.631+0000 7fc80e7fc640 10 monclient: _check_auth_tickets 2026-02-24T19:24:32.643 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.631+0000 7fc80e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:32.643 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.631+0000 7fc80e7fc640 1 -- 10.20.193.26:0/1393867887 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc804003170 con 0x7fc810161ac0 2026-02-24T19:24:32.643 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.631+0000 7fc80e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:32.643 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.631+0000 7fc80e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:32.643 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.631+0000 7fc80e7fc640 10 monclient: dump: 2026-02-24T19:24:32.643 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:32.643 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.643 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.643 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.643 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:32.643 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.643 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:32.644 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:32.644 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:32.644 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.644 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.631+0000 7fc815f1b640 5 monclient: authenticate success, global_id 30792 2026-02-24T19:24:32.644 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.631+0000 7fc815f1b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:32.644 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.632+0000 7fc80e7fc640 1 -- 10.20.193.26:0/1393867887 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc804003340 con 0x7fc810161ac0 2026-02-24T19:24:32.644 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.632+0000 7fc80e7fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:32.644 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.632+0000 7fc80e7fc640 1 -- 10.20.193.26:0/1393867887 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc804003780 con 0x7fc810161ac0 2026-02-24T19:24:32.644 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.632+0000 7fc80e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:32.644 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.632+0000 7fc80e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:32.644 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.632+0000 7fc80e7fc640 10 monclient: dump: 2026-02-24T19:24:32.644 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:32.645 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.645 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.645 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.645 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:32.645 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.645 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:32.645 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:32.645 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:32.645 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.645 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.632+0000 7fc815f1b640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:32.645 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.632+0000 7fc815f1b640 4 set_mon_vals no callback set 2026-02-24T19:24:32.645 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.632+0000 7fc815f1b640 10 monclient: shutdown 2026-02-24T19:24:32.645 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.632+0000 7fc815f1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:32.646 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.632+0000 7fc815f1b640 1 -- 10.20.193.26:0/1393867887 >> v1:10.20.193.26:6789/0 conn(0x7fc810161ac0 legacy=0x7fc81015fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.646 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.632+0000 7fc815f1b640 1 -- 10.20.193.26:0/1393867887 shutdown_connections 2026-02-24T19:24:32.646 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.632+0000 7fc815f1b640 1 -- 10.20.193.26:0/1393867887 >> 10.20.193.26:0/1393867887 conn(0x7fc8100b2f60 msgr2=0x7fc8100b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:32.646 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.632+0000 7fc815f1b640 1 -- 10.20.193.26:0/1393867887 shutdown_connections 2026-02-24T19:24:32.646 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.632+0000 7fc815f1b640 1 -- 10.20.193.26:0/1393867887 wait complete. 2026-02-24T19:24:32.646 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.632+0000 7fc815f1b640 10 monclient: build_initial_monmap 2026-02-24T19:24:32.646 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.632+0000 7fc815f1b640 10 monclient: monmap: 2026-02-24T19:24:32.646 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:32.646 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:32.646 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:32.647 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:32.647 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:32.647 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:32.647 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:32.647 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:32.647 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:32.647 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.647 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.633+0000 7fc815f1b640 1 librados: starting msgr at 2026-02-24T19:24:32.647 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.633+0000 7fc815f1b640 1 librados: starting objecter 2026-02-24T19:24:32.647 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.633+0000 7fc815f1b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:32.647 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.633+0000 7fc815f1b640 1 Processor -- start 2026-02-24T19:24:32.647 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.633+0000 7fc815f1b640 1 -- start start 2026-02-24T19:24:32.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.633+0000 7fc815f1b640 1 librados: setting wanted keys 2026-02-24T19:24:32.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.633+0000 7fc815f1b640 1 librados: calling monclient init 2026-02-24T19:24:32.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.633+0000 7fc815f1b640 10 monclient: init 2026-02-24T19:24:32.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.633+0000 7fc815f1b640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:32.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.633+0000 7fc815f1b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-24T19:24:32.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.633+0000 7fc815f1b640 10 monclient(hunting): picked mon.noname-c con 0x7fc810159e10 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:32.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.633+0000 7fc815f1b640 10 monclient(hunting): picked mon.noname-b con 0x7fc81015a1e0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:32.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.633+0000 7fc815f1b640 10 monclient(hunting): picked mon.noname-a con 0x7fc810161ac0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:32.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.633+0000 7fc815f1b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc810163ee0 con 0x7fc810161ac0 2026-02-24T19:24:32.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.633+0000 7fc815f1b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8100af340 con 0x7fc81015a1e0 2026-02-24T19:24:32.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.633+0000 7fc815f1b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8100af620 con 0x7fc810159e10 2026-02-24T19:24:32.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.633+0000 7fc815f1b640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:32.648 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.633+0000 7fc815f1b640 10 monclient(hunting): authenticate will time out at 4055.315680s 2026-02-24T19:24:32.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.633+0000 7fc80ffff640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7fc810161ac0 0x7fc810158330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59092/0 (socket says 10.20.193.26:59092) 2026-02-24T19:24:32.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.633+0000 7fc80ffff640 1 -- 10.20.193.26:0/1212701010 learned_addr learned my addr 10.20.193.26:0/1212701010 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:32.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.634+0000 7fc7ebfff640 10 client.?.objecter ms_handle_connect 0x7fc810161ac0 2026-02-24T19:24:32.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.634+0000 7fc7ebfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:32.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.634+0000 7fc7ebfff640 10 client.?.objecter ms_handle_connect 0x7fc81015a1e0 2026-02-24T19:24:32.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.634+0000 7fc7ebfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:32.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.634+0000 7fc7ebfff640 10 client.?.objecter ms_handle_connect 0x7fc810159e10 2026-02-24T19:24:32.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.634+0000 7fc7ebfff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:32.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.635+0000 7fc7ebfff640 1 -- 10.20.193.26:0/1212701010 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3639299012 0 0) 0x7fc810163ee0 con 0x7fc810161ac0 2026-02-24T19:24:32.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.635+0000 7fc7ebfff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:32.649 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.635+0000 7fc7ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:32.650 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.635+0000 7fc7ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:32.650 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.635+0000 7fc7ebfff640 10 monclient(hunting): my global_id is 30795 2026-02-24T19:24:32.650 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.635+0000 7fc7ebfff640 1 -- 10.20.193.26:0/1212701010 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7e0003610 con 0x7fc810161ac0 2026-02-24T19:24:32.650 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.635+0000 7fc7ebfff640 1 -- 10.20.193.26:0/1212701010 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 952068749 0 0) 0x7fc8100af340 con 0x7fc81015a1e0 2026-02-24T19:24:32.650 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.635+0000 7fc7ebfff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:32.650 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.635+0000 7fc7ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:32.650 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.635+0000 7fc7ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:32.650 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.635+0000 7fc7ebfff640 10 monclient(hunting): my global_id is 28210 2026-02-24T19:24:32.650 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.635+0000 7fc7ebfff640 1 -- 10.20.193.26:0/1212701010 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc810163ee0 con 0x7fc81015a1e0 2026-02-24T19:24:32.650 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.635+0000 7fc7ebfff640 1 -- 10.20.193.26:0/1212701010 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 467835353 0 0) 0x7fc8100af620 con 0x7fc810159e10 2026-02-24T19:24:32.650 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.635+0000 7fc7ebfff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:32.650 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.635+0000 7fc7ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:32.651 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.635+0000 7fc7ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:32.651 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.635+0000 7fc7ebfff640 10 monclient(hunting): my global_id is 30134 2026-02-24T19:24:32.651 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.635+0000 7fc7ebfff640 1 -- 10.20.193.26:0/1212701010 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8100af340 con 0x7fc810159e10 2026-02-24T19:24:32.651 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.637+0000 7fc7ebfff640 1 -- 10.20.193.26:0/1212701010 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2689966787 0 0) 0x7fc8100af340 con 0x7fc810159e10 2026-02-24T19:24:32.651 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.637+0000 7fc7ebfff640 1 -- 10.20.193.26:0/1212701010 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc8100af620 con 0x7fc810159e10 2026-02-24T19:24:32.651 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.637+0000 7fc7ebfff640 1 -- 10.20.193.26:0/1212701010 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc7fc003060 con 0x7fc810159e10 2026-02-24T19:24:32.651 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.637+0000 7fc7ebfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:32.651 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.637+0000 7fc7ebfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:32.651 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.637+0000 7fc7ebfff640 10 monclient(hunting): dump: 2026-02-24T19:24:32.651 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:32.651 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.651 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.652 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.652 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:32.652 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.652 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:32.652 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:32.652 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:32.652 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.652 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.637+0000 7fc7ebfff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:32.652 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.637+0000 7fc7ebfff640 1 -- 10.20.193.26:0/1212701010 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3976881607 0 0) 0x7fc810163ee0 con 0x7fc81015a1e0 2026-02-24T19:24:32.652 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.637+0000 7fc7ebfff640 1 -- 10.20.193.26:0/1212701010 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc8100af340 con 0x7fc81015a1e0 2026-02-24T19:24:32.652 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.637+0000 7fc7ebfff640 1 -- 10.20.193.26:0/1212701010 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc800003070 con 0x7fc81015a1e0 2026-02-24T19:24:32.652 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.637+0000 7fc7ebfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:32.652 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.637+0000 7fc7ebfff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:32.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.637+0000 7fc7ebfff640 10 monclient(hunting): dump: 2026-02-24T19:24:32.653 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:32.653 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.653 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.653 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.653 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:32.653 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.653 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:32.653 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:32.653 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:32.653 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.653 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.637+0000 7fc7ebfff640 1 -- 10.20.193.26:0/1212701010 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3764585513 0 0) 0x7fc7e0003610 con 0x7fc810161ac0 2026-02-24T19:24:32.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.637+0000 7fc7ebfff640 1 -- 10.20.193.26:0/1212701010 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc810163ee0 con 0x7fc810161ac0 2026-02-24T19:24:32.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.637+0000 7fc7ebfff640 1 -- 10.20.193.26:0/1212701010 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc804003690 con 0x7fc810161ac0 2026-02-24T19:24:32.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.637+0000 7fc7ebfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:32.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.637+0000 7fc7ebfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:32.654 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.637+0000 7fc7ebfff640 10 monclient(hunting): dump: 2026-02-24T19:24:32.654 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:32.654 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.654 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.654 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.654 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:32.654 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.654 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:32.654 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:32.655 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:32.655 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.639+0000 7fc7ebfff640 1 -- 10.20.193.26:0/1212701010 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 110933046 0 0) 0x7fc8100af620 con 0x7fc810159e10 2026-02-24T19:24:32.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.639+0000 7fc7ebfff640 1 -- 10.20.193.26:0/1212701010 >> v1:10.20.193.70:6789/0 conn(0x7fc81015a1e0 legacy=0x7fc8100a7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.639+0000 7fc7ebfff640 1 -- 10.20.193.26:0/1212701010 >> v1:10.20.193.26:6789/0 conn(0x7fc810161ac0 legacy=0x7fc810158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.639+0000 7fc7ebfff640 10 monclient: _finish_hunting 0 2026-02-24T19:24:32.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.639+0000 7fc7ebfff640 1 monclient: found mon.c 2026-02-24T19:24:32.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.639+0000 7fc7ebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:32.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.639+0000 7fc7ebfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:32.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.639+0000 7fc7ebfff640 1 -- 10.20.193.26:0/1212701010 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8100af900 con 0x7fc810159e10 2026-02-24T19:24:32.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.639+0000 7fc7ebfff640 10 monclient: _finish_auth 0 2026-02-24T19:24:32.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.639+0000 7fc7ebfff640 10 monclient: _check_auth_tickets 2026-02-24T19:24:32.655 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.639+0000 7fc7ebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:32.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.639+0000 7fc815f1b640 5 monclient: authenticate success, global_id 30134 2026-02-24T19:24:32.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.639+0000 7fc815f1b640 10 monclient: _renew_subs 2026-02-24T19:24:32.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.639+0000 7fc815f1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:32.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.639+0000 7fc815f1b640 1 -- 10.20.193.26:0/1212701010 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc8100afbe0 con 0x7fc810159e10 2026-02-24T19:24:32.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.639+0000 7fc815f1b640 10 client.30134.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:32.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.639+0000 7fc815f1b640 10 monclient: _renew_subs 2026-02-24T19:24:32.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.639+0000 7fc815f1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:32.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.639+0000 7fc815f1b640 1 -- 10.20.193.26:0/1212701010 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc8100b01a0 con 0x7fc810159e10 2026-02-24T19:24:32.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.639+0000 7fc815f1b640 1 librados: init done 2026-02-24T19:24:32.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.639+0000 7fc815f1b640 10 client.30134.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:32.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.639+0000 7fc815f1b640 15 client.30134.objecter _session_command_op_assign -1 1 2026-02-24T19:24:32.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.639+0000 7fc815f1b640 20 client.30134.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:32.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.639+0000 7fc815f1b640 10 client.30134.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:32.656 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.639+0000 7fc815f1b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:32.657 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.639+0000 7fc815f1b640 1 -- 10.20.193.26:0/1212701010 --> v1:10.20.193.103:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fc810138e30 con 0x7fc810159e10 2026-02-24T19:24:32.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.647+0000 7fc7ebfff640 1 -- 10.20.193.26:0/1212701010 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc810138e30 con 0x7fc810159e10 2026-02-24T19:24:32.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.647+0000 7fc7ebfff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:32.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.647+0000 7fc7ebfff640 1 -- 10.20.193.26:0/1212701010 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7fc7fc0038a0 con 0x7fc810159e10 2026-02-24T19:24:32.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.647+0000 7fc7ebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:32.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.647+0000 7fc7ebfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:32.659 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.647+0000 7fc7ebfff640 10 monclient: dump: 2026-02-24T19:24:32.659 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:32.659 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.659 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.659 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.660 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:32.660 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.660 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:32.660 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:32.660 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:32.660 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.647+0000 7fc80dffb640 4 set_mon_vals no callback set 2026-02-24T19:24:32.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.648+0000 7fc7ebfff640 1 -- 10.20.193.26:0/1212701010 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7fc7fc01c710 con 0x7fc810159e10 2026-02-24T19:24:32.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.648+0000 7fc80effd640 10 monclient: get_auth_request con 0x7fc7e0077e90 auth_method 0 2026-02-24T19:24:32.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.648+0000 7fc7ebfff640 10 client.30134.objecter ms_handle_connect 0x7fc7e0077e90 2026-02-24T19:24:32.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.649+0000 7fc7ebfff640 1 -- 10.20.193.26:0/1212701010 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7fc7fc091e00 con 0x7fc810159e10 2026-02-24T19:24:32.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.649+0000 7fc7ebfff640 10 client.30134.objecter ms_dispatch2 0x7fc810000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:32.660 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.649+0000 7fc7ebfff640 3 client.30134.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:32.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.649+0000 7fc7ebfff640 3 client.30134.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:32.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.649+0000 7fc7ebfff640 10 client.30134.objecter checking command 1 2026-02-24T19:24:32.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.649+0000 7fc7ebfff640 20 client.30134.objecter _get_session s=0x7fc7e00a21f0 osd=11 3 2026-02-24T19:24:32.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.649+0000 7fc7ebfff640 20 client.30134.objecter put_session s=0x7fc7e00a21f0 osd=11 3 2026-02-24T19:24:32.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.649+0000 7fc7ebfff640 15 client.30134.objecter _session_command_op_remove -1 1 2026-02-24T19:24:32.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.649+0000 7fc7ebfff640 20 client.30134.objecter _get_session s=0x7fc7e00a21f0 osd=11 3 2026-02-24T19:24:32.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.649+0000 7fc7ebfff640 20 client.30134.objecter get_session s=0x7fc7e00a21f0 osd=11 3 2026-02-24T19:24:32.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.649+0000 7fc7ebfff640 15 client.30134.objecter _session_command_op_assign 11 1 2026-02-24T19:24:32.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.649+0000 7fc7ebfff640 20 client.30134.objecter put_session s=0x7fc7e00a21f0 osd=11 4 2026-02-24T19:24:32.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.649+0000 7fc7ebfff640 10 client.30134.objecter _send_command 1 2026-02-24T19:24:32.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.649+0000 7fc7ebfff640 1 -- 10.20.193.26:0/1212701010 --> v1:10.20.193.162:6813/1717662802 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc7e00c4500 con 0x7fc7e00a28a0 2026-02-24T19:24:32.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.649+0000 7fc7ebfff640 20 client.30134.objecter dump_active .. 0 homeless 2026-02-24T19:24:32.661 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.649+0000 7fc7ebfff640 1 -- 10.20.193.26:0/1212701010 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_get_version_reply(handle=1 version=346) ==== 24+0+0 (unknown 2991753921 0 0) 0x7fc7fc0584a0 con 0x7fc810159e10 2026-02-24T19:24:32.662 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.649+0000 7fc7ebfff640 10 monclient: handle_get_version_reply finishing 1 version 346 2026-02-24T19:24:32.662 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.649+0000 7fc80ffff640 10 monclient: get_auth_request con 0x7fc7e00a28a0 auth_method 0 2026-02-24T19:24:32.662 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.650+0000 7fc7ebfff640 10 client.30134.objecter ms_handle_connect 0x7fc7e00a28a0 2026-02-24T19:24:32.663 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.661+0000 7fc7ebfff640 1 -- 10.20.193.26:0/1212701010 <== osd.11 v1:10.20.193.162:6813/1717662802 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fc7e00c4500 con 0x7fc7e00a28a0 2026-02-24T19:24:32.663 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.661+0000 7fc7ebfff640 10 client.30134.objecter ms_dispatch2 0x7fc810000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:32.663 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.661+0000 7fc7ebfff640 10 client.30134.objecter _finish_command 1 = system:0 2026-02-24T19:24:32.663 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.661+0000 7fc7ebfff640 20 client.30134.objecter put_session s=0x7fc7e00a21f0 osd=11 4 2026-02-24T19:24:32.663 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.661+0000 7fc7ebfff640 15 client.30134.objecter _session_command_op_remove 11 1 2026-02-24T19:24:32.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.667+0000 7fc815f1b640 10 client.30134.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:32.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.667+0000 7fc815f1b640 15 client.30134.objecter _session_command_op_assign -1 2 2026-02-24T19:24:32.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.667+0000 7fc815f1b640 20 client.30134.objecter _get_session s=0x7fc7e00a21f0 osd=11 3 2026-02-24T19:24:32.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.667+0000 7fc815f1b640 20 client.30134.objecter put_session s=0x7fc7e00a21f0 osd=11 3 2026-02-24T19:24:32.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.667+0000 7fc815f1b640 20 client.30134.objecter _get_session s=0x7fc7e00a21f0 osd=11 3 2026-02-24T19:24:32.669 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.667+0000 7fc815f1b640 15 client.30134.objecter _session_command_op_remove -1 2 2026-02-24T19:24:32.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.667+0000 7fc815f1b640 20 client.30134.objecter get_session s=0x7fc7e00a21f0 osd=11 3 2026-02-24T19:24:32.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.667+0000 7fc815f1b640 15 client.30134.objecter _session_command_op_assign 11 2 2026-02-24T19:24:32.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.667+0000 7fc815f1b640 20 client.30134.objecter put_session s=0x7fc7e00a21f0 osd=11 4 2026-02-24T19:24:32.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.667+0000 7fc815f1b640 10 client.30134.objecter _send_command 2 2026-02-24T19:24:32.670 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.667+0000 7fc815f1b640 1 -- 10.20.193.26:0/1212701010 --> v1:10.20.193.162:6813/1717662802 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc810056c80 con 0x7fc7e00a28a0 2026-02-24T19:24:32.678 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.677+0000 7fc7ebfff640 1 -- 10.20.193.26:0/1212701010 <== osd.11 v1:10.20.193.162:6813/1717662802 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fc810056c80 con 0x7fc7e00a28a0 2026-02-24T19:24:32.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.677+0000 7fc7ebfff640 10 client.30134.objecter ms_dispatch2 0x7fc810000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:32.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.677+0000 7fc7ebfff640 10 client.30134.objecter _finish_command 2 = system:0 2026-02-24T19:24:32.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.677+0000 7fc7ebfff640 20 client.30134.objecter put_session s=0x7fc7e00a21f0 osd=11 4 2026-02-24T19:24:32.679 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.677+0000 7fc7ebfff640 15 client.30134.objecter _session_command_op_remove 11 2 2026-02-24T19:24:32.679 INFO:teuthology.orchestra.run.trial026.stdout:{ 2026-02-24T19:24:32.679 INFO:teuthology.orchestra.run.trial026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:32.679 INFO:teuthology.orchestra.run.trial026.stdout:} 2026-02-24T19:24:32.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.677+0000 7fc815f1b640 10 librados: watch_flush enter 2026-02-24T19:24:32.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.677+0000 7fc815f1b640 10 librados: watch_flush exit 2026-02-24T19:24:32.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.677+0000 7fc815f1b640 10 client.30134.objecter close_session for osd.11 2026-02-24T19:24:32.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.677+0000 7fc815f1b640 1 -- 10.20.193.26:0/1212701010 >> v1:10.20.193.162:6813/1717662802 conn(0x7fc7e00a28a0 legacy=0x7fc7e00c2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.677+0000 7fc815f1b640 20 client.30134.objecter put_session s=0x7fc7e00a21f0 osd=11 1 2026-02-24T19:24:32.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.677+0000 7fc815f1b640 20 client.30134.objecter shutdown clearing up homeless session... 2026-02-24T19:24:32.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.677+0000 7fc815f1b640 10 client.30134.objecter successfully canceled tick 2026-02-24T19:24:32.681 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.677+0000 7fc815f1b640 1 -- 10.20.193.26:0/1212701010 >> v1:10.20.193.162:6800/3889602630 conn(0x7fc7e0077e90 legacy=0x7fc7e0098340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.677+0000 7fc815f1b640 10 monclient: shutdown 2026-02-24T19:24:32.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.677+0000 7fc815f1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:32.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.677+0000 7fc815f1b640 1 -- 10.20.193.26:0/1212701010 >> v1:10.20.193.103:6789/0 conn(0x7fc810159e10 legacy=0x7fc8101637d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.677+0000 7fc80ffff640 1 -- 10.20.193.26:0/1212701010 reap_dead start 2026-02-24T19:24:32.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.677+0000 7fc815f1b640 1 -- 10.20.193.26:0/1212701010 shutdown_connections 2026-02-24T19:24:32.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.677+0000 7fc815f1b640 1 -- 10.20.193.26:0/1212701010 >> 10.20.193.26:0/1212701010 conn(0x7fc8100b2f60 msgr2=0x7fc8100b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:32.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.677+0000 7fc815f1b640 1 -- 10.20.193.26:0/1212701010 shutdown_connections 2026-02-24T19:24:32.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.677+0000 7fc815f1b640 1 -- 10.20.193.26:0/1212701010 wait complete. 2026-02-24T19:24:32.682 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.677+0000 7fc815f1b640 1 librados: shutdown 2026-02-24T19:24:32.686 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 11 2026-02-24T19:24:32.753 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.752+0000 7f978c32c640 10 monclient: get_monmap_and_config 2026-02-24T19:24:32.754 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.752+0000 7f978c32c640 10 monclient: build_initial_monmap 2026-02-24T19:24:32.754 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.752+0000 7f978c32c640 10 monclient: monmap: 2026-02-24T19:24:32.754 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:32.754 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.754 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:32.753085+0000 2026-02-24T19:24:32.754 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:32.753085+0000 2026-02-24T19:24:32.754 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:32.754 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.754 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:32.755 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:32.755 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:32.755 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.757 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.752+0000 7f978c32c640 1 Processor -- start 2026-02-24T19:24:32.757 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.752+0000 7f978c32c640 1 -- start start 2026-02-24T19:24:32.757 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.752+0000 7f978c32c640 10 monclient: init 2026-02-24T19:24:32.757 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.753+0000 7f978c32c640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:32.757 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.753+0000 7f978c32c640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:32.758 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.753+0000 7f978c32c640 10 monclient(hunting): picked mon.noname-a con 0x7f9784157780 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:32.758 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.753+0000 7f978c32c640 10 monclient(hunting): picked mon.noname-c con 0x7f9784157b50 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:32.758 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.753+0000 7f978c32c640 10 monclient(hunting): picked mon.noname-b con 0x7f9784164d00 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:32.758 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.753+0000 7f978c32c640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f978405de70 con 0x7f9784157780 2026-02-24T19:24:32.758 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.753+0000 7f978c32c640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9784055b20 con 0x7f9784164d00 2026-02-24T19:24:32.758 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.753+0000 7f978c32c640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9784055e00 con 0x7f9784157b50 2026-02-24T19:24:32.758 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.753+0000 7f978c32c640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:32.758 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.753+0000 7f978c32c640 10 monclient(hunting): authenticate will time out at 4055.435294s 2026-02-24T19:24:32.758 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.753+0000 7f978a0a1640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f9784157780 0x7f9784056ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59100/0 (socket says 10.20.193.26:59100) 2026-02-24T19:24:32.758 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.753+0000 7f978a0a1640 1 -- 10.20.193.26:0/2827975665 learned_addr learned my addr 10.20.193.26:0/2827975665 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:32.758 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.755+0000 7f978909f640 1 -- 10.20.193.26:0/2827975665 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2948540358 0 0) 0x7f9784055e00 con 0x7f9784157b50 2026-02-24T19:24:32.759 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.755+0000 7f978909f640 10 monclient(hunting): _negotiate 2026-02-24T19:24:32.759 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.755+0000 7f978909f640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:32.759 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.755+0000 7f978909f640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:32.759 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.755+0000 7f978909f640 10 monclient(hunting): my global_id is 30137 2026-02-24T19:24:32.759 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.755+0000 7f978909f640 1 -- 10.20.193.26:0/2827975665 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f976c003610 con 0x7f9784157b50 2026-02-24T19:24:32.759 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.755+0000 7f978909f640 1 -- 10.20.193.26:0/2827975665 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3524913165 0 0) 0x7f9784055b20 con 0x7f9784164d00 2026-02-24T19:24:32.759 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.755+0000 7f978909f640 10 monclient(hunting): _negotiate 2026-02-24T19:24:32.759 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.755+0000 7f978909f640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:32.759 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.755+0000 7f978909f640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:32.759 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.755+0000 7f978909f640 10 monclient(hunting): my global_id is 28213 2026-02-24T19:24:32.759 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.755+0000 7f978909f640 1 -- 10.20.193.26:0/2827975665 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9784055e00 con 0x7f9784164d00 2026-02-24T19:24:32.759 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.755+0000 7f978909f640 1 -- 10.20.193.26:0/2827975665 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2246098638 0 0) 0x7f978405de70 con 0x7f9784157780 2026-02-24T19:24:32.760 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.755+0000 7f978909f640 10 monclient(hunting): _negotiate 2026-02-24T19:24:32.760 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.755+0000 7f978909f640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:32.760 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.755+0000 7f978909f640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:32.760 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.755+0000 7f978909f640 10 monclient(hunting): my global_id is 30798 2026-02-24T19:24:32.760 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.755+0000 7f978909f640 1 -- 10.20.193.26:0/2827975665 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9784055b20 con 0x7f9784157780 2026-02-24T19:24:32.767 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.756+0000 7f978909f640 1 -- 10.20.193.26:0/2827975665 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4244284697 0 0) 0x7f976c003610 con 0x7f9784157b50 2026-02-24T19:24:32.768 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.756+0000 7f978909f640 1 -- 10.20.193.26:0/2827975665 >> v1:10.20.193.70:6789/0 conn(0x7f9784164d00 legacy=0x7f97841c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.768 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.756+0000 7f978909f640 1 -- 10.20.193.26:0/2827975665 >> v1:10.20.193.26:6789/0 conn(0x7f9784157780 legacy=0x7f9784056ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.768 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.756+0000 7f978909f640 10 monclient: _finish_hunting 0 2026-02-24T19:24:32.768 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.756+0000 7f978909f640 1 monclient: found mon.noname-c 2026-02-24T19:24:32.768 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.756+0000 7f978909f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:32.768 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.756+0000 7f978909f640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.103:6789/0 2026-02-24T19:24:32.768 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.756+0000 7f978909f640 1 -- 10.20.193.26:0/2827975665 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97840560e0 con 0x7f9784157b50 2026-02-24T19:24:32.768 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.756+0000 7f978909f640 10 monclient: _finish_auth 0 2026-02-24T19:24:32.768 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.756+0000 7f978909f640 10 monclient: _check_auth_tickets 2026-02-24T19:24:32.768 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.756+0000 7f978909f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:32.769 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.756+0000 7f978909f640 1 -- 10.20.193.26:0/2827975665 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9778002df0 con 0x7f9784157b50 2026-02-24T19:24:32.769 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.756+0000 7f978909f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:32.769 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.756+0000 7f978909f640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:32.769 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.756+0000 7f978909f640 10 monclient: dump: 2026-02-24T19:24:32.769 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:32.769 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.769 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.769 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.769 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:32.769 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.769 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:32.769 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:32.770 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:32.770 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.770 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.756+0000 7f978c32c640 5 monclient: authenticate success, global_id 30137 2026-02-24T19:24:32.770 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.756+0000 7f978c32c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:32.770 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.757+0000 7f978909f640 1 -- 10.20.193.26:0/2827975665 <== mon.2 v1:10.20.193.103:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9778003040 con 0x7f9784157b50 2026-02-24T19:24:32.770 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.757+0000 7f978909f640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:32.770 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.757+0000 7f978909f640 1 -- 10.20.193.26:0/2827975665 <== mon.2 v1:10.20.193.103:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9778003450 con 0x7f9784157b50 2026-02-24T19:24:32.770 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.757+0000 7f978c32c640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:32.770 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.757+0000 7f978c32c640 4 set_mon_vals no callback set 2026-02-24T19:24:32.770 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.757+0000 7f978909f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:32.770 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.757+0000 7f978909f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:32.770 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.757+0000 7f978909f640 10 monclient: dump: 2026-02-24T19:24:32.771 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:32.771 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.771 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.771 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.771 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:32.771 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.771 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:32.771 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:32.771 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:32.771 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.771 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.757+0000 7f978c32c640 10 monclient: shutdown 2026-02-24T19:24:32.771 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.757+0000 7f978c32c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:32.771 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.757+0000 7f978c32c640 1 -- 10.20.193.26:0/2827975665 >> v1:10.20.193.103:6789/0 conn(0x7f9784157b50 legacy=0x7f97841645f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.772 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.757+0000 7f978c32c640 1 -- 10.20.193.26:0/2827975665 shutdown_connections 2026-02-24T19:24:32.772 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.757+0000 7f978c32c640 1 -- 10.20.193.26:0/2827975665 >> 10.20.193.26:0/2827975665 conn(0x7f97840b2ef0 msgr2=0x7f97840b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:32.772 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.757+0000 7f978c32c640 1 -- 10.20.193.26:0/2827975665 shutdown_connections 2026-02-24T19:24:32.772 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.757+0000 7f978c32c640 1 -- 10.20.193.26:0/2827975665 wait complete. 2026-02-24T19:24:32.772 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.758+0000 7f978c32c640 10 monclient: build_initial_monmap 2026-02-24T19:24:32.772 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.758+0000 7f978c32c640 10 monclient: monmap: 2026-02-24T19:24:32.772 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:32.772 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:32.772 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:32.772 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:32.772 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:32.773 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:32.773 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:32.773 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:32.773 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:32.773 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.773 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.758+0000 7f978c32c640 1 librados: starting msgr at 2026-02-24T19:24:32.773 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.758+0000 7f978c32c640 1 librados: starting objecter 2026-02-24T19:24:32.773 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.758+0000 7f978c32c640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:32.773 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.758+0000 7f978c32c640 1 Processor -- start 2026-02-24T19:24:32.773 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.758+0000 7f978c32c640 1 -- start start 2026-02-24T19:24:32.773 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.758+0000 7f978c32c640 1 librados: setting wanted keys 2026-02-24T19:24:32.773 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.758+0000 7f978c32c640 1 librados: calling monclient init 2026-02-24T19:24:32.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.758+0000 7f978c32c640 10 monclient: init 2026-02-24T19:24:32.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.759+0000 7f978c32c640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:32.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.759+0000 7f978c32c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:24:32.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.759+0000 7f978c32c640 10 monclient(hunting): picked mon.noname-a con 0x7f9784157780 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:32.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.759+0000 7f978c32c640 10 monclient(hunting): picked mon.noname-b con 0x7f9784157b50 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:32.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.759+0000 7f978c32c640 10 monclient(hunting): picked mon.noname-c con 0x7f9784164d00 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:32.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.759+0000 7f978c32c640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f978413a880 con 0x7f9784157780 2026-02-24T19:24:32.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.759+0000 7f978c32c640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f978405c4e0 con 0x7f9784157b50 2026-02-24T19:24:32.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.759+0000 7f978c32c640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f978405c7c0 con 0x7f9784164d00 2026-02-24T19:24:32.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.759+0000 7f978c32c640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:32.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.759+0000 7f978c32c640 10 monclient(hunting): authenticate will time out at 4055.441065s 2026-02-24T19:24:32.774 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.759+0000 7f978a0a1640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f9784157780 0x7f978413a170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59102/0 (socket says 10.20.193.26:59102) 2026-02-24T19:24:32.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.759+0000 7f978a0a1640 1 -- 10.20.193.26:0/430312359 learned_addr learned my addr 10.20.193.26:0/430312359 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:32.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.759+0000 7f976affd640 10 client.?.objecter ms_handle_connect 0x7f9784157780 2026-02-24T19:24:32.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.759+0000 7f976affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:32.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.759+0000 7f976affd640 10 client.?.objecter ms_handle_connect 0x7f9784164d00 2026-02-24T19:24:32.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.759+0000 7f976affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:32.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.760+0000 7f976affd640 10 client.?.objecter ms_handle_connect 0x7f9784157b50 2026-02-24T19:24:32.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.760+0000 7f976affd640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:32.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.760+0000 7f976affd640 1 -- 10.20.193.26:0/430312359 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3500124315 0 0) 0x7f978413a880 con 0x7f9784157780 2026-02-24T19:24:32.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.760+0000 7f976affd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:32.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.760+0000 7f976affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:32.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.760+0000 7f976affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:32.775 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.760+0000 7f976affd640 10 monclient(hunting): my global_id is 30801 2026-02-24T19:24:32.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.760+0000 7f976affd640 1 -- 10.20.193.26:0/430312359 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9754003610 con 0x7f9784157780 2026-02-24T19:24:32.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.760+0000 7f976affd640 1 -- 10.20.193.26:0/430312359 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 225935117 0 0) 0x7f978405c7c0 con 0x7f9784164d00 2026-02-24T19:24:32.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.760+0000 7f976affd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:32.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.760+0000 7f976affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:32.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.760+0000 7f976affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:32.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.760+0000 7f976affd640 10 monclient(hunting): my global_id is 30140 2026-02-24T19:24:32.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.760+0000 7f976affd640 1 -- 10.20.193.26:0/430312359 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f978413a880 con 0x7f9784164d00 2026-02-24T19:24:32.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.760+0000 7f976affd640 1 -- 10.20.193.26:0/430312359 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1092734603 0 0) 0x7f978405c4e0 con 0x7f9784157b50 2026-02-24T19:24:32.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.760+0000 7f976affd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:32.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.760+0000 7f976affd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:32.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.760+0000 7f976affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:32.776 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.760+0000 7f976affd640 10 monclient(hunting): my global_id is 28216 2026-02-24T19:24:32.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.761+0000 7f976affd640 1 -- 10.20.193.26:0/430312359 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f978405c7c0 con 0x7f9784157b50 2026-02-24T19:24:32.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.763+0000 7f976affd640 1 -- 10.20.193.26:0/430312359 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2557163416 0 0) 0x7f978413a880 con 0x7f9784164d00 2026-02-24T19:24:32.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.763+0000 7f976affd640 1 -- 10.20.193.26:0/430312359 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f978405c4e0 con 0x7f9784164d00 2026-02-24T19:24:32.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.763+0000 7f976affd640 1 -- 10.20.193.26:0/430312359 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f97800032c0 con 0x7f9784164d00 2026-02-24T19:24:32.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.763+0000 7f976affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:32.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.763+0000 7f976affd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:32.777 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.763+0000 7f976affd640 10 monclient(hunting): dump: 2026-02-24T19:24:32.777 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:32.777 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.777 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.777 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.777 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:32.777 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.778 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:32.778 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:32.778 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:32.778 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.763+0000 7f976affd640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:32.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.763+0000 7f976affd640 1 -- 10.20.193.26:0/430312359 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 947248177 0 0) 0x7f9754003610 con 0x7f9784157780 2026-02-24T19:24:32.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.763+0000 7f976affd640 1 -- 10.20.193.26:0/430312359 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f978413a880 con 0x7f9784157780 2026-02-24T19:24:32.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.763+0000 7f976affd640 1 -- 10.20.193.26:0/430312359 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9774003060 con 0x7f9784157780 2026-02-24T19:24:32.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.763+0000 7f976affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:32.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.763+0000 7f976affd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:32.778 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.763+0000 7f976affd640 10 monclient(hunting): dump: 2026-02-24T19:24:32.778 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:32.778 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.779 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.779 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.779 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:32.779 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.779 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:32.779 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:32.779 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:32.779 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.779 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.763+0000 7f976affd640 1 -- 10.20.193.26:0/430312359 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3305965739 0 0) 0x7f978405c7c0 con 0x7f9784157b50 2026-02-24T19:24:32.779 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.763+0000 7f976affd640 1 -- 10.20.193.26:0/430312359 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9754003610 con 0x7f9784157b50 2026-02-24T19:24:32.779 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.763+0000 7f976affd640 1 -- 10.20.193.26:0/430312359 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9778003390 con 0x7f9784157b50 2026-02-24T19:24:32.779 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.763+0000 7f976affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:32.779 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.763+0000 7f976affd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:32.780 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.763+0000 7f976affd640 10 monclient(hunting): dump: 2026-02-24T19:24:32.780 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:32.780 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.780 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.780 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.780 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:32.780 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.780 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:32.780 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:32.780 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:32.780 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.764+0000 7f976affd640 1 -- 10.20.193.26:0/430312359 <== mon.2 v1:10.20.193.103:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1697341268 0 0) 0x7f978405c4e0 con 0x7f9784164d00 2026-02-24T19:24:32.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.764+0000 7f976affd640 1 -- 10.20.193.26:0/430312359 >> v1:10.20.193.70:6789/0 conn(0x7f9784157b50 legacy=0x7f97841590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.764+0000 7f976affd640 1 -- 10.20.193.26:0/430312359 >> v1:10.20.193.26:6789/0 conn(0x7f9784157780 legacy=0x7f978413a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.764+0000 7f976affd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:32.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.764+0000 7f976affd640 1 monclient: found mon.c 2026-02-24T19:24:32.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.764+0000 7f976affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:32.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.764+0000 7f976affd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:32.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.764+0000 7f976affd640 1 -- 10.20.193.26:0/430312359 --> v1:10.20.193.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f978405caa0 con 0x7f9784164d00 2026-02-24T19:24:32.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.764+0000 7f976affd640 10 monclient: _finish_auth 0 2026-02-24T19:24:32.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.764+0000 7f976affd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:32.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.764+0000 7f976affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:32.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.764+0000 7f978c32c640 5 monclient: authenticate success, global_id 30140 2026-02-24T19:24:32.781 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.764+0000 7f978c32c640 10 monclient: _renew_subs 2026-02-24T19:24:32.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.764+0000 7f978c32c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:32.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.764+0000 7f978c32c640 1 -- 10.20.193.26:0/430312359 --> v1:10.20.193.103:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f978405cd80 con 0x7f9784164d00 2026-02-24T19:24:32.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.764+0000 7f978c32c640 10 client.30140.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:32.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.764+0000 7f978c32c640 10 monclient: _renew_subs 2026-02-24T19:24:32.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.764+0000 7f978c32c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:32.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.764+0000 7f978c32c640 1 -- 10.20.193.26:0/430312359 --> v1:10.20.193.103:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f978405d340 con 0x7f9784164d00 2026-02-24T19:24:32.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.764+0000 7f978c32c640 1 librados: init done 2026-02-24T19:24:32.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.765+0000 7f978c32c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:32.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.765+0000 7f978c32c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:32.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.765+0000 7f978c32c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.103:6789/0 2026-02-24T19:24:32.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.765+0000 7f978c32c640 1 -- 10.20.193.26:0/430312359 --> v1:10.20.193.103:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f978405e250 con 0x7f9784164d00 2026-02-24T19:24:32.784 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.771+0000 7f976affd640 1 -- 10.20.193.26:0/430312359 <== mon.2 v1:10.20.193.103:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9780003710 con 0x7f9784164d00 2026-02-24T19:24:32.784 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.771+0000 7f976affd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:32.784 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.771+0000 7f976affd640 1 -- 10.20.193.26:0/430312359 <== mon.2 v1:10.20.193.103:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f9780003ae0 con 0x7f9784164d00 2026-02-24T19:24:32.784 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.771+0000 7f976affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:32.784 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.771+0000 7f976affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:32.784 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.771+0000 7f976affd640 10 monclient: dump: 2026-02-24T19:24:32.784 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:32.784 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:32.784 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.784 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:32.785 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:32.785 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:32.785 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:32.785 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:32.785 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:32.785 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:32.785 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.771+0000 7f978889e640 4 set_mon_vals no callback set 2026-02-24T19:24:32.785 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.772+0000 7f976affd640 1 -- 10.20.193.26:0/430312359 <== mon.2 v1:10.20.193.103:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f9780003ae0 con 0x7f9784164d00 2026-02-24T19:24:32.785 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.773+0000 7f978a0a1640 10 monclient: get_auth_request con 0x7f9754077e60 auth_method 0 2026-02-24T19:24:32.785 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.773+0000 7f976affd640 10 client.30140.objecter ms_handle_connect 0x7f9754077e60 2026-02-24T19:24:32.785 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.773+0000 7f976affd640 1 -- 10.20.193.26:0/430312359 <== mon.2 v1:10.20.193.103:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7f9780092190 con 0x7f9784164d00 2026-02-24T19:24:32.785 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.773+0000 7f976affd640 10 client.30140.objecter ms_dispatch2 0x7f9784000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:32.785 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.773+0000 7f976affd640 3 client.30140.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:32.785 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.773+0000 7f976affd640 3 client.30140.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:32.786 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.773+0000 7f976affd640 20 client.30140.objecter dump_active .. 0 homeless 2026-02-24T19:24:32.861 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.860+0000 7f976affd640 1 -- 10.20.193.26:0/430312359 <== mon.2 v1:10.20.193.103:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f978405e250 con 0x7f9784164d00 2026-02-24T19:24:32.862 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.860+0000 7f976affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:32.862 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.860+0000 7f976affd640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:32.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.964+0000 7f978c32c640 1 -- 10.20.193.26:0/430312359 --> v1:10.20.193.162:6800/3889602630 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "11", "target": ["mon-mgr", ""]}) -- 0x7f9784161ea0 con 0x7f9754077e60 2026-02-24T19:24:32.966 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.964+0000 7f976affd640 1 -- 10.20.193.26:0/430312359 <== mgr.4107 v1:10.20.193.162:6800/3889602630 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 11 to deep-scrub) ==== 42+0+0 (unknown 2412662492 0 0) 0x7f9784161ea0 con 0x7f9754077e60 2026-02-24T19:24:32.966 INFO:teuthology.orchestra.run.trial026.stderr:instructed osd(s) 11 to deep-scrub 2026-02-24T19:24:32.968 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.965+0000 7f978c32c640 10 librados: watch_flush enter 2026-02-24T19:24:32.968 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.965+0000 7f978c32c640 10 librados: watch_flush exit 2026-02-24T19:24:32.968 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.965+0000 7f978c32c640 20 client.30140.objecter shutdown clearing up homeless session... 2026-02-24T19:24:32.968 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.965+0000 7f978c32c640 10 client.30140.objecter successfully canceled tick 2026-02-24T19:24:32.968 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.965+0000 7f978c32c640 1 -- 10.20.193.26:0/430312359 >> v1:10.20.193.162:6800/3889602630 conn(0x7f9754077e60 legacy=0x7f9754098310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.968 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.965+0000 7f978c32c640 10 monclient: shutdown 2026-02-24T19:24:32.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.965+0000 7f978c32c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:32.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.965+0000 7f978c32c640 1 -- 10.20.193.26:0/430312359 >> v1:10.20.193.103:6789/0 conn(0x7f9784164d00 legacy=0x7f9784146190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:32.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.965+0000 7f978c32c640 1 -- 10.20.193.26:0/430312359 shutdown_connections 2026-02-24T19:24:32.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.965+0000 7f978c32c640 1 -- 10.20.193.26:0/430312359 >> 10.20.193.26:0/430312359 conn(0x7f97840b2ef0 msgr2=0x7f978413b780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:32.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.966+0000 7f978c32c640 1 -- 10.20.193.26:0/430312359 shutdown_connections 2026-02-24T19:24:32.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.966+0000 7f978c32c640 1 -- 10.20.193.26:0/430312359 wait complete. 2026-02-24T19:24:32.969 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:32.966+0000 7f978c32c640 1 librados: shutdown 2026-02-24T19:24:32.976 INFO:tasks.ceph:Scrubbing osd.15 2026-02-24T19:24:32.976 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 config set osd_debug_deep_scrub_sleep 0 2026-02-24T19:24:33.046 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.045+0000 7f59aeee8640 10 monclient: get_monmap_and_config 2026-02-24T19:24:33.046 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.045+0000 7f59aeee8640 10 monclient: build_initial_monmap 2026-02-24T19:24:33.047 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.045+0000 7f59aeee8640 10 monclient: monmap: 2026-02-24T19:24:33.047 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:33.047 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:33.047 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:33.045942+0000 2026-02-24T19:24:33.047 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:33.045942+0000 2026-02-24T19:24:33.047 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:33.047 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:33.047 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:33.047 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:33.047 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:33.048 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:33.050 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.045+0000 7f59aeee8640 1 Processor -- start 2026-02-24T19:24:33.050 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.045+0000 7f59aeee8640 1 -- start start 2026-02-24T19:24:33.050 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.045+0000 7f59aeee8640 10 monclient: init 2026-02-24T19:24:33.050 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.046+0000 7f59aeee8640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:33.050 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.046+0000 7f59aeee8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:24:33.050 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.046+0000 7f59aeee8640 10 monclient(hunting): picked mon.noname-b con 0x7f59a815e2a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:33.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.046+0000 7f59aeee8640 10 monclient(hunting): picked mon.noname-a con 0x7f59a8059e10 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:33.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.046+0000 7f59aeee8640 10 monclient(hunting): picked mon.noname-c con 0x7f59a81a5660 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:33.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.046+0000 7f59aeee8640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a8162df0 con 0x7f59a8059e10 2026-02-24T19:24:33.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.046+0000 7f59aeee8640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a81630d0 con 0x7f59a815e2a0 2026-02-24T19:24:33.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.046+0000 7f59aeee8640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a81633b0 con 0x7f59a81a5660 2026-02-24T19:24:33.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.046+0000 7f59aeee8640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:33.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.046+0000 7f59aeee8640 10 monclient(hunting): authenticate will time out at 4055.728216s 2026-02-24T19:24:33.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.046+0000 7f599ffff640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f59a8059e10 0x7f59a815ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59104/0 (socket says 10.20.193.26:59104) 2026-02-24T19:24:33.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.046+0000 7f599ffff640 1 -- 10.20.193.26:0/1417924876 learned_addr learned my addr 10.20.193.26:0/1417924876 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:33.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.047+0000 7f599f7fe640 1 -- 10.20.193.26:0/1417924876 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 744866068 0 0) 0x7f59a8162df0 con 0x7f59a8059e10 2026-02-24T19:24:33.051 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.047+0000 7f599f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:33.052 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.047+0000 7f599f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:33.052 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.047+0000 7f599f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:33.052 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.047+0000 7f599f7fe640 10 monclient(hunting): my global_id is 30804 2026-02-24T19:24:33.052 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.047+0000 7f599f7fe640 1 -- 10.20.193.26:0/1417924876 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5994003610 con 0x7f59a8059e10 2026-02-24T19:24:33.052 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.048+0000 7f599f7fe640 1 -- 10.20.193.26:0/1417924876 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1047439508 0 0) 0x7f59a81633b0 con 0x7f59a81a5660 2026-02-24T19:24:33.052 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.048+0000 7f599f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:33.052 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.048+0000 7f599f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:33.052 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.048+0000 7f599f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:33.052 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.048+0000 7f599f7fe640 10 monclient(hunting): my global_id is 30143 2026-02-24T19:24:33.052 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.048+0000 7f599f7fe640 1 -- 10.20.193.26:0/1417924876 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59a8162df0 con 0x7f59a81a5660 2026-02-24T19:24:33.052 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.048+0000 7f599f7fe640 1 -- 10.20.193.26:0/1417924876 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2981880498 0 0) 0x7f59a81630d0 con 0x7f59a815e2a0 2026-02-24T19:24:33.052 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.048+0000 7f599f7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:33.053 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.048+0000 7f599f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:33.053 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.048+0000 7f599f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:33.053 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.048+0000 7f599f7fe640 10 monclient(hunting): my global_id is 28219 2026-02-24T19:24:33.053 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.048+0000 7f599f7fe640 1 -- 10.20.193.26:0/1417924876 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59a81633b0 con 0x7f59a815e2a0 2026-02-24T19:24:33.060 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.049+0000 7f599f7fe640 1 -- 10.20.193.26:0/1417924876 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2519633833 0 0) 0x7f5994003610 con 0x7f59a8059e10 2026-02-24T19:24:33.060 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.049+0000 7f599f7fe640 1 -- 10.20.193.26:0/1417924876 >> v1:10.20.193.103:6789/0 conn(0x7f59a81a5660 legacy=0x7f59a81c5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:33.060 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.049+0000 7f599f7fe640 1 -- 10.20.193.26:0/1417924876 >> v1:10.20.193.70:6789/0 conn(0x7f59a815e2a0 legacy=0x7f59a805da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:33.060 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.049+0000 7f599f7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:24:33.060 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.049+0000 7f599f7fe640 1 monclient: found mon.noname-a 2026-02-24T19:24:33.060 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.049+0000 7f599f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:33.060 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.049+0000 7f599f7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:24:33.060 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.049+0000 7f599f7fe640 1 -- 10.20.193.26:0/1417924876 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a8163690 con 0x7f59a8059e10 2026-02-24T19:24:33.060 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.049+0000 7f599f7fe640 10 monclient: _finish_auth 0 2026-02-24T19:24:33.061 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.049+0000 7f599f7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:24:33.061 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.049+0000 7f599f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:33.061 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.049+0000 7f599f7fe640 1 -- 10.20.193.26:0/1417924876 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f5990002df0 con 0x7f59a8059e10 2026-02-24T19:24:33.061 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.049+0000 7f599f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:33.061 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.049+0000 7f599f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:33.061 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.049+0000 7f599f7fe640 10 monclient: dump: 2026-02-24T19:24:33.061 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:33.061 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:33.061 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.061 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.061 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:33.061 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:33.062 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:33.062 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:33.062 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:33.062 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:33.062 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.049+0000 7f59aeee8640 5 monclient: authenticate success, global_id 30804 2026-02-24T19:24:33.062 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.049+0000 7f59aeee8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:33.062 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.050+0000 7f599f7fe640 1 -- 10.20.193.26:0/1417924876 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5990002fc0 con 0x7f59a8059e10 2026-02-24T19:24:33.062 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.050+0000 7f599f7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:33.062 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.050+0000 7f599f7fe640 1 -- 10.20.193.26:0/1417924876 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f5990003400 con 0x7f59a8059e10 2026-02-24T19:24:33.062 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.050+0000 7f599f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:33.062 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.050+0000 7f599f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:33.062 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.050+0000 7f599f7fe640 10 monclient: dump: 2026-02-24T19:24:33.063 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:33.063 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:33.063 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.063 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.063 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:33.063 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:33.063 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:33.063 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:33.063 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:33.063 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:33.063 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.050+0000 7f59aeee8640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:33.063 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.050+0000 7f59aeee8640 4 set_mon_vals no callback set 2026-02-24T19:24:33.064 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.050+0000 7f59aeee8640 10 monclient: shutdown 2026-02-24T19:24:33.064 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.050+0000 7f59aeee8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:33.064 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.050+0000 7f59aeee8640 1 -- 10.20.193.26:0/1417924876 >> v1:10.20.193.26:6789/0 conn(0x7f59a8059e10 legacy=0x7f59a815ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:33.064 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.050+0000 7f59aeee8640 1 -- 10.20.193.26:0/1417924876 shutdown_connections 2026-02-24T19:24:33.064 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.050+0000 7f59aeee8640 1 -- 10.20.193.26:0/1417924876 >> 10.20.193.26:0/1417924876 conn(0x7f59a80b2f60 msgr2=0x7f59a80b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:33.064 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.050+0000 7f59aeee8640 1 -- 10.20.193.26:0/1417924876 shutdown_connections 2026-02-24T19:24:33.064 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.050+0000 7f59aeee8640 1 -- 10.20.193.26:0/1417924876 wait complete. 2026-02-24T19:24:33.064 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.051+0000 7f59aeee8640 10 monclient: build_initial_monmap 2026-02-24T19:24:33.064 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.051+0000 7f59aeee8640 10 monclient: monmap: 2026-02-24T19:24:33.064 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:33.065 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:33.065 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:33.065 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:33.065 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:33.065 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:33.065 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:33.065 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:33.065 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:33.065 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:33.065 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.051+0000 7f59aeee8640 1 librados: starting msgr at 2026-02-24T19:24:33.065 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.051+0000 7f59aeee8640 1 librados: starting objecter 2026-02-24T19:24:33.065 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.051+0000 7f59aeee8640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:33.066 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.051+0000 7f59aeee8640 1 Processor -- start 2026-02-24T19:24:33.066 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.051+0000 7f59aeee8640 1 -- start start 2026-02-24T19:24:33.066 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.051+0000 7f59aeee8640 1 librados: setting wanted keys 2026-02-24T19:24:33.066 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.051+0000 7f59aeee8640 1 librados: calling monclient init 2026-02-24T19:24:33.066 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.051+0000 7f59aeee8640 10 monclient: init 2026-02-24T19:24:33.066 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.051+0000 7f59aeee8640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:33.066 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.051+0000 7f59aeee8640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:33.066 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.051+0000 7f59aeee8640 10 monclient(hunting): picked mon.noname-a con 0x7f59a8059e10 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:33.066 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.051+0000 7f59aeee8640 10 monclient(hunting): picked mon.noname-c con 0x7f59a815e2a0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:33.066 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.051+0000 7f59aeee8640 10 monclient(hunting): picked mon.noname-b con 0x7f59a81a5660 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:33.066 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.051+0000 7f59aeee8640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a8191850 con 0x7f59a8059e10 2026-02-24T19:24:33.066 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.051+0000 7f59aeee8640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a8129040 con 0x7f59a81a5660 2026-02-24T19:24:33.066 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.051+0000 7f59aeee8640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a8129950 con 0x7f59a815e2a0 2026-02-24T19:24:33.067 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.051+0000 7f59aeee8640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:33.067 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.051+0000 7f59aeee8640 10 monclient(hunting): authenticate will time out at 4055.733951s 2026-02-24T19:24:33.067 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.052+0000 7f59acc5d640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f59a8059e10 0x7f59a8122260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59106/0 (socket says 10.20.193.26:59106) 2026-02-24T19:24:33.067 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.052+0000 7f59acc5d640 1 -- 10.20.193.26:0/1257934244 learned_addr learned my addr 10.20.193.26:0/1257934244 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:33.067 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.052+0000 7f599d7fa640 10 client.?.objecter ms_handle_connect 0x7f59a8059e10 2026-02-24T19:24:33.067 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.052+0000 7f599d7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:33.067 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.052+0000 7f599d7fa640 10 client.?.objecter ms_handle_connect 0x7f59a81a5660 2026-02-24T19:24:33.067 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.052+0000 7f599d7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:33.067 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.052+0000 7f599d7fa640 10 client.?.objecter ms_handle_connect 0x7f59a815e2a0 2026-02-24T19:24:33.067 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.052+0000 7f599d7fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:33.067 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.053+0000 7f599d7fa640 1 -- 10.20.193.26:0/1257934244 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2125652926 0 0) 0x7f59a8129040 con 0x7f59a81a5660 2026-02-24T19:24:33.067 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.053+0000 7f599d7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:33.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.053+0000 7f599d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:33.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.053+0000 7f599d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:33.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.053+0000 7f599d7fa640 10 monclient(hunting): my global_id is 28222 2026-02-24T19:24:33.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.053+0000 7f599d7fa640 1 -- 10.20.193.26:0/1257934244 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5978003610 con 0x7f59a81a5660 2026-02-24T19:24:33.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.053+0000 7f599d7fa640 1 -- 10.20.193.26:0/1257934244 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3748206342 0 0) 0x7f59a8129950 con 0x7f59a815e2a0 2026-02-24T19:24:33.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.053+0000 7f599d7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:33.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.053+0000 7f599d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:33.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.053+0000 7f599d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:33.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.053+0000 7f599d7fa640 10 monclient(hunting): my global_id is 30146 2026-02-24T19:24:33.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.053+0000 7f599d7fa640 1 -- 10.20.193.26:0/1257934244 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59a8129040 con 0x7f59a815e2a0 2026-02-24T19:24:33.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.053+0000 7f599d7fa640 1 -- 10.20.193.26:0/1257934244 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3149804825 0 0) 0x7f59a8191850 con 0x7f59a8059e10 2026-02-24T19:24:33.068 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.053+0000 7f599d7fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:33.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.053+0000 7f599d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:33.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.053+0000 7f599d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:33.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.053+0000 7f599d7fa640 10 monclient(hunting): my global_id is 30807 2026-02-24T19:24:33.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.053+0000 7f599d7fa640 1 -- 10.20.193.26:0/1257934244 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59a8129950 con 0x7f59a8059e10 2026-02-24T19:24:33.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.056+0000 7f599d7fa640 1 -- 10.20.193.26:0/1257934244 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1122565453 0 0) 0x7f59a8129040 con 0x7f59a815e2a0 2026-02-24T19:24:33.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.056+0000 7f599d7fa640 1 -- 10.20.193.26:0/1257934244 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59a8191850 con 0x7f59a815e2a0 2026-02-24T19:24:33.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.056+0000 7f599d7fa640 1 -- 10.20.193.26:0/1257934244 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1638916101 0 0) 0x7f5978003610 con 0x7f59a81a5660 2026-02-24T19:24:33.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.056+0000 7f599d7fa640 1 -- 10.20.193.26:0/1257934244 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59a8129040 con 0x7f59a81a5660 2026-02-24T19:24:33.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.056+0000 7f599d7fa640 1 -- 10.20.193.26:0/1257934244 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f5990003310 con 0x7f59a815e2a0 2026-02-24T19:24:33.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.056+0000 7f599d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:33.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.056+0000 7f599d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-24T19:24:33.069 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.056+0000 7f599d7fa640 10 monclient(hunting): dump: 2026-02-24T19:24:33.070 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:33.070 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:33.070 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.070 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.070 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:33.070 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:33.070 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:33.070 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:33.070 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:33.070 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:33.070 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.056+0000 7f599d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:33.070 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.056+0000 7f599d7fa640 1 -- 10.20.193.26:0/1257934244 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f59a40033b0 con 0x7f59a81a5660 2026-02-24T19:24:33.070 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.056+0000 7f599d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:33.071 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.056+0000 7f599d7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:33.071 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.056+0000 7f599d7fa640 10 monclient(hunting): dump: 2026-02-24T19:24:33.071 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:33.071 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:33.071 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.071 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.071 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:33.071 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:33.071 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:33.071 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:33.071 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:33.071 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:33.071 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.056+0000 7f599d7fa640 1 -- 10.20.193.26:0/1257934244 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 755168057 0 0) 0x7f59a8129950 con 0x7f59a8059e10 2026-02-24T19:24:33.072 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.056+0000 7f599d7fa640 1 -- 10.20.193.26:0/1257934244 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5978003610 con 0x7f59a8059e10 2026-02-24T19:24:33.072 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.056+0000 7f599d7fa640 1 -- 10.20.193.26:0/1257934244 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f5998003170 con 0x7f59a8059e10 2026-02-24T19:24:33.072 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.056+0000 7f599d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:33.072 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.056+0000 7f599d7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:33.072 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.056+0000 7f599d7fa640 10 monclient(hunting): dump: 2026-02-24T19:24:33.072 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:33.072 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:33.072 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.072 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.072 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:33.072 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:33.072 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:33.073 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:33.073 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:33.073 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:33.073 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.057+0000 7f599d7fa640 1 -- 10.20.193.26:0/1257934244 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3691328578 0 0) 0x7f59a8129040 con 0x7f59a81a5660 2026-02-24T19:24:33.073 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.057+0000 7f599d7fa640 1 -- 10.20.193.26:0/1257934244 >> v1:10.20.193.103:6789/0 conn(0x7f59a815e2a0 legacy=0x7f59a8191140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:33.073 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.057+0000 7f599d7fa640 1 -- 10.20.193.26:0/1257934244 >> v1:10.20.193.26:6789/0 conn(0x7f59a8059e10 legacy=0x7f59a8122260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:33.073 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.057+0000 7f599d7fa640 10 monclient: _finish_hunting 0 2026-02-24T19:24:33.073 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.057+0000 7f599d7fa640 1 monclient: found mon.b 2026-02-24T19:24:33.073 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.057+0000 7f599d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:33.073 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.057+0000 7f599d7fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:33.073 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.057+0000 7f599d7fa640 1 -- 10.20.193.26:0/1257934244 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a8129c30 con 0x7f59a81a5660 2026-02-24T19:24:33.073 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.057+0000 7f599d7fa640 10 monclient: _finish_auth 0 2026-02-24T19:24:33.073 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.057+0000 7f599d7fa640 10 monclient: _check_auth_tickets 2026-02-24T19:24:33.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.057+0000 7f599d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:33.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.057+0000 7f59aeee8640 5 monclient: authenticate success, global_id 28222 2026-02-24T19:24:33.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.057+0000 7f59aeee8640 10 monclient: _renew_subs 2026-02-24T19:24:33.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.057+0000 7f59aeee8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:33.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.057+0000 7f59aeee8640 1 -- 10.20.193.26:0/1257934244 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f59a8129f10 con 0x7f59a81a5660 2026-02-24T19:24:33.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.057+0000 7f59aeee8640 10 client.28222.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:33.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.057+0000 7f59aeee8640 10 monclient: _renew_subs 2026-02-24T19:24:33.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.057+0000 7f59aeee8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:33.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.057+0000 7f59aeee8640 1 -- 10.20.193.26:0/1257934244 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f59a812ae20 con 0x7f59a81a5660 2026-02-24T19:24:33.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.057+0000 7f59aeee8640 1 librados: init done 2026-02-24T19:24:33.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.058+0000 7f59aeee8640 10 client.28222.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:33.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.058+0000 7f59aeee8640 15 client.28222.objecter _session_command_op_assign -1 1 2026-02-24T19:24:33.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.058+0000 7f59aeee8640 20 client.28222.objecter _get_session osd=-1 returning homeless 2026-02-24T19:24:33.074 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.058+0000 7f59aeee8640 10 client.28222.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:33.075 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.058+0000 7f59aeee8640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:33.075 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.058+0000 7f59aeee8640 1 -- 10.20.193.26:0/1257934244 --> v1:10.20.193.70:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f59a8129320 con 0x7f59a81a5660 2026-02-24T19:24:33.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.066+0000 7f599d7fa640 1 -- 10.20.193.26:0/1257934244 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f59a8129320 con 0x7f59a81a5660 2026-02-24T19:24:33.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.066+0000 7f599d7fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:33.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.066+0000 7f599d7fa640 1 -- 10.20.193.26:0/1257934244 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f59a4003a90 con 0x7f59a81a5660 2026-02-24T19:24:33.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.066+0000 7f599d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:33.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.066+0000 7f599d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:33.078 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.066+0000 7f599d7fa640 10 monclient: dump: 2026-02-24T19:24:33.078 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:33.078 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:33.078 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.078 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.078 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:33.078 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:33.078 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:33.078 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:33.078 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:33.078 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:33.078 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.066+0000 7f599effd640 4 set_mon_vals no callback set 2026-02-24T19:24:33.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.067+0000 7f599d7fa640 1 -- 10.20.193.26:0/1257934244 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f59a4003c70 con 0x7f59a81a5660 2026-02-24T19:24:33.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.067+0000 7f59acc5d640 10 monclient: get_auth_request con 0x7f5978077e80 auth_method 0 2026-02-24T19:24:33.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.068+0000 7f599d7fa640 10 client.28222.objecter ms_handle_connect 0x7f5978077e80 2026-02-24T19:24:33.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.068+0000 7f599d7fa640 1 -- 10.20.193.26:0/1257934244 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7f59a4092060 con 0x7f59a81a5660 2026-02-24T19:24:33.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.068+0000 7f599d7fa640 10 client.28222.objecter ms_dispatch2 0x7f59a8000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:33.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.068+0000 7f599d7fa640 3 client.28222.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:33.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.068+0000 7f599d7fa640 3 client.28222.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:33.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.068+0000 7f599d7fa640 10 client.28222.objecter checking command 1 2026-02-24T19:24:33.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.068+0000 7f599d7fa640 20 client.28222.objecter _get_session s=0x7f59780a21e0 osd=15 3 2026-02-24T19:24:33.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.068+0000 7f599d7fa640 20 client.28222.objecter put_session s=0x7f59780a21e0 osd=15 3 2026-02-24T19:24:33.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.068+0000 7f599d7fa640 15 client.28222.objecter _session_command_op_remove -1 1 2026-02-24T19:24:33.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.068+0000 7f599d7fa640 20 client.28222.objecter _get_session s=0x7f59780a21e0 osd=15 3 2026-02-24T19:24:33.079 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.068+0000 7f599d7fa640 20 client.28222.objecter get_session s=0x7f59780a21e0 osd=15 3 2026-02-24T19:24:33.080 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.068+0000 7f599d7fa640 15 client.28222.objecter _session_command_op_assign 15 1 2026-02-24T19:24:33.080 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.068+0000 7f599d7fa640 20 client.28222.objecter put_session s=0x7f59780a21e0 osd=15 4 2026-02-24T19:24:33.080 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.068+0000 7f599d7fa640 10 client.28222.objecter _send_command 1 2026-02-24T19:24:33.080 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.068+0000 7f599d7fa640 1 -- 10.20.193.26:0/1257934244 --> v1:10.20.193.162:6801/3445416924 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f59780c44f0 con 0x7f59780a2890 2026-02-24T19:24:33.080 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.068+0000 7f599d7fa640 20 client.28222.objecter dump_active .. 0 homeless 2026-02-24T19:24:33.080 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.068+0000 7f599d7fa640 1 -- 10.20.193.26:0/1257934244 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_get_version_reply(handle=1 version=346) ==== 24+0+0 (unknown 2991753921 0 0) 0x7f59a405c160 con 0x7f59a81a5660 2026-02-24T19:24:33.080 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.068+0000 7f599d7fa640 10 monclient: handle_get_version_reply finishing 1 version 346 2026-02-24T19:24:33.080 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.069+0000 7f599ffff640 10 monclient: get_auth_request con 0x7f59780a2890 auth_method 0 2026-02-24T19:24:33.080 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.070+0000 7f599d7fa640 10 client.28222.objecter ms_handle_connect 0x7f59780a2890 2026-02-24T19:24:33.086 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.084+0000 7f599d7fa640 1 -- 10.20.193.26:0/1257934244 <== osd.15 v1:10.20.193.162:6801/3445416924 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f59780c44f0 con 0x7f59780a2890 2026-02-24T19:24:33.086 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.084+0000 7f599d7fa640 10 client.28222.objecter ms_dispatch2 0x7f59a8000b90 command_reply(tid 1: 0 ) 2026-02-24T19:24:33.086 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.084+0000 7f599d7fa640 10 client.28222.objecter _finish_command 1 = system:0 2026-02-24T19:24:33.086 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.084+0000 7f599d7fa640 20 client.28222.objecter put_session s=0x7f59780a21e0 osd=15 4 2026-02-24T19:24:33.086 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.084+0000 7f599d7fa640 15 client.28222.objecter _session_command_op_remove 15 1 2026-02-24T19:24:33.093 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.092+0000 7f59aeee8640 10 client.28222.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-24T19:24:33.094 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.092+0000 7f59aeee8640 15 client.28222.objecter _session_command_op_assign -1 2 2026-02-24T19:24:33.094 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.092+0000 7f59aeee8640 20 client.28222.objecter _get_session s=0x7f59780a21e0 osd=15 3 2026-02-24T19:24:33.094 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.092+0000 7f59aeee8640 20 client.28222.objecter put_session s=0x7f59780a21e0 osd=15 3 2026-02-24T19:24:33.094 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.092+0000 7f59aeee8640 20 client.28222.objecter _get_session s=0x7f59780a21e0 osd=15 3 2026-02-24T19:24:33.094 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.092+0000 7f59aeee8640 15 client.28222.objecter _session_command_op_remove -1 2 2026-02-24T19:24:33.094 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.092+0000 7f59aeee8640 20 client.28222.objecter get_session s=0x7f59780a21e0 osd=15 3 2026-02-24T19:24:33.094 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.092+0000 7f59aeee8640 15 client.28222.objecter _session_command_op_assign 15 2 2026-02-24T19:24:33.094 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.092+0000 7f59aeee8640 20 client.28222.objecter put_session s=0x7f59780a21e0 osd=15 4 2026-02-24T19:24:33.094 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.092+0000 7f59aeee8640 10 client.28222.objecter _send_command 2 2026-02-24T19:24:33.094 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.092+0000 7f59aeee8640 1 -- 10.20.193.26:0/1257934244 --> v1:10.20.193.162:6801/3445416924 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f59a8195e60 con 0x7f59780a2890 2026-02-24T19:24:33.102 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.100+0000 7f599d7fa640 1 -- 10.20.193.26:0/1257934244 <== osd.15 v1:10.20.193.162:6801/3445416924 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f59a8195e60 con 0x7f59780a2890 2026-02-24T19:24:33.102 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.100+0000 7f599d7fa640 10 client.28222.objecter ms_dispatch2 0x7f59a8000b90 command_reply(tid 2: 0 ) 2026-02-24T19:24:33.102 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.100+0000 7f599d7fa640 10 client.28222.objecter _finish_command 2 = system:0 2026-02-24T19:24:33.102 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.100+0000 7f599d7fa640 20 client.28222.objecter put_session s=0x7f59780a21e0 osd=15 4 2026-02-24T19:24:33.102 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.100+0000 7f599d7fa640 15 client.28222.objecter _session_command_op_remove 15 2 2026-02-24T19:24:33.102 INFO:teuthology.orchestra.run.trial026.stdout:{ 2026-02-24T19:24:33.102 INFO:teuthology.orchestra.run.trial026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-24T19:24:33.103 INFO:teuthology.orchestra.run.trial026.stdout:} 2026-02-24T19:24:33.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.100+0000 7f59aeee8640 10 librados: watch_flush enter 2026-02-24T19:24:33.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.100+0000 7f59aeee8640 10 librados: watch_flush exit 2026-02-24T19:24:33.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.100+0000 7f59aeee8640 10 client.28222.objecter close_session for osd.15 2026-02-24T19:24:33.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.100+0000 7f59aeee8640 1 -- 10.20.193.26:0/1257934244 >> v1:10.20.193.162:6801/3445416924 conn(0x7f59780a2890 legacy=0x7f59780c2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:33.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.100+0000 7f59aeee8640 20 client.28222.objecter put_session s=0x7f59780a21e0 osd=15 1 2026-02-24T19:24:33.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.100+0000 7f59aeee8640 20 client.28222.objecter shutdown clearing up homeless session... 2026-02-24T19:24:33.104 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.100+0000 7f59aeee8640 10 client.28222.objecter successfully canceled tick 2026-02-24T19:24:33.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.100+0000 7f59aeee8640 1 -- 10.20.193.26:0/1257934244 >> v1:10.20.193.162:6800/3889602630 conn(0x7f5978077e80 legacy=0x7f5978098330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:33.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.100+0000 7f59aeee8640 10 monclient: shutdown 2026-02-24T19:24:33.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.100+0000 7f59aeee8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:33.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.100+0000 7f59aeee8640 1 -- 10.20.193.26:0/1257934244 >> v1:10.20.193.70:6789/0 conn(0x7f59a81a5660 legacy=0x7f59a812a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:33.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.100+0000 7f59ad45e640 1 -- 10.20.193.26:0/1257934244 reap_dead start 2026-02-24T19:24:33.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.100+0000 7f59aeee8640 1 -- 10.20.193.26:0/1257934244 shutdown_connections 2026-02-24T19:24:33.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.100+0000 7f59aeee8640 1 -- 10.20.193.26:0/1257934244 >> 10.20.193.26:0/1257934244 conn(0x7f59a80b2f60 msgr2=0x7f59a80b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:33.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.100+0000 7f59aeee8640 1 -- 10.20.193.26:0/1257934244 shutdown_connections 2026-02-24T19:24:33.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.100+0000 7f59aeee8640 1 -- 10.20.193.26:0/1257934244 wait complete. 2026-02-24T19:24:33.105 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.100+0000 7f59aeee8640 1 librados: shutdown 2026-02-24T19:24:33.110 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 15 2026-02-24T19:24:33.177 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.175+0000 7f461e108640 10 monclient: get_monmap_and_config 2026-02-24T19:24:33.177 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.175+0000 7f461e108640 10 monclient: build_initial_monmap 2026-02-24T19:24:33.177 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.175+0000 7f461e108640 10 monclient: monmap: 2026-02-24T19:24:33.177 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:33.177 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:33.178 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:33.176589+0000 2026-02-24T19:24:33.178 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:33.176589+0000 2026-02-24T19:24:33.178 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:33.178 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:33.178 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:33.178 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:33.178 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:33.178 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:33.181 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.176+0000 7f461e108640 1 Processor -- start 2026-02-24T19:24:33.181 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.176+0000 7f461e108640 1 -- start start 2026-02-24T19:24:33.181 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.176+0000 7f461e108640 10 monclient: init 2026-02-24T19:24:33.181 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.177+0000 7f461e108640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:33.181 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.177+0000 7f461e108640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-24T19:24:33.181 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.177+0000 7f461e108640 10 monclient(hunting): picked mon.noname-a con 0x7f461815d0c0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:33.181 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.177+0000 7f461e108640 10 monclient(hunting): picked mon.noname-c con 0x7f46180b0ca0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:33.181 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.177+0000 7f461e108640 10 monclient(hunting): picked mon.noname-b con 0x7f46180b28b0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:33.181 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.177+0000 7f461e108640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46180b8540 con 0x7f461815d0c0 2026-02-24T19:24:33.182 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.177+0000 7f461e108640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46180b5da0 con 0x7f46180b28b0 2026-02-24T19:24:33.182 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.177+0000 7f461e108640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46180b6080 con 0x7f46180b0ca0 2026-02-24T19:24:33.182 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.177+0000 7f461e108640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:33.182 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.177+0000 7f461e108640 10 monclient(hunting): authenticate will time out at 4055.859182s 2026-02-24T19:24:33.182 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.177+0000 7f4616ffd640 1 --1- >> v1:10.20.193.103:6789/0 conn(0x7f46180b0ca0 0x7f46180b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:57364/0 (socket says 10.20.193.26:57364) 2026-02-24T19:24:33.182 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.177+0000 7f4616ffd640 1 -- 10.20.193.26:0/1768476958 learned_addr learned my addr 10.20.193.26:0/1768476958 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:33.182 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.178+0000 7f46167fc640 1 -- 10.20.193.26:0/1768476958 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2329414518 0 0) 0x7f46180b5da0 con 0x7f46180b28b0 2026-02-24T19:24:33.182 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.178+0000 7f46167fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:33.182 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.178+0000 7f46167fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:33.182 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.178+0000 7f46167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:33.182 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.178+0000 7f46167fc640 10 monclient(hunting): my global_id is 28225 2026-02-24T19:24:33.182 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.178+0000 7f46167fc640 1 -- 10.20.193.26:0/1768476958 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45fc003610 con 0x7f46180b28b0 2026-02-24T19:24:33.183 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.179+0000 7f46167fc640 1 -- 10.20.193.26:0/1768476958 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3940940595 0 0) 0x7f46180b6080 con 0x7f46180b0ca0 2026-02-24T19:24:33.183 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.179+0000 7f46167fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:33.183 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.179+0000 7f46167fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:33.183 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.179+0000 7f46167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:33.183 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.179+0000 7f46167fc640 10 monclient(hunting): my global_id is 30149 2026-02-24T19:24:33.183 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.179+0000 7f46167fc640 1 -- 10.20.193.26:0/1768476958 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46180b5da0 con 0x7f46180b0ca0 2026-02-24T19:24:33.183 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.179+0000 7f46167fc640 1 -- 10.20.193.26:0/1768476958 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3313984095 0 0) 0x7f46180b8540 con 0x7f461815d0c0 2026-02-24T19:24:33.183 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.179+0000 7f46167fc640 10 monclient(hunting): _negotiate 2026-02-24T19:24:33.183 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.179+0000 7f46167fc640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:33.183 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.179+0000 7f46167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:33.183 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.179+0000 7f46167fc640 10 monclient(hunting): my global_id is 30810 2026-02-24T19:24:33.184 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.179+0000 7f46167fc640 1 -- 10.20.193.26:0/1768476958 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46180b6080 con 0x7f461815d0c0 2026-02-24T19:24:33.189 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.180+0000 7f46167fc640 1 -- 10.20.193.26:0/1768476958 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3736399326 0 0) 0x7f45fc003610 con 0x7f46180b28b0 2026-02-24T19:24:33.190 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.180+0000 7f46167fc640 1 -- 10.20.193.26:0/1768476958 >> v1:10.20.193.103:6789/0 conn(0x7f46180b0ca0 legacy=0x7f46180b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:33.190 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.180+0000 7f46167fc640 1 -- 10.20.193.26:0/1768476958 >> v1:10.20.193.26:6789/0 conn(0x7f461815d0c0 legacy=0x7f46180b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:33.190 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.180+0000 7f46167fc640 10 monclient: _finish_hunting 0 2026-02-24T19:24:33.190 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.180+0000 7f46167fc640 1 monclient: found mon.noname-b 2026-02-24T19:24:33.190 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.180+0000 7f46167fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:33.190 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.180+0000 7f46167fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:24:33.190 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.180+0000 7f46167fc640 1 -- 10.20.193.26:0/1768476958 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4618163e10 con 0x7f46180b28b0 2026-02-24T19:24:33.190 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.180+0000 7f46167fc640 10 monclient: _finish_auth 0 2026-02-24T19:24:33.190 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.180+0000 7f46167fc640 10 monclient: _check_auth_tickets 2026-02-24T19:24:33.190 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.180+0000 7f46167fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:33.190 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.180+0000 7f46167fc640 1 -- 10.20.193.26:0/1768476958 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f460c003170 con 0x7f46180b28b0 2026-02-24T19:24:33.191 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.180+0000 7f46167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:33.191 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.180+0000 7f46167fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:33.191 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.180+0000 7f46167fc640 10 monclient: dump: 2026-02-24T19:24:33.191 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:33.191 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:33.191 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.191 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.191 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:33.191 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:33.191 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:33.191 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:33.191 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:33.192 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:33.192 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.180+0000 7f461e108640 5 monclient: authenticate success, global_id 28225 2026-02-24T19:24:33.192 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.180+0000 7f461e108640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:33.192 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.181+0000 7f46167fc640 1 -- 10.20.193.26:0/1768476958 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f460c003340 con 0x7f46180b28b0 2026-02-24T19:24:33.192 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.181+0000 7f46167fc640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:33.192 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.181+0000 7f46167fc640 1 -- 10.20.193.26:0/1768476958 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f460c003780 con 0x7f46180b28b0 2026-02-24T19:24:33.192 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.181+0000 7f46167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:33.192 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.181+0000 7f46167fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:33.192 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.181+0000 7f46167fc640 10 monclient: dump: 2026-02-24T19:24:33.192 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:33.192 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:33.192 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.192 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.193 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:33.193 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:33.193 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:33.193 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:33.193 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:33.193 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:33.193 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.181+0000 7f461e108640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:33.193 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.181+0000 7f461e108640 4 set_mon_vals no callback set 2026-02-24T19:24:33.193 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.181+0000 7f461e108640 10 monclient: shutdown 2026-02-24T19:24:33.193 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.181+0000 7f461e108640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:33.193 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.181+0000 7f461e108640 1 -- 10.20.193.26:0/1768476958 >> v1:10.20.193.70:6789/0 conn(0x7f46180b28b0 legacy=0x7f46180b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:33.193 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.181+0000 7f461e108640 1 -- 10.20.193.26:0/1768476958 shutdown_connections 2026-02-24T19:24:33.194 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.181+0000 7f461e108640 1 -- 10.20.193.26:0/1768476958 >> 10.20.193.26:0/1768476958 conn(0x7f46180b5290 msgr2=0x7f46180b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:33.194 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.181+0000 7f461e108640 1 -- 10.20.193.26:0/1768476958 shutdown_connections 2026-02-24T19:24:33.194 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.181+0000 7f461e108640 1 -- 10.20.193.26:0/1768476958 wait complete. 2026-02-24T19:24:33.194 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.182+0000 7f461e108640 10 monclient: build_initial_monmap 2026-02-24T19:24:33.194 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.182+0000 7f461e108640 10 monclient: monmap: 2026-02-24T19:24:33.194 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:33.194 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:33.194 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:33.194 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:33.194 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:33.194 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:33.194 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:33.194 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:33.195 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:33.195 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:33.195 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.182+0000 7f461e108640 1 librados: starting msgr at 2026-02-24T19:24:33.195 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.182+0000 7f461e108640 1 librados: starting objecter 2026-02-24T19:24:33.195 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.182+0000 7f461e108640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:33.195 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.182+0000 7f461e108640 1 Processor -- start 2026-02-24T19:24:33.195 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.182+0000 7f461e108640 1 -- start start 2026-02-24T19:24:33.195 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.182+0000 7f461e108640 1 librados: setting wanted keys 2026-02-24T19:24:33.195 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.182+0000 7f461e108640 1 librados: calling monclient init 2026-02-24T19:24:33.195 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.182+0000 7f461e108640 10 monclient: init 2026-02-24T19:24:33.195 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.183+0000 7f461e108640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:33.195 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.183+0000 7f461e108640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:24:33.196 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.183+0000 7f461e108640 10 monclient(hunting): picked mon.noname-a con 0x7f46180b0ca0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:33.196 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.183+0000 7f461e108640 10 monclient(hunting): picked mon.noname-b con 0x7f46180b28b0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:33.196 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.183+0000 7f461e108640 10 monclient(hunting): picked mon.noname-c con 0x7f461815d0c0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:33.196 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.183+0000 7f461e108640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46180b81f0 con 0x7f46180b0ca0 2026-02-24T19:24:33.196 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.183+0000 7f461e108640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4618155870 con 0x7f46180b28b0 2026-02-24T19:24:33.196 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.183+0000 7f461e108640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4618155b50 con 0x7f461815d0c0 2026-02-24T19:24:33.196 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.183+0000 7f461e108640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:33.196 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.183+0000 7f461e108640 10 monclient(hunting): authenticate will time out at 4055.865144s 2026-02-24T19:24:33.196 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.183+0000 7f4616ffd640 1 --1- >> v1:10.20.193.70:6789/0 conn(0x7f46180b28b0 0x7f46180b7ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.70:6789/0 says I am v1:10.20.193.26:59234/0 (socket says 10.20.193.26:59234) 2026-02-24T19:24:33.196 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.183+0000 7f4616ffd640 1 -- 10.20.193.26:0/2861358114 learned_addr learned my addr 10.20.193.26:0/2861358114 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:33.196 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.183+0000 7f45f3fff640 10 client.?.objecter ms_handle_connect 0x7f46180b28b0 2026-02-24T19:24:33.196 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.183+0000 7f45f3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:33.196 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.183+0000 7f45f3fff640 10 client.?.objecter ms_handle_connect 0x7f461815d0c0 2026-02-24T19:24:33.197 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.183+0000 7f45f3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:33.197 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.184+0000 7f45f3fff640 10 client.?.objecter ms_handle_connect 0x7f46180b0ca0 2026-02-24T19:24:33.197 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.184+0000 7f45f3fff640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:33.197 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.184+0000 7f45f3fff640 1 -- 10.20.193.26:0/2861358114 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 258578412 0 0) 0x7f4618155870 con 0x7f46180b28b0 2026-02-24T19:24:33.197 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.184+0000 7f45f3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:33.197 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.184+0000 7f45f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:33.197 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.184+0000 7f45f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:33.197 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.184+0000 7f45f3fff640 10 monclient(hunting): my global_id is 28228 2026-02-24T19:24:33.197 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.184+0000 7f45f3fff640 1 -- 10.20.193.26:0/2861358114 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45e8003610 con 0x7f46180b28b0 2026-02-24T19:24:33.197 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.184+0000 7f45f3fff640 1 -- 10.20.193.26:0/2861358114 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1058275776 0 0) 0x7f4618155b50 con 0x7f461815d0c0 2026-02-24T19:24:33.197 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.184+0000 7f45f3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:33.197 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.184+0000 7f45f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:33.198 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.184+0000 7f45f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:33.198 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.184+0000 7f45f3fff640 10 monclient(hunting): my global_id is 30152 2026-02-24T19:24:33.198 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.184+0000 7f45f3fff640 1 -- 10.20.193.26:0/2861358114 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4618155870 con 0x7f461815d0c0 2026-02-24T19:24:33.198 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.185+0000 7f45f3fff640 1 -- 10.20.193.26:0/2861358114 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3552895833 0 0) 0x7f46180b81f0 con 0x7f46180b0ca0 2026-02-24T19:24:33.198 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.185+0000 7f45f3fff640 10 monclient(hunting): _negotiate 2026-02-24T19:24:33.198 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.185+0000 7f45f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:33.198 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.185+0000 7f45f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:33.198 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.185+0000 7f45f3fff640 10 monclient(hunting): my global_id is 30813 2026-02-24T19:24:33.198 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.185+0000 7f45f3fff640 1 -- 10.20.193.26:0/2861358114 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4618155b50 con 0x7f46180b0ca0 2026-02-24T19:24:33.198 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.187+0000 7f45f3fff640 1 -- 10.20.193.26:0/2861358114 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 675688606 0 0) 0x7f45e8003610 con 0x7f46180b28b0 2026-02-24T19:24:33.199 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.187+0000 7f45f3fff640 1 -- 10.20.193.26:0/2861358114 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f46180b81f0 con 0x7f46180b28b0 2026-02-24T19:24:33.199 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.187+0000 7f45f3fff640 1 -- 10.20.193.26:0/2861358114 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f4608003170 con 0x7f46180b28b0 2026-02-24T19:24:33.199 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.187+0000 7f45f3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:33.199 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.187+0000 7f45f3fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:33.199 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.187+0000 7f45f3fff640 10 monclient(hunting): dump: 2026-02-24T19:24:33.199 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:33.199 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:33.199 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.199 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.199 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:33.199 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:33.199 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:33.199 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:33.200 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:33.200 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:33.200 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.187+0000 7f45f3fff640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:33.200 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.187+0000 7f45f3fff640 1 -- 10.20.193.26:0/2861358114 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 522624252 0 0) 0x7f4618155870 con 0x7f461815d0c0 2026-02-24T19:24:33.200 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.187+0000 7f45f3fff640 1 -- 10.20.193.26:0/2861358114 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f45e8003610 con 0x7f461815d0c0 2026-02-24T19:24:33.200 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.187+0000 7f45f3fff640 1 -- 10.20.193.26:0/2861358114 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f460c0034f0 con 0x7f461815d0c0 2026-02-24T19:24:33.200 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.187+0000 7f45f3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:33.200 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.187+0000 7f45f3fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:33.200 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.187+0000 7f45f3fff640 10 monclient(hunting): dump: 2026-02-24T19:24:33.200 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:33.200 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:33.200 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.201 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.201 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:33.201 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:33.201 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:33.201 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:33.201 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:33.201 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:33.201 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.188+0000 7f45f3fff640 1 -- 10.20.193.26:0/2861358114 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4160304282 0 0) 0x7f4618155b50 con 0x7f46180b0ca0 2026-02-24T19:24:33.201 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.188+0000 7f45f3fff640 1 -- 10.20.193.26:0/2861358114 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4618155870 con 0x7f46180b0ca0 2026-02-24T19:24:33.201 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.188+0000 7f45f3fff640 1 -- 10.20.193.26:0/2861358114 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f4604002fb0 con 0x7f46180b0ca0 2026-02-24T19:24:33.201 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.188+0000 7f45f3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:33.201 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.188+0000 7f45f3fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:33.201 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.188+0000 7f45f3fff640 10 monclient(hunting): dump: 2026-02-24T19:24:33.202 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:33.202 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:33.202 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.202 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.202 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:33.202 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:33.202 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:33.202 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:33.202 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:33.202 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:33.205 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.188+0000 7f45f3fff640 1 -- 10.20.193.26:0/2861358114 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3324701444 0 0) 0x7f46180b81f0 con 0x7f46180b28b0 2026-02-24T19:24:33.205 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.188+0000 7f45f3fff640 1 -- 10.20.193.26:0/2861358114 >> v1:10.20.193.103:6789/0 conn(0x7f461815d0c0 legacy=0x7f4618138770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:33.205 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.188+0000 7f45f3fff640 1 -- 10.20.193.26:0/2861358114 >> v1:10.20.193.26:6789/0 conn(0x7f46180b0ca0 legacy=0x7f4618155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:33.205 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.188+0000 7f45f3fff640 10 monclient: _finish_hunting 0 2026-02-24T19:24:33.205 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.188+0000 7f45f3fff640 1 monclient: found mon.b 2026-02-24T19:24:33.205 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.188+0000 7f45f3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:33.205 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.188+0000 7f45f3fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:33.206 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.188+0000 7f45f3fff640 1 -- 10.20.193.26:0/2861358114 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4618155e30 con 0x7f46180b28b0 2026-02-24T19:24:33.206 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.188+0000 7f45f3fff640 10 monclient: _finish_auth 0 2026-02-24T19:24:33.206 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.188+0000 7f45f3fff640 10 monclient: _check_auth_tickets 2026-02-24T19:24:33.206 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.188+0000 7f45f3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:33.206 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.188+0000 7f461e108640 5 monclient: authenticate success, global_id 28228 2026-02-24T19:24:33.206 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.188+0000 7f461e108640 10 monclient: _renew_subs 2026-02-24T19:24:33.206 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.188+0000 7f461e108640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:33.206 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.188+0000 7f461e108640 1 -- 10.20.193.26:0/2861358114 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4618137f70 con 0x7f46180b28b0 2026-02-24T19:24:33.206 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.188+0000 7f461e108640 10 client.28228.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:33.206 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.188+0000 7f461e108640 10 monclient: _renew_subs 2026-02-24T19:24:33.206 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.188+0000 7f461e108640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:33.206 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.188+0000 7f461e108640 1 -- 10.20.193.26:0/2861358114 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4618138e80 con 0x7f46180b28b0 2026-02-24T19:24:33.206 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.188+0000 7f461e108640 1 librados: init done 2026-02-24T19:24:33.207 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.189+0000 7f461e108640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:33.207 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.189+0000 7f461e108640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:33.207 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.189+0000 7f461e108640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:33.207 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.189+0000 7f461e108640 1 -- 10.20.193.26:0/2861358114 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4618055260 con 0x7f46180b28b0 2026-02-24T19:24:33.207 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.194+0000 7f45f3fff640 1 -- 10.20.193.26:0/2861358114 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f46080034c0 con 0x7f46180b28b0 2026-02-24T19:24:33.207 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.194+0000 7f45f3fff640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:33.207 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.194+0000 7f45f3fff640 1 -- 10.20.193.26:0/2861358114 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f4608004d20 con 0x7f46180b28b0 2026-02-24T19:24:33.207 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.194+0000 7f45f3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:33.207 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.194+0000 7f45f3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:33.207 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.194+0000 7f4615ffb640 4 set_mon_vals no callback set 2026-02-24T19:24:33.207 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.194+0000 7f45f3fff640 10 monclient: dump: 2026-02-24T19:24:33.207 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:33.207 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:33.208 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.208 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.208 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:33.208 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:33.208 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:33.208 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:33.208 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:33.208 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:33.208 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.197+0000 7f45f3fff640 1 -- 10.20.193.26:0/2861358114 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f460801db90 con 0x7f46180b28b0 2026-02-24T19:24:33.208 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.198+0000 7f46177fe640 10 monclient: get_auth_request con 0x7f45e8077e20 auth_method 0 2026-02-24T19:24:33.208 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.198+0000 7f45f3fff640 10 client.28228.objecter ms_handle_connect 0x7f45e8077e20 2026-02-24T19:24:33.208 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.198+0000 7f45f3fff640 1 -- 10.20.193.26:0/2861358114 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7f46080933d0 con 0x7f46180b28b0 2026-02-24T19:24:33.208 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.198+0000 7f45f3fff640 10 client.28228.objecter ms_dispatch2 0x7f4618000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:33.209 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.198+0000 7f45f3fff640 3 client.28228.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:33.209 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.198+0000 7f45f3fff640 3 client.28228.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:33.209 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.198+0000 7f45f3fff640 20 client.28228.objecter dump_active .. 0 homeless 2026-02-24T19:24:33.288 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.287+0000 7f45f3fff640 1 -- 10.20.193.26:0/2861358114 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f4618055260 con 0x7f46180b28b0 2026-02-24T19:24:33.288 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.287+0000 7f45f3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:33.288 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.287+0000 7f45f3fff640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:33.394 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.392+0000 7f461e108640 1 -- 10.20.193.26:0/2861358114 --> v1:10.20.193.162:6800/3889602630 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "15", "target": ["mon-mgr", ""]}) -- 0x7f4618139160 con 0x7f45e8077e20 2026-02-24T19:24:33.394 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.392+0000 7f45f3fff640 1 -- 10.20.193.26:0/2861358114 <== mgr.4107 v1:10.20.193.162:6800/3889602630 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 15 to deep-scrub) ==== 42+0+0 (unknown 337234985 0 0) 0x7f4618139160 con 0x7f45e8077e20 2026-02-24T19:24:33.394 INFO:teuthology.orchestra.run.trial026.stderr:instructed osd(s) 15 to deep-scrub 2026-02-24T19:24:33.396 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.394+0000 7f461e108640 10 librados: watch_flush enter 2026-02-24T19:24:33.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.394+0000 7f461e108640 10 librados: watch_flush exit 2026-02-24T19:24:33.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.394+0000 7f461e108640 20 client.28228.objecter shutdown clearing up homeless session... 2026-02-24T19:24:33.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.394+0000 7f461e108640 10 client.28228.objecter successfully canceled tick 2026-02-24T19:24:33.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.394+0000 7f461e108640 1 -- 10.20.193.26:0/2861358114 >> v1:10.20.193.162:6800/3889602630 conn(0x7f45e8077e20 legacy=0x7f45e80982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:33.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.394+0000 7f461e108640 10 monclient: shutdown 2026-02-24T19:24:33.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.394+0000 7f461e108640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:33.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.394+0000 7f461e108640 1 -- 10.20.193.26:0/2861358114 >> v1:10.20.193.70:6789/0 conn(0x7f46180b28b0 legacy=0x7f46180b7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:33.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.394+0000 7f461e108640 1 -- 10.20.193.26:0/2861358114 shutdown_connections 2026-02-24T19:24:33.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.394+0000 7f461e108640 1 -- 10.20.193.26:0/2861358114 >> 10.20.193.26:0/2861358114 conn(0x7f46180b5290 msgr2=0x7f4618158a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:33.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.394+0000 7f461e108640 1 -- 10.20.193.26:0/2861358114 shutdown_connections 2026-02-24T19:24:33.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.394+0000 7f461e108640 1 -- 10.20.193.26:0/2861358114 wait complete. 2026-02-24T19:24:33.397 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.394+0000 7f461e108640 1 librados: shutdown 2026-02-24T19:24:33.404 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T19:24:33.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.470+0000 7f8956bed640 10 monclient: get_monmap_and_config 2026-02-24T19:24:33.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.470+0000 7f8956bed640 10 monclient: build_initial_monmap 2026-02-24T19:24:33.472 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.470+0000 7f8956bed640 10 monclient: monmap: 2026-02-24T19:24:33.472 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:33.472 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:33.472 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:33.471706+0000 2026-02-24T19:24:33.472 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:33.471706+0000 2026-02-24T19:24:33.473 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:33.473 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:33.473 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:33.473 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:33.473 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:33.473 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:33.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.471+0000 7f8956bed640 1 Processor -- start 2026-02-24T19:24:33.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.471+0000 7f8956bed640 1 -- start start 2026-02-24T19:24:33.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.471+0000 7f8956bed640 10 monclient: init 2026-02-24T19:24:33.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.471+0000 7f8956bed640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:33.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.471+0000 7f8956bed640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:24:33.474 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.471+0000 7f8956bed640 10 monclient(hunting): picked mon.noname-a con 0x7f89501603a0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:33.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.471+0000 7f8956bed640 10 monclient(hunting): picked mon.noname-b con 0x7f8950056690 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:33.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.471+0000 7f8956bed640 10 monclient(hunting): picked mon.noname-c con 0x7f89501613d0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:33.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.471+0000 7f8956bed640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8950161850 con 0x7f89501603a0 2026-02-24T19:24:33.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.471+0000 7f8956bed640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89500592d0 con 0x7f8950056690 2026-02-24T19:24:33.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.471+0000 7f8956bed640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89500595b0 con 0x7f89501613d0 2026-02-24T19:24:33.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.471+0000 7f8956bed640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:33.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.472+0000 7f8956bed640 10 monclient(hunting): authenticate will time out at 4056.154003s 2026-02-24T19:24:33.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.472+0000 7f8954962640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f89501603a0 0x7f8950160770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59142/0 (socket says 10.20.193.26:59142) 2026-02-24T19:24:33.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.472+0000 7f8954962640 1 -- 10.20.193.26:0/596808039 learned_addr learned my addr 10.20.193.26:0/596808039 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:33.475 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.472+0000 7f8955163640 1 --1- 10.20.193.26:0/596808039 >> v1:10.20.193.103:6789/0 conn(0x7f89501613d0 0x7f89500b20c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.103:6789/0 says I am v1:10.20.193.26:57378/0 (socket says 10.20.193.26:57378) 2026-02-24T19:24:33.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.473+0000 7f89477fe640 1 -- 10.20.193.26:0/596808039 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1053257792 0 0) 0x7f89500592d0 con 0x7f8950056690 2026-02-24T19:24:33.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.473+0000 7f89477fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:33.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.473+0000 7f89477fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:33.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.473+0000 7f89477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:33.476 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.473+0000 7f89477fe640 10 monclient(hunting): my global_id is 28231 2026-02-24T19:24:33.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.473+0000 7f89477fe640 1 -- 10.20.193.26:0/596808039 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f893c0058a0 con 0x7f8950056690 2026-02-24T19:24:33.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.473+0000 7f89477fe640 1 -- 10.20.193.26:0/596808039 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 596215299 0 0) 0x7f8940002910 con 0x7f89501603a0 2026-02-24T19:24:33.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.473+0000 7f89477fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:33.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.473+0000 7f89477fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:33.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.473+0000 7f89477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:33.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.473+0000 7f89477fe640 10 monclient(hunting): my global_id is 30816 2026-02-24T19:24:33.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.473+0000 7f89477fe640 1 -- 10.20.193.26:0/596808039 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89500592d0 con 0x7f89501603a0 2026-02-24T19:24:33.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.474+0000 7f89477fe640 1 -- 10.20.193.26:0/596808039 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 125668512 0 0) 0x7f89500595b0 con 0x7f89501613d0 2026-02-24T19:24:33.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.474+0000 7f89477fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:33.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.474+0000 7f89477fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:33.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.474+0000 7f89477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:33.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.474+0000 7f89477fe640 10 monclient(hunting): my global_id is 30155 2026-02-24T19:24:33.477 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.474+0000 7f89477fe640 1 -- 10.20.193.26:0/596808039 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8940002910 con 0x7f89501613d0 2026-02-24T19:24:33.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.475+0000 7f89477fe640 1 -- 10.20.193.26:0/596808039 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1001386226 0 0) 0x7f893c0058a0 con 0x7f8950056690 2026-02-24T19:24:33.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.475+0000 7f89477fe640 1 -- 10.20.193.26:0/596808039 >> v1:10.20.193.103:6789/0 conn(0x7f89501613d0 legacy=0x7f89500b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:33.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.475+0000 7f89477fe640 1 -- 10.20.193.26:0/596808039 >> v1:10.20.193.26:6789/0 conn(0x7f89501603a0 legacy=0x7f8950160770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:33.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.475+0000 7f89477fe640 10 monclient: _finish_hunting 0 2026-02-24T19:24:33.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.475+0000 7f89477fe640 1 monclient: found mon.noname-b 2026-02-24T19:24:33.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.475+0000 7f89477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:33.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.475+0000 7f89477fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:24:33.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.475+0000 7f89477fe640 1 -- 10.20.193.26:0/596808039 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8950059890 con 0x7f8950056690 2026-02-24T19:24:33.481 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.475+0000 7f89477fe640 10 monclient: _finish_auth 0 2026-02-24T19:24:33.482 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.475+0000 7f89477fe640 10 monclient: _check_auth_tickets 2026-02-24T19:24:33.482 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.475+0000 7f89477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:33.482 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.475+0000 7f89477fe640 1 -- 10.20.193.26:0/596808039 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f8938002df0 con 0x7f8950056690 2026-02-24T19:24:33.482 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.475+0000 7f89477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:33.482 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.475+0000 7f89477fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:33.482 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.475+0000 7f89477fe640 10 monclient: dump: 2026-02-24T19:24:33.482 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:33.482 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:33.482 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.482 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.482 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:33.482 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:33.482 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:33.482 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:33.482 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:33.483 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:33.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.475+0000 7f8956bed640 5 monclient: authenticate success, global_id 28231 2026-02-24T19:24:33.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.475+0000 7f8956bed640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:33.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.476+0000 7f89477fe640 1 -- 10.20.193.26:0/596808039 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8938002fc0 con 0x7f8950056690 2026-02-24T19:24:33.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.476+0000 7f89477fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:33.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.476+0000 7f89477fe640 1 -- 10.20.193.26:0/596808039 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f8938003400 con 0x7f8950056690 2026-02-24T19:24:33.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.476+0000 7f89477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:33.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.476+0000 7f89477fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:33.483 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.476+0000 7f89477fe640 10 monclient: dump: 2026-02-24T19:24:33.483 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:33.483 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:33.483 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.483 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.483 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:33.483 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:33.483 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:33.484 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:33.484 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:33.484 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:33.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.476+0000 7f8956bed640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:33.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.476+0000 7f8956bed640 4 set_mon_vals no callback set 2026-02-24T19:24:33.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.476+0000 7f8956bed640 10 monclient: shutdown 2026-02-24T19:24:33.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.476+0000 7f8956bed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:33.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.476+0000 7f8956bed640 1 -- 10.20.193.26:0/596808039 >> v1:10.20.193.70:6789/0 conn(0x7f8950056690 legacy=0x7f8950057f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:33.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.476+0000 7f8956bed640 1 -- 10.20.193.26:0/596808039 shutdown_connections 2026-02-24T19:24:33.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.476+0000 7f8956bed640 1 -- 10.20.193.26:0/596808039 >> 10.20.193.26:0/596808039 conn(0x7f89500b65f0 msgr2=0x7f89500b69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:33.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.476+0000 7f8956bed640 1 -- 10.20.193.26:0/596808039 shutdown_connections 2026-02-24T19:24:33.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.476+0000 7f8956bed640 1 -- 10.20.193.26:0/596808039 wait complete. 2026-02-24T19:24:33.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.477+0000 7f8956bed640 10 monclient: build_initial_monmap 2026-02-24T19:24:33.484 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.477+0000 7f8956bed640 10 monclient: monmap: 2026-02-24T19:24:33.484 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:33.484 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:33.485 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:33.485 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:33.485 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:33.485 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:33.485 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:33.485 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:33.485 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:33.485 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:33.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.477+0000 7f8956bed640 1 librados: starting msgr at 2026-02-24T19:24:33.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.477+0000 7f8956bed640 1 librados: starting objecter 2026-02-24T19:24:33.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.477+0000 7f8956bed640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:33.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.477+0000 7f8956bed640 1 Processor -- start 2026-02-24T19:24:33.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.477+0000 7f8956bed640 1 -- start start 2026-02-24T19:24:33.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.477+0000 7f8956bed640 1 librados: setting wanted keys 2026-02-24T19:24:33.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.477+0000 7f8956bed640 1 librados: calling monclient init 2026-02-24T19:24:33.485 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.477+0000 7f8956bed640 10 monclient: init 2026-02-24T19:24:33.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.477+0000 7f8956bed640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:33.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.477+0000 7f8956bed640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-24T19:24:33.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.478+0000 7f8956bed640 10 monclient(hunting): picked mon.noname-b con 0x7f8950056690 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:33.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.478+0000 7f8956bed640 10 monclient(hunting): picked mon.noname-c con 0x7f89501603a0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:33.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.478+0000 7f8956bed640 10 monclient(hunting): picked mon.noname-a con 0x7f89501613d0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:33.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.478+0000 7f8956bed640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f895013a9b0 con 0x7f89501613d0 2026-02-24T19:24:33.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.478+0000 7f8956bed640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8950139b50 con 0x7f8950056690 2026-02-24T19:24:33.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.478+0000 7f8956bed640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8950139e30 con 0x7f89501603a0 2026-02-24T19:24:33.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.478+0000 7f8956bed640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:33.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.478+0000 7f8956bed640 10 monclient(hunting): authenticate will time out at 4056.160063s 2026-02-24T19:24:33.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.478+0000 7f8955163640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f89501613d0 0x7f89501fe3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:59154/0 (socket says 10.20.193.26:59154) 2026-02-24T19:24:33.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.478+0000 7f8955163640 1 -- 10.20.193.26:0/2283954140 learned_addr learned my addr 10.20.193.26:0/2283954140 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:33.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.478+0000 7f89457fa640 10 client.?.objecter ms_handle_connect 0x7f89501613d0 2026-02-24T19:24:33.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.478+0000 7f89457fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:33.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.478+0000 7f89457fa640 10 client.?.objecter ms_handle_connect 0x7f8950056690 2026-02-24T19:24:33.486 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.478+0000 7f89457fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:33.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.478+0000 7f89457fa640 10 client.?.objecter ms_handle_connect 0x7f89501603a0 2026-02-24T19:24:33.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.478+0000 7f89457fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:33.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.479+0000 7f89457fa640 1 -- 10.20.193.26:0/2283954140 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2879666408 0 0) 0x7f895013a9b0 con 0x7f89501613d0 2026-02-24T19:24:33.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.479+0000 7f89457fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:33.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.479+0000 7f89457fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:33.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.479+0000 7f89457fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:33.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.479+0000 7f89457fa640 10 monclient(hunting): my global_id is 30819 2026-02-24T19:24:33.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.479+0000 7f89457fa640 1 -- 10.20.193.26:0/2283954140 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8920003610 con 0x7f89501613d0 2026-02-24T19:24:33.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.479+0000 7f89457fa640 1 -- 10.20.193.26:0/2283954140 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3905726874 0 0) 0x7f8950139b50 con 0x7f8950056690 2026-02-24T19:24:33.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.479+0000 7f89457fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:33.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.479+0000 7f89457fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:33.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.479+0000 7f89457fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:33.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.479+0000 7f89457fa640 10 monclient(hunting): my global_id is 28234 2026-02-24T19:24:33.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.479+0000 7f89457fa640 1 -- 10.20.193.26:0/2283954140 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f895013a9b0 con 0x7f8950056690 2026-02-24T19:24:33.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.479+0000 7f89457fa640 1 -- 10.20.193.26:0/2283954140 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1863135785 0 0) 0x7f8950139e30 con 0x7f89501603a0 2026-02-24T19:24:33.487 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.479+0000 7f89457fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:33.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.479+0000 7f89457fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:33.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.479+0000 7f89457fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:33.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.479+0000 7f89457fa640 10 monclient(hunting): my global_id is 30158 2026-02-24T19:24:33.488 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.479+0000 7f89457fa640 1 -- 10.20.193.26:0/2283954140 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8950139b50 con 0x7f89501603a0 2026-02-24T19:24:33.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.481+0000 7f89457fa640 1 -- 10.20.193.26:0/2283954140 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1343757673 0 0) 0x7f895013a9b0 con 0x7f8950056690 2026-02-24T19:24:33.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.481+0000 7f89457fa640 1 -- 10.20.193.26:0/2283954140 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8950139e30 con 0x7f8950056690 2026-02-24T19:24:33.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.481+0000 7f89457fa640 1 -- 10.20.193.26:0/2283954140 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f8940003250 con 0x7f8950056690 2026-02-24T19:24:33.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.481+0000 7f89457fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:33.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.481+0000 7f89457fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:33.490 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.481+0000 7f89457fa640 10 monclient(hunting): dump: 2026-02-24T19:24:33.490 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:33.490 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:33.490 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.490 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.490 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:33.490 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:33.490 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:33.490 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:33.491 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:33.491 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:33.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.481+0000 7f89457fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:33.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.481+0000 7f89457fa640 1 -- 10.20.193.26:0/2283954140 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3035059188 0 0) 0x7f8950139b50 con 0x7f89501603a0 2026-02-24T19:24:33.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.481+0000 7f89457fa640 1 -- 10.20.193.26:0/2283954140 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f895013a9b0 con 0x7f89501603a0 2026-02-24T19:24:33.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.481+0000 7f89457fa640 1 -- 10.20.193.26:0/2283954140 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f8938003310 con 0x7f89501603a0 2026-02-24T19:24:33.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.481+0000 7f89457fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:33.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.481+0000 7f89457fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:33.491 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.481+0000 7f89457fa640 10 monclient(hunting): dump: 2026-02-24T19:24:33.491 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:33.491 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:33.491 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.491 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.491 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:33.491 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:33.491 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:33.492 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:33.492 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:33.492 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:33.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.481+0000 7f89457fa640 1 -- 10.20.193.26:0/2283954140 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3310673764 0 0) 0x7f8920003610 con 0x7f89501613d0 2026-02-24T19:24:33.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.481+0000 7f89457fa640 1 -- 10.20.193.26:0/2283954140 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8950139b50 con 0x7f89501613d0 2026-02-24T19:24:33.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.481+0000 7f89457fa640 1 -- 10.20.193.26:0/2283954140 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f894c003410 con 0x7f89501613d0 2026-02-24T19:24:33.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.481+0000 7f89457fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:33.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.481+0000 7f89457fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:33.492 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.481+0000 7f89457fa640 10 monclient(hunting): dump: 2026-02-24T19:24:33.492 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:33.492 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:33.492 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.492 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.492 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:33.492 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:33.493 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:33.493 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:33.493 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:33.493 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:33.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.483+0000 7f89457fa640 1 -- 10.20.193.26:0/2283954140 <== mon.1 v1:10.20.193.70:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2345131266 0 0) 0x7f8950139e30 con 0x7f8950056690 2026-02-24T19:24:33.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.483+0000 7f89457fa640 1 -- 10.20.193.26:0/2283954140 >> v1:10.20.193.103:6789/0 conn(0x7f89501603a0 legacy=0x7f895015ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:33.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.483+0000 7f89457fa640 1 -- 10.20.193.26:0/2283954140 >> v1:10.20.193.26:6789/0 conn(0x7f89501613d0 legacy=0x7f89501fe3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:33.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.483+0000 7f89457fa640 10 monclient: _finish_hunting 0 2026-02-24T19:24:33.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.483+0000 7f89457fa640 1 monclient: found mon.b 2026-02-24T19:24:33.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.483+0000 7f89457fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:33.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.483+0000 7f89457fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:33.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.483+0000 7f89457fa640 1 -- 10.20.193.26:0/2283954140 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f895013a110 con 0x7f8950056690 2026-02-24T19:24:33.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.483+0000 7f89457fa640 10 monclient: _finish_auth 0 2026-02-24T19:24:33.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.483+0000 7f89457fa640 10 monclient: _check_auth_tickets 2026-02-24T19:24:33.493 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.483+0000 7f89457fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:33.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.483+0000 7f8956bed640 5 monclient: authenticate success, global_id 28234 2026-02-24T19:24:33.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.483+0000 7f8956bed640 10 monclient: _renew_subs 2026-02-24T19:24:33.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.483+0000 7f8956bed640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:33.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.483+0000 7f8956bed640 1 -- 10.20.193.26:0/2283954140 --> v1:10.20.193.70:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f895013a3f0 con 0x7f8950056690 2026-02-24T19:24:33.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.483+0000 7f8956bed640 10 client.28234.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:33.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.483+0000 7f8956bed640 10 monclient: _renew_subs 2026-02-24T19:24:33.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.483+0000 7f8956bed640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:33.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.483+0000 7f8956bed640 1 -- 10.20.193.26:0/2283954140 --> v1:10.20.193.70:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f89501fcfc0 con 0x7f8950056690 2026-02-24T19:24:33.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.483+0000 7f8956bed640 1 librados: init done 2026-02-24T19:24:33.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.483+0000 7f8956bed640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:33.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.483+0000 7f8956bed640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:33.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.483+0000 7f8956bed640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.70:6789/0 2026-02-24T19:24:33.494 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.483+0000 7f8956bed640 1 -- 10.20.193.26:0/2283954140 --> v1:10.20.193.70:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f895015d900 con 0x7f8950056690 2026-02-24T19:24:33.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.491+0000 7f89457fa640 1 -- 10.20.193.26:0/2283954140 <== mon.1 v1:10.20.193.70:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f89400033f0 con 0x7f8950056690 2026-02-24T19:24:33.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.491+0000 7f89457fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:33.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.491+0000 7f89457fa640 1 -- 10.20.193.26:0/2283954140 <== mon.1 v1:10.20.193.70:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f8940004d20 con 0x7f8950056690 2026-02-24T19:24:33.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.491+0000 7f89457fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:33.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.491+0000 7f89457fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:33.495 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.491+0000 7f89457fa640 10 monclient: dump: 2026-02-24T19:24:33.496 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:33.496 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:33.496 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.496 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:33.496 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:33.496 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:33.496 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:33.496 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:33.496 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:33.496 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:33.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.491+0000 7f8946ffd640 4 set_mon_vals no callback set 2026-02-24T19:24:33.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.492+0000 7f89457fa640 1 -- 10.20.193.26:0/2283954140 <== mon.1 v1:10.20.193.70:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f894001db90 con 0x7f8950056690 2026-02-24T19:24:33.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.493+0000 7f8947fff640 10 monclient: get_auth_request con 0x7f8920077f20 auth_method 0 2026-02-24T19:24:33.496 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.493+0000 7f89457fa640 10 client.28234.objecter ms_handle_connect 0x7f8920077f20 2026-02-24T19:24:33.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.577+0000 7f89457fa640 1 -- 10.20.193.26:0/2283954140 <== mon.1 v1:10.20.193.70:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7f8940093360 con 0x7f8950056690 2026-02-24T19:24:33.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.577+0000 7f89457fa640 10 client.28234.objecter ms_dispatch2 0x7f8950000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:33.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.577+0000 7f89457fa640 3 client.28234.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:33.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.577+0000 7f89457fa640 3 client.28234.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:33.579 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.577+0000 7f89457fa640 20 client.28234.objecter dump_active .. 0 homeless 2026-02-24T19:24:33.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.579+0000 7f89457fa640 1 -- 10.20.193.26:0/2283954140 <== mon.1 v1:10.20.193.70:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f8950161850 con 0x7f8950056690 2026-02-24T19:24:33.580 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.579+0000 7f89457fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:33.581 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.579+0000 7f89457fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:33.687 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.685+0000 7f8956bed640 1 -- 10.20.193.26:0/2283954140 --> v1:10.20.193.162:6800/3889602630 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8950163240 con 0x7f8920077f20 2026-02-24T19:24:33.688 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.687+0000 7f89457fa640 1 -- 10.20.193.26:0/2283954140 <== mgr.4107 v1:10.20.193.162:6800/3889602630 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125155 (unknown 2965378022 0 2750112383) 0x7f8950163240 con 0x7f8920077f20 2026-02-24T19:24:33.689 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:24:33.690 INFO:teuthology.orchestra.run.trial026.stderr:dumped all 2026-02-24T19:24:33.691 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.689+0000 7f8956bed640 10 librados: watch_flush enter 2026-02-24T19:24:33.691 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.689+0000 7f8956bed640 10 librados: watch_flush exit 2026-02-24T19:24:33.691 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.689+0000 7f8956bed640 20 client.28234.objecter shutdown clearing up homeless session... 2026-02-24T19:24:33.692 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.689+0000 7f8956bed640 10 client.28234.objecter successfully canceled tick 2026-02-24T19:24:33.692 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.689+0000 7f8956bed640 1 -- 10.20.193.26:0/2283954140 >> v1:10.20.193.162:6800/3889602630 conn(0x7f8920077f20 legacy=0x7f89200983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:33.692 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.689+0000 7f8956bed640 10 monclient: shutdown 2026-02-24T19:24:33.692 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.689+0000 7f8956bed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:33.692 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.689+0000 7f8956bed640 1 -- 10.20.193.26:0/2283954140 >> v1:10.20.193.70:6789/0 conn(0x7f8950056690 legacy=0x7f89501fd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:33.692 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.689+0000 7f8956bed640 1 -- 10.20.193.26:0/2283954140 shutdown_connections 2026-02-24T19:24:33.692 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.689+0000 7f8956bed640 1 -- 10.20.193.26:0/2283954140 >> 10.20.193.26:0/2283954140 conn(0x7f89500b65f0 msgr2=0x7f895005da00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:33.692 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.689+0000 7f8956bed640 1 -- 10.20.193.26:0/2283954140 shutdown_connections 2026-02-24T19:24:33.692 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.689+0000 7f8956bed640 1 -- 10.20.193.26:0/2283954140 wait complete. 2026-02-24T19:24:33.692 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:33.689+0000 7f8956bed640 1 librados: shutdown 2026-02-24T19:24:33.699 INFO:teuthology.orchestra.run.trial026.stdout:{"pg_ready":true,"pg_map":{"version":548,"stamp":"2026-02-24T19:24:32.670371+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49,"ondisk_log_size":49,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":560928,"kb_used_data":111520,"kb_used_omap":25609,"kb_used_meta":423542,"kb_avail":1509388512,"statfs":{"total":1546188226560,"available":1545613836288,"internally_reserved":0,"allocated":114196480,"data_stored":70663632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26224368,"internal_metadata":433707280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":102,"apply_latency_ms":102,"commit_latency_ns":102000000,"apply_latency_ns":102000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.828011"},"pg_stats":[{"pgid":"9.15","version":"0'0","reported_seq":644,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:30.294147+0000","last_change":"2026-02-24T19:24:30.294147+0000","last_active":"2026-02-24T19:24:30.294147+0000","last_peered":"2026-02-24T19:24:30.294147+0000","last_clean":"2026-02-24T19:24:30.294147+0000","last_became_active":"2026-02-24T19:18:45.991617+0000","last_became_peered":"2026-02-24T19:18:45.991617+0000","last_unstale":"2026-02-24T19:24:30.294147+0000","last_undegraded":"2026-02-24T19:24:30.294147+0000","last_fullsized":"2026-02-24T19:24:30.294147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:30.292429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:30.292429+0000","last_clean_scrub_stamp":"2026-02-24T19:24:30.292429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:47:07.528096+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":645,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:30.874684+0000","last_change":"2026-02-24T19:24:30.874684+0000","last_active":"2026-02-24T19:24:30.874684+0000","last_peered":"2026-02-24T19:24:30.874684+0000","last_clean":"2026-02-24T19:24:30.874684+0000","last_became_active":"2026-02-24T19:18:45.681436+0000","last_became_peered":"2026-02-24T19:18:45.681436+0000","last_unstale":"2026-02-24T19:24:30.874684+0000","last_undegraded":"2026-02-24T19:24:30.874684+0000","last_fullsized":"2026-02-24T19:24:30.874684+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:30.873912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:30.873912+0000","last_clean_scrub_stamp":"2026-02-24T19:24:30.873912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:52:42.711999+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":638,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:24.487793+0000","last_change":"2026-02-24T19:18:46.870170+0000","last_active":"2026-02-24T19:24:24.487793+0000","last_peered":"2026-02-24T19:24:24.487793+0000","last_clean":"2026-02-24T19:24:24.487793+0000","last_became_active":"2026-02-24T19:18:46.867835+0000","last_became_peered":"2026-02-24T19:18:46.867835+0000","last_unstale":"2026-02-24T19:24:24.487793+0000","last_undegraded":"2026-02-24T19:24:24.487793+0000","last_fullsized":"2026-02-24T19:24:24.487793+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:26:18.415712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":632,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:24.068587+0000","last_change":"2026-02-24T19:18:46.457667+0000","last_active":"2026-02-24T19:24:24.068587+0000","last_peered":"2026-02-24T19:24:24.068587+0000","last_clean":"2026-02-24T19:24:24.068587+0000","last_became_active":"2026-02-24T19:18:46.452160+0000","last_became_peered":"2026-02-24T19:18:46.452160+0000","last_unstale":"2026-02-24T19:24:24.068587+0000","last_undegraded":"2026-02-24T19:24:24.068587+0000","last_fullsized":"2026-02-24T19:24:24.068587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:59:23.251747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":637,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:23.940424+0000","last_change":"2026-02-24T19:18:46.510024+0000","last_active":"2026-02-24T19:24:23.940424+0000","last_peered":"2026-02-24T19:24:23.940424+0000","last_clean":"2026-02-24T19:24:23.940424+0000","last_became_active":"2026-02-24T19:18:46.482414+0000","last_became_peered":"2026-02-24T19:18:46.482414+0000","last_unstale":"2026-02-24T19:24:23.940424+0000","last_undegraded":"2026-02-24T19:24:23.940424+0000","last_fullsized":"2026-02-24T19:24:23.940424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:12:29.082198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,13],"acting":[14,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":641,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:27.847703+0000","last_change":"2026-02-24T19:24:27.847703+0000","last_active":"2026-02-24T19:24:27.847703+0000","last_peered":"2026-02-24T19:24:27.847703+0000","last_clean":"2026-02-24T19:24:27.847703+0000","last_became_active":"2026-02-24T19:18:45.877648+0000","last_became_peered":"2026-02-24T19:18:45.877648+0000","last_unstale":"2026-02-24T19:24:27.847703+0000","last_undegraded":"2026-02-24T19:24:27.847703+0000","last_fullsized":"2026-02-24T19:24:27.847703+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:27.842564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:27.842564+0000","last_clean_scrub_stamp":"2026-02-24T19:24:27.842564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:35:59.883652+0000","scrub_duration":125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":638,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:24.478484+0000","last_change":"2026-02-24T19:18:45.539139+0000","last_active":"2026-02-24T19:24:24.478484+0000","last_peered":"2026-02-24T19:24:24.478484+0000","last_clean":"2026-02-24T19:24:24.478484+0000","last_became_active":"2026-02-24T19:18:45.537014+0000","last_became_peered":"2026-02-24T19:18:45.537014+0000","last_unstale":"2026-02-24T19:24:24.478484+0000","last_undegraded":"2026-02-24T19:24:24.478484+0000","last_fullsized":"2026-02-24T19:24:24.478484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:53:12.241320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":645,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:29.571471+0000","last_change":"2026-02-24T19:24:29.571471+0000","last_active":"2026-02-24T19:24:29.571471+0000","last_peered":"2026-02-24T19:24:29.571471+0000","last_clean":"2026-02-24T19:24:29.571471+0000","last_became_active":"2026-02-24T19:18:46.435006+0000","last_became_peered":"2026-02-24T19:18:46.435006+0000","last_unstale":"2026-02-24T19:24:29.571471+0000","last_undegraded":"2026-02-24T19:24:29.571471+0000","last_fullsized":"2026-02-24T19:24:29.571471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:29.569563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:29.569563+0000","last_clean_scrub_stamp":"2026-02-24T19:24:29.569563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:19:56.324872+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,0],"acting":[12,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":642,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:28.746174+0000","last_change":"2026-02-24T19:24:28.746174+0000","last_active":"2026-02-24T19:24:28.746174+0000","last_peered":"2026-02-24T19:24:28.746174+0000","last_clean":"2026-02-24T19:24:28.746174+0000","last_became_active":"2026-02-24T19:18:47.212334+0000","last_became_peered":"2026-02-24T19:18:47.212334+0000","last_unstale":"2026-02-24T19:24:28.746174+0000","last_undegraded":"2026-02-24T19:24:28.746174+0000","last_fullsized":"2026-02-24T19:24:28.746174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:28.744363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:28.744363+0000","last_clean_scrub_stamp":"2026-02-24T19:24:28.744363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:31:54.898775+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":636,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:23.895440+0000","last_change":"2026-02-24T19:18:45.704988+0000","last_active":"2026-02-24T19:24:23.895440+0000","last_peered":"2026-02-24T19:24:23.895440+0000","last_clean":"2026-02-24T19:24:23.895440+0000","last_became_active":"2026-02-24T19:18:45.702531+0000","last_became_peered":"2026-02-24T19:18:45.702531+0000","last_unstale":"2026-02-24T19:24:23.895440+0000","last_undegraded":"2026-02-24T19:24:23.895440+0000","last_fullsized":"2026-02-24T19:24:23.895440+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:40:40.455743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0],"acting":[10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":642,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:31.247645+0000","last_change":"2026-02-24T19:24:31.247645+0000","last_active":"2026-02-24T19:24:31.247645+0000","last_peered":"2026-02-24T19:24:31.247645+0000","last_clean":"2026-02-24T19:24:31.247645+0000","last_became_active":"2026-02-24T19:18:45.245053+0000","last_became_peered":"2026-02-24T19:18:45.245053+0000","last_unstale":"2026-02-24T19:24:31.247645+0000","last_undegraded":"2026-02-24T19:24:31.247645+0000","last_fullsized":"2026-02-24T19:24:31.247645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:31.242987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:31.242987+0000","last_clean_scrub_stamp":"2026-02-24T19:24:31.242987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:48:31.854018+0000","scrub_duration":88,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":638,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:24.475664+0000","last_change":"2026-02-24T19:18:45.470833+0000","last_active":"2026-02-24T19:24:24.475664+0000","last_peered":"2026-02-24T19:24:24.475664+0000","last_clean":"2026-02-24T19:24:24.475664+0000","last_became_active":"2026-02-24T19:18:45.468683+0000","last_became_peered":"2026-02-24T19:18:45.468683+0000","last_unstale":"2026-02-24T19:24:24.475664+0000","last_undegraded":"2026-02-24T19:24:24.475664+0000","last_fullsized":"2026-02-24T19:24:24.475664+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:29:30.418354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":645,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:30.190257+0000","last_change":"2026-02-24T19:24:30.190257+0000","last_active":"2026-02-24T19:24:30.190257+0000","last_peered":"2026-02-24T19:24:30.190257+0000","last_clean":"2026-02-24T19:24:30.190257+0000","last_became_active":"2026-02-24T19:18:45.260524+0000","last_became_peered":"2026-02-24T19:18:45.260524+0000","last_unstale":"2026-02-24T19:24:30.190257+0000","last_undegraded":"2026-02-24T19:24:30.190257+0000","last_fullsized":"2026-02-24T19:24:30.190257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:30.188746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:30.188746+0000","last_clean_scrub_stamp":"2026-02-24T19:24:30.188746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:24:29.478695+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":649,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:24.066656+0000","last_change":"2026-02-24T19:18:07.814826+0000","last_active":"2026-02-24T19:24:24.066656+0000","last_peered":"2026-02-24T19:24:24.066656+0000","last_clean":"2026-02-24T19:24:24.066656+0000","last_became_active":"2026-02-24T19:18:06.131387+0000","last_became_peered":"2026-02-24T19:18:06.131387+0000","last_unstale":"2026-02-24T19:24:24.066656+0000","last_undegraded":"2026-02-24T19:24:24.066656+0000","last_fullsized":"2026-02-24T19:24:24.066656+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:38:29.559020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.060150395000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":635,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:23.954198+0000","last_change":"2026-02-24T19:18:46.022578+0000","last_active":"2026-02-24T19:24:23.954198+0000","last_peered":"2026-02-24T19:24:23.954198+0000","last_clean":"2026-02-24T19:24:23.954198+0000","last_became_active":"2026-02-24T19:18:46.019677+0000","last_became_peered":"2026-02-24T19:18:46.019677+0000","last_unstale":"2026-02-24T19:24:23.954198+0000","last_undegraded":"2026-02-24T19:24:23.954198+0000","last_fullsized":"2026-02-24T19:24:23.954198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:32:42.029209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,13],"acting":[6,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":654,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:24.467374+0000","last_change":"2026-02-24T19:18:08.286588+0000","last_active":"2026-02-24T19:24:24.467374+0000","last_peered":"2026-02-24T19:24:24.467374+0000","last_clean":"2026-02-24T19:24:24.467374+0000","last_became_active":"2026-02-24T19:18:05.714006+0000","last_became_peered":"2026-02-24T19:18:05.714006+0000","last_unstale":"2026-02-24T19:24:24.467374+0000","last_undegraded":"2026-02-24T19:24:24.467374+0000","last_fullsized":"2026-02-24T19:24:24.467374+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:57:02.402866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030292255000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,10],"acting":[15,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":644,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:31.551373+0000","last_change":"2026-02-24T19:24:31.551373+0000","last_active":"2026-02-24T19:24:31.551373+0000","last_peered":"2026-02-24T19:24:31.551373+0000","last_clean":"2026-02-24T19:24:31.551373+0000","last_became_active":"2026-02-24T19:18:46.049357+0000","last_became_peered":"2026-02-24T19:18:46.049357+0000","last_unstale":"2026-02-24T19:24:31.551373+0000","last_undegraded":"2026-02-24T19:24:31.551373+0000","last_fullsized":"2026-02-24T19:24:31.551373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:31.549495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:31.549495+0000","last_clean_scrub_stamp":"2026-02-24T19:24:31.549495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:38:15.774759+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,7],"acting":[10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":655,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:24.025766+0000","last_change":"2026-02-24T19:18:07.750038+0000","last_active":"2026-02-24T19:24:24.025766+0000","last_peered":"2026-02-24T19:24:24.025766+0000","last_clean":"2026-02-24T19:24:24.025766+0000","last_became_active":"2026-02-24T19:18:06.025485+0000","last_became_peered":"2026-02-24T19:18:06.025485+0000","last_unstale":"2026-02-24T19:24:24.025766+0000","last_undegraded":"2026-02-24T19:24:24.025766+0000","last_fullsized":"2026-02-24T19:24:24.025766+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:00:12.835602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.040704530000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":635,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:23.963751+0000","last_change":"2026-02-24T19:18:45.751018+0000","last_active":"2026-02-24T19:24:23.963751+0000","last_peered":"2026-02-24T19:24:23.963751+0000","last_clean":"2026-02-24T19:24:23.963751+0000","last_became_active":"2026-02-24T19:18:45.739451+0000","last_became_peered":"2026-02-24T19:18:45.739451+0000","last_unstale":"2026-02-24T19:24:23.963751+0000","last_undegraded":"2026-02-24T19:24:23.963751+0000","last_fullsized":"2026-02-24T19:24:23.963751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:58:38.717085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":663,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:29.996846+0000","last_change":"2026-02-24T19:24:29.996846+0000","last_active":"2026-02-24T19:24:29.996846+0000","last_peered":"2026-02-24T19:24:29.996846+0000","last_clean":"2026-02-24T19:24:29.996846+0000","last_became_active":"2026-02-24T19:18:05.911513+0000","last_became_peered":"2026-02-24T19:18:05.911513+0000","last_unstale":"2026-02-24T19:24:29.996846+0000","last_undegraded":"2026-02-24T19:24:29.996846+0000","last_fullsized":"2026-02-24T19:24:29.996846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:29.991903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:29.991903+0000","last_clean_scrub_stamp":"2026-02-24T19:24:29.991903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:40:23.274739+0000","scrub_duration":93,"objects_trimmed":0,"snaptrim_duration":0.027602962000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":643,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:29.301241+0000","last_change":"2026-02-24T19:24:29.301241+0000","last_active":"2026-02-24T19:24:29.301241+0000","last_peered":"2026-02-24T19:24:29.301241+0000","last_clean":"2026-02-24T19:24:29.301241+0000","last_became_active":"2026-02-24T19:18:45.316395+0000","last_became_peered":"2026-02-24T19:18:45.316395+0000","last_unstale":"2026-02-24T19:24:29.301241+0000","last_undegraded":"2026-02-24T19:24:29.301241+0000","last_fullsized":"2026-02-24T19:24:29.301241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:29.299830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:29.299830+0000","last_clean_scrub_stamp":"2026-02-24T19:24:29.299830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:33:23.438837+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.2","version":"29'2","reported_seq":652,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:24.033092+0000","last_change":"2026-02-24T19:18:07.812765+0000","last_active":"2026-02-24T19:24:24.033092+0000","last_peered":"2026-02-24T19:24:24.033092+0000","last_clean":"2026-02-24T19:24:24.033092+0000","last_became_active":"2026-02-24T19:18:06.102285+0000","last_became_peered":"2026-02-24T19:18:06.102285+0000","last_unstale":"2026-02-24T19:24:24.033092+0000","last_undegraded":"2026-02-24T19:24:24.033092+0000","last_fullsized":"2026-02-24T19:24:24.033092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T07:17:19.620766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.071463911000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":632,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:24.034031+0000","last_change":"2026-02-24T19:18:46.227053+0000","last_active":"2026-02-24T19:24:24.034031+0000","last_peered":"2026-02-24T19:24:24.034031+0000","last_clean":"2026-02-24T19:24:24.034031+0000","last_became_active":"2026-02-24T19:18:46.224954+0000","last_became_peered":"2026-02-24T19:18:46.224954+0000","last_unstale":"2026-02-24T19:24:24.034031+0000","last_undegraded":"2026-02-24T19:24:24.034031+0000","last_fullsized":"2026-02-24T19:24:24.034031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:09:45.760181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":661,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:28.382011+0000","last_change":"2026-02-24T19:24:28.382011+0000","last_active":"2026-02-24T19:24:28.382011+0000","last_peered":"2026-02-24T19:24:28.382011+0000","last_clean":"2026-02-24T19:24:28.382011+0000","last_became_active":"2026-02-24T19:18:06.040390+0000","last_became_peered":"2026-02-24T19:18:06.040390+0000","last_unstale":"2026-02-24T19:24:28.382011+0000","last_undegraded":"2026-02-24T19:24:28.382011+0000","last_fullsized":"2026-02-24T19:24:28.382011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:28.378075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:28.378075+0000","last_clean_scrub_stamp":"2026-02-24T19:24:28.378075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:18:04.248400+0000","scrub_duration":106,"objects_trimmed":0,"snaptrim_duration":0.035880255999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":642,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:29.759006+0000","last_change":"2026-02-24T19:24:29.759006+0000","last_active":"2026-02-24T19:24:29.759006+0000","last_peered":"2026-02-24T19:24:29.759006+0000","last_clean":"2026-02-24T19:24:29.759006+0000","last_became_active":"2026-02-24T19:18:45.633612+0000","last_became_peered":"2026-02-24T19:18:45.633612+0000","last_unstale":"2026-02-24T19:24:29.759006+0000","last_undegraded":"2026-02-24T19:24:29.759006+0000","last_fullsized":"2026-02-24T19:24:29.759006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:29.757449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:29.757449+0000","last_clean_scrub_stamp":"2026-02-24T19:24:29.757449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:19:53.458829+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":653,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:23.962002+0000","last_change":"2026-02-24T19:18:08.371822+0000","last_active":"2026-02-24T19:24:23.962002+0000","last_peered":"2026-02-24T19:24:23.962002+0000","last_clean":"2026-02-24T19:24:23.962002+0000","last_became_active":"2026-02-24T19:18:05.913043+0000","last_became_peered":"2026-02-24T19:18:05.913043+0000","last_unstale":"2026-02-24T19:24:23.962002+0000","last_undegraded":"2026-02-24T19:24:23.962002+0000","last_fullsized":"2026-02-24T19:24:23.962002+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:07:35.933859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030508101999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":642,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:29.618678+0000","last_change":"2026-02-24T19:24:29.618678+0000","last_active":"2026-02-24T19:24:29.618678+0000","last_peered":"2026-02-24T19:24:29.618678+0000","last_clean":"2026-02-24T19:24:29.618678+0000","last_became_active":"2026-02-24T19:18:46.150051+0000","last_became_peered":"2026-02-24T19:18:46.150051+0000","last_unstale":"2026-02-24T19:24:29.618678+0000","last_undegraded":"2026-02-24T19:24:29.618678+0000","last_fullsized":"2026-02-24T19:24:29.618678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:29.616807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:29.616807+0000","last_clean_scrub_stamp":"2026-02-24T19:24:29.616807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:36:28.276907+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"27'1","reported_seq":651,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:24.046168+0000","last_change":"2026-02-24T19:18:07.773906+0000","last_active":"2026-02-24T19:24:24.046168+0000","last_peered":"2026-02-24T19:24:24.046168+0000","last_clean":"2026-02-24T19:24:24.046168+0000","last_became_active":"2026-02-24T19:18:05.910166+0000","last_became_peered":"2026-02-24T19:18:05.910166+0000","last_unstale":"2026-02-24T19:24:24.046168+0000","last_undegraded":"2026-02-24T19:24:24.046168+0000","last_fullsized":"2026-02-24T19:24:24.046168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:03.820909+0000","last_clean_scrub_stamp":"2026-02-24T19:18:03.820909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:39:15.323606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.036726662,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"346'34","reported_seq":710,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:28.808516+0000","last_change":"2026-02-24T19:24:28.808516+0000","last_active":"2026-02-24T19:24:28.808516+0000","last_peered":"2026-02-24T19:24:28.808516+0000","last_clean":"2026-02-24T19:24:28.808516+0000","last_became_active":"2026-02-24T19:17:58.584752+0000","last_became_peered":"2026-02-24T19:17:58.584752+0000","last_unstale":"2026-02-24T19:24:28.808516+0000","last_undegraded":"2026-02-24T19:24:28.808516+0000","last_fullsized":"2026-02-24T19:24:28.808516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"346'34","last_scrub_stamp":"2026-02-24T19:24:28.803437+0000","last_deep_scrub":"346'34","last_deep_scrub_stamp":"2026-02-24T19:24:28.803437+0000","last_clean_scrub_stamp":"2026-02-24T19:24:28.803437+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:20:04.604903+0000","scrub_duration":229,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,10],"acting":[12,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":645,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:29.260032+0000","last_change":"2026-02-24T19:24:29.260032+0000","last_active":"2026-02-24T19:24:29.260032+0000","last_peered":"2026-02-24T19:24:29.260032+0000","last_clean":"2026-02-24T19:24:29.260032+0000","last_became_active":"2026-02-24T19:18:45.762826+0000","last_became_peered":"2026-02-24T19:18:45.762826+0000","last_unstale":"2026-02-24T19:24:29.260032+0000","last_undegraded":"2026-02-24T19:24:29.260032+0000","last_fullsized":"2026-02-24T19:24:29.260032+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:29.258326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:29.258326+0000","last_clean_scrub_stamp":"2026-02-24T19:24:29.258326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:19:49.590854+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,13],"acting":[5,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":635,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:23.927585+0000","last_change":"2026-02-24T19:18:45.851171+0000","last_active":"2026-02-24T19:24:23.927585+0000","last_peered":"2026-02-24T19:24:23.927585+0000","last_clean":"2026-02-24T19:24:23.927585+0000","last_became_active":"2026-02-24T19:18:45.848885+0000","last_became_peered":"2026-02-24T19:18:45.848885+0000","last_unstale":"2026-02-24T19:24:23.927585+0000","last_undegraded":"2026-02-24T19:24:23.927585+0000","last_fullsized":"2026-02-24T19:24:23.927585+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:33:05.467412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,12],"acting":[7,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":638,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:24.450969+0000","last_change":"2026-02-24T19:18:45.779094+0000","last_active":"2026-02-24T19:24:24.450969+0000","last_peered":"2026-02-24T19:24:24.450969+0000","last_clean":"2026-02-24T19:24:24.450969+0000","last_became_active":"2026-02-24T19:18:45.776560+0000","last_became_peered":"2026-02-24T19:18:45.776560+0000","last_unstale":"2026-02-24T19:24:24.450969+0000","last_undegraded":"2026-02-24T19:24:24.450969+0000","last_fullsized":"2026-02-24T19:24:24.450969+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:41:36.699391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"9.1","version":"346'12","reported_seq":669,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:27.792394+0000","last_change":"2026-02-24T19:24:27.792394+0000","last_active":"2026-02-24T19:24:27.792394+0000","last_peered":"2026-02-24T19:24:27.792394+0000","last_clean":"2026-02-24T19:24:27.792394+0000","last_became_active":"2026-02-24T19:18:47.223324+0000","last_became_peered":"2026-02-24T19:18:47.223324+0000","last_unstale":"2026-02-24T19:24:27.792394+0000","last_undegraded":"2026-02-24T19:24:27.792394+0000","last_fullsized":"2026-02-24T19:24:27.792394+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"346'12","last_scrub_stamp":"2026-02-24T19:24:27.790575+0000","last_deep_scrub":"346'12","last_deep_scrub_stamp":"2026-02-24T19:24:27.790575+0000","last_clean_scrub_stamp":"2026-02-24T19:24:27.790575+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:55:27.407251+0000","scrub_duration":84,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":637,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:23.955835+0000","last_change":"2026-02-24T19:18:46.077881+0000","last_active":"2026-02-24T19:24:23.955835+0000","last_peered":"2026-02-24T19:24:23.955835+0000","last_clean":"2026-02-24T19:24:23.955835+0000","last_became_active":"2026-02-24T19:18:46.075425+0000","last_became_peered":"2026-02-24T19:18:46.075425+0000","last_unstale":"2026-02-24T19:24:23.955835+0000","last_undegraded":"2026-02-24T19:24:23.955835+0000","last_fullsized":"2026-02-24T19:24:23.955835+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:23:06.041454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,8],"acting":[14,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":637,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:23.959233+0000","last_change":"2026-02-24T19:18:45.984836+0000","last_active":"2026-02-24T19:24:23.959233+0000","last_peered":"2026-02-24T19:24:23.959233+0000","last_clean":"2026-02-24T19:24:23.959233+0000","last_became_active":"2026-02-24T19:18:45.978376+0000","last_became_peered":"2026-02-24T19:18:45.978376+0000","last_unstale":"2026-02-24T19:24:23.959233+0000","last_undegraded":"2026-02-24T19:24:23.959233+0000","last_fullsized":"2026-02-24T19:24:23.959233+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:43:57.738043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,9],"acting":[14,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":637,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:23.953707+0000","last_change":"2026-02-24T19:18:46.028144+0000","last_active":"2026-02-24T19:24:23.953707+0000","last_peered":"2026-02-24T19:24:23.953707+0000","last_clean":"2026-02-24T19:24:23.953707+0000","last_became_active":"2026-02-24T19:18:46.025768+0000","last_became_peered":"2026-02-24T19:18:46.025768+0000","last_unstale":"2026-02-24T19:24:23.953707+0000","last_undegraded":"2026-02-24T19:24:23.953707+0000","last_fullsized":"2026-02-24T19:24:23.953707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:49:38.486896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,8],"acting":[14,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":635,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:23.930006+0000","last_change":"2026-02-24T19:18:45.820589+0000","last_active":"2026-02-24T19:24:23.930006+0000","last_peered":"2026-02-24T19:24:23.930006+0000","last_clean":"2026-02-24T19:24:23.930006+0000","last_became_active":"2026-02-24T19:18:45.818087+0000","last_became_peered":"2026-02-24T19:18:45.818087+0000","last_unstale":"2026-02-24T19:24:23.930006+0000","last_undegraded":"2026-02-24T19:24:23.930006+0000","last_fullsized":"2026-02-24T19:24:23.930006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:57:48.688473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,12],"acting":[7,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":637,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:24.022257+0000","last_change":"2026-02-24T19:18:45.323793+0000","last_active":"2026-02-24T19:24:24.022257+0000","last_peered":"2026-02-24T19:24:24.022257+0000","last_clean":"2026-02-24T19:24:24.022257+0000","last_became_active":"2026-02-24T19:18:45.320912+0000","last_became_peered":"2026-02-24T19:18:45.320912+0000","last_unstale":"2026-02-24T19:24:24.022257+0000","last_undegraded":"2026-02-24T19:24:24.022257+0000","last_fullsized":"2026-02-24T19:24:24.022257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:36:16.467243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":642,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:30.618071+0000","last_change":"2026-02-24T19:24:30.618071+0000","last_active":"2026-02-24T19:24:30.618071+0000","last_peered":"2026-02-24T19:24:30.618071+0000","last_clean":"2026-02-24T19:24:30.618071+0000","last_became_active":"2026-02-24T19:18:45.399050+0000","last_became_peered":"2026-02-24T19:18:45.399050+0000","last_unstale":"2026-02-24T19:24:30.618071+0000","last_undegraded":"2026-02-24T19:24:30.618071+0000","last_fullsized":"2026-02-24T19:24:30.618071+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:30.616316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:30.616316+0000","last_clean_scrub_stamp":"2026-02-24T19:24:30.616316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:20:11.292020+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":644,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:31.307242+0000","last_change":"2026-02-24T19:24:31.307242+0000","last_active":"2026-02-24T19:24:31.307242+0000","last_peered":"2026-02-24T19:24:31.307242+0000","last_clean":"2026-02-24T19:24:31.307242+0000","last_became_active":"2026-02-24T19:18:45.721374+0000","last_became_peered":"2026-02-24T19:18:45.721374+0000","last_unstale":"2026-02-24T19:24:31.307242+0000","last_undegraded":"2026-02-24T19:24:31.307242+0000","last_fullsized":"2026-02-24T19:24:31.307242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:31.306497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:31.306497+0000","last_clean_scrub_stamp":"2026-02-24T19:24:31.306497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:38:09.825388+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,6],"acting":[13,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":637,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:24.023442+0000","last_change":"2026-02-24T19:18:45.558833+0000","last_active":"2026-02-24T19:24:24.023442+0000","last_peered":"2026-02-24T19:24:24.023442+0000","last_clean":"2026-02-24T19:24:24.023442+0000","last_became_active":"2026-02-24T19:18:45.553944+0000","last_became_peered":"2026-02-24T19:18:45.553944+0000","last_unstale":"2026-02-24T19:24:24.023442+0000","last_undegraded":"2026-02-24T19:24:24.023442+0000","last_fullsized":"2026-02-24T19:24:24.023442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:18:43.121130+0000","last_clean_scrub_stamp":"2026-02-24T19:18:43.121130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:02:54.257449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,13],"acting":[9,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":15},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":21,"seq":90194313298,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33880,"kb_used_data":6920,"kb_used_omap":214,"kb_used_meta":26729,"kb_avail":94337960,"statfs":{"total":96636764160,"available":96602071040,"internally_reserved":0,"allocated":7086080,"data_stored":4366744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":219578,"internal_metadata":27371078},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33880,"kb_used_data":6920,"kb_used_omap":3017,"kb_used_meta":23926,"kb_avail":94337960,"statfs":{"total":96636764160,"available":96602071040,"internally_reserved":0,"allocated":7086080,"data_stored":4366744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3089424,"internal_metadata":24501232},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33880,"kb_used_data":6920,"kb_used_omap":213,"kb_used_meta":26730,"kb_avail":94337960,"statfs":{"total":96636764160,"available":96602071040,"internally_reserved":0,"allocated":7086080,"data_stored":4366744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":219129,"internal_metadata":27371527},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313297,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33884,"kb_used_data":6924,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94337956,"statfs":{"total":96636764160,"available":96602066944,"internally_reserved":0,"allocated":7090176,"data_stored":4366749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":214951,"internal_metadata":27375705},"hb_peers":[1,3,4,5,6,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313298,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33880,"kb_used_data":6920,"kb_used_omap":211,"kb_used_meta":26732,"kb_avail":94337960,"statfs":{"total":96636764160,"available":96602071040,"internally_reserved":0,"allocated":7086080,"data_stored":4366744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":216616,"internal_metadata":27374040},"hb_peers":[0,2,3,4,5,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313297,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51928,"kb_used_data":6920,"kb_used_omap":107,"kb_used_meta":44884,"kb_avail":94319912,"statfs":{"total":96636764160,"available":96583589888,"internally_reserved":0,"allocated":7086080,"data_stored":4366744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":110577,"internal_metadata":45961231},"hb_peers":[0,1,3,4,5,6,7,8,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313297,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33884,"kb_used_data":6924,"kb_used_omap":5823,"kb_used_meta":21120,"kb_avail":94337956,"statfs":{"total":96636764160,"available":96602066944,"internally_reserved":0,"allocated":7090176,"data_stored":4366763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5963562,"internal_metadata":21627094},"hb_peers":[0,2,4,5,6,7,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313297,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33880,"kb_used_data":6920,"kb_used_omap":98,"kb_used_meta":26845,"kb_avail":94337960,"statfs":{"total":96636764160,"available":96602071040,"internally_reserved":0,"allocated":7086080,"data_stored":4366744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":100579,"internal_metadata":27490077},"hb_peers":[0,1,2,3,5,6,7,8,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313298,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33880,"kb_used_data":6920,"kb_used_omap":212,"kb_used_meta":26731,"kb_avail":94337960,"statfs":{"total":96636764160,"available":96602071040,"internally_reserved":0,"allocated":7086080,"data_stored":4366744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":217465,"internal_metadata":27373191},"hb_peers":[0,1,2,4,6,7,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313297,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33880,"kb_used_data":6920,"kb_used_omap":8635,"kb_used_meta":18308,"kb_avail":94337960,"statfs":{"total":96636764160,"available":96602071040,"internally_reserved":0,"allocated":7086080,"data_stored":4366744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8842288,"internal_metadata":18748368},"hb_peers":[1,2,4,5,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313297,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33880,"kb_used_data":6920,"kb_used_omap":210,"kb_used_meta":26733,"kb_avail":94337960,"statfs":{"total":96636764160,"available":96602071040,"internally_reserved":0,"allocated":7086080,"data_stored":4366744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":215882,"internal_metadata":27374774},"hb_peers":[0,2,3,4,5,6,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33880,"kb_used_data":6920,"kb_used_omap":212,"kb_used_meta":26731,"kb_avail":94337960,"statfs":{"total":96636764160,"available":96602071040,"internally_reserved":0,"allocated":7086080,"data_stored":4366744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":217549,"internal_metadata":27373107},"hb_peers":[0,1,2,3,4,5,6,7,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33880,"kb_used_data":6920,"kb_used_omap":212,"kb_used_meta":26731,"kb_avail":94337960,"statfs":{"total":96636764160,"available":96602071040,"internally_reserved":0,"allocated":7086080,"data_stored":4366744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":217494,"internal_metadata":27373162},"hb_peers":[0,1,2,3,4,6,7,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34272,"kb_used_data":7312,"kb_used_omap":5830,"kb_used_meta":21113,"kb_avail":94337568,"statfs":{"total":96636764160,"available":96601669632,"internally_reserved":0,"allocated":7487488,"data_stored":4764584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5970303,"internal_metadata":21620353},"hb_peers":[0,1,3,4,5,6,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313298,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33888,"kb_used_data":6928,"kb_used_omap":213,"kb_used_meta":26730,"kb_avail":94337952,"statfs":{"total":96636764160,"available":96602062848,"internally_reserved":0,"allocated":7094272,"data_stored":4366768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":218291,"internal_metadata":27372365},"hb_peers":[0,1,2,3,4,5,6,7,8,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34272,"kb_used_data":7312,"kb_used_omap":186,"kb_used_meta":26757,"kb_avail":94337568,"statfs":{"total":96636764160,"available":96601669632,"internally_reserved":0,"allocated":7487488,"data_stored":4764584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":190680,"internal_metadata":27399976},"hb_peers":[0,1,3,4,5,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T19:24:33.706 INFO:tasks.ceph:pgid 9.17 last_scrub_stamp 2026-02-24T19:18:43.121130+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=43, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:33.706 INFO:tasks.ceph:pgid 9.16 last_scrub_stamp 2026-02-24T19:18:43.121130+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=43, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:33.706 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2026-02-24T19:18:43.121130+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=43, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:33.706 INFO:tasks.ceph:pgid 9.13 last_scrub_stamp 2026-02-24T19:18:43.121130+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=43, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:33.706 INFO:tasks.ceph:pgid 9.1c last_scrub_stamp 2026-02-24T19:18:43.121130+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=43, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:33.706 INFO:tasks.ceph:pgid 9.1e last_scrub_stamp 2026-02-24T19:18:43.121130+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=43, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:33.707 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-24T19:18:03.820909+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=3, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:33.707 INFO:tasks.ceph:pgid 9.d last_scrub_stamp 2026-02-24T19:18:43.121130+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=43, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:33.707 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-24T19:18:03.820909+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=3, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:33.707 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-24T19:18:03.820909+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=3, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:33.707 INFO:tasks.ceph:pgid 9.f last_scrub_stamp 2026-02-24T19:18:43.121130+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=43, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:33.707 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-24T19:18:03.820909+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=3, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:33.707 INFO:tasks.ceph:pgid 9.a last_scrub_stamp 2026-02-24T19:18:43.121130+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=43, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:33.707 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-24T19:18:03.820909+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=3, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:33.708 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-24T19:18:03.820909+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=3, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:33.708 INFO:tasks.ceph:pgid 9.3 last_scrub_stamp 2026-02-24T19:18:43.121130+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=43, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:33.708 INFO:tasks.ceph:pgid 9.0 last_scrub_stamp 2026-02-24T19:18:43.121130+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=43, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:33.708 INFO:tasks.ceph:pgid 9.6 last_scrub_stamp 2026-02-24T19:18:43.121130+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=43, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:33.708 INFO:tasks.ceph:pgid 9.7 last_scrub_stamp 2026-02-24T19:18:43.121130+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=43, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:33.708 INFO:tasks.ceph:pgid 9.4 last_scrub_stamp 2026-02-24T19:18:43.121130+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=43, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:33.708 INFO:tasks.ceph:pgid 9.5 last_scrub_stamp 2026-02-24T19:18:43.121130+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=43, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:33.708 INFO:tasks.ceph:pgid 9.1a last_scrub_stamp 2026-02-24T19:18:43.121130+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=43, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:33.709 INFO:tasks.ceph:pgid 9.19 last_scrub_stamp 2026-02-24T19:18:43.121130+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=18, tm_sec=43, tm_wday=1, tm_yday=55, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=24, tm_hour=19, tm_min=24, tm_sec=25, tm_wday=1, tm_yday=55, tm_isdst=0) 2026-02-24T19:24:33.709 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-24T19:24:46.857 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:07:44.831 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:46.858 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:07:44.833 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:46.868 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:07:44.842 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:46.883 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:07:44.819 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:46.884 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:07:44.855 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:46.885 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:07:44.821 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:46.885 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:07:44.856 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:46.894 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:07:44.830 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:46.895 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:07:44.866 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:24:53.709 DEBUG:teuthology.orchestra.run.trial026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-24T19:24:53.779 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.778+0000 7f4b268b1640 10 monclient: get_monmap_and_config 2026-02-24T19:24:53.780 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.778+0000 7f4b268b1640 10 monclient: build_initial_monmap 2026-02-24T19:24:53.780 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.778+0000 7f4b268b1640 10 monclient: monmap: 2026-02-24T19:24:53.780 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:53.780 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:53.780 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:53.779225+0000 2026-02-24T19:24:53.780 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:53.779225+0000 2026-02-24T19:24:53.780 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:53.780 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:53.780 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:53.780 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:53.781 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:53.781 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:53.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.778+0000 7f4b268b1640 1 Processor -- start 2026-02-24T19:24:53.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.778+0000 7f4b268b1640 1 -- start start 2026-02-24T19:24:53.782 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.778+0000 7f4b268b1640 10 monclient: init 2026-02-24T19:24:53.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.779+0000 7f4b268b1640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:53.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.779+0000 7f4b268b1640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-24T19:24:53.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.779+0000 7f4b268b1640 10 monclient(hunting): picked mon.noname-b con 0x7f4b20055bf0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:53.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.779+0000 7f4b268b1640 10 monclient(hunting): picked mon.noname-a con 0x7f4b20164040 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:53.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.779+0000 7f4b268b1640 10 monclient(hunting): picked mon.noname-c con 0x7f4b20055fc0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:53.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.779+0000 7f4b268b1640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b200b3a00 con 0x7f4b20164040 2026-02-24T19:24:53.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.779+0000 7f4b268b1640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b200b3c70 con 0x7f4b20055bf0 2026-02-24T19:24:53.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.779+0000 7f4b268b1640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b200b3f50 con 0x7f4b20055fc0 2026-02-24T19:24:53.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.779+0000 7f4b268b1640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:53.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.779+0000 7f4b268b1640 10 monclient(hunting): authenticate will time out at 4076.461487s 2026-02-24T19:24:53.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.779+0000 7f4b1f7fe640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f4b20164040 0x7f4b20056690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:52452/0 (socket says 10.20.193.26:52452) 2026-02-24T19:24:53.783 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.779+0000 7f4b1f7fe640 1 -- 10.20.193.26:0/3220997571 learned_addr learned my addr 10.20.193.26:0/3220997571 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:53.784 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.781+0000 7f4b1effd640 1 -- 10.20.193.26:0/3220997571 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3888012970 0 0) 0x7f4b200b3a00 con 0x7f4b20164040 2026-02-24T19:24:53.784 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.781+0000 7f4b1effd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:53.784 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.781+0000 7f4b1effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:53.784 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.781+0000 7f4b1effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:53.784 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.781+0000 7f4b1effd640 10 monclient(hunting): my global_id is 30822 2026-02-24T19:24:53.784 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.781+0000 7f4b1effd640 1 -- 10.20.193.26:0/3220997571 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b04003610 con 0x7f4b20164040 2026-02-24T19:24:53.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.781+0000 7f4b1effd640 1 -- 10.20.193.26:0/3220997571 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 719327671 0 0) 0x7f4b200b3f50 con 0x7f4b20055fc0 2026-02-24T19:24:53.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.781+0000 7f4b1effd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:53.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.781+0000 7f4b1effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:53.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.781+0000 7f4b1effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:53.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.781+0000 7f4b1effd640 10 monclient(hunting): my global_id is 30161 2026-02-24T19:24:53.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.781+0000 7f4b1effd640 1 -- 10.20.193.26:0/3220997571 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b200b3a00 con 0x7f4b20055fc0 2026-02-24T19:24:53.789 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.781+0000 7f4b1effd640 1 -- 10.20.193.26:0/3220997571 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3438356370 0 0) 0x7f4b200b3c70 con 0x7f4b20055bf0 2026-02-24T19:24:53.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.781+0000 7f4b1effd640 10 monclient(hunting): _negotiate 2026-02-24T19:24:53.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.781+0000 7f4b1effd640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:53.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.781+0000 7f4b1effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:53.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.781+0000 7f4b1effd640 10 monclient(hunting): my global_id is 28237 2026-02-24T19:24:53.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.781+0000 7f4b1effd640 1 -- 10.20.193.26:0/3220997571 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b200b3f50 con 0x7f4b20055bf0 2026-02-24T19:24:53.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.782+0000 7f4b1effd640 1 -- 10.20.193.26:0/3220997571 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1081205869 0 0) 0x7f4b04003610 con 0x7f4b20164040 2026-02-24T19:24:53.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.782+0000 7f4b1effd640 1 -- 10.20.193.26:0/3220997571 >> v1:10.20.193.103:6789/0 conn(0x7f4b20055fc0 legacy=0x7f4b200b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:53.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.782+0000 7f4b1effd640 1 -- 10.20.193.26:0/3220997571 >> v1:10.20.193.70:6789/0 conn(0x7f4b20055bf0 legacy=0x7f4b200b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:53.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.782+0000 7f4b1effd640 10 monclient: _finish_hunting 0 2026-02-24T19:24:53.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.782+0000 7f4b1effd640 1 monclient: found mon.noname-a 2026-02-24T19:24:53.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.782+0000 7f4b1effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:53.790 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.782+0000 7f4b1effd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.26:6789/0 2026-02-24T19:24:53.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.782+0000 7f4b1effd640 1 -- 10.20.193.26:0/3220997571 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b200b4230 con 0x7f4b20164040 2026-02-24T19:24:53.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.782+0000 7f4b1effd640 10 monclient: _finish_auth 0 2026-02-24T19:24:53.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.782+0000 7f4b1effd640 10 monclient: _check_auth_tickets 2026-02-24T19:24:53.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.782+0000 7f4b1effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:53.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.782+0000 7f4b1effd640 1 -- 10.20.193.26:0/3220997571 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f4b10002df0 con 0x7f4b20164040 2026-02-24T19:24:53.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.782+0000 7f4b1effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:53.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.782+0000 7f4b1effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:53.791 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.782+0000 7f4b1effd640 10 monclient: dump: 2026-02-24T19:24:53.791 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:53.791 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:53.791 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:53.791 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:53.791 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:53.792 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:53.792 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:53.792 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:53.792 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:53.792 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:53.792 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.782+0000 7f4b268b1640 5 monclient: authenticate success, global_id 30822 2026-02-24T19:24:53.792 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.782+0000 7f4b268b1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:53.792 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.783+0000 7f4b1effd640 1 -- 10.20.193.26:0/3220997571 <== mon.0 v1:10.20.193.26:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4b10002fc0 con 0x7f4b20164040 2026-02-24T19:24:53.792 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.783+0000 7f4b1effd640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:53.792 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.783+0000 7f4b1effd640 1 -- 10.20.193.26:0/3220997571 <== mon.0 v1:10.20.193.26:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f4b10003400 con 0x7f4b20164040 2026-02-24T19:24:53.792 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.783+0000 7f4b1effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:53.792 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.783+0000 7f4b1effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:53.793 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.783+0000 7f4b1effd640 10 monclient: dump: 2026-02-24T19:24:53.793 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:53.793 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:53.793 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:53.793 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:53.793 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:53.793 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:53.793 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:53.793 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:53.793 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:53.793 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:53.793 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.783+0000 7f4b268b1640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:53.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.783+0000 7f4b268b1640 4 set_mon_vals no callback set 2026-02-24T19:24:53.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.783+0000 7f4b268b1640 10 monclient: shutdown 2026-02-24T19:24:53.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.783+0000 7f4b268b1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:53.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.783+0000 7f4b268b1640 1 -- 10.20.193.26:0/3220997571 >> v1:10.20.193.26:6789/0 conn(0x7f4b20164040 legacy=0x7f4b20056690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:53.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.784+0000 7f4b268b1640 1 -- 10.20.193.26:0/3220997571 shutdown_connections 2026-02-24T19:24:53.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.784+0000 7f4b268b1640 1 -- 10.20.193.26:0/3220997571 >> 10.20.193.26:0/3220997571 conn(0x7f4b200b7bb0 msgr2=0x7f4b200b7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:53.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.784+0000 7f4b268b1640 1 -- 10.20.193.26:0/3220997571 shutdown_connections 2026-02-24T19:24:53.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.784+0000 7f4b268b1640 1 -- 10.20.193.26:0/3220997571 wait complete. 2026-02-24T19:24:53.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.784+0000 7f4b268b1640 10 monclient: build_initial_monmap 2026-02-24T19:24:53.794 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.784+0000 7f4b268b1640 10 monclient: monmap: 2026-02-24T19:24:53.794 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:53.794 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:53.794 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:53.795 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:53.795 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:53.795 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:53.795 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:53.795 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:53.795 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:53.795 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:53.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.784+0000 7f4b268b1640 1 librados: starting msgr at 2026-02-24T19:24:53.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.784+0000 7f4b268b1640 1 librados: starting objecter 2026-02-24T19:24:53.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.784+0000 7f4b268b1640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:53.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.784+0000 7f4b268b1640 1 Processor -- start 2026-02-24T19:24:53.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.784+0000 7f4b268b1640 1 -- start start 2026-02-24T19:24:53.795 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.784+0000 7f4b268b1640 1 librados: setting wanted keys 2026-02-24T19:24:53.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.784+0000 7f4b268b1640 1 librados: calling monclient init 2026-02-24T19:24:53.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.784+0000 7f4b268b1640 10 monclient: init 2026-02-24T19:24:53.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.785+0000 7f4b268b1640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:53.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.785+0000 7f4b268b1640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:24:53.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.785+0000 7f4b268b1640 10 monclient(hunting): picked mon.noname-c con 0x7f4b20055bf0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:53.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.785+0000 7f4b268b1640 10 monclient(hunting): picked mon.noname-a con 0x7f4b20055fc0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:53.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.785+0000 7f4b268b1640 10 monclient(hunting): picked mon.noname-b con 0x7f4b20164040 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:53.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.785+0000 7f4b268b1640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b20130570 con 0x7f4b20055fc0 2026-02-24T19:24:53.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.785+0000 7f4b268b1640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b20159070 con 0x7f4b20164040 2026-02-24T19:24:53.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.785+0000 7f4b268b1640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b20139c10 con 0x7f4b20055bf0 2026-02-24T19:24:53.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.785+0000 7f4b268b1640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:53.796 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.785+0000 7f4b268b1640 10 monclient(hunting): authenticate will time out at 4076.467237s 2026-02-24T19:24:53.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.785+0000 7f4b1f7fe640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f4b20055fc0 0x7f4b201602c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:52456/0 (socket says 10.20.193.26:52456) 2026-02-24T19:24:53.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.785+0000 7f4b1f7fe640 1 -- 10.20.193.26:0/243129232 learned_addr learned my addr 10.20.193.26:0/243129232 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:53.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.785+0000 7f4b1cff9640 10 client.?.objecter ms_handle_connect 0x7f4b20055fc0 2026-02-24T19:24:53.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.785+0000 7f4b1cff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:53.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.785+0000 7f4b1cff9640 10 client.?.objecter ms_handle_connect 0x7f4b20164040 2026-02-24T19:24:53.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.785+0000 7f4b1cff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:53.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.785+0000 7f4b1cff9640 10 client.?.objecter ms_handle_connect 0x7f4b20055bf0 2026-02-24T19:24:53.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.785+0000 7f4b1cff9640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:53.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.786+0000 7f4b1cff9640 1 -- 10.20.193.26:0/243129232 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1718660502 0 0) 0x7f4b20130570 con 0x7f4b20055fc0 2026-02-24T19:24:53.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.786+0000 7f4b1cff9640 10 monclient(hunting): _negotiate 2026-02-24T19:24:53.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.786+0000 7f4b1cff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:53.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.786+0000 7f4b1cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:53.797 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.786+0000 7f4b1cff9640 10 monclient(hunting): my global_id is 30825 2026-02-24T19:24:53.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.786+0000 7f4b1cff9640 1 -- 10.20.193.26:0/243129232 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4af0003610 con 0x7f4b20055fc0 2026-02-24T19:24:53.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.786+0000 7f4b1cff9640 1 -- 10.20.193.26:0/243129232 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1220830242 0 0) 0x7f4b20139c10 con 0x7f4b20055bf0 2026-02-24T19:24:53.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.786+0000 7f4b1cff9640 10 monclient(hunting): _negotiate 2026-02-24T19:24:53.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.786+0000 7f4b1cff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:53.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.786+0000 7f4b1cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:53.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.786+0000 7f4b1cff9640 10 monclient(hunting): my global_id is 30164 2026-02-24T19:24:53.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.786+0000 7f4b1cff9640 1 -- 10.20.193.26:0/243129232 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b20130570 con 0x7f4b20055bf0 2026-02-24T19:24:53.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.787+0000 7f4b1cff9640 1 -- 10.20.193.26:0/243129232 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1311014689 0 0) 0x7f4b20159070 con 0x7f4b20164040 2026-02-24T19:24:53.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.787+0000 7f4b1cff9640 10 monclient(hunting): _negotiate 2026-02-24T19:24:53.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.787+0000 7f4b1cff9640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:53.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.787+0000 7f4b1cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:53.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.787+0000 7f4b1cff9640 10 monclient(hunting): my global_id is 28240 2026-02-24T19:24:53.798 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.787+0000 7f4b1cff9640 1 -- 10.20.193.26:0/243129232 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b20139c10 con 0x7f4b20164040 2026-02-24T19:24:53.801 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.788+0000 7f4b1cff9640 1 -- 10.20.193.26:0/243129232 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3897423540 0 0) 0x7f4af0003610 con 0x7f4b20055fc0 2026-02-24T19:24:53.801 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.788+0000 7f4b1cff9640 1 -- 10.20.193.26:0/243129232 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4b20159070 con 0x7f4b20055fc0 2026-02-24T19:24:53.801 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.788+0000 7f4b1cff9640 1 -- 10.20.193.26:0/243129232 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f4b10003310 con 0x7f4b20055fc0 2026-02-24T19:24:53.801 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.788+0000 7f4b1cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:53.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.788+0000 7f4b1cff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:53.802 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.788+0000 7f4b1cff9640 10 monclient(hunting): dump: 2026-02-24T19:24:53.802 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:53.802 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:53.802 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:53.802 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:53.802 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:53.802 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:53.802 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:53.802 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:53.802 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:53.802 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:53.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.788+0000 7f4b1cff9640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:53.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.789+0000 7f4b1cff9640 1 -- 10.20.193.26:0/243129232 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2750244045 0 0) 0x7f4b20130570 con 0x7f4b20055bf0 2026-02-24T19:24:53.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.789+0000 7f4b1cff9640 1 -- 10.20.193.26:0/243129232 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4af0003610 con 0x7f4b20055bf0 2026-02-24T19:24:53.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.789+0000 7f4b1cff9640 1 -- 10.20.193.26:0/243129232 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f4b0c003060 con 0x7f4b20055bf0 2026-02-24T19:24:53.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.789+0000 7f4b1cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:53.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.789+0000 7f4b1cff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:53.803 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.789+0000 7f4b1cff9640 10 monclient(hunting): dump: 2026-02-24T19:24:53.803 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:53.803 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:53.803 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:53.803 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:53.803 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:53.803 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:53.804 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:53.804 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:53.804 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:53.804 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:53.804 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.789+0000 7f4b1cff9640 1 -- 10.20.193.26:0/243129232 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2825654752 0 0) 0x7f4b20139c10 con 0x7f4b20164040 2026-02-24T19:24:53.804 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.789+0000 7f4b1cff9640 1 -- 10.20.193.26:0/243129232 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4b20130570 con 0x7f4b20164040 2026-02-24T19:24:53.804 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.789+0000 7f4b1cff9640 1 -- 10.20.193.26:0/243129232 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f4b14003430 con 0x7f4b20164040 2026-02-24T19:24:53.804 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.789+0000 7f4b1cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:53.804 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.789+0000 7f4b1cff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:53.804 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.789+0000 7f4b1cff9640 10 monclient(hunting): dump: 2026-02-24T19:24:53.804 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:53.804 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:53.805 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:53.805 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:53.805 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:53.805 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:53.805 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:53.805 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:53.805 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:53.805 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:53.805 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.790+0000 7f4b1cff9640 1 -- 10.20.193.26:0/243129232 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1121293237 0 0) 0x7f4b20159070 con 0x7f4b20055fc0 2026-02-24T19:24:53.805 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.790+0000 7f4b1cff9640 1 -- 10.20.193.26:0/243129232 >> v1:10.20.193.103:6789/0 conn(0x7f4b20055bf0 legacy=0x7f4b2012fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:53.805 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.790+0000 7f4b1cff9640 1 -- 10.20.193.26:0/243129232 >> v1:10.20.193.70:6789/0 conn(0x7f4b20164040 legacy=0x7f4b20157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:53.805 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.790+0000 7f4b1cff9640 10 monclient: _finish_hunting 0 2026-02-24T19:24:53.805 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.790+0000 7f4b1cff9640 1 monclient: found mon.a 2026-02-24T19:24:53.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.790+0000 7f4b1cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:53.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.790+0000 7f4b1cff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:53.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.790+0000 7f4b1cff9640 1 -- 10.20.193.26:0/243129232 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b20139ef0 con 0x7f4b20055fc0 2026-02-24T19:24:53.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.790+0000 7f4b1cff9640 10 monclient: _finish_auth 0 2026-02-24T19:24:53.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.790+0000 7f4b1cff9640 10 monclient: _check_auth_tickets 2026-02-24T19:24:53.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.790+0000 7f4b1cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:53.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.790+0000 7f4b268b1640 5 monclient: authenticate success, global_id 30825 2026-02-24T19:24:53.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.790+0000 7f4b268b1640 10 monclient: _renew_subs 2026-02-24T19:24:53.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.790+0000 7f4b268b1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:53.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.790+0000 7f4b268b1640 1 -- 10.20.193.26:0/243129232 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4b2013a1d0 con 0x7f4b20055fc0 2026-02-24T19:24:53.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.790+0000 7f4b268b1640 10 client.30825.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:53.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.790+0000 7f4b268b1640 10 monclient: _renew_subs 2026-02-24T19:24:53.806 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.790+0000 7f4b268b1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:53.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.790+0000 7f4b268b1640 1 -- 10.20.193.26:0/243129232 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4b20157960 con 0x7f4b20055fc0 2026-02-24T19:24:53.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.790+0000 7f4b268b1640 1 librados: init done 2026-02-24T19:24:53.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.791+0000 7f4b268b1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:53.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.791+0000 7f4b268b1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:53.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.791+0000 7f4b268b1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:53.807 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.791+0000 7f4b268b1640 1 -- 10.20.193.26:0/243129232 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b200b2d40 con 0x7f4b20055fc0 2026-02-24T19:24:53.882 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.881+0000 7f4b1cff9640 1 -- 10.20.193.26:0/243129232 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4b10002970 con 0x7f4b20055fc0 2026-02-24T19:24:53.883 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.881+0000 7f4b1cff9640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:53.883 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.881+0000 7f4b1cff9640 1 -- 10.20.193.26:0/243129232 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f4b10004b80 con 0x7f4b20055fc0 2026-02-24T19:24:53.883 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.881+0000 7f4b1cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:53.883 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.881+0000 7f4b1cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:53.883 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.881+0000 7f4b1e7fc640 4 set_mon_vals no callback set 2026-02-24T19:24:53.883 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.881+0000 7f4b1cff9640 10 monclient: dump: 2026-02-24T19:24:53.883 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:53.883 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:53.883 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:53.883 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:53.883 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:53.884 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:53.884 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:53.884 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:53.884 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:53.884 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:53.884 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.881+0000 7f4b1cff9640 1 -- 10.20.193.26:0/243129232 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f4b1001d9f0 con 0x7f4b20055fc0 2026-02-24T19:24:53.885 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.882+0000 7f4b1ffff640 10 monclient: get_auth_request con 0x7f4af0077e20 auth_method 0 2026-02-24T19:24:53.885 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.882+0000 7f4b1cff9640 10 client.30825.objecter ms_handle_connect 0x7f4af0077e20 2026-02-24T19:24:53.886 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.884+0000 7f4b1cff9640 1 -- 10.20.193.26:0/243129232 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7f4b100930c0 con 0x7f4b20055fc0 2026-02-24T19:24:53.886 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.884+0000 7f4b1cff9640 10 client.30825.objecter ms_dispatch2 0x7f4b20000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:53.886 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.884+0000 7f4b1cff9640 3 client.30825.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:53.886 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.884+0000 7f4b1cff9640 3 client.30825.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:53.886 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.884+0000 7f4b1cff9640 20 client.30825.objecter dump_active .. 0 homeless 2026-02-24T19:24:53.886 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.884+0000 7f4b1cff9640 1 -- 10.20.193.26:0/243129232 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f4b1005daf0 con 0x7f4b20055fc0 2026-02-24T19:24:53.886 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.884+0000 7f4b1cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:53.886 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.884+0000 7f4b1cff9640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:53.988 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.987+0000 7f4b268b1640 1 -- 10.20.193.26:0/243129232 --> v1:10.20.193.162:6800/3889602630 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4b201399c0 con 0x7f4af0077e20 2026-02-24T19:24:53.990 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.988+0000 7f4b1cff9640 1 -- 10.20.193.26:0/243129232 <== mgr.4107 v1:10.20.193.162:6800/3889602630 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125000 (unknown 2965378022 0 1112768640) 0x7f4b201399c0 con 0x7f4af0077e20 2026-02-24T19:24:53.991 INFO:teuthology.orchestra.run.trial026.stdout: 2026-02-24T19:24:53.992 INFO:teuthology.orchestra.run.trial026.stderr:dumped all 2026-02-24T19:24:53.993 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.990+0000 7f4b268b1640 10 librados: watch_flush enter 2026-02-24T19:24:53.993 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.990+0000 7f4b268b1640 10 librados: watch_flush exit 2026-02-24T19:24:53.993 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.990+0000 7f4b268b1640 20 client.30825.objecter shutdown clearing up homeless session... 2026-02-24T19:24:53.994 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.990+0000 7f4b268b1640 10 client.30825.objecter successfully canceled tick 2026-02-24T19:24:53.994 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.990+0000 7f4b268b1640 1 -- 10.20.193.26:0/243129232 >> v1:10.20.193.162:6800/3889602630 conn(0x7f4af0077e20 legacy=0x7f4af00982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:53.994 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.990+0000 7f4b268b1640 10 monclient: shutdown 2026-02-24T19:24:53.994 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.990+0000 7f4b268b1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:53.994 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.990+0000 7f4b268b1640 1 -- 10.20.193.26:0/243129232 >> v1:10.20.193.26:6789/0 conn(0x7f4b20055fc0 legacy=0x7f4b201602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:53.994 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.990+0000 7f4b268b1640 1 -- 10.20.193.26:0/243129232 shutdown_connections 2026-02-24T19:24:53.994 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.990+0000 7f4b268b1640 1 -- 10.20.193.26:0/243129232 >> 10.20.193.26:0/243129232 conn(0x7f4b200b7bb0 msgr2=0x7f4b20131510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:53.994 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.990+0000 7f4b268b1640 1 -- 10.20.193.26:0/243129232 shutdown_connections 2026-02-24T19:24:53.994 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.990+0000 7f4b268b1640 1 -- 10.20.193.26:0/243129232 wait complete. 2026-02-24T19:24:53.994 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:53.990+0000 7f4b268b1640 1 librados: shutdown 2026-02-24T19:24:54.000 INFO:teuthology.orchestra.run.trial026.stdout:{"pg_ready":true,"pg_map":{"version":558,"stamp":"2026-02-24T19:24:52.673581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":560928,"kb_used_data":111520,"kb_used_omap":25609,"kb_used_meta":423542,"kb_avail":1509388512,"statfs":{"total":1546188226560,"available":1545613836288,"internally_reserved":0,"allocated":114196480,"data_stored":70663632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26224368,"internal_metadata":433707280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001821"},"pg_stats":[{"pgid":"9.15","version":"0'0","reported_seq":644,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:30.294147+0000","last_change":"2026-02-24T19:24:30.294147+0000","last_active":"2026-02-24T19:24:30.294147+0000","last_peered":"2026-02-24T19:24:30.294147+0000","last_clean":"2026-02-24T19:24:30.294147+0000","last_became_active":"2026-02-24T19:18:45.991617+0000","last_became_peered":"2026-02-24T19:18:45.991617+0000","last_unstale":"2026-02-24T19:24:30.294147+0000","last_undegraded":"2026-02-24T19:24:30.294147+0000","last_fullsized":"2026-02-24T19:24:30.294147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:30.292429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:30.292429+0000","last_clean_scrub_stamp":"2026-02-24T19:24:30.292429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:47:07.528096+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,7],"acting":[13,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":645,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:30.874684+0000","last_change":"2026-02-24T19:24:30.874684+0000","last_active":"2026-02-24T19:24:30.874684+0000","last_peered":"2026-02-24T19:24:30.874684+0000","last_clean":"2026-02-24T19:24:30.874684+0000","last_became_active":"2026-02-24T19:18:45.681436+0000","last_became_peered":"2026-02-24T19:18:45.681436+0000","last_unstale":"2026-02-24T19:24:30.874684+0000","last_undegraded":"2026-02-24T19:24:30.874684+0000","last_fullsized":"2026-02-24T19:24:30.874684+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:30.873912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:30.873912+0000","last_clean_scrub_stamp":"2026-02-24T19:24:30.873912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T20:52:42.711999+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":646,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:35.523326+0000","last_change":"2026-02-24T19:24:35.523326+0000","last_active":"2026-02-24T19:24:35.523326+0000","last_peered":"2026-02-24T19:24:35.523326+0000","last_clean":"2026-02-24T19:24:35.523326+0000","last_became_active":"2026-02-24T19:18:46.867835+0000","last_became_peered":"2026-02-24T19:18:46.867835+0000","last_unstale":"2026-02-24T19:24:35.523326+0000","last_undegraded":"2026-02-24T19:24:35.523326+0000","last_fullsized":"2026-02-24T19:24:35.523326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:35.522514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:35.522514+0000","last_clean_scrub_stamp":"2026-02-24T19:24:35.522514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:37:14.198916+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10],"acting":[11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":641,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:36.695153+0000","last_change":"2026-02-24T19:24:36.695153+0000","last_active":"2026-02-24T19:24:36.695153+0000","last_peered":"2026-02-24T19:24:36.695153+0000","last_clean":"2026-02-24T19:24:36.695153+0000","last_became_active":"2026-02-24T19:18:46.452160+0000","last_became_peered":"2026-02-24T19:18:46.452160+0000","last_unstale":"2026-02-24T19:24:36.695153+0000","last_undegraded":"2026-02-24T19:24:36.695153+0000","last_fullsized":"2026-02-24T19:24:36.695153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:36.694412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:36.694412+0000","last_clean_scrub_stamp":"2026-02-24T19:24:36.694412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:44:04.683393+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":645,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:35.400851+0000","last_change":"2026-02-24T19:24:35.400851+0000","last_active":"2026-02-24T19:24:35.400851+0000","last_peered":"2026-02-24T19:24:35.400851+0000","last_clean":"2026-02-24T19:24:35.400851+0000","last_became_active":"2026-02-24T19:18:46.482414+0000","last_became_peered":"2026-02-24T19:18:46.482414+0000","last_unstale":"2026-02-24T19:24:35.400851+0000","last_undegraded":"2026-02-24T19:24:35.400851+0000","last_fullsized":"2026-02-24T19:24:35.400851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:35.399796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:35.399796+0000","last_clean_scrub_stamp":"2026-02-24T19:24:35.399796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:32:59.036838+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,13],"acting":[14,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":641,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:27.847703+0000","last_change":"2026-02-24T19:24:27.847703+0000","last_active":"2026-02-24T19:24:27.847703+0000","last_peered":"2026-02-24T19:24:27.847703+0000","last_clean":"2026-02-24T19:24:27.847703+0000","last_became_active":"2026-02-24T19:18:45.877648+0000","last_became_peered":"2026-02-24T19:18:45.877648+0000","last_unstale":"2026-02-24T19:24:27.847703+0000","last_undegraded":"2026-02-24T19:24:27.847703+0000","last_fullsized":"2026-02-24T19:24:27.847703+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:27.842564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:27.842564+0000","last_clean_scrub_stamp":"2026-02-24T19:24:27.842564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:35:59.883652+0000","scrub_duration":125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":646,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:34.509920+0000","last_change":"2026-02-24T19:24:34.509920+0000","last_active":"2026-02-24T19:24:34.509920+0000","last_peered":"2026-02-24T19:24:34.509920+0000","last_clean":"2026-02-24T19:24:34.509920+0000","last_became_active":"2026-02-24T19:18:45.537014+0000","last_became_peered":"2026-02-24T19:18:45.537014+0000","last_unstale":"2026-02-24T19:24:34.509920+0000","last_undegraded":"2026-02-24T19:24:34.509920+0000","last_fullsized":"2026-02-24T19:24:34.509920+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:34.508211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:34.508211+0000","last_clean_scrub_stamp":"2026-02-24T19:24:34.508211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:47:54.571856+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3],"acting":[11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":645,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:29.571471+0000","last_change":"2026-02-24T19:24:29.571471+0000","last_active":"2026-02-24T19:24:29.571471+0000","last_peered":"2026-02-24T19:24:29.571471+0000","last_clean":"2026-02-24T19:24:29.571471+0000","last_became_active":"2026-02-24T19:18:46.435006+0000","last_became_peered":"2026-02-24T19:18:46.435006+0000","last_unstale":"2026-02-24T19:24:29.571471+0000","last_undegraded":"2026-02-24T19:24:29.571471+0000","last_fullsized":"2026-02-24T19:24:29.571471+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:29.569563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:29.569563+0000","last_clean_scrub_stamp":"2026-02-24T19:24:29.569563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:19:56.324872+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,0],"acting":[12,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":642,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:28.746174+0000","last_change":"2026-02-24T19:24:28.746174+0000","last_active":"2026-02-24T19:24:28.746174+0000","last_peered":"2026-02-24T19:24:28.746174+0000","last_clean":"2026-02-24T19:24:28.746174+0000","last_became_active":"2026-02-24T19:18:47.212334+0000","last_became_peered":"2026-02-24T19:18:47.212334+0000","last_unstale":"2026-02-24T19:24:28.746174+0000","last_undegraded":"2026-02-24T19:24:28.746174+0000","last_fullsized":"2026-02-24T19:24:28.746174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:28.744363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:28.744363+0000","last_clean_scrub_stamp":"2026-02-24T19:24:28.744363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:31:54.898775+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":644,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:32.563453+0000","last_change":"2026-02-24T19:24:32.563453+0000","last_active":"2026-02-24T19:24:32.563453+0000","last_peered":"2026-02-24T19:24:32.563453+0000","last_clean":"2026-02-24T19:24:32.563453+0000","last_became_active":"2026-02-24T19:18:45.702531+0000","last_became_peered":"2026-02-24T19:18:45.702531+0000","last_unstale":"2026-02-24T19:24:32.563453+0000","last_undegraded":"2026-02-24T19:24:32.563453+0000","last_fullsized":"2026-02-24T19:24:32.563453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:32.561653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:32.561653+0000","last_clean_scrub_stamp":"2026-02-24T19:24:32.561653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:33:23.050491+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,0],"acting":[10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":642,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:31.247645+0000","last_change":"2026-02-24T19:24:31.247645+0000","last_active":"2026-02-24T19:24:31.247645+0000","last_peered":"2026-02-24T19:24:31.247645+0000","last_clean":"2026-02-24T19:24:31.247645+0000","last_became_active":"2026-02-24T19:18:45.245053+0000","last_became_peered":"2026-02-24T19:18:45.245053+0000","last_unstale":"2026-02-24T19:24:31.247645+0000","last_undegraded":"2026-02-24T19:24:31.247645+0000","last_fullsized":"2026-02-24T19:24:31.247645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:31.242987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:31.242987+0000","last_clean_scrub_stamp":"2026-02-24T19:24:31.242987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:48:31.854018+0000","scrub_duration":88,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":647,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:36.497454+0000","last_change":"2026-02-24T19:24:36.496669+0000","last_active":"2026-02-24T19:24:36.497454+0000","last_peered":"2026-02-24T19:24:36.497454+0000","last_clean":"2026-02-24T19:24:36.497454+0000","last_became_active":"2026-02-24T19:18:45.468683+0000","last_became_peered":"2026-02-24T19:18:45.468683+0000","last_unstale":"2026-02-24T19:24:36.497454+0000","last_undegraded":"2026-02-24T19:24:36.497454+0000","last_fullsized":"2026-02-24T19:24:36.497454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:36.495187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:36.495187+0000","last_clean_scrub_stamp":"2026-02-24T19:24:36.495187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:17:13.692697+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":645,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:30.190257+0000","last_change":"2026-02-24T19:24:30.190257+0000","last_active":"2026-02-24T19:24:30.190257+0000","last_peered":"2026-02-24T19:24:30.190257+0000","last_clean":"2026-02-24T19:24:30.190257+0000","last_became_active":"2026-02-24T19:18:45.260524+0000","last_became_peered":"2026-02-24T19:18:45.260524+0000","last_unstale":"2026-02-24T19:24:30.190257+0000","last_undegraded":"2026-02-24T19:24:30.190257+0000","last_fullsized":"2026-02-24T19:24:30.190257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:30.188746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:30.188746+0000","last_clean_scrub_stamp":"2026-02-24T19:24:30.188746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:24:29.478695+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8],"acting":[5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":658,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:35.655847+0000","last_change":"2026-02-24T19:24:35.655215+0000","last_active":"2026-02-24T19:24:35.655847+0000","last_peered":"2026-02-24T19:24:35.655847+0000","last_clean":"2026-02-24T19:24:35.655847+0000","last_became_active":"2026-02-24T19:18:06.131387+0000","last_became_peered":"2026-02-24T19:18:06.131387+0000","last_unstale":"2026-02-24T19:24:35.655847+0000","last_undegraded":"2026-02-24T19:24:35.655847+0000","last_fullsized":"2026-02-24T19:24:35.655847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:35.653407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:35.653407+0000","last_clean_scrub_stamp":"2026-02-24T19:24:35.653407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:46:16.708637+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0.060150395000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":643,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:32.517441+0000","last_change":"2026-02-24T19:24:32.517441+0000","last_active":"2026-02-24T19:24:32.517441+0000","last_peered":"2026-02-24T19:24:32.517441+0000","last_clean":"2026-02-24T19:24:32.517441+0000","last_became_active":"2026-02-24T19:18:46.019677+0000","last_became_peered":"2026-02-24T19:18:46.019677+0000","last_unstale":"2026-02-24T19:24:32.517441+0000","last_undegraded":"2026-02-24T19:24:32.517441+0000","last_fullsized":"2026-02-24T19:24:32.517441+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:32.515879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:32.515879+0000","last_clean_scrub_stamp":"2026-02-24T19:24:32.515879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:48:05.427263+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,13],"acting":[6,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":663,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:33.558263+0000","last_change":"2026-02-24T19:24:33.557604+0000","last_active":"2026-02-24T19:24:33.558263+0000","last_peered":"2026-02-24T19:24:33.558263+0000","last_clean":"2026-02-24T19:24:33.558263+0000","last_became_active":"2026-02-24T19:18:05.714006+0000","last_became_peered":"2026-02-24T19:18:05.714006+0000","last_unstale":"2026-02-24T19:24:33.558263+0000","last_undegraded":"2026-02-24T19:24:33.558263+0000","last_fullsized":"2026-02-24T19:24:33.558263+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:33.556773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:33.556773+0000","last_clean_scrub_stamp":"2026-02-24T19:24:33.556773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:49:13.620886+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0.030292255000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,10],"acting":[15,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":644,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:31.551373+0000","last_change":"2026-02-24T19:24:31.551373+0000","last_active":"2026-02-24T19:24:31.551373+0000","last_peered":"2026-02-24T19:24:31.551373+0000","last_clean":"2026-02-24T19:24:31.551373+0000","last_became_active":"2026-02-24T19:18:46.049357+0000","last_became_peered":"2026-02-24T19:18:46.049357+0000","last_unstale":"2026-02-24T19:24:31.551373+0000","last_undegraded":"2026-02-24T19:24:31.551373+0000","last_fullsized":"2026-02-24T19:24:31.551373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:31.549495+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:31.549495+0000","last_clean_scrub_stamp":"2026-02-24T19:24:31.549495+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:38:15.774759+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,7],"acting":[10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":663,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:31.839411+0000","last_change":"2026-02-24T19:24:31.839411+0000","last_active":"2026-02-24T19:24:31.839411+0000","last_peered":"2026-02-24T19:24:31.839411+0000","last_clean":"2026-02-24T19:24:31.839411+0000","last_became_active":"2026-02-24T19:18:06.025485+0000","last_became_peered":"2026-02-24T19:18:06.025485+0000","last_unstale":"2026-02-24T19:24:31.839411+0000","last_undegraded":"2026-02-24T19:24:31.839411+0000","last_fullsized":"2026-02-24T19:24:31.839411+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:31.837723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:31.837723+0000","last_clean_scrub_stamp":"2026-02-24T19:24:31.837723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:12:22.128669+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0.040704530000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":643,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:33.503718+0000","last_change":"2026-02-24T19:24:33.503718+0000","last_active":"2026-02-24T19:24:33.503718+0000","last_peered":"2026-02-24T19:24:33.503718+0000","last_clean":"2026-02-24T19:24:33.503718+0000","last_became_active":"2026-02-24T19:18:45.739451+0000","last_became_peered":"2026-02-24T19:18:45.739451+0000","last_unstale":"2026-02-24T19:24:33.503718+0000","last_undegraded":"2026-02-24T19:24:33.503718+0000","last_fullsized":"2026-02-24T19:24:33.503718+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:33.502188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:33.502188+0000","last_clean_scrub_stamp":"2026-02-24T19:24:33.502188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:54:44.771720+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":663,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:29.996846+0000","last_change":"2026-02-24T19:24:29.996846+0000","last_active":"2026-02-24T19:24:29.996846+0000","last_peered":"2026-02-24T19:24:29.996846+0000","last_clean":"2026-02-24T19:24:29.996846+0000","last_became_active":"2026-02-24T19:18:05.911513+0000","last_became_peered":"2026-02-24T19:18:05.911513+0000","last_unstale":"2026-02-24T19:24:29.996846+0000","last_undegraded":"2026-02-24T19:24:29.996846+0000","last_fullsized":"2026-02-24T19:24:29.996846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:29.991903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:29.991903+0000","last_clean_scrub_stamp":"2026-02-24T19:24:29.991903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:40:23.274739+0000","scrub_duration":93,"objects_trimmed":0,"snaptrim_duration":0.027602962000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0],"acting":[9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":643,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:29.301241+0000","last_change":"2026-02-24T19:24:29.301241+0000","last_active":"2026-02-24T19:24:29.301241+0000","last_peered":"2026-02-24T19:24:29.301241+0000","last_clean":"2026-02-24T19:24:29.301241+0000","last_became_active":"2026-02-24T19:18:45.316395+0000","last_became_peered":"2026-02-24T19:18:45.316395+0000","last_unstale":"2026-02-24T19:24:29.301241+0000","last_undegraded":"2026-02-24T19:24:29.301241+0000","last_fullsized":"2026-02-24T19:24:29.301241+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:29.299830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:29.299830+0000","last_clean_scrub_stamp":"2026-02-24T19:24:29.299830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:33:23.438837+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1],"acting":[8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.2","version":"346'3","reported_seq":661,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:32.708334+0000","last_change":"2026-02-24T19:24:32.708334+0000","last_active":"2026-02-24T19:24:32.708334+0000","last_peered":"2026-02-24T19:24:32.708334+0000","last_clean":"2026-02-24T19:24:32.708334+0000","last_became_active":"2026-02-24T19:18:06.102285+0000","last_became_peered":"2026-02-24T19:18:06.102285+0000","last_unstale":"2026-02-24T19:24:32.708334+0000","last_undegraded":"2026-02-24T19:24:32.708334+0000","last_fullsized":"2026-02-24T19:24:32.708334+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"346'3","last_scrub_stamp":"2026-02-24T19:24:32.703570+0000","last_deep_scrub":"346'3","last_deep_scrub_stamp":"2026-02-24T19:24:32.703570+0000","last_clean_scrub_stamp":"2026-02-24T19:24:32.703570+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T02:20:57.915737+0000","scrub_duration":158,"objects_trimmed":0,"snaptrim_duration":0.071463911000000005,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":640,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:34.618381+0000","last_change":"2026-02-24T19:24:34.618381+0000","last_active":"2026-02-24T19:24:34.618381+0000","last_peered":"2026-02-24T19:24:34.618381+0000","last_clean":"2026-02-24T19:24:34.618381+0000","last_became_active":"2026-02-24T19:18:46.224954+0000","last_became_peered":"2026-02-24T19:18:46.224954+0000","last_unstale":"2026-02-24T19:24:34.618381+0000","last_undegraded":"2026-02-24T19:24:34.618381+0000","last_fullsized":"2026-02-24T19:24:34.618381+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:34.616997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:34.616997+0000","last_clean_scrub_stamp":"2026-02-24T19:24:34.616997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:40:30.848946+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":661,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:28.382011+0000","last_change":"2026-02-24T19:24:28.382011+0000","last_active":"2026-02-24T19:24:28.382011+0000","last_peered":"2026-02-24T19:24:28.382011+0000","last_clean":"2026-02-24T19:24:28.382011+0000","last_became_active":"2026-02-24T19:18:06.040390+0000","last_became_peered":"2026-02-24T19:18:06.040390+0000","last_unstale":"2026-02-24T19:24:28.382011+0000","last_undegraded":"2026-02-24T19:24:28.382011+0000","last_fullsized":"2026-02-24T19:24:28.382011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:28.378075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:28.378075+0000","last_clean_scrub_stamp":"2026-02-24T19:24:28.378075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:18:04.248400+0000","scrub_duration":106,"objects_trimmed":0,"snaptrim_duration":0.035880255999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4],"acting":[8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":642,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:29.759006+0000","last_change":"2026-02-24T19:24:29.759006+0000","last_active":"2026-02-24T19:24:29.759006+0000","last_peered":"2026-02-24T19:24:29.759006+0000","last_clean":"2026-02-24T19:24:29.759006+0000","last_became_active":"2026-02-24T19:18:45.633612+0000","last_became_peered":"2026-02-24T19:18:45.633612+0000","last_unstale":"2026-02-24T19:24:29.759006+0000","last_undegraded":"2026-02-24T19:24:29.759006+0000","last_fullsized":"2026-02-24T19:24:29.759006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:29.757449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:29.757449+0000","last_clean_scrub_stamp":"2026-02-24T19:24:29.757449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:19:53.458829+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":661,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:31.491541+0000","last_change":"2026-02-24T19:24:31.491541+0000","last_active":"2026-02-24T19:24:31.491541+0000","last_peered":"2026-02-24T19:24:31.491541+0000","last_clean":"2026-02-24T19:24:31.491541+0000","last_became_active":"2026-02-24T19:18:05.913043+0000","last_became_peered":"2026-02-24T19:18:05.913043+0000","last_unstale":"2026-02-24T19:24:31.491541+0000","last_undegraded":"2026-02-24T19:24:31.491541+0000","last_fullsized":"2026-02-24T19:24:31.491541+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:31.489635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:31.489635+0000","last_clean_scrub_stamp":"2026-02-24T19:24:31.489635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:54:51.259769+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0.030508101999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":642,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:29.618678+0000","last_change":"2026-02-24T19:24:29.618678+0000","last_active":"2026-02-24T19:24:29.618678+0000","last_peered":"2026-02-24T19:24:29.618678+0000","last_clean":"2026-02-24T19:24:29.618678+0000","last_became_active":"2026-02-24T19:18:46.150051+0000","last_became_peered":"2026-02-24T19:18:46.150051+0000","last_unstale":"2026-02-24T19:24:29.618678+0000","last_undegraded":"2026-02-24T19:24:29.618678+0000","last_fullsized":"2026-02-24T19:24:29.618678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:29.616807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:29.616807+0000","last_clean_scrub_stamp":"2026-02-24T19:24:29.616807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:36:28.276907+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"346'2","reported_seq":660,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:33.608044+0000","last_change":"2026-02-24T19:24:33.608044+0000","last_active":"2026-02-24T19:24:33.608044+0000","last_peered":"2026-02-24T19:24:33.608044+0000","last_clean":"2026-02-24T19:24:33.608044+0000","last_became_active":"2026-02-24T19:18:05.910166+0000","last_became_peered":"2026-02-24T19:18:05.910166+0000","last_unstale":"2026-02-24T19:24:33.608044+0000","last_undegraded":"2026-02-24T19:24:33.608044+0000","last_fullsized":"2026-02-24T19:24:33.608044+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"346'2","last_scrub_stamp":"2026-02-24T19:24:33.606478+0000","last_deep_scrub":"346'2","last_deep_scrub_stamp":"2026-02-24T19:24:33.606478+0000","last_clean_scrub_stamp":"2026-02-24T19:24:33.606478+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T05:04:38.211597+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0.036726662,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"346'34","reported_seq":710,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:28.808516+0000","last_change":"2026-02-24T19:24:28.808516+0000","last_active":"2026-02-24T19:24:28.808516+0000","last_peered":"2026-02-24T19:24:28.808516+0000","last_clean":"2026-02-24T19:24:28.808516+0000","last_became_active":"2026-02-24T19:17:58.584752+0000","last_became_peered":"2026-02-24T19:17:58.584752+0000","last_unstale":"2026-02-24T19:24:28.808516+0000","last_undegraded":"2026-02-24T19:24:28.808516+0000","last_fullsized":"2026-02-24T19:24:28.808516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"346'34","last_scrub_stamp":"2026-02-24T19:24:28.803437+0000","last_deep_scrub":"346'34","last_deep_scrub_stamp":"2026-02-24T19:24:28.803437+0000","last_clean_scrub_stamp":"2026-02-24T19:24:28.803437+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:20:04.604903+0000","scrub_duration":229,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,10],"acting":[12,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":645,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:29.260032+0000","last_change":"2026-02-24T19:24:29.260032+0000","last_active":"2026-02-24T19:24:29.260032+0000","last_peered":"2026-02-24T19:24:29.260032+0000","last_clean":"2026-02-24T19:24:29.260032+0000","last_became_active":"2026-02-24T19:18:45.762826+0000","last_became_peered":"2026-02-24T19:18:45.762826+0000","last_unstale":"2026-02-24T19:24:29.260032+0000","last_undegraded":"2026-02-24T19:24:29.260032+0000","last_fullsized":"2026-02-24T19:24:29.260032+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:29.258326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:29.258326+0000","last_clean_scrub_stamp":"2026-02-24T19:24:29.258326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:19:49.590854+0000","scrub_duration":41,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,13],"acting":[5,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":643,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:33.168596+0000","last_change":"2026-02-24T19:24:33.168596+0000","last_active":"2026-02-24T19:24:33.168596+0000","last_peered":"2026-02-24T19:24:33.168596+0000","last_clean":"2026-02-24T19:24:33.168596+0000","last_became_active":"2026-02-24T19:18:45.848885+0000","last_became_peered":"2026-02-24T19:18:45.848885+0000","last_unstale":"2026-02-24T19:24:33.168596+0000","last_undegraded":"2026-02-24T19:24:33.168596+0000","last_fullsized":"2026-02-24T19:24:33.168596+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:33.163941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:33.163941+0000","last_clean_scrub_stamp":"2026-02-24T19:24:33.163941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:20:05.061936+0000","scrub_duration":113,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,12],"acting":[7,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":647,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:33.620285+0000","last_change":"2026-02-24T19:24:33.619489+0000","last_active":"2026-02-24T19:24:33.620285+0000","last_peered":"2026-02-24T19:24:33.620285+0000","last_clean":"2026-02-24T19:24:33.620285+0000","last_became_active":"2026-02-24T19:18:45.776560+0000","last_became_peered":"2026-02-24T19:18:45.776560+0000","last_unstale":"2026-02-24T19:24:33.620285+0000","last_undegraded":"2026-02-24T19:24:33.620285+0000","last_fullsized":"2026-02-24T19:24:33.620285+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:33.614702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:33.614702+0000","last_clean_scrub_stamp":"2026-02-24T19:24:33.614702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T19:28:21.743840+0000","scrub_duration":90,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4],"acting":[11,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"9.1","version":"346'12","reported_seq":669,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:27.792394+0000","last_change":"2026-02-24T19:24:27.792394+0000","last_active":"2026-02-24T19:24:27.792394+0000","last_peered":"2026-02-24T19:24:27.792394+0000","last_clean":"2026-02-24T19:24:27.792394+0000","last_became_active":"2026-02-24T19:18:47.223324+0000","last_became_peered":"2026-02-24T19:18:47.223324+0000","last_unstale":"2026-02-24T19:24:27.792394+0000","last_undegraded":"2026-02-24T19:24:27.792394+0000","last_fullsized":"2026-02-24T19:24:27.792394+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"346'12","last_scrub_stamp":"2026-02-24T19:24:27.790575+0000","last_deep_scrub":"346'12","last_deep_scrub_stamp":"2026-02-24T19:24:27.790575+0000","last_clean_scrub_stamp":"2026-02-24T19:24:27.790575+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:55:27.407251+0000","scrub_duration":84,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":645,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:34.405407+0000","last_change":"2026-02-24T19:24:34.405407+0000","last_active":"2026-02-24T19:24:34.405407+0000","last_peered":"2026-02-24T19:24:34.405407+0000","last_clean":"2026-02-24T19:24:34.405407+0000","last_became_active":"2026-02-24T19:18:46.075425+0000","last_became_peered":"2026-02-24T19:18:46.075425+0000","last_unstale":"2026-02-24T19:24:34.405407+0000","last_undegraded":"2026-02-24T19:24:34.405407+0000","last_fullsized":"2026-02-24T19:24:34.405407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:34.403708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:34.403708+0000","last_clean_scrub_stamp":"2026-02-24T19:24:34.403708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T22:56:29.068283+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,8],"acting":[14,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":645,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:33.358282+0000","last_change":"2026-02-24T19:24:33.358282+0000","last_active":"2026-02-24T19:24:33.358282+0000","last_peered":"2026-02-24T19:24:33.358282+0000","last_clean":"2026-02-24T19:24:33.358282+0000","last_became_active":"2026-02-24T19:18:45.978376+0000","last_became_peered":"2026-02-24T19:18:45.978376+0000","last_unstale":"2026-02-24T19:24:33.358282+0000","last_undegraded":"2026-02-24T19:24:33.358282+0000","last_fullsized":"2026-02-24T19:24:33.358282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:33.356660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:33.356660+0000","last_clean_scrub_stamp":"2026-02-24T19:24:33.356660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T00:41:19.357421+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,9],"acting":[14,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":645,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:32.459587+0000","last_change":"2026-02-24T19:24:32.459587+0000","last_active":"2026-02-24T19:24:32.459587+0000","last_peered":"2026-02-24T19:24:32.459587+0000","last_clean":"2026-02-24T19:24:32.459587+0000","last_became_active":"2026-02-24T19:18:46.025768+0000","last_became_peered":"2026-02-24T19:18:46.025768+0000","last_unstale":"2026-02-24T19:24:32.459587+0000","last_undegraded":"2026-02-24T19:24:32.459587+0000","last_fullsized":"2026-02-24T19:24:32.459587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:32.454144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:32.454144+0000","last_clean_scrub_stamp":"2026-02-24T19:24:32.454144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T21:09:01.047867+0000","scrub_duration":100,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,8],"acting":[14,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":643,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:34.018851+0000","last_change":"2026-02-24T19:24:34.018851+0000","last_active":"2026-02-24T19:24:34.018851+0000","last_peered":"2026-02-24T19:24:34.018851+0000","last_clean":"2026-02-24T19:24:34.018851+0000","last_became_active":"2026-02-24T19:18:45.818087+0000","last_became_peered":"2026-02-24T19:18:45.818087+0000","last_unstale":"2026-02-24T19:24:34.018851+0000","last_undegraded":"2026-02-24T19:24:34.018851+0000","last_fullsized":"2026-02-24T19:24:34.018851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:34.017251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:34.017251+0000","last_clean_scrub_stamp":"2026-02-24T19:24:34.017251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T06:10:59.282294+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,12],"acting":[7,12],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":645,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:33.890024+0000","last_change":"2026-02-24T19:24:33.890024+0000","last_active":"2026-02-24T19:24:33.890024+0000","last_peered":"2026-02-24T19:24:33.890024+0000","last_clean":"2026-02-24T19:24:33.890024+0000","last_became_active":"2026-02-24T19:18:45.320912+0000","last_became_peered":"2026-02-24T19:18:45.320912+0000","last_unstale":"2026-02-24T19:24:33.890024+0000","last_undegraded":"2026-02-24T19:24:33.890024+0000","last_fullsized":"2026-02-24T19:24:33.890024+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:33.888058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:33.888058+0000","last_clean_scrub_stamp":"2026-02-24T19:24:33.888058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T01:33:27.378053+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":642,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:30.618071+0000","last_change":"2026-02-24T19:24:30.618071+0000","last_active":"2026-02-24T19:24:30.618071+0000","last_peered":"2026-02-24T19:24:30.618071+0000","last_clean":"2026-02-24T19:24:30.618071+0000","last_became_active":"2026-02-24T19:18:45.399050+0000","last_became_peered":"2026-02-24T19:18:45.399050+0000","last_unstale":"2026-02-24T19:24:30.618071+0000","last_undegraded":"2026-02-24T19:24:30.618071+0000","last_fullsized":"2026-02-24T19:24:30.618071+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:30.616316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:30.616316+0000","last_clean_scrub_stamp":"2026-02-24T19:24:30.616316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T03:20:11.292020+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8],"acting":[1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":644,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:31.307242+0000","last_change":"2026-02-24T19:24:31.307242+0000","last_active":"2026-02-24T19:24:31.307242+0000","last_peered":"2026-02-24T19:24:31.307242+0000","last_clean":"2026-02-24T19:24:31.307242+0000","last_became_active":"2026-02-24T19:18:45.721374+0000","last_became_peered":"2026-02-24T19:18:45.721374+0000","last_unstale":"2026-02-24T19:24:31.307242+0000","last_undegraded":"2026-02-24T19:24:31.307242+0000","last_fullsized":"2026-02-24T19:24:31.307242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:31.306497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:31.306497+0000","last_clean_scrub_stamp":"2026-02-24T19:24:31.306497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-26T04:38:09.825388+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,6],"acting":[13,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":645,"reported_epoch":346,"state":"active+clean","last_fresh":"2026-02-24T19:24:32.865193+0000","last_change":"2026-02-24T19:24:32.865193+0000","last_active":"2026-02-24T19:24:32.865193+0000","last_peered":"2026-02-24T19:24:32.865193+0000","last_clean":"2026-02-24T19:24:32.865193+0000","last_became_active":"2026-02-24T19:18:45.553944+0000","last_became_peered":"2026-02-24T19:18:45.553944+0000","last_unstale":"2026-02-24T19:24:32.865193+0000","last_undegraded":"2026-02-24T19:24:32.865193+0000","last_fullsized":"2026-02-24T19:24:32.865193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-24T19:24:32.863411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-24T19:24:32.863411+0000","last_clean_scrub_stamp":"2026-02-24T19:24:32.863411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-25T23:55:07.200207+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,13],"acting":[9,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":15},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":15,"up_from":21,"seq":90194313302,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33880,"kb_used_data":6920,"kb_used_omap":214,"kb_used_meta":26729,"kb_avail":94337960,"statfs":{"total":96636764160,"available":96602071040,"internally_reserved":0,"allocated":7086080,"data_stored":4366744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":219578,"internal_metadata":27371078},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313301,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33880,"kb_used_data":6920,"kb_used_omap":3017,"kb_used_meta":23926,"kb_avail":94337960,"statfs":{"total":96636764160,"available":96602071040,"internally_reserved":0,"allocated":7086080,"data_stored":4366744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3089424,"internal_metadata":24501232},"hb_peers":[0,1,2,4,5,6,7,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313301,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33880,"kb_used_data":6920,"kb_used_omap":213,"kb_used_meta":26730,"kb_avail":94337960,"statfs":{"total":96636764160,"available":96602071040,"internally_reserved":0,"allocated":7086080,"data_stored":4366744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":219129,"internal_metadata":27371527},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313301,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33884,"kb_used_data":6924,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94337956,"statfs":{"total":96636764160,"available":96602066944,"internally_reserved":0,"allocated":7090176,"data_stored":4366749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":214951,"internal_metadata":27375705},"hb_peers":[1,3,4,5,6,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":21,"seq":90194313302,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33880,"kb_used_data":6920,"kb_used_omap":211,"kb_used_meta":26732,"kb_avail":94337960,"statfs":{"total":96636764160,"available":96602071040,"internally_reserved":0,"allocated":7086080,"data_stored":4366744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":216616,"internal_metadata":27374040},"hb_peers":[0,2,3,4,5,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313301,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51928,"kb_used_data":6920,"kb_used_omap":107,"kb_used_meta":44884,"kb_avail":94319912,"statfs":{"total":96636764160,"available":96583589888,"internally_reserved":0,"allocated":7086080,"data_stored":4366744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":110577,"internal_metadata":45961231},"hb_peers":[0,1,3,4,5,6,7,8,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313301,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33884,"kb_used_data":6924,"kb_used_omap":5823,"kb_used_meta":21120,"kb_avail":94337956,"statfs":{"total":96636764160,"available":96602066944,"internally_reserved":0,"allocated":7090176,"data_stored":4366763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5963562,"internal_metadata":21627094},"hb_peers":[0,2,4,5,6,7,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313301,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33880,"kb_used_data":6920,"kb_used_omap":98,"kb_used_meta":26845,"kb_avail":94337960,"statfs":{"total":96636764160,"available":96602071040,"internally_reserved":0,"allocated":7086080,"data_stored":4366744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":100579,"internal_metadata":27490077},"hb_peers":[0,1,2,3,5,6,7,8,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313302,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33880,"kb_used_data":6920,"kb_used_omap":212,"kb_used_meta":26731,"kb_avail":94337960,"statfs":{"total":96636764160,"available":96602071040,"internally_reserved":0,"allocated":7086080,"data_stored":4366744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":217465,"internal_metadata":27373191},"hb_peers":[0,1,2,4,6,7,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313301,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33880,"kb_used_data":6920,"kb_used_omap":8635,"kb_used_meta":18308,"kb_avail":94337960,"statfs":{"total":96636764160,"available":96602071040,"internally_reserved":0,"allocated":7086080,"data_stored":4366744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8842288,"internal_metadata":18748368},"hb_peers":[1,2,4,5,7,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":21,"seq":90194313301,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33880,"kb_used_data":6920,"kb_used_omap":210,"kb_used_meta":26733,"kb_avail":94337960,"statfs":{"total":96636764160,"available":96602071040,"internally_reserved":0,"allocated":7086080,"data_stored":4366744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":215882,"internal_metadata":27374774},"hb_peers":[0,2,3,4,5,6,8,9,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313301,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33880,"kb_used_data":6920,"kb_used_omap":212,"kb_used_meta":26731,"kb_avail":94337960,"statfs":{"total":96636764160,"available":96602071040,"internally_reserved":0,"allocated":7086080,"data_stored":4366744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":217549,"internal_metadata":27373107},"hb_peers":[0,1,2,3,4,5,6,7,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313301,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33880,"kb_used_data":6920,"kb_used_omap":212,"kb_used_meta":26731,"kb_avail":94337960,"statfs":{"total":96636764160,"available":96602071040,"internally_reserved":0,"allocated":7086080,"data_stored":4366744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":217494,"internal_metadata":27373162},"hb_peers":[0,1,2,3,4,6,7,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313302,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34272,"kb_used_data":7312,"kb_used_omap":5830,"kb_used_meta":21113,"kb_avail":94337568,"statfs":{"total":96636764160,"available":96601669632,"internally_reserved":0,"allocated":7487488,"data_stored":4764584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5970303,"internal_metadata":21620353},"hb_peers":[0,1,3,4,5,6,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":11,"up_from":21,"seq":90194313302,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33888,"kb_used_data":6928,"kb_used_omap":213,"kb_used_meta":26730,"kb_avail":94337952,"statfs":{"total":96636764160,"available":96602062848,"internally_reserved":0,"allocated":7094272,"data_stored":4366768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":218291,"internal_metadata":27372365},"hb_peers":[0,1,2,3,4,5,6,7,8,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313301,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34272,"kb_used_data":7312,"kb_used_omap":186,"kb_used_meta":26757,"kb_avail":94337568,"statfs":{"total":96636764160,"available":96601669632,"internally_reserved":0,"allocated":7487488,"data_stored":4764584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":190680,"internal_metadata":27399976},"hb_peers":[0,1,3,4,5,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-24T19:24:54.005 DEBUG:teuthology.orchestra.run.trial026:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-24T19:24:54.072 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.070+0000 7f647b02b640 10 monclient: get_monmap_and_config 2026-02-24T19:24:54.072 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.070+0000 7f647b02b640 10 monclient: build_initial_monmap 2026-02-24T19:24:54.072 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.070+0000 7f647b02b640 10 monclient: monmap: 2026-02-24T19:24:54.072 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:54.072 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:54.073 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:24:54.071721+0000 2026-02-24T19:24:54.073 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:24:54.071721+0000 2026-02-24T19:24:54.073 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:54.073 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:54.073 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:54.073 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:54.073 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:54.073 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:54.075 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.071+0000 7f647b02b640 1 Processor -- start 2026-02-24T19:24:54.075 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.071+0000 7f647b02b640 1 -- start start 2026-02-24T19:24:54.076 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.071+0000 7f647b02b640 10 monclient: init 2026-02-24T19:24:54.076 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.071+0000 7f647b02b640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:54.076 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.071+0000 7f647b02b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-24T19:24:54.076 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.071+0000 7f647b02b640 10 monclient(hunting): picked mon.noname-c con 0x7f647415afd0 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:54.076 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.071+0000 7f647b02b640 10 monclient(hunting): picked mon.noname-a con 0x7f647415b3a0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:54.076 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.071+0000 7f647b02b640 10 monclient(hunting): picked mon.noname-b con 0x7f6474163890 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:54.076 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.071+0000 7f647b02b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6474162380 con 0x7f647415b3a0 2026-02-24T19:24:54.076 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.071+0000 7f647b02b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64740b1c30 con 0x7f6474163890 2026-02-24T19:24:54.076 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.071+0000 7f647b02b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64740b1f10 con 0x7f647415afd0 2026-02-24T19:24:54.076 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.071+0000 7f647b02b640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:54.076 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.071+0000 7f647b02b640 10 monclient(hunting): authenticate will time out at 4076.753985s 2026-02-24T19:24:54.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.072+0000 7f646bfff640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f647415b3a0 0x7f647405d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:52466/0 (socket says 10.20.193.26:52466) 2026-02-24T19:24:54.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.072+0000 7f646bfff640 1 -- 10.20.193.26:0/1534257553 learned_addr learned my addr 10.20.193.26:0/1534257553 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:54.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.073+0000 7f646b7fe640 1 -- 10.20.193.26:0/1534257553 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2168556798 0 0) 0x7f6474162380 con 0x7f647415b3a0 2026-02-24T19:24:54.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.073+0000 7f646b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:54.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.073+0000 7f646b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:54.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.073+0000 7f646b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:54.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.073+0000 7f646b7fe640 10 monclient(hunting): my global_id is 30828 2026-02-24T19:24:54.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.073+0000 7f646b7fe640 1 -- 10.20.193.26:0/1534257553 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6460003610 con 0x7f647415b3a0 2026-02-24T19:24:54.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.073+0000 7f646b7fe640 1 -- 10.20.193.26:0/1534257553 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3369969817 0 0) 0x7f64740b1c30 con 0x7f6474163890 2026-02-24T19:24:54.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.073+0000 7f646b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:54.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.073+0000 7f646b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:54.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.073+0000 7f646b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:54.077 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.073+0000 7f646b7fe640 10 monclient(hunting): my global_id is 28243 2026-02-24T19:24:54.078 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.073+0000 7f646b7fe640 1 -- 10.20.193.26:0/1534257553 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6474162380 con 0x7f6474163890 2026-02-24T19:24:54.078 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.074+0000 7f646b7fe640 1 -- 10.20.193.26:0/1534257553 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3624353907 0 0) 0x7f64740b1f10 con 0x7f647415afd0 2026-02-24T19:24:54.078 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.074+0000 7f646b7fe640 10 monclient(hunting): _negotiate 2026-02-24T19:24:54.078 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.074+0000 7f646b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:54.078 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.074+0000 7f646b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:54.078 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.074+0000 7f646b7fe640 10 monclient(hunting): my global_id is 30167 2026-02-24T19:24:54.078 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.074+0000 7f646b7fe640 1 -- 10.20.193.26:0/1534257553 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64740b1c30 con 0x7f647415afd0 2026-02-24T19:24:54.083 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.075+0000 7f646b7fe640 1 -- 10.20.193.26:0/1534257553 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1707500706 0 0) 0x7f6474162380 con 0x7f6474163890 2026-02-24T19:24:54.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.075+0000 7f646b7fe640 1 -- 10.20.193.26:0/1534257553 >> v1:10.20.193.103:6789/0 conn(0x7f647415afd0 legacy=0x7f6474059be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:54.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.075+0000 7f646b7fe640 1 -- 10.20.193.26:0/1534257553 >> v1:10.20.193.26:6789/0 conn(0x7f647415b3a0 legacy=0x7f647405d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:54.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.075+0000 7f646b7fe640 10 monclient: _finish_hunting 0 2026-02-24T19:24:54.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.075+0000 7f646b7fe640 1 monclient: found mon.noname-b 2026-02-24T19:24:54.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.075+0000 7f646b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:54.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.075+0000 7f646b7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.70:6789/0 2026-02-24T19:24:54.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.075+0000 7f646b7fe640 1 -- 10.20.193.26:0/1534257553 --> v1:10.20.193.70:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64740b21f0 con 0x7f6474163890 2026-02-24T19:24:54.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.075+0000 7f646b7fe640 10 monclient: _finish_auth 0 2026-02-24T19:24:54.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.075+0000 7f646b7fe640 10 monclient: _check_auth_tickets 2026-02-24T19:24:54.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.075+0000 7f646b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:54.084 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.075+0000 7f646b7fe640 1 -- 10.20.193.26:0/1534257553 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6470003170 con 0x7f6474163890 2026-02-24T19:24:54.085 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.075+0000 7f646b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:54.085 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.075+0000 7f646b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-24T19:24:54.085 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.075+0000 7f646b7fe640 10 monclient: dump: 2026-02-24T19:24:54.085 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:54.085 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:54.085 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:54.085 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:54.085 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:54.085 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:54.085 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:54.085 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:54.085 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:54.085 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:54.086 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.075+0000 7f647b02b640 5 monclient: authenticate success, global_id 28243 2026-02-24T19:24:54.086 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.075+0000 7f647b02b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-24T19:24:54.086 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.076+0000 7f646b7fe640 1 -- 10.20.193.26:0/1534257553 <== mon.1 v1:10.20.193.70:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6470003340 con 0x7f6474163890 2026-02-24T19:24:54.086 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.076+0000 7f646b7fe640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:54.086 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.076+0000 7f646b7fe640 1 -- 10.20.193.26:0/1534257553 <== mon.1 v1:10.20.193.70:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6470003780 con 0x7f6474163890 2026-02-24T19:24:54.086 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.076+0000 7f647b02b640 10 monclient: get_monmap_and_config success 2026-02-24T19:24:54.086 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.076+0000 7f647b02b640 4 set_mon_vals no callback set 2026-02-24T19:24:54.086 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.076+0000 7f646b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:54.086 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.076+0000 7f646b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:54.086 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.076+0000 7f646b7fe640 10 monclient: dump: 2026-02-24T19:24:54.086 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:54.086 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:54.087 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:54.087 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:54.087 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:54.087 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:54.087 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:54.087 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:54.087 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:54.087 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:54.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.076+0000 7f647b02b640 10 monclient: shutdown 2026-02-24T19:24:54.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.076+0000 7f647b02b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:54.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.076+0000 7f647b02b640 1 -- 10.20.193.26:0/1534257553 >> v1:10.20.193.70:6789/0 conn(0x7f6474163890 legacy=0x7f6474164480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:54.087 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.076+0000 7f647b02b640 1 -- 10.20.193.26:0/1534257553 shutdown_connections 2026-02-24T19:24:54.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.076+0000 7f647b02b640 1 -- 10.20.193.26:0/1534257553 >> 10.20.193.26:0/1534257553 conn(0x7f64740b2f10 msgr2=0x7f64740b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:54.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.076+0000 7f647b02b640 1 -- 10.20.193.26:0/1534257553 shutdown_connections 2026-02-24T19:24:54.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.076+0000 7f647b02b640 1 -- 10.20.193.26:0/1534257553 wait complete. 2026-02-24T19:24:54.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.076+0000 7f647b02b640 10 monclient: build_initial_monmap 2026-02-24T19:24:54.088 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.076+0000 7f647b02b640 10 monclient: monmap: 2026-02-24T19:24:54.088 INFO:teuthology.orchestra.run.trial026.stderr:epoch 0 2026-02-24T19:24:54.088 INFO:teuthology.orchestra.run.trial026.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-24T19:24:54.088 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 0.000000 2026-02-24T19:24:54.088 INFO:teuthology.orchestra.run.trial026.stderr:created 0.000000 2026-02-24T19:24:54.088 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 0 (unknown) 2026-02-24T19:24:54.088 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 1 2026-02-24T19:24:54.088 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.noname-a 2026-02-24T19:24:54.088 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.noname-b 2026-02-24T19:24:54.088 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.noname-c 2026-02-24T19:24:54.089 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:54.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.077+0000 7f647b02b640 1 librados: starting msgr at 2026-02-24T19:24:54.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.077+0000 7f647b02b640 1 librados: starting objecter 2026-02-24T19:24:54.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.077+0000 7f647b02b640 20 client.?.objecter Objecter: read policy: balance 2026-02-24T19:24:54.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.077+0000 7f647b02b640 1 Processor -- start 2026-02-24T19:24:54.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.077+0000 7f647b02b640 1 -- start start 2026-02-24T19:24:54.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.077+0000 7f647b02b640 1 librados: setting wanted keys 2026-02-24T19:24:54.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.077+0000 7f647b02b640 1 librados: calling monclient init 2026-02-24T19:24:54.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.077+0000 7f647b02b640 10 monclient: init 2026-02-24T19:24:54.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.077+0000 7f647b02b640 10 monclient: _reopen_session rank -1 2026-02-24T19:24:54.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.077+0000 7f647b02b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-24T19:24:54.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.077+0000 7f647b02b640 10 monclient(hunting): picked mon.noname-a con 0x7f647415afd0 addr v1:10.20.193.26:6789/0 2026-02-24T19:24:54.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.077+0000 7f647b02b640 10 monclient(hunting): picked mon.noname-b con 0x7f647415b3a0 addr v1:10.20.193.70:6789/0 2026-02-24T19:24:54.089 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.077+0000 7f647b02b640 10 monclient(hunting): picked mon.noname-c con 0x7f6474163890 addr v1:10.20.193.103:6789/0 2026-02-24T19:24:54.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.077+0000 7f647b02b640 1 -- --> v1:10.20.193.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f647414c000 con 0x7f647415afd0 2026-02-24T19:24:54.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.077+0000 7f647b02b640 1 -- --> v1:10.20.193.70:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6474137fd0 con 0x7f647415b3a0 2026-02-24T19:24:54.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.077+0000 7f647b02b640 1 -- --> v1:10.20.193.103:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64741382b0 con 0x7f6474163890 2026-02-24T19:24:54.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.077+0000 7f647b02b640 10 monclient(hunting): _renew_subs 2026-02-24T19:24:54.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.077+0000 7f647b02b640 10 monclient(hunting): authenticate will time out at 4076.759520s 2026-02-24T19:24:54.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.077+0000 7f6478da0640 1 --1- >> v1:10.20.193.26:6789/0 conn(0x7f647415afd0 0x7f64740a7840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.26:6789/0 says I am v1:10.20.193.26:52474/0 (socket says 10.20.193.26:52474) 2026-02-24T19:24:54.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.077+0000 7f6478da0640 1 -- 10.20.193.26:0/4003511616 learned_addr learned my addr 10.20.193.26:0/4003511616 (peer_addr_for_me v1:10.20.193.26:0/0) 2026-02-24T19:24:54.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.077+0000 7f64697fa640 10 client.?.objecter ms_handle_connect 0x7f647415afd0 2026-02-24T19:24:54.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.077+0000 7f64697fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:54.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.078+0000 7f64697fa640 10 client.?.objecter ms_handle_connect 0x7f6474163890 2026-02-24T19:24:54.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.078+0000 7f64697fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:54.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.078+0000 7f64697fa640 10 client.?.objecter ms_handle_connect 0x7f647415b3a0 2026-02-24T19:24:54.090 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.078+0000 7f64697fa640 10 client.?.objecter resend_mon_ops 2026-02-24T19:24:54.091 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.078+0000 7f64697fa640 1 -- 10.20.193.26:0/4003511616 <== mon.0 v1:10.20.193.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1129354402 0 0) 0x7f647414c000 con 0x7f647415afd0 2026-02-24T19:24:54.091 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.078+0000 7f64697fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:54.091 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.078+0000 7f64697fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:54.091 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.078+0000 7f64697fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:54.091 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.078+0000 7f64697fa640 10 monclient(hunting): my global_id is 30831 2026-02-24T19:24:54.091 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.078+0000 7f64697fa640 1 -- 10.20.193.26:0/4003511616 --> v1:10.20.193.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6444003610 con 0x7f647415afd0 2026-02-24T19:24:54.091 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.079+0000 7f64697fa640 1 -- 10.20.193.26:0/4003511616 <== mon.1 v1:10.20.193.70:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4033624069 0 0) 0x7f6474137fd0 con 0x7f647415b3a0 2026-02-24T19:24:54.091 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.079+0000 7f64697fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:54.091 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.079+0000 7f64697fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:54.091 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.079+0000 7f64697fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:54.091 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.079+0000 7f64697fa640 10 monclient(hunting): my global_id is 28246 2026-02-24T19:24:54.091 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.079+0000 7f64697fa640 1 -- 10.20.193.26:0/4003511616 --> v1:10.20.193.70:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f647414c000 con 0x7f647415b3a0 2026-02-24T19:24:54.092 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.079+0000 7f64697fa640 1 -- 10.20.193.26:0/4003511616 <== mon.2 v1:10.20.193.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1948818876 0 0) 0x7f64741382b0 con 0x7f6474163890 2026-02-24T19:24:54.092 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.079+0000 7f64697fa640 10 monclient(hunting): _negotiate 2026-02-24T19:24:54.092 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.079+0000 7f64697fa640 10 monclient(hunting): _init_auth method 2 2026-02-24T19:24:54.092 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.079+0000 7f64697fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-24T19:24:54.092 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.079+0000 7f64697fa640 10 monclient(hunting): my global_id is 30170 2026-02-24T19:24:54.092 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.079+0000 7f64697fa640 1 -- 10.20.193.26:0/4003511616 --> v1:10.20.193.103:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6474137fd0 con 0x7f6474163890 2026-02-24T19:24:54.092 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.081+0000 7f64697fa640 1 -- 10.20.193.26:0/4003511616 <== mon.0 v1:10.20.193.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 662404710 0 0) 0x7f6444003610 con 0x7f647415afd0 2026-02-24T19:24:54.092 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.081+0000 7f64697fa640 1 -- 10.20.193.26:0/4003511616 --> v1:10.20.193.26:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f64741382b0 con 0x7f647415afd0 2026-02-24T19:24:54.092 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.081+0000 7f64697fa640 1 -- 10.20.193.26:0/4003511616 <== mon.0 v1:10.20.193.26:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6464003170 con 0x7f647415afd0 2026-02-24T19:24:54.092 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.081+0000 7f64697fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:54.092 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.081+0000 7f64697fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-24T19:24:54.092 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.081+0000 7f64697fa640 10 monclient(hunting): dump: 2026-02-24T19:24:54.092 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:54.092 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:54.093 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:54.093 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:54.093 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:54.093 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:54.093 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:54.093 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:54.093 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:54.093 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:54.093 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.081+0000 7f64697fa640 10 monclient(hunting): _finish_auth 0 2026-02-24T19:24:54.093 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.081+0000 7f64697fa640 1 -- 10.20.193.26:0/4003511616 <== mon.1 v1:10.20.193.70:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2407200440 0 0) 0x7f647414c000 con 0x7f647415b3a0 2026-02-24T19:24:54.093 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.081+0000 7f64697fa640 1 -- 10.20.193.26:0/4003511616 --> v1:10.20.193.70:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6444003610 con 0x7f647415b3a0 2026-02-24T19:24:54.093 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.081+0000 7f64697fa640 1 -- 10.20.193.26:0/4003511616 <== mon.1 v1:10.20.193.70:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f645c0030b0 con 0x7f647415b3a0 2026-02-24T19:24:54.093 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.081+0000 7f64697fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:54.094 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.081+0000 7f64697fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-24T19:24:54.094 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.081+0000 7f64697fa640 10 monclient(hunting): dump: 2026-02-24T19:24:54.094 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:54.094 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:54.094 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:54.094 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:54.094 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:54.094 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:54.094 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:54.094 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:54.094 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:54.094 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:54.094 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.081+0000 7f64697fa640 1 -- 10.20.193.26:0/4003511616 <== mon.2 v1:10.20.193.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 34006570 0 0) 0x7f6474137fd0 con 0x7f6474163890 2026-02-24T19:24:54.095 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.081+0000 7f64697fa640 1 -- 10.20.193.26:0/4003511616 --> v1:10.20.193.103:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f647414c000 con 0x7f6474163890 2026-02-24T19:24:54.095 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.081+0000 7f64697fa640 1 -- 10.20.193.26:0/4003511616 <== mon.2 v1:10.20.193.103:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6470003690 con 0x7f6474163890 2026-02-24T19:24:54.095 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.081+0000 7f64697fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-24T19:24:54.095 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.081+0000 7f64697fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-24T19:24:54.095 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.081+0000 7f64697fa640 10 monclient(hunting): dump: 2026-02-24T19:24:54.095 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:54.095 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:54.095 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:54.095 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:54.095 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:54.095 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:54.095 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:54.095 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:54.096 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:54.096 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:54.097 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.083+0000 7f64697fa640 1 -- 10.20.193.26:0/4003511616 <== mon.0 v1:10.20.193.26:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 945704435 0 0) 0x7f64741382b0 con 0x7f647415afd0 2026-02-24T19:24:54.097 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.083+0000 7f64697fa640 1 -- 10.20.193.26:0/4003511616 >> v1:10.20.193.103:6789/0 conn(0x7f6474163890 legacy=0x7f647414b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:54.097 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.083+0000 7f64697fa640 1 -- 10.20.193.26:0/4003511616 >> v1:10.20.193.70:6789/0 conn(0x7f647415b3a0 legacy=0x7f6474137210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:54.097 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.083+0000 7f64697fa640 10 monclient: _finish_hunting 0 2026-02-24T19:24:54.097 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.083+0000 7f64697fa640 1 monclient: found mon.a 2026-02-24T19:24:54.097 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.083+0000 7f64697fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-24T19:24:54.098 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.083+0000 7f64697fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:54.098 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.083+0000 7f64697fa640 1 -- 10.20.193.26:0/4003511616 --> v1:10.20.193.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6474138590 con 0x7f647415afd0 2026-02-24T19:24:54.098 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.083+0000 7f64697fa640 10 monclient: _finish_auth 0 2026-02-24T19:24:54.098 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.083+0000 7f64697fa640 10 monclient: _check_auth_tickets 2026-02-24T19:24:54.098 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.083+0000 7f64697fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-24T19:24:54.098 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.083+0000 7f647b02b640 5 monclient: authenticate success, global_id 30831 2026-02-24T19:24:54.098 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.083+0000 7f647b02b640 10 monclient: _renew_subs 2026-02-24T19:24:54.098 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.083+0000 7f647b02b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:54.098 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.083+0000 7f647b02b640 1 -- 10.20.193.26:0/4003511616 --> v1:10.20.193.26:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6474138870 con 0x7f647415afd0 2026-02-24T19:24:54.098 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.083+0000 7f647b02b640 10 client.30831.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-24T19:24:54.098 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.083+0000 7f647b02b640 10 monclient: _renew_subs 2026-02-24T19:24:54.098 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.083+0000 7f647b02b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:54.099 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.083+0000 7f647b02b640 1 -- 10.20.193.26:0/4003511616 --> v1:10.20.193.26:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6474135d20 con 0x7f647415afd0 2026-02-24T19:24:54.099 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.083+0000 7f647b02b640 1 librados: init done 2026-02-24T19:24:54.099 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.083+0000 7f647b02b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:54.099 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.083+0000 7f647b02b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:54.099 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.083+0000 7f647b02b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:54.099 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.083+0000 7f647b02b640 1 -- 10.20.193.26:0/4003511616 --> v1:10.20.193.26:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6474051c70 con 0x7f647415afd0 2026-02-24T19:24:54.173 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.171+0000 7f64697fa640 1 -- 10.20.193.26:0/4003511616 <== mon.0 v1:10.20.193.26:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6464003310 con 0x7f647415afd0 2026-02-24T19:24:54.173 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.171+0000 7f64697fa640 10 monclient: handle_config config(0 keys) 2026-02-24T19:24:54.173 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.171+0000 7f64697fa640 1 -- 10.20.193.26:0/4003511616 <== mon.0 v1:10.20.193.26:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 1053809981 0 0) 0x7f6464003b50 con 0x7f647415afd0 2026-02-24T19:24:54.173 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.171+0000 7f64697fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-24T19:24:54.173 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.171+0000 7f64697fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-24T19:24:54.173 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.171+0000 7f646affd640 4 set_mon_vals no callback set 2026-02-24T19:24:54.173 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.171+0000 7f64697fa640 10 monclient: dump: 2026-02-24T19:24:54.173 INFO:teuthology.orchestra.run.trial026.stderr:epoch 1 2026-02-24T19:24:54.173 INFO:teuthology.orchestra.run.trial026.stderr:fsid 33b2b598-dbc5-4d7a-8df7-657f0501fe9e 2026-02-24T19:24:54.173 INFO:teuthology.orchestra.run.trial026.stderr:last_changed 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:54.174 INFO:teuthology.orchestra.run.trial026.stderr:created 2026-02-24T19:16:34.719715+0000 2026-02-24T19:24:54.174 INFO:teuthology.orchestra.run.trial026.stderr:min_mon_release 20 (tentacle) 2026-02-24T19:24:54.174 INFO:teuthology.orchestra.run.trial026.stderr:election_strategy: 3 2026-02-24T19:24:54.174 INFO:teuthology.orchestra.run.trial026.stderr:0: v1:10.20.193.26:6789/0 mon.a 2026-02-24T19:24:54.174 INFO:teuthology.orchestra.run.trial026.stderr:1: v1:10.20.193.70:6789/0 mon.b 2026-02-24T19:24:54.174 INFO:teuthology.orchestra.run.trial026.stderr:2: v1:10.20.193.103:6789/0 mon.c 2026-02-24T19:24:54.174 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:24:54.175 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.172+0000 7f64697fa640 1 -- 10.20.193.26:0/4003511616 <== mon.0 v1:10.20.193.26:6789/0 7 ==== mgrmap(e 5) ==== 101563+0+0 (unknown 2390810924 0 0) 0x7f6464003d30 con 0x7f647415afd0 2026-02-24T19:24:54.175 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.172+0000 7f646bfff640 10 monclient: get_auth_request con 0x7f6444077e70 auth_method 0 2026-02-24T19:24:54.175 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.173+0000 7f64697fa640 10 client.30831.objecter ms_handle_connect 0x7f6444077e70 2026-02-24T19:24:54.176 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.174+0000 7f64697fa640 1 -- 10.20.193.26:0/4003511616 <== mon.0 v1:10.20.193.26:6789/0 8 ==== osd_map(346..346 src has 1..346) ==== 9031+0+0 (unknown 3680056557 0 0) 0x7f6464093250 con 0x7f647415afd0 2026-02-24T19:24:54.176 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.174+0000 7f64697fa640 10 client.30831.objecter ms_dispatch2 0x7f6474000b90 osd_map(346..346 src has 1..346) 2026-02-24T19:24:54.176 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.174+0000 7f64697fa640 3 client.30831.objecter handle_osd_map got epochs [346,346] > 0 2026-02-24T19:24:54.176 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.174+0000 7f64697fa640 3 client.30831.objecter handle_osd_map decoding full epoch 346 2026-02-24T19:24:54.176 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.174+0000 7f64697fa640 20 client.30831.objecter dump_active .. 0 homeless 2026-02-24T19:24:54.177 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.174+0000 7f64697fa640 1 -- 10.20.193.26:0/4003511616 <== mon.0 v1:10.20.193.26:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+231577 (unknown 1092875540 0 2729787001) 0x7f6474051c70 con 0x7f647415afd0 2026-02-24T19:24:54.177 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.175+0000 7f64697fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-24T19:24:54.177 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.175+0000 7f64697fa640 10 monclient: _finish_command 1 = system:0 2026-02-24T19:24:54.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.279+0000 7f647b02b640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-24T19:24:54.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.279+0000 7f647b02b640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-24T19:24:54.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.279+0000 7f647b02b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.26:6789/0 2026-02-24T19:24:54.281 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.279+0000 7f647b02b640 1 -- 10.20.193.26:0/4003511616 --> v1:10.20.193.26:6789/0 -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f6474164350 con 0x7f647415afd0 2026-02-24T19:24:54.337 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.336+0000 7f64697fa640 1 -- 10.20.193.26:0/4003511616 <== mon.0 v1:10.20.193.26:6789/0 10 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) ==== 123+0+0 (unknown 691139944 0 0) 0x7f646405dc80 con 0x7f647415afd0 2026-02-24T19:24:54.338 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.336+0000 7f64697fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-24T19:24:54.338 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.336+0000 7f64697fa640 10 monclient: _finish_command 2 = system:0 2026-02-24T19:24:54.340 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.338+0000 7f647b02b640 10 librados: watch_flush enter 2026-02-24T19:24:54.341 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.338+0000 7f647b02b640 10 librados: watch_flush exit 2026-02-24T19:24:54.341 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.338+0000 7f647b02b640 20 client.30831.objecter shutdown clearing up homeless session... 2026-02-24T19:24:54.341 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.338+0000 7f647b02b640 10 client.30831.objecter successfully canceled tick 2026-02-24T19:24:54.341 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.338+0000 7f647b02b640 1 -- 10.20.193.26:0/4003511616 >> v1:10.20.193.162:6800/3889602630 conn(0x7f6444077e70 legacy=0x7f6444098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:54.341 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.338+0000 7f647b02b640 10 monclient: shutdown 2026-02-24T19:24:54.341 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.338+0000 7f647b02b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-24T19:24:54.341 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.338+0000 7f647b02b640 1 -- 10.20.193.26:0/4003511616 >> v1:10.20.193.26:6789/0 conn(0x7f647415afd0 legacy=0x7f64740a7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-24T19:24:54.341 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.338+0000 7f647b02b640 1 -- 10.20.193.26:0/4003511616 shutdown_connections 2026-02-24T19:24:54.341 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.338+0000 7f647b02b640 1 -- 10.20.193.26:0/4003511616 >> 10.20.193.26:0/4003511616 conn(0x7f64740b2f10 msgr2=0x7f64740ad8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-24T19:24:54.341 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.338+0000 7f647b02b640 1 -- 10.20.193.26:0/4003511616 shutdown_connections 2026-02-24T19:24:54.341 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.338+0000 7f647b02b640 1 -- 10.20.193.26:0/4003511616 wait complete. 2026-02-24T19:24:54.341 INFO:teuthology.orchestra.run.trial026.stderr:2026-02-24T19:24:54.338+0000 7f647b02b640 1 librados: shutdown 2026-02-24T19:24:54.350 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-24T19:24:54.351 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-24T19:24:54.351 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-24T19:24:54.351 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:24:54.357 INFO:tasks.ceph.osd.0.trial026.stderr:2026-02-24T19:24:54.352+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 (PID: 44881) UID: 0 2026-02-24T19:24:54.358 INFO:tasks.ceph.osd.0.trial026.stderr:2026-02-24T19:24:54.353+0000 c765640 -1 osd.0 346 *** Got signal Terminated *** 2026-02-24T19:25:00.453 INFO:tasks.ceph.osd.0:Stopped 2026-02-24T19:25:00.453 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-24T19:25:00.453 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:00.460 INFO:tasks.ceph.osd.4.trial026.stderr:2026-02-24T19:25:00.454+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 (PID: 44882) UID: 0 2026-02-24T19:25:00.460 INFO:tasks.ceph.osd.4.trial026.stderr:2026-02-24T19:25:00.455+0000 c765640 -1 osd.4 348 *** Got signal Terminated *** 2026-02-24T19:25:06.555 INFO:tasks.ceph.osd.4:Stopped 2026-02-24T19:25:06.556 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2026-02-24T19:25:06.556 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:06.563 INFO:tasks.ceph.osd.8.trial026.stderr:2026-02-24T19:25:06.557+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.8.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 8 (PID: 44886) UID: 0 2026-02-24T19:25:06.563 INFO:tasks.ceph.osd.8.trial026.stderr:2026-02-24T19:25:06.558+0000 c765640 -1 osd.8 350 *** Got signal Terminated *** 2026-02-24T19:25:11.914 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:08:09.888 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:11.917 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:08:09.891 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:11.928 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:08:09.903 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:11.942 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:08:09.878 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:11.944 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:08:09.880 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:11.944 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:08:09.915 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:11.946 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:08:09.917 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:11.954 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:08:09.890 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:11.957 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:08:09.928 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:12.658 INFO:tasks.ceph.osd.8:Stopped 2026-02-24T19:25:12.658 DEBUG:tasks.ceph.osd.12:waiting for process to exit 2026-02-24T19:25:12.658 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:12.665 INFO:tasks.ceph.osd.12.trial026.stderr:2026-02-24T19:25:12.660+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.12.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 12 (PID: 44889) UID: 0 2026-02-24T19:25:12.666 INFO:tasks.ceph.osd.12.trial026.stderr:2026-02-24T19:25:12.660+0000 c765640 -1 osd.12 352 *** Got signal Terminated *** 2026-02-24T19:25:16.163 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.12 is failed for ~0s 2026-02-24T19:25:18.760 INFO:tasks.ceph.osd.12:Stopped 2026-02-24T19:25:18.760 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-24T19:25:18.760 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:18.767 INFO:tasks.ceph.osd.1.trial070.stderr:2026-02-24T19:25:18.761+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 (PID: 44493) UID: 0 2026-02-24T19:25:18.767 INFO:tasks.ceph.osd.1.trial070.stderr:2026-02-24T19:25:18.761+0000 c765640 -1 osd.1 354 *** Got signal Terminated *** 2026-02-24T19:25:22.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2026-02-24T19:25:22.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.12 has been restored 2026-02-24T19:25:24.861 INFO:tasks.ceph.osd.1:Stopped 2026-02-24T19:25:24.862 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-24T19:25:24.862 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:24.869 INFO:tasks.ceph.osd.5.trial070.stderr:2026-02-24T19:25:24.862+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 (PID: 44499) UID: 0 2026-02-24T19:25:24.869 INFO:tasks.ceph.osd.5.trial070.stderr:2026-02-24T19:25:24.863+0000 c765640 -1 osd.5 356 *** Got signal Terminated *** 2026-02-24T19:25:29.388 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2026-02-24T19:25:30.964 INFO:tasks.ceph.osd.5:Stopped 2026-02-24T19:25:30.964 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2026-02-24T19:25:30.964 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:30.971 INFO:tasks.ceph.osd.9.trial070.stderr:2026-02-24T19:25:30.964+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.9.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 9 (PID: 44501) UID: 0 2026-02-24T19:25:30.971 INFO:tasks.ceph.osd.9.trial070.stderr:2026-02-24T19:25:30.965+0000 c765640 -1 osd.9 358 *** Got signal Terminated *** 2026-02-24T19:25:32.020 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:08:29.994 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:32.021 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:08:29.996 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:32.025 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:08:29.996 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:32.028 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:08:29.999 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:32.034 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:08:30.008 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:32.041 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:08:30.012 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:32.046 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:08:29.982 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:32.047 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:08:29.983 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:32.059 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:08:29.995 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:35.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.9 is failed for ~0s 2026-02-24T19:25:37.065 INFO:tasks.ceph.osd.9:Stopped 2026-02-24T19:25:37.065 DEBUG:tasks.ceph.osd.13:waiting for process to exit 2026-02-24T19:25:37.066 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:37.072 INFO:tasks.ceph.osd.13.trial070.stderr:2026-02-24T19:25:37.066+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.13.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 13 (PID: 44504) UID: 0 2026-02-24T19:25:37.072 INFO:tasks.ceph.osd.13.trial070.stderr:2026-02-24T19:25:37.066+0000 c765640 -1 osd.13 361 *** Got signal Terminated *** 2026-02-24T19:25:42.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.13 is failed for ~0s 2026-02-24T19:25:42.109 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.9 has been restored 2026-02-24T19:25:43.167 INFO:tasks.ceph.osd.13:Stopped 2026-02-24T19:25:43.167 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-24T19:25:43.167 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:43.174 INFO:tasks.ceph.osd.2.trial103.stderr:2026-02-24T19:25:43.168+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 (PID: 44609) UID: 0 2026-02-24T19:25:43.174 INFO:tasks.ceph.osd.2.trial103.stderr:2026-02-24T19:25:43.169+0000 c765640 -1 osd.2 364 *** Got signal Terminated *** 2026-02-24T19:25:48.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2026-02-24T19:25:48.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.13 has been restored 2026-02-24T19:25:49.269 INFO:tasks.ceph.osd.2:Stopped 2026-02-24T19:25:49.270 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2026-02-24T19:25:49.270 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:49.277 INFO:tasks.ceph.osd.6.trial103.stderr:2026-02-24T19:25:49.271+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 (PID: 44611) UID: 0 2026-02-24T19:25:49.277 INFO:tasks.ceph.osd.6.trial103.stderr:2026-02-24T19:25:49.272+0000 c765640 -1 osd.6 366 *** Got signal Terminated *** 2026-02-24T19:25:52.013 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:08:49.988 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:52.015 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:08:49.989 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:52.027 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:08:50.001 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:52.039 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:08:50.010 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:52.040 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:08:50.011 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:52.043 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:08:49.980 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:52.044 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:08:49.981 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:52.052 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:08:50.023 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:52.057 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:08:49.994 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:25:54.427 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2026-02-24T19:25:54.427 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2026-02-24T19:25:55.371 INFO:tasks.ceph.osd.6:Stopped 2026-02-24T19:25:55.371 DEBUG:tasks.ceph.osd.10:waiting for process to exit 2026-02-24T19:25:55.371 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:25:55.378 INFO:tasks.ceph.osd.10.trial103.stderr:2026-02-24T19:25:55.372+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.10.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 10 (PID: 44615) UID: 0 2026-02-24T19:25:55.380 INFO:tasks.ceph.osd.10.trial103.stderr:2026-02-24T19:25:55.373+0000 c765640 -1 osd.10 368 *** Got signal Terminated *** 2026-02-24T19:26:00.434 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.10 is failed for ~0s 2026-02-24T19:26:00.435 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2026-02-24T19:26:01.473 INFO:tasks.ceph.osd.10:Stopped 2026-02-24T19:26:01.474 DEBUG:tasks.ceph.osd.14:waiting for process to exit 2026-02-24T19:26:01.474 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:26:01.481 INFO:tasks.ceph.osd.14.trial103.stderr:2026-02-24T19:26:01.475+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.14.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 14 (PID: 44616) UID: 0 2026-02-24T19:26:01.481 INFO:tasks.ceph.osd.14.trial103.stderr:2026-02-24T19:26:01.476+0000 c765640 -1 osd.14 370 *** Got signal Terminated *** 2026-02-24T19:26:06.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.14 is failed for ~0s 2026-02-24T19:26:06.341 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.10 has been restored 2026-02-24T19:26:07.576 INFO:tasks.ceph.osd.14:Stopped 2026-02-24T19:26:07.576 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-24T19:26:07.577 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:26:07.584 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-24T19:26:07.577+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 (PID: 45124) UID: 0 2026-02-24T19:26:07.584 INFO:tasks.ceph.osd.3.trial162.stderr:2026-02-24T19:26:07.578+0000 c765640 -1 osd.3 372 *** Got signal Terminated *** 2026-02-24T19:26:12.028 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:09:10.002 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:26:12.052 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:09:10.026 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:26:12.061 INFO:tasks.ceph.mon.a.trial026.stderr:==00:00:09:10.035 44480== Warning: unimplemented fcntl command: 1036 2026-02-24T19:26:12.074 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:09:10.045 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:26:12.075 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:09:10.046 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:26:12.075 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:09:10.011 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:26:12.076 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:09:10.012 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:26:12.084 INFO:tasks.ceph.mon.b.trial070.stderr:==00:00:09:10.055 44262== Warning: unimplemented fcntl command: 1036 2026-02-24T19:26:12.086 INFO:tasks.ceph.mon.c.trial103.stderr:==00:00:09:10.022 44374== Warning: unimplemented fcntl command: 1036 2026-02-24T19:26:12.146 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2026-02-24T19:26:12.146 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.14 has been restored 2026-02-24T19:26:13.678 INFO:tasks.ceph.osd.3:Stopped 2026-02-24T19:26:13.678 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2026-02-24T19:26:13.679 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:26:13.686 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-24T19:26:13.679+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 (PID: 45128) UID: 0 2026-02-24T19:26:13.686 INFO:tasks.ceph.osd.7.trial162.stderr:2026-02-24T19:26:13.680+0000 c765640 -1 osd.7 372 *** Got signal Terminated *** 2026-02-24T19:26:17.852 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2026-02-24T19:26:17.852 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2026-02-24T19:26:19.780 INFO:tasks.ceph.osd.7:Stopped 2026-02-24T19:26:19.781 DEBUG:tasks.ceph.osd.11:waiting for process to exit 2026-02-24T19:26:19.781 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:26:19.788 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-24T19:26:19.781+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.11.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 11 (PID: 45131) UID: 0 2026-02-24T19:26:19.789 INFO:tasks.ceph.osd.11.trial162.stderr:2026-02-24T19:26:19.782+0000 c765640 -1 osd.11 372 *** Got signal Terminated *** 2026-02-24T19:26:23.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2026-02-24T19:26:25.882 INFO:tasks.ceph.osd.11:Stopped 2026-02-24T19:26:25.882 DEBUG:tasks.ceph.osd.15:waiting for process to exit 2026-02-24T19:26:25.882 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:26:25.889 INFO:tasks.ceph.osd.15.trial162.stderr:2026-02-24T19:26:25.883+0000 c765640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.15.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 15 (PID: 45133) UID: 0 2026-02-24T19:26:25.889 INFO:tasks.ceph.osd.15.trial162.stderr:2026-02-24T19:26:25.884+0000 c765640 -1 osd.15 372 *** Got signal Terminated *** 2026-02-24T19:26:29.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.15 is failed for ~0s 2026-02-24T19:26:31.984 INFO:tasks.ceph.osd.15:Stopped 2026-02-24T19:26:31.984 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-24T19:26:31.985 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2026-02-24T19:26:31.985 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:26:32.014 INFO:tasks.ceph.mgr.y:Stopped 2026-02-24T19:26:32.014 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-24T19:26:32.014 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:26:32.015 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-24T19:26:32.013+0000 7fbc245ed640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i x (PID: 44053) UID: 0 2026-02-24T19:26:32.015 INFO:tasks.ceph.mgr.x.trial162.stderr:2026-02-24T19:26:32.013+0000 7fbc245ed640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2026-02-24T19:26:32.047 INFO:tasks.ceph.mgr.x:Stopped 2026-02-24T19:26:32.047 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-24T19:26:32.047 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-24T19:26:32.048 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:26:32.064 INFO:tasks.ceph.mon.a.trial026.stderr:2026-02-24T19:26:32.057+0000 add7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 44478) UID: 0 2026-02-24T19:26:32.065 INFO:tasks.ceph.mon.a.trial026.stderr:2026-02-24T19:26:32.058+0000 add7640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-24T19:26:34.264 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2026-02-24T19:26:34.264 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.15 has been restored 2026-02-24T19:26:38.149 INFO:tasks.ceph.mon.a:Stopped 2026-02-24T19:26:38.150 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-24T19:26:38.150 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:26:38.158 INFO:tasks.ceph.mon.b.trial070.stderr:2026-02-24T19:26:38.150+0000 add7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 44260) UID: 0 2026-02-24T19:26:38.158 INFO:tasks.ceph.mon.b.trial070.stderr:2026-02-24T19:26:38.151+0000 add7640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2026-02-24T19:26:39.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2026-02-24T19:26:39.366 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2026-02-24T19:26:44.252 INFO:tasks.ceph.mon.b:Stopped 2026-02-24T19:26:44.252 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-24T19:26:44.252 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-24T19:26:44.260 INFO:tasks.ceph.mon.c.trial103.stderr:2026-02-24T19:26:44.253+0000 add7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 44372) UID: 0 2026-02-24T19:26:44.261 INFO:tasks.ceph.mon.c.trial103.stderr:2026-02-24T19:26:44.254+0000 add7640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2026-02-24T19:26:44.467 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2026-02-24T19:26:49.468 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2026-02-24T19:26:50.354 INFO:tasks.ceph.mon.c:Stopped 2026-02-24T19:26:50.354 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-24T19:26:50.354 DEBUG:teuthology.orchestra.run.trial026:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | egrep -v OSD_DOWN | head -n 1 2026-02-24T19:26:50.385 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial026.front.sepia.ceph.com 2026-02-24T19:26:50.385 DEBUG:teuthology.orchestra.run.trial026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-24T19:26:50.455 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@trial026.front.sepia.ceph.com 2026-02-24T19:26:50.455 DEBUG:teuthology.orchestra.run.trial026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2026-02-24T19:26:50.522 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-8 on ubuntu@trial026.front.sepia.ceph.com 2026-02-24T19:26:50.522 DEBUG:teuthology.orchestra.run.trial026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-8 2026-02-24T19:26:50.593 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-12 on ubuntu@trial026.front.sepia.ceph.com 2026-02-24T19:26:50.594 DEBUG:teuthology.orchestra.run.trial026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-12 2026-02-24T19:26:50.668 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial070.front.sepia.ceph.com 2026-02-24T19:26:50.668 DEBUG:teuthology.orchestra.run.trial070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-24T19:26:50.706 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@trial070.front.sepia.ceph.com 2026-02-24T19:26:50.706 DEBUG:teuthology.orchestra.run.trial070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2026-02-24T19:26:50.782 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-9 on ubuntu@trial070.front.sepia.ceph.com 2026-02-24T19:26:50.782 DEBUG:teuthology.orchestra.run.trial070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-9 2026-02-24T19:26:50.852 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-13 on ubuntu@trial070.front.sepia.ceph.com 2026-02-24T19:26:50.852 DEBUG:teuthology.orchestra.run.trial070:> sync && sudo umount -f /var/lib/ceph/osd/ceph-13 2026-02-24T19:26:50.920 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial103.front.sepia.ceph.com 2026-02-24T19:26:50.921 DEBUG:teuthology.orchestra.run.trial103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-24T19:26:50.962 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@trial103.front.sepia.ceph.com 2026-02-24T19:26:50.962 DEBUG:teuthology.orchestra.run.trial103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2026-02-24T19:26:51.035 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-10 on ubuntu@trial103.front.sepia.ceph.com 2026-02-24T19:26:51.035 DEBUG:teuthology.orchestra.run.trial103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-10 2026-02-24T19:26:51.110 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-14 on ubuntu@trial103.front.sepia.ceph.com 2026-02-24T19:26:51.111 DEBUG:teuthology.orchestra.run.trial103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-14 2026-02-24T19:26:51.183 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial162.front.sepia.ceph.com 2026-02-24T19:26:51.184 DEBUG:teuthology.orchestra.run.trial162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-24T19:26:51.239 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@trial162.front.sepia.ceph.com 2026-02-24T19:26:51.239 DEBUG:teuthology.orchestra.run.trial162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2026-02-24T19:26:51.274 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-11 on ubuntu@trial162.front.sepia.ceph.com 2026-02-24T19:26:51.275 DEBUG:teuthology.orchestra.run.trial162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-11 2026-02-24T19:26:51.350 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-15 on ubuntu@trial162.front.sepia.ceph.com 2026-02-24T19:26:51.351 DEBUG:teuthology.orchestra.run.trial162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-15 2026-02-24T19:26:51.427 INFO:tasks.ceph:Archiving mon data... 2026-02-24T19:26:51.428 DEBUG:teuthology.misc:Transferring archived files from trial026:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68687/data/mon.a.tgz 2026-02-24T19:26:51.429 DEBUG:teuthology.orchestra.run.trial026:> mktemp 2026-02-24T19:26:51.447 INFO:teuthology.orchestra.run.trial026.stdout:/tmp/tmp.KDXEqD3HV0 2026-02-24T19:26:51.447 DEBUG:teuthology.orchestra.run.trial026:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.KDXEqD3HV0 2026-02-24T19:26:51.626 DEBUG:teuthology.orchestra.run.trial026:> sudo chmod 0666 /tmp/tmp.KDXEqD3HV0 2026-02-24T19:26:51.708 DEBUG:teuthology.orchestra.remote:trial026:/tmp/tmp.KDXEqD3HV0 is 909KB 2026-02-24T19:26:51.813 DEBUG:teuthology.orchestra.run.trial026:> rm -fr /tmp/tmp.KDXEqD3HV0 2026-02-24T19:26:51.831 DEBUG:teuthology.misc:Transferring archived files from trial070:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68687/data/mon.b.tgz 2026-02-24T19:26:51.831 DEBUG:teuthology.orchestra.run.trial070:> mktemp 2026-02-24T19:26:51.849 INFO:teuthology.orchestra.run.trial070.stdout:/tmp/tmp.RlBpehOx9a 2026-02-24T19:26:51.849 DEBUG:teuthology.orchestra.run.trial070:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.RlBpehOx9a 2026-02-24T19:26:52.028 DEBUG:teuthology.orchestra.run.trial070:> sudo chmod 0666 /tmp/tmp.RlBpehOx9a 2026-02-24T19:26:52.108 DEBUG:teuthology.orchestra.remote:trial070:/tmp/tmp.RlBpehOx9a is 910KB 2026-02-24T19:26:52.209 DEBUG:teuthology.orchestra.run.trial070:> rm -fr /tmp/tmp.RlBpehOx9a 2026-02-24T19:26:52.226 DEBUG:teuthology.misc:Transferring archived files from trial103:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68687/data/mon.c.tgz 2026-02-24T19:26:52.226 DEBUG:teuthology.orchestra.run.trial103:> mktemp 2026-02-24T19:26:52.243 INFO:teuthology.orchestra.run.trial103.stdout:/tmp/tmp.aX7vkzI6jT 2026-02-24T19:26:52.244 DEBUG:teuthology.orchestra.run.trial103:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.aX7vkzI6jT 2026-02-24T19:26:52.423 DEBUG:teuthology.orchestra.run.trial103:> sudo chmod 0666 /tmp/tmp.aX7vkzI6jT 2026-02-24T19:26:52.504 DEBUG:teuthology.orchestra.remote:trial103:/tmp/tmp.aX7vkzI6jT is 910KB 2026-02-24T19:26:52.603 DEBUG:teuthology.orchestra.run.trial103:> rm -fr /tmp/tmp.aX7vkzI6jT 2026-02-24T19:26:52.620 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-24T19:26:52.621 DEBUG:teuthology.orchestra.run.trial026:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-24T19:26:52.623 DEBUG:teuthology.orchestra.run.trial070:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-24T19:26:52.626 DEBUG:teuthology.orchestra.run.trial103:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-24T19:26:52.662 DEBUG:teuthology.orchestra.run.trial162:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-24T19:26:52.945 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-24T19:26:53.202 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-24T19:26:53.461 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-24T19:26:53.672 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-24T19:26:53.672 INFO:tasks.ceph:Archiving crash dumps... 2026-02-24T19:26:53.674 DEBUG:teuthology.misc:Transferring archived files from trial026:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68687/remote/trial026/crash 2026-02-24T19:26:53.676 DEBUG:teuthology.orchestra.run.trial026:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-24T19:26:53.703 DEBUG:teuthology.misc:Transferring archived files from trial070:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68687/remote/trial070/crash 2026-02-24T19:26:53.704 DEBUG:teuthology.orchestra.run.trial070:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-24T19:26:53.730 DEBUG:teuthology.misc:Transferring archived files from trial103:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68687/remote/trial103/crash 2026-02-24T19:26:53.732 DEBUG:teuthology.orchestra.run.trial103:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-24T19:26:53.759 DEBUG:teuthology.misc:Transferring archived files from trial162:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68687/remote/trial162/crash 2026-02-24T19:26:53.760 DEBUG:teuthology.orchestra.run.trial162:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-24T19:26:53.787 INFO:tasks.ceph:Compressing logs... 2026-02-24T19:26:53.788 DEBUG:teuthology.orchestra.run.trial026:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T19:26:53.791 DEBUG:teuthology.orchestra.run.trial070:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T19:26:53.793 DEBUG:teuthology.orchestra.run.trial103:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T19:26:53.803 DEBUG:teuthology.orchestra.run.trial162:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T19:26:53.812 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46786.log 2026-02-24T19:26:53.824 INFO:teuthology.orchestra.run.trial070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-24T19:26:53.824 INFO:teuthology.orchestra.run.trial070.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.5.log 2026-02-24T19:26:53.825 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.13.log 2026-02-24T19:26:53.825 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/valgrind/osd.5.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.1.log 2026-02-24T19:26:53.825 INFO:teuthology.orchestra.run.trial070.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.5.log.gz 2026-02-24T19:26:53.825 INFO:teuthology.orchestra.run.trial070.stderr:gzip -5/var/log/ceph/valgrind/osd.13.log: --verbose -- /var/log/ceph/valgrind/osd.9.log 2026-02-24T19:26:53.825 INFO:teuthology.orchestra.run.trial070.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.13.log.gz 2026-02-24T19:26:53.825 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/valgrind/osd.1.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2026-02-24T19:26:53.825 INFO:teuthology.orchestra.run.trial070.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/osd.1.log.gz 2026-02-24T19:26:53.825 INFO:teuthology.orchestra.run.trial070.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-24T19:26:53.825 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/valgrind/osd.9.log: 66.0% -- replaced with /var/log/ceph/valgrind/osd.9.log.gz 2026-02-24T19:26:53.825 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-24T19:26:53.825 INFO:teuthology.orchestra.run.trial070.stderr: 65.5% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2026-02-24T19:26:53.826 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.13.log 2026-02-24T19:26:53.826 INFO:teuthology.orchestra.run.trial070.stderr:gzip -5 --verbose --/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.1.log 2026-02-24T19:26:53.826 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-osd.13.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-24T19:26:53.826 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.9.log 2026-02-24T19:26:53.826 INFO:teuthology.orchestra.run.trial070.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-osd.9.log: 88.4% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-24T19:26:53.826 INFO:teuthology.orchestra.run.trial070.stderr: 91.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-24T19:26:53.833 INFO:teuthology.orchestra.run.trial103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-24T19:26:53.833 INFO:teuthology.orchestra.run.trial103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-24T19:26:53.833 INFO:teuthology.orchestra.run.trial103.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.2.log 2026-02-24T19:26:53.833 INFO:teuthology.orchestra.run.trial103.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.6.log 2026-02-24T19:26:53.833 INFO:teuthology.orchestra.run.trial103.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.14.log 2026-02-24T19:26:53.834 INFO:teuthology.orchestra.run.trial103.stderr:/var/log/ceph/valgrind/osd.2.log: /var/log/ceph/valgrind/osd.6.log: 66.0% -- replaced with /var/log/ceph/valgrind/osd.2.log.gz 2026-02-24T19:26:53.834 INFO:teuthology.orchestra.run.trial103.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.10.log 2026-02-24T19:26:53.834 INFO:teuthology.orchestra.run.trial103.stderr: 66.1% -- replaced with /var/log/ceph/valgrind/osd.6.log.gz 2026-02-24T19:26:53.834 INFO:teuthology.orchestra.run.trial103.stderr:/var/log/ceph/valgrind/osd.14.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2026-02-24T19:26:53.834 INFO:teuthology.orchestra.run.trial103.stderr: 65.9% -- replaced with /var/log/ceph/valgrind/osd.14.log.gz 2026-02-24T19:26:53.834 INFO:teuthology.orchestra.run.trial103.stderr:/var/log/ceph/valgrind/osd.10.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.10.log 2026-02-24T19:26:53.834 INFO:teuthology.orchestra.run.trial103.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.10.log.gz 2026-02-24T19:26:53.834 INFO:teuthology.orchestra.run.trial103.stderr:/var/log/ceph/valgrind/mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.14.log 2026-02-24T19:26:53.834 INFO:teuthology.orchestra.run.trial103.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2026-02-24T19:26:53.834 INFO:teuthology.orchestra.run.trial103.stderr:/var/log/ceph/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-24T19:26:53.834 INFO:teuthology.orchestra.run.trial103.stderr:/var/log/ceph/ceph-osd.14.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2026-02-24T19:26:53.835 INFO:teuthology.orchestra.run.trial103.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-24T19:26:53.835 INFO:teuthology.orchestra.run.trial103.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph.log: 88.4% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-24T19:26:53.835 INFO:teuthology.orchestra.run.trial103.stderr: 91.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-24T19:26:53.857 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-24T19:26:53.857 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.46786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52601.log 2026-02-24T19:26:53.857 INFO:teuthology.orchestra.run.trial026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46786.log.gz 2026-02-24T19:26:53.857 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50700.log 2026-02-24T19:26:53.857 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-24T19:26:53.858 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.52601.log: /var/log/ceph/ceph-client.admin.50700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50886.log 2026-02-24T19:26:53.858 INFO:teuthology.orchestra.run.trial026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52601.log.gz 2026-02-24T19:26:53.858 INFO:teuthology.orchestra.run.trial026.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.50700.log.gz 2026-02-24T19:26:53.858 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50737.log 2026-02-24T19:26:53.858 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.50886.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2026-02-24T19:26:53.858 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.50737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44921.log 2026-02-24T19:26:53.858 INFO:teuthology.orchestra.run.trial026.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.50886.log.gz 2026-02-24T19:26:53.858 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44990.log 2026-02-24T19:26:53.858 INFO:teuthology.orchestra.run.trial026.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.50737.log.gz 2026-02-24T19:26:53.858 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.44921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51259.log 2026-02-24T19:26:53.858 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.44990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50185.log 2026-02-24T19:26:53.858 INFO:teuthology.orchestra.run.trial026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44921.log.gz 2026-02-24T19:26:53.858 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.51259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48711.log 2026-02-24T19:26:53.858 INFO:teuthology.orchestra.run.trial026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44990.log.gz 2026-02-24T19:26:53.858 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.50185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53434.log 2026-02-24T19:26:53.858 INFO:teuthology.orchestra.run.trial026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51259.log.gz 2026-02-24T19:26:53.858 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.48711.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.50185.log.gz 2026-02-24T19:26:53.858 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50047.log 2026-02-24T19:26:53.858 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.53434.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48711.log.gz 2026-02-24T19:26:53.859 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51034.log 2026-02-24T19:26:53.859 INFO:teuthology.orchestra.run.trial026.stderr:gzip/var/log/ceph/ceph-client.admin.50047.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50162.log 2026-02-24T19:26:53.859 INFO:teuthology.orchestra.run.trial026.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53434.log.gz 2026-02-24T19:26:53.859 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.51034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49305.log 2026-02-24T19:26:53.859 INFO:teuthology.orchestra.run.trial026.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.50047.log.gz 2026-02-24T19:26:53.859 INFO:teuthology.orchestra.run.trial026.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.51034.log.gz 2026-02-24T19:26:53.859 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.50162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49294.log 2026-02-24T19:26:53.859 INFO:teuthology.orchestra.run.trial026.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.50162.log.gz 2026-02-24T19:26:53.859 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49297.log 2026-02-24T19:26:53.859 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.49305.log: /var/log/ceph/ceph-client.admin.49294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49312.log 2026-02-24T19:26:53.859 INFO:teuthology.orchestra.run.trial026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49305.log.gz 2026-02-24T19:26:53.859 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.49297.log: gzip -5 --verbose 87.5% -- /var/log/ceph/ceph-client.admin.49911.log -- replaced with /var/log/ceph/ceph-client.admin.49294.log.gz 2026-02-24T19:26:53.859 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:26:53.859 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.49312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49280.log 2026-02-24T19:26:53.859 INFO:teuthology.orchestra.run.trial026.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49297.log.gz 2026-02-24T19:26:53.859 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.49911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50570.log 2026-02-24T19:26:53.859 INFO:teuthology.orchestra.run.trial026.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49312.log.gz 2026-02-24T19:26:53.859 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.49280.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.49911.log.gz 2026-02-24T19:26:53.859 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48858.log 2026-02-24T19:26:53.860 INFO:teuthology.orchestra.run.trial026.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49280.log.gz 2026-02-24T19:26:53.860 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.50570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49278.log 2026-02-24T19:26:53.860 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.48858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49931.log 2026-02-24T19:26:53.860 INFO:teuthology.orchestra.run.trial026.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.50570.log.gz 2026-02-24T19:26:53.860 INFO:teuthology.orchestra.run.trial026.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2026-02-24T19:26:53.860 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.49278.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.0.log 2026-02-24T19:26:53.860 INFO:teuthology.orchestra.run.trial026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48858.log.gz 2026-02-24T19:26:53.860 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.12.log 2026-02-24T19:26:53.860 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.49931.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49278.log.gz 2026-02-24T19:26:53.860 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/valgrind/osd.0.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.8.log 2026-02-24T19:26:53.860 INFO:teuthology.orchestra.run.trial026.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.0.log.gz 2026-02-24T19:26:53.860 INFO:teuthology.orchestra.run.trial026.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.49931.log.gz 2026-02-24T19:26:53.860 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/valgrind/osd.12.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2026-02-24T19:26:53.860 INFO:teuthology.orchestra.run.trial026.stderr: 65.9% -- replaced with /var/log/ceph/valgrind/osd.12.log.gz 2026-02-24T19:26:53.860 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/valgrind/osd.8.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.4.log 2026-02-24T19:26:53.860 INFO:teuthology.orchestra.run.trial026.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.8.log.gz 2026-02-24T19:26:53.860 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/valgrind/mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49306.log 2026-02-24T19:26:53.860 INFO:teuthology.orchestra.run.trial026.stderr: 65.5% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2026-02-24T19:26:53.860 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/valgrind/osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52405.log 2026-02-24T19:26:53.860 INFO:teuthology.orchestra.run.trial026.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/osd.4.log.gz 2026-02-24T19:26:53.860 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.49306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52307.log 2026-02-24T19:26:53.861 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.52405.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.49306.log.gz 2026-02-24T19:26:53.861 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44944.log 2026-02-24T19:26:53.861 INFO:teuthology.orchestra.run.trial026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52405.log.gz 2026-02-24T19:26:53.861 INFO:teuthology.orchestra.run.trial026.stderr:gzip/var/log/ceph/ceph-client.admin.52307.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50663.log 2026-02-24T19:26:53.861 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.44944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52356.log 2026-02-24T19:26:53.861 INFO:teuthology.orchestra.run.trial026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52307.log.gz 2026-02-24T19:26:53.861 INFO:teuthology.orchestra.run.trial026.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44944.log.gz 2026-02-24T19:26:53.861 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.50663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49307.log 2026-02-24T19:26:53.861 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.52356.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.50663.log.gz 2026-02-24T19:26:53.861 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50018.log 2026-02-24T19:26:53.861 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.49307.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52356.log.gz 2026-02-24T19:26:53.861 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44531.log 2026-02-24T19:26:53.861 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.50018.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49307.log.gz 2026-02-24T19:26:53.861 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49304.log 2026-02-24T19:26:53.861 INFO:teuthology.orchestra.run.trial026.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50018.log.gz 2026-02-24T19:26:53.861 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.44531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52552.log 2026-02-24T19:26:53.861 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49724.log 2026-02-24T19:26:53.861 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.49304.log: /var/log/ceph/ceph-client.admin.52552.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.44531.log.gz 2026-02-24T19:26:53.861 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52209.log 2026-02-24T19:26:53.861 INFO:teuthology.orchestra.run.trial026.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49304.log.gz 2026-02-24T19:26:53.861 INFO:teuthology.orchestra.run.trial026.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.52552.log.gz 2026-02-24T19:26:53.861 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50077.log 2026-02-24T19:26:53.862 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.49724.log: /var/log/ceph/ceph-client.admin.52209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49275.log 2026-02-24T19:26:53.862 INFO:teuthology.orchestra.run.trial026.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49724.log.gz 2026-02-24T19:26:53.862 INFO:teuthology.orchestra.run.trial026.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52209.log.gz 2026-02-24T19:26:53.862 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.50077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51504.log 2026-02-24T19:26:53.862 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.49275.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.50077.log.gz 2026-02-24T19:26:53.862 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50814.log 2026-02-24T19:26:53.862 INFO:teuthology.orchestra.run.trial026.stderr: 87.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.49275.log.gz 2026-02-24T19:26:53.862 INFO:teuthology.orchestra.run.trial026.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.12.log 2026-02-24T19:26:53.862 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.51504.log: /var/log/ceph/ceph-client.admin.50814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52895.log 2026-02-24T19:26:53.862 INFO:teuthology.orchestra.run.trial026.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51504.log.gz 2026-02-24T19:26:53.862 INFO:teuthology.orchestra.run.trial026.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50814.log.gz 2026-02-24T19:26:53.862 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-osd.12.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50029.log 2026-02-24T19:26:53.862 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.52895.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-24T19:26:53.862 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.50029.log: gzip -5 --verbose -- 87.6% /var/log/ceph/ceph-client.admin.51768.log 2026-02-24T19:26:53.862 INFO:teuthology.orchestra.run.trial026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52895.log.gz 2026-02-24T19:26:53.862 INFO:teuthology.orchestra.run.trial026.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.50029.log.gz 2026-02-24T19:26:53.862 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52160.log 2026-02-24T19:26:53.862 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.51768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52846.log 2026-02-24T19:26:53.862 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52650.log 2026-02-24T19:26:53.862 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.52160.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51768.log.gz 2026-02-24T19:26:53.862 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.52846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50908.log 2026-02-24T19:26:53.862 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.52650.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52846.log.gz 2026-02-24T19:26:53.863 INFO:teuthology.orchestra.run.trial026.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52160.log.gz 2026-02-24T19:26:53.863 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51296.log 2026-02-24T19:26:53.863 INFO:teuthology.orchestra.run.trial026.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52650.log.gz 2026-02-24T19:26:53.863 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.50908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53481.log 2026-02-24T19:26:53.863 INFO:teuthology.orchestra.run.trial026.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.50908.log.gz 2026-02-24T19:26:53.863 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50504.log 2026-02-24T19:26:53.863 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.51296.log: /var/log/ceph/ceph-client.admin.53481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50017.log 2026-02-24T19:26:53.863 INFO:teuthology.orchestra.run.trial026.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.51296.log.gz 2026-02-24T19:26:53.863 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.50504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53238.log 2026-02-24T19:26:53.863 INFO:teuthology.orchestra.run.trial026.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53481.log.gz 2026-02-24T19:26:53.863 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.50017.log: gzip 86.6% -- replaced with /var/log/ceph/ceph-client.admin.50504.log.gz -5 2026-02-24T19:26:53.863 INFO:teuthology.orchestra.run.trial026.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52503.log 2026-02-24T19:26:53.863 INFO:teuthology.orchestra.run.trial026.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.50017.log.gz 2026-02-24T19:26:53.863 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.53238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48646.log 2026-02-24T19:26:53.863 INFO:teuthology.orchestra.run.trial026.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53238.log.gz 2026-02-24T19:26:53.863 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.52503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51455.log 2026-02-24T19:26:53.863 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.48646.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-24T19:26:53.863 INFO:teuthology.orchestra.run.trial026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52503.log.gz 2026-02-24T19:26:53.863 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.51455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51817.log 2026-02-24T19:26:53.863 INFO:teuthology.orchestra.run.trial026.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48646.log.gz 2026-02-24T19:26:53.863 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph.audit.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51455.log.gz 2026-02-24T19:26:53.863 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52013.log 2026-02-24T19:26:53.863 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52944.log 2026-02-24T19:26:53.864 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.51817.log: /var/log/ceph/ceph-client.admin.52013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53385.log 2026-02-24T19:26:53.864 INFO:teuthology.orchestra.run.trial026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51817.log.gz 2026-02-24T19:26:53.864 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.52944.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52013.log.gz 2026-02-24T19:26:53.864 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53091.log 2026-02-24T19:26:53.864 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose 87.2% -- /var/log/ceph/ceph-client.admin.48486.log -- replaced with /var/log/ceph/ceph-client.admin.52944.log.gz 2026-02-24T19:26:53.864 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:26:53.864 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.53385.log: /var/log/ceph/ceph-client.admin.53091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49944.log 2026-02-24T19:26:53.864 INFO:teuthology.orchestra.run.trial026.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53385.log.gz 2026-02-24T19:26:53.864 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.48486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51095.log 2026-02-24T19:26:53.864 INFO:teuthology.orchestra.run.trial026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53091.log.gz 2026-02-24T19:26:53.864 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.49944.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48486.log.gz 2026-02-24T19:26:53.864 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51866.log 2026-02-24T19:26:53.864 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.51095.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.49944.log.gz 2026-02-24T19:26:53.864 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52748.log 2026-02-24T19:26:53.864 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.51866.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.51095.log.gz 2026-02-24T19:26:53.864 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52699.log 2026-02-24T19:26:53.864 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.52748.log: gzip 86.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.51866.log.gz --verbose 2026-02-24T19:26:53.864 INFO:teuthology.orchestra.run.trial026.stderr: -- /var/log/ceph/ceph-client.admin.52062.log 2026-02-24T19:26:53.864 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.52699.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52748.log.gz 2026-02-24T19:26:53.864 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51380.log 2026-02-24T19:26:53.864 INFO:teuthology.orchestra.run.trial026.stderr: 91.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-24T19:26:53.864 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.52062.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52699.log.gz 2026-02-24T19:26:53.864 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50048.log 2026-02-24T19:26:53.864 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.51380.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52062.log.gz 2026-02-24T19:26:53.865 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52258.log 2026-02-24T19:26:53.865 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.50048.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.51380.log.gz 2026-02-24T19:26:53.865 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50050.log 2026-02-24T19:26:53.865 INFO:teuthology.orchestra.run.trial026.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.50048.log.gz 2026-02-24T19:26:53.865 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51719.log 2026-02-24T19:26:53.865 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.52258.log: /var/log/ceph/ceph-client.admin.50050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49308.log 2026-02-24T19:26:53.865 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.51719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53336.log 2026-02-24T19:26:53.865 INFO:teuthology.orchestra.run.trial026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52258.log.gz 2026-02-24T19:26:53.865 INFO:teuthology.orchestra.run.trial026.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.50050.log.gz 2026-02-24T19:26:53.865 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.49308.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51719.log.gz 2026-02-24T19:26:53.865 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50596.log 2026-02-24T19:26:53.865 INFO:teuthology.orchestra.run.trial026.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49308.log.gz 2026-02-24T19:26:53.865 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.53336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51353.log 2026-02-24T19:26:53.865 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.50596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51964.log 2026-02-24T19:26:53.865 INFO:teuthology.orchestra.run.trial026.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53336.log.gz 2026-02-24T19:26:53.865 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.51353.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.50596.log.gz 2026-02-24T19:26:53.865 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51915.log 2026-02-24T19:26:53.865 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.51964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49295.log 2026-02-24T19:26:53.865 INFO:teuthology.orchestra.run.trial026.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51353.log.gz 2026-02-24T19:26:53.865 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.51915.log: gzip 86.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.51964.log.gz -- 2026-02-24T19:26:53.865 INFO:teuthology.orchestra.run.trial026.stderr: /var/log/ceph/ceph-client.admin.51143.log 2026-02-24T19:26:53.865 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.49295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49272.log 2026-02-24T19:26:53.865 INFO:teuthology.orchestra.run.trial026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51915.log.gz 2026-02-24T19:26:53.865 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.51143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51670.log 2026-02-24T19:26:53.865 INFO:teuthology.orchestra.run.trial026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49295.log.gz 2026-02-24T19:26:53.866 INFO:teuthology.orchestra.run.trial026.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.51143.log.gz 2026-02-24T19:26:53.866 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.49272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51037.log 2026-02-24T19:26:53.866 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.51670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49808.log 2026-02-24T19:26:53.866 INFO:teuthology.orchestra.run.trial026.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49272.log.gz 2026-02-24T19:26:53.866 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.51037.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.38182.log 2026-02-24T19:26:53.866 INFO:teuthology.orchestra.run.trial026.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51670.log.gz 2026-02-24T19:26:53.866 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.49808.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.51037.log.gz 2026-02-24T19:26:53.866 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51553.log 2026-02-24T19:26:53.866 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph.tmp-client.admin.38182.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.49808.log.gz 2026-02-24T19:26:53.866 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48760.log 2026-02-24T19:26:53.866 INFO:teuthology.orchestra.run.trial026.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.38182.log.gz 2026-02-24T19:26:53.866 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.51553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48549.log 2026-02-24T19:26:53.866 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.48760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52454.log 2026-02-24T19:26:53.866 INFO:teuthology.orchestra.run.trial026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51553.log.gz 2026-02-24T19:26:53.866 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.48549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52993.log 2026-02-24T19:26:53.866 INFO:teuthology.orchestra.run.trial026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48760.log.gz 2026-02-24T19:26:53.866 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.52454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52111.log 2026-02-24T19:26:53.866 INFO:teuthology.orchestra.run.trial026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48549.log.gz 2026-02-24T19:26:53.866 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.52993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49283.log 2026-02-24T19:26:53.866 INFO:teuthology.orchestra.run.trial026.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52454.log.gz 2026-02-24T19:26:53.866 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.52111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44653.log 2026-02-24T19:26:53.866 INFO:teuthology.orchestra.run.trial026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52993.log.gz 2026-02-24T19:26:53.866 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.49283.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.52111.log.gz 2026-02-24T19:26:53.866 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49300.log 2026-02-24T19:26:53.867 INFO:teuthology.orchestra.run.trial026.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.49283.log.gz 2026-02-24T19:26:53.867 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.44653.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-24T19:26:53.867 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.49300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48619.log 2026-02-24T19:26:53.867 INFO:teuthology.orchestra.run.trial026.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.44653.log.gz 2026-02-24T19:26:53.867 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50917.log 2026-02-24T19:26:53.867 INFO:teuthology.orchestra.run.trial026.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49300.log.gz 2026-02-24T19:26:53.867 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.48619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53042.log 2026-02-24T19:26:53.867 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.50917.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48619.log.gz 2026-02-24T19:26:53.867 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50475.log 2026-02-24T19:26:53.867 INFO:teuthology.orchestra.run.trial026.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.50917.log.gz 2026-02-24T19:26:53.867 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.53042.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.8.log 2026-02-24T19:26:53.867 INFO:teuthology.orchestra.run.trial026.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53042.log.gz 2026-02-24T19:26:53.867 INFO:teuthology.orchestra.run.trial026.stderr:gzip/var/log/ceph/ceph-client.admin.50475.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53287.log 2026-02-24T19:26:53.867 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53140.log 2026-02-24T19:26:53.867 INFO:teuthology.orchestra.run.trial026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50475.log.gz 2026-02-24T19:26:53.867 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.53287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51036.log 2026-02-24T19:26:53.867 INFO:teuthology.orchestra.run.trial026.stderr: 88.4% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-24T19:26:53.867 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.53140.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53287.log.gz 2026-02-24T19:26:53.867 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49996.log 2026-02-24T19:26:53.867 INFO:teuthology.orchestra.run.trial026.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53140.log.gz 2026-02-24T19:26:53.867 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.51036.log: /var/log/ceph/ceph-client.admin.48809.log 2026-02-24T19:26:53.867 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.49996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49741.log 2026-02-24T19:26:53.867 INFO:teuthology.orchestra.run.trial026.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.51036.log.gz 2026-02-24T19:26:53.867 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.48809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51621.log 2026-02-24T19:26:53.867 INFO:teuthology.orchestra.run.trial026.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.49996.log.gz 2026-02-24T19:26:53.868 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.49741.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48809.log.gz 2026-02-24T19:26:53.868 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53189.log 2026-02-24T19:26:53.868 INFO:teuthology.orchestra.run.trial026.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.49741.log.gz 2026-02-24T19:26:53.868 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.51621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49285.log 2026-02-24T19:26:53.868 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.53189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52797.log 2026-02-24T19:26:53.868 INFO:teuthology.orchestra.run.trial026.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51621.log.gz 2026-02-24T19:26:53.868 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.49285.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53189.log.gz 2026-02-24T19:26:53.868 INFO:teuthology.orchestra.run.trial026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49285.log.gz 2026-02-24T19:26:53.868 INFO:teuthology.orchestra.run.trial026.stderr:/var/log/ceph/ceph-client.admin.52797.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52797.log.gz 2026-02-24T19:26:53.876 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49491.log 2026-02-24T19:26:53.876 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48868.log 2026-02-24T19:26:53.876 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49564.log 2026-02-24T19:26:53.876 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49491.log: /var/log/ceph/ceph-client.admin.48868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49407.log 2026-02-24T19:26:53.876 INFO:teuthology.orchestra.run.trial162.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.49491.log.gz 2026-02-24T19:26:53.876 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44365.log 2026-02-24T19:26:53.876 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44318.log 2026-02-24T19:26:53.876 INFO:teuthology.orchestra.run.trial162.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49564.log.gz 2026-02-24T19:26:53.876 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51114.log 2026-02-24T19:26:53.876 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.44365.log: /var/log/ceph/ceph-client.admin.44318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57694.log 2026-02-24T19:26:53.876 INFO:teuthology.orchestra.run.trial162.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.44365.log.gz 2026-02-24T19:26:53.876 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.51114.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44318.log.gz 2026-02-24T19:26:53.876 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-24T19:26:53.876 INFO:teuthology.orchestra.run.trial162.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49407.log.gz 2026-02-24T19:26:53.876 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51115.log 2026-02-24T19:26:53.876 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.57694.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51624.log 2026-02-24T19:26:53.876 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48906.log 2026-02-24T19:26:53.876 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.51115.log: /var/log/ceph/ceph-client.admin.51624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44631.log 2026-02-24T19:26:53.876 INFO:teuthology.orchestra.run.trial162.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.51114.log.gz 2026-02-24T19:26:53.876 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.48906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49213.log 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.44631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44773.log 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.57694.log.gz 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44631.log.gz 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49072.log 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.51115.log.gz 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.44773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44486.log 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49072.log: 90.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.51624.log.gz -5 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49260.log 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44773.log.gz 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.44486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49579.log 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.44486.log.gz 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49890.log 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49731.log 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49890.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44584.log 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.7.log 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.44584.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.11.log 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44584.log.gz 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/valgrind/osd.7.log: 66.0% -- replaced with /var/log/ceph/valgrind/osd.7.log.gz 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.15.log 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49213.log.gz 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/valgrind/osd.11.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.3.log 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.49579.log.gz 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.11.log.gz 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/valgrind/osd.15.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49072.log.gz 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44726.log 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/osd.15.log.gz 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/valgrind/osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49001.log 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/osd.3.log.gz 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.44726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49613.log 2026-02-24T19:26:53.877 INFO:teuthology.orchestra.run.trial162.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44726.log.gz 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54032.log 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.49260.log.gz 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49613.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.11.log 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.54032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49201.log 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49613.log.gz 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49469.log 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48885.log 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49018.log 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.48885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49307.log 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.49001.log.gz 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.54032.log.gz 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49580.log 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51626.log 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49810.log 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.48906.log.gz 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49201.log.gz 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr:gzip/var/log/ceph/ceph-client.admin.51626.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49336.log 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49620.log 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44213.log 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48926.log 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49620.log.gz 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.44213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50990.log 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.49469.log.gz 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.48926.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.44213.log.gz 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49772.log 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.48885.log.gz 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.51626.log.gz 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.50990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57690.log 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49580.log.gz 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49582.log 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.49307.log.gz 2026-02-24T19:26:53.878 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.57690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44961.log 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49424.log 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.44961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50992.log 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.48926.log.gz 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48845.log 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.50992.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.50990.log.gz 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49336.log.gz 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44678.log 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.49582.log.gz 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44961.log.gz 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.48845.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.49810.log.gz 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49847.log 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr: 90.2%/var/log/ceph/ceph-client.admin.44678.log: -- replaced with /var/log/ceph/ceph-client.admin.57690.log.gz 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45008.log 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44678.log.gz 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48967.log 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.45008.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.50992.log.gz 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44914.log 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.48967.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45008.log.gzgzip 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49611.log 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.44914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48953.log 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44914.log.gz 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49885.log 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49592.log 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.48953.log: /var/log/ceph/ceph-client.admin.49885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51625.log 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44820.log 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.48967.log.gz 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.51625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49694.log 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.44820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54030.log 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.49611.log.gz 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49642.log 2026-02-24T19:26:53.879 INFO:teuthology.orchestra.run.trial162.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44820.log.gz 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.54030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54031.log 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49694.log.gz 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49642.log: gzip -5 --verbose 90.2% -- /var/log/ceph/ceph-client.admin.49149.log -- replaced with /var/log/ceph/ceph-client.admin.49592.log.gz 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.51625.log.gz 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.54031.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.49731.log.gz 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49826.log 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49885.log.gz 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49871.log 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50974.log 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.54030.log.gz 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54028.log 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.50974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49595.log 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.54031.log.gz 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.54028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44867.log 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.49826.log.gz 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49107.log 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.44867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44261.log 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49595.log.gz 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49107.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44867.log.gz 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44537.log 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.44261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54029.log 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.50974.log.gz 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.44537.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.54028.log.gz 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.44261.log.gz 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.49847.log.gz 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49039.log 2026-02-24T19:26:53.882 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.54029.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44537.log.gz 2026-02-24T19:26:53.883 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50991.log 2026-02-24T19:26:53.883 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49363.log 2026-02-24T19:26:53.883 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.50991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51116.log 2026-02-24T19:26:53.883 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49363.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.54029.log.gz 2026-02-24T19:26:53.883 INFO:teuthology.orchestra.run.trial162.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50991.log.gz 2026-02-24T19:26:53.883 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49166.log 2026-02-24T19:26:53.883 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.15.log 2026-02-24T19:26:53.883 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.51116.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.49772.log.gz 2026-02-24T19:26:53.883 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.49166.log: gzip 90.1% -- replaced with /var/log/ceph/ceph-client.admin.49642.log.gz -5 2026-02-24T19:26:53.883 INFO:teuthology.orchestra.run.trial162.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50975.log 2026-02-24T19:26:53.884 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-osd.15.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57695.log 2026-02-24T19:26:53.884 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.50975.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.49149.log.gz 2026-02-24T19:26:53.884 INFO:teuthology.orchestra.run.trial162.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.49107.log.gz 2026-02-24T19:26:53.884 INFO:teuthology.orchestra.run.trial162.stderr:/var/log/ceph/ceph-client.admin.57695.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.50975.log.gz 2026-02-24T19:26:53.884 INFO:teuthology.orchestra.run.trial162.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.51116.log.gz 2026-02-24T19:26:53.884 INFO:teuthology.orchestra.run.trial162.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.49890.log.gz 2026-02-24T19:26:53.884 INFO:teuthology.orchestra.run.trial162.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.49871.log.gz 2026-02-24T19:26:53.884 INFO:teuthology.orchestra.run.trial162.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49166.log.gz 2026-02-24T19:26:53.884 INFO:teuthology.orchestra.run.trial162.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.57695.log.gz 2026-02-24T19:26:53.885 INFO:teuthology.orchestra.run.trial162.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.49363.log.gz 2026-02-24T19:26:53.887 INFO:teuthology.orchestra.run.trial162.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48845.log.gz 2026-02-24T19:26:53.894 INFO:teuthology.orchestra.run.trial162.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.48868.log.gz 2026-02-24T19:26:53.897 INFO:teuthology.orchestra.run.trial162.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.49424.log.gz 2026-02-24T19:26:53.903 INFO:teuthology.orchestra.run.trial162.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.48953.log.gz 2026-02-24T19:26:53.922 INFO:teuthology.orchestra.run.trial162.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.49039.log.gz 2026-02-24T19:26:53.948 INFO:teuthology.orchestra.run.trial162.stderr: 89.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-24T19:26:54.342 INFO:teuthology.orchestra.run.trial162.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.49018.log.gz 2026-02-24T19:26:54.457 INFO:teuthology.orchestra.run.trial070.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-24T19:26:54.469 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2026-02-24T19:26:54.492 INFO:teuthology.orchestra.run.trial103.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-24T19:26:54.545 INFO:teuthology.orchestra.run.trial070.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-24T19:26:54.550 INFO:teuthology.orchestra.run.trial026.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.12.log.gz 2026-02-24T19:26:54.552 INFO:teuthology.orchestra.run.trial026.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-24T19:26:54.571 INFO:teuthology.orchestra.run.trial070.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-24T19:26:54.579 INFO:teuthology.orchestra.run.trial026.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.8.log.gz 2026-02-24T19:26:54.581 INFO:teuthology.orchestra.run.trial070.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.9.log.gz 2026-02-24T19:26:54.583 INFO:teuthology.orchestra.run.trial026.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-24T19:26:54.585 INFO:teuthology.orchestra.run.trial103.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2026-02-24T19:26:54.596 INFO:teuthology.orchestra.run.trial103.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.14.log.gz 2026-02-24T19:26:54.633 INFO:teuthology.orchestra.run.trial103.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-24T19:26:54.636 INFO:teuthology.orchestra.run.trial162.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-24T19:26:54.637 INFO:teuthology.orchestra.run.trial103.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.10.log.gz 2026-02-24T19:26:54.639 INFO:teuthology.orchestra.run.trial103.stderr: 2026-02-24T19:26:54.639 INFO:teuthology.orchestra.run.trial103.stderr:real 0m0.823s 2026-02-24T19:26:54.639 INFO:teuthology.orchestra.run.trial103.stderr:user 0m3.660s 2026-02-24T19:26:54.639 INFO:teuthology.orchestra.run.trial103.stderr:sys 0m0.176s 2026-02-24T19:26:54.640 INFO:teuthology.orchestra.run.trial070.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.13.log.gz 2026-02-24T19:26:54.641 INFO:teuthology.orchestra.run.trial070.stderr: 2026-02-24T19:26:54.641 INFO:teuthology.orchestra.run.trial070.stderr:real 0m0.835s 2026-02-24T19:26:54.641 INFO:teuthology.orchestra.run.trial070.stderr:user 0m3.521s 2026-02-24T19:26:54.641 INFO:teuthology.orchestra.run.trial070.stderr:sys 0m0.202s 2026-02-24T19:26:54.650 INFO:teuthology.orchestra.run.trial162.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2026-02-24T19:26:54.714 INFO:teuthology.orchestra.run.trial162.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.11.log.gz 2026-02-24T19:26:54.817 INFO:teuthology.orchestra.run.trial162.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.15.log.gz 2026-02-24T19:26:54.819 INFO:teuthology.orchestra.run.trial162.stderr: 2026-02-24T19:26:54.820 INFO:teuthology.orchestra.run.trial162.stderr:real 0m0.969s 2026-02-24T19:26:54.820 INFO:teuthology.orchestra.run.trial162.stderr:user 0m4.004s 2026-02-24T19:26:54.820 INFO:teuthology.orchestra.run.trial162.stderr:sys 0m0.258s 2026-02-24T19:26:54.864 INFO:teuthology.orchestra.run.trial026.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-24T19:26:54.866 INFO:teuthology.orchestra.run.trial026.stderr: 2026-02-24T19:26:54.866 INFO:teuthology.orchestra.run.trial026.stderr:real 0m1.061s 2026-02-24T19:26:54.866 INFO:teuthology.orchestra.run.trial026.stderr:user 0m3.878s 2026-02-24T19:26:54.866 INFO:teuthology.orchestra.run.trial026.stderr:sys 0m0.243s 2026-02-24T19:26:54.867 INFO:tasks.ceph:Archiving logs... 2026-02-24T19:26:54.867 DEBUG:teuthology.misc:Transferring archived files from trial026:/var/log/ceph to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68687/remote/trial026/log 2026-02-24T19:26:54.877 DEBUG:teuthology.orchestra.run.trial026:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T19:26:55.332 DEBUG:teuthology.misc:Transferring archived files from trial070:/var/log/ceph to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68687/remote/trial070/log 2026-02-24T19:26:55.333 DEBUG:teuthology.orchestra.run.trial070:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T19:26:55.661 DEBUG:teuthology.misc:Transferring archived files from trial103:/var/log/ceph to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68687/remote/trial103/log 2026-02-24T19:26:55.662 DEBUG:teuthology.orchestra.run.trial103:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T19:26:56.001 DEBUG:teuthology.misc:Transferring archived files from trial162:/var/log/ceph to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68687/remote/trial162/log 2026-02-24T19:26:56.002 DEBUG:teuthology.orchestra.run.trial162:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-24T19:26:56.419 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-24T19:26:56.433 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-24T19:26:56.433 DEBUG:teuthology.orchestra.run.trial026:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T19:26:56.435 DEBUG:teuthology.orchestra.run.trial070:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T19:26:56.437 DEBUG:teuthology.orchestra.run.trial103:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T19:26:56.439 DEBUG:teuthology.orchestra.run.trial162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-24T19:26:56.693 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-24T19:26:56.706 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-24T19:26:56.706 DEBUG:teuthology.orchestra.run.trial026:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T19:26:56.708 DEBUG:teuthology.orchestra.run.trial070:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T19:26:56.709 DEBUG:teuthology.orchestra.run.trial103:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T19:26:56.711 DEBUG:teuthology.orchestra.run.trial162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-24T19:26:56.722 INFO:teuthology.orchestra.run.trial026.stderr:bash: line 1: ntpq: command not found 2026-02-24T19:26:56.724 INFO:teuthology.orchestra.run.trial070.stderr:bash: line 1: ntpq: command not found 2026-02-24T19:26:56.725 INFO:teuthology.orchestra.run.trial103.stderr:bash: line 1: ntpq: command not found 2026-02-24T19:26:56.728 INFO:teuthology.orchestra.run.trial162.stderr:bash: line 1: ntpq: command not found 2026-02-24T19:26:56.741 INFO:teuthology.orchestra.run.trial103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T19:26:56.741 INFO:teuthology.orchestra.run.trial103.stdout:=============================================================================== 2026-02-24T19:26:56.741 INFO:teuthology.orchestra.run.trial103.stdout:^- 170-187-147-56.ip.linode> 2 9 377 486 -8186us[-8186us] +/- 81ms 2026-02-24T19:26:56.741 INFO:teuthology.orchestra.run.trial103.stdout:^+ 44.190.5.123 2 7 377 103 +769us[ +769us] +/- 33ms 2026-02-24T19:26:56.742 INFO:teuthology.orchestra.run.trial103.stdout:^* 108.61.215.221.vultruser> 2 9 377 492 -535us[ -557us] +/- 23ms 2026-02-24T19:26:56.742 INFO:teuthology.orchestra.run.trial103.stdout:^- 23.186.168.129 2 8 173 160 -31us[ -31us] +/- 56ms 2026-02-24T19:26:56.755 INFO:teuthology.orchestra.run.trial162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T19:26:56.756 INFO:teuthology.orchestra.run.trial162.stdout:=============================================================================== 2026-02-24T19:26:56.756 INFO:teuthology.orchestra.run.trial162.stdout:^- 172-233-177-198.ip.linod> 2 8 377 232 -14ms[ -14ms] +/- 94ms 2026-02-24T19:26:56.756 INFO:teuthology.orchestra.run.trial162.stdout:^* nyc2.us.ntp.li 2 9 377 237 -190us[ -213us] +/- 3014us 2026-02-24T19:26:56.756 INFO:teuthology.orchestra.run.trial162.stdout:^- beta.kenyonralph.com 3 7 377 169 -2295us[-2295us] +/- 33ms 2026-02-24T19:26:56.756 INFO:teuthology.orchestra.run.trial162.stdout:^- 216-144-228-179-host.col> 2 9 377 489 -80us[ -101us] +/- 11ms 2026-02-24T19:26:56.756 INFO:teuthology.orchestra.run.trial070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T19:26:56.756 INFO:teuthology.orchestra.run.trial070.stdout:=============================================================================== 2026-02-24T19:26:56.757 INFO:teuthology.orchestra.run.trial070.stdout:^+ srcf-ntp.stanford.edu 2 9 377 95 +1944us[+1944us] +/- 74ms 2026-02-24T19:26:56.757 INFO:teuthology.orchestra.run.trial070.stdout:^+ 73.185.182.209 2 9 377 237 +1765us[ +357us] +/- 56ms 2026-02-24T19:26:56.757 INFO:teuthology.orchestra.run.trial070.stdout:^+ lax1.us.ntp.li 2 9 377 487 +773us[ -770us] +/- 34ms 2026-02-24T19:26:56.757 INFO:teuthology.orchestra.run.trial070.stdout:^* frumentum-zeus.infra.fru> 2 8 377 162 -1748us[-3173us] +/- 24ms 2026-02-24T19:26:56.899 INFO:teuthology.orchestra.run.trial026.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-24T19:26:56.899 INFO:teuthology.orchestra.run.trial026.stdout:=============================================================================== 2026-02-24T19:26:56.899 INFO:teuthology.orchestra.run.trial026.stdout:^* time.cloudflare.com 3 8 377 163 -131us[ -216us] +/- 6508us 2026-02-24T19:26:56.899 INFO:teuthology.orchestra.run.trial026.stdout:^- 149.28.61.105.vultruserc> 3 8 377 166 +827us[ +742us] +/- 32ms 2026-02-24T19:26:56.899 INFO:teuthology.orchestra.run.trial026.stdout:^- arm1.maxhost.io 2 9 377 491 +101us[ +53us] +/- 54ms 2026-02-24T19:26:56.900 INFO:teuthology.orchestra.run.trial026.stdout:^- usmoi.meezy.link 2 7 377 103 -1328us[-1328us] +/- 23ms 2026-02-24T19:26:56.901 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-24T19:26:56.915 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-24T19:26:56.915 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-24T19:26:56.930 DEBUG:teuthology.orchestra.run.trial026:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-24T19:26:56.996 DEBUG:teuthology.orchestra.run.trial070:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-24T19:26:57.051 DEBUG:teuthology.orchestra.run.trial103:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-24T19:26:57.104 DEBUG:teuthology.orchestra.run.trial162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-24T19:26:57.160 DEBUG:teuthology.orchestra.run.trial026:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T19:26:57.188 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T19:26:57.188 DEBUG:teuthology.orchestra.run.trial070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T19:26:57.214 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T19:26:57.214 DEBUG:teuthology.orchestra.run.trial103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T19:26:57.241 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T19:26:57.242 DEBUG:teuthology.orchestra.run.trial162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-24T19:26:57.269 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T19:26:57.270 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-24T19:26:57.286 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-24T19:26:57.301 INFO:teuthology.task.internal:Duration was 3836.456575 seconds 2026-02-24T19:26:57.301 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-24T19:26:57.317 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-24T19:26:57.317 DEBUG:teuthology.orchestra.run.trial026:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T19:26:57.320 DEBUG:teuthology.orchestra.run.trial070:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T19:26:57.323 DEBUG:teuthology.orchestra.run.trial103:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T19:26:57.326 DEBUG:teuthology.orchestra.run.trial162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-24T19:26:57.355 INFO:teuthology.orchestra.run.trial026.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T19:26:57.359 INFO:teuthology.orchestra.run.trial070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T19:26:57.360 INFO:teuthology.orchestra.run.trial103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T19:26:57.363 INFO:teuthology.orchestra.run.trial162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-24T19:26:57.819 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-24T19:26:57.820 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial026.front.sepia.ceph.com 2026-02-24T19:26:57.820 DEBUG:teuthology.orchestra.run.trial026:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T19:26:57.840 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial070.front.sepia.ceph.com 2026-02-24T19:26:57.841 DEBUG:teuthology.orchestra.run.trial070:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T19:26:57.877 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial103.front.sepia.ceph.com 2026-02-24T19:26:57.878 DEBUG:teuthology.orchestra.run.trial103:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T19:26:57.897 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial162.front.sepia.ceph.com 2026-02-24T19:26:57.898 DEBUG:teuthology.orchestra.run.trial162:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-24T19:26:57.918 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-24T19:26:57.918 DEBUG:teuthology.orchestra.run.trial026:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T19:26:57.920 DEBUG:teuthology.orchestra.run.trial070:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T19:26:57.923 DEBUG:teuthology.orchestra.run.trial103:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T19:26:57.939 DEBUG:teuthology.orchestra.run.trial162:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T19:26:58.020 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-24T19:26:58.020 DEBUG:teuthology.orchestra.run.trial026:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T19:26:58.023 DEBUG:teuthology.orchestra.run.trial070:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T19:26:58.025 DEBUG:teuthology.orchestra.run.trial103:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T19:26:58.028 DEBUG:teuthology.orchestra.run.trial162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-24T19:26:58.043 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T19:26:58.044 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T19:26:58.044 INFO:teuthology.orchestra.run.trial026.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T19:26:58.044 INFO:teuthology.orchestra.run.trial026.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T19:26:58.044 INFO:teuthology.orchestra.run.trial026.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T19:26:58.045 INFO:teuthology.orchestra.run.trial070.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T19:26:58.047 INFO:teuthology.orchestra.run.trial070.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T19:26:58.047 INFO:teuthology.orchestra.run.trial070.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T19:26:58.047 INFO:teuthology.orchestra.run.trial070.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T19:26:58.047 INFO:teuthology.orchestra.run.trial070.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T19:26:58.049 INFO:teuthology.orchestra.run.trial103.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T19:26:58.050 INFO:teuthology.orchestra.run.trial103.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T19:26:58.050 INFO:teuthology.orchestra.run.trial103.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T19:26:58.050 INFO:teuthology.orchestra.run.trial103.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T19:26:58.050 INFO:teuthology.orchestra.run.trial103.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T19:26:58.051 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-24T19:26:58.051 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-24T19:26:58.052 INFO:teuthology.orchestra.run.trial162.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-24T19:26:58.052 INFO:teuthology.orchestra.run.trial162.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-24T19:26:58.052 INFO:teuthology.orchestra.run.trial162.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-24T19:26:58.054 INFO:teuthology.orchestra.run.trial026.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 83.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T19:26:58.057 INFO:teuthology.orchestra.run.trial070.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T19:26:58.061 INFO:teuthology.orchestra.run.trial103.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 83.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T19:26:58.062 INFO:teuthology.orchestra.run.trial162.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 82.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-24T19:26:58.064 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-24T19:26:58.081 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-24T19:26:58.081 DEBUG:teuthology.orchestra.run.trial026:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T19:26:58.121 DEBUG:teuthology.orchestra.run.trial070:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T19:26:58.145 DEBUG:teuthology.orchestra.run.trial103:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T19:26:58.169 DEBUG:teuthology.orchestra.run.trial162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-24T19:26:58.196 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-24T19:26:58.212 DEBUG:teuthology.orchestra.run.trial026:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T19:26:58.215 DEBUG:teuthology.orchestra.run.trial070:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T19:26:58.218 DEBUG:teuthology.orchestra.run.trial103:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T19:26:58.220 DEBUG:teuthology.orchestra.run.trial162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-24T19:26:58.239 INFO:teuthology.orchestra.run.trial026.stdout:kernel.core_pattern = core 2026-02-24T19:26:58.240 INFO:teuthology.orchestra.run.trial070.stdout:kernel.core_pattern = core 2026-02-24T19:26:58.240 INFO:teuthology.orchestra.run.trial103.stdout:kernel.core_pattern = core 2026-02-24T19:26:58.260 INFO:teuthology.orchestra.run.trial162.stdout:kernel.core_pattern = core 2026-02-24T19:26:58.272 DEBUG:teuthology.orchestra.run.trial026:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T19:26:58.314 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T19:26:58.314 DEBUG:teuthology.orchestra.run.trial070:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T19:26:58.329 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T19:26:58.330 DEBUG:teuthology.orchestra.run.trial103:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T19:26:58.345 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T19:26:58.346 DEBUG:teuthology.orchestra.run.trial162:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-24T19:26:58.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-24T19:26:58.364 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-24T19:26:58.380 INFO:teuthology.task.internal:Transferring archived files... 2026-02-24T19:26:58.381 DEBUG:teuthology.misc:Transferring archived files from trial026:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68687/remote/trial026 2026-02-24T19:26:58.381 DEBUG:teuthology.orchestra.run.trial026:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T19:26:58.416 DEBUG:teuthology.misc:Transferring archived files from trial070:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68687/remote/trial070 2026-02-24T19:26:58.417 DEBUG:teuthology.orchestra.run.trial070:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T19:26:58.453 DEBUG:teuthology.misc:Transferring archived files from trial103:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68687/remote/trial103 2026-02-24T19:26:58.453 DEBUG:teuthology.orchestra.run.trial103:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T19:26:58.491 DEBUG:teuthology.misc:Transferring archived files from trial162:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jayaprakash-2026-02-24_16:27:17-rados-wip-yuri3-testing-2026-02-19-1610-tentacle-distro-default-trial/68687/remote/trial162 2026-02-24T19:26:58.492 DEBUG:teuthology.orchestra.run.trial162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-24T19:26:58.545 INFO:teuthology.task.internal:Removing archive directory... 2026-02-24T19:26:58.545 DEBUG:teuthology.orchestra.run.trial026:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T19:26:58.548 DEBUG:teuthology.orchestra.run.trial070:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T19:26:58.551 DEBUG:teuthology.orchestra.run.trial103:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T19:26:58.553 DEBUG:teuthology.orchestra.run.trial162:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-24T19:26:58.579 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-24T19:26:58.595 INFO:teuthology.task.internal:Not uploading archives. 2026-02-24T19:26:58.595 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-24T19:26:58.611 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-24T19:26:58.611 DEBUG:teuthology.orchestra.run.trial026:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T19:26:58.614 DEBUG:teuthology.orchestra.run.trial070:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T19:26:58.616 DEBUG:teuthology.orchestra.run.trial103:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T19:26:58.619 DEBUG:teuthology.orchestra.run.trial162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-24T19:26:58.628 INFO:teuthology.orchestra.run.trial026.stdout: 917522 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 19:26 /home/ubuntu/cephtest 2026-02-24T19:26:58.630 INFO:teuthology.orchestra.run.trial070.stdout: 917525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 19:26 /home/ubuntu/cephtest 2026-02-24T19:26:58.633 INFO:teuthology.orchestra.run.trial103.stdout: 920834 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 19:26 /home/ubuntu/cephtest 2026-02-24T19:26:58.635 INFO:teuthology.orchestra.run.trial162.stdout: 917521 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 24 19:26 /home/ubuntu/cephtest 2026-02-24T19:26:58.636 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-24T19:26:58.652 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-24T19:26:58.690 INFO:teuthology.run:Summary data: description: rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{btree} base mem$/{normal-2} onode-segment$/{none} write$/{random/{compr$/{no$/{no}} random}}}} rados read-affinity/balance tasks/rados_api_tests validater/valgrind} duration: 3836.456575155258 flavor: default owner: scheduled_jayaprakash@soko04.front.sepia.ceph.com success: true 2026-02-24T19:26:58.690 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-24T19:26:58.807 INFO:teuthology.run:pass